2021-01-28T03:33:11.832 INFO:root:teuthology version: 1.0.0-f185165d 2021-01-28T03:33:11.840 DEBUG:teuthology.run:Teuthology command: teuthology --block --lock --owner scheduled_kchai@teuthology --name kchai-2021-01-28_03:28:19-rados-wip-kefu-testing-2021-01-27-1353-distro-basic-smithi --archive /home/teuthworker/archive/kchai-2021-01-28_03:28:19-rados-wip-kefu-testing-2021-01-27-1353-distro-basic-smithi/5834171 --verbose --description rados/cephadm/with-work/{distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} -- /tmp/teuthology-worker.9xapuwhd.tmp 2021-01-28T03:33:11.896 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-01-28T03:33:11.985 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/kchai-2021-01-28_03:28:19-rados-wip-kefu-testing-2021-01-27-1353-distro-basic-smithi/5834171 branch: wip-kefu-testing-2021-01-27-1353 description: rados/cephadm/with-work/{distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} email: tchaikov@gmail.com first_in_suite: false job_id: '5834171' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: kchai-2021-01-28_03:28:19-rados-wip-kefu-testing-2021-01-27-1353-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-kefu-testing-2021-01-27-1353 ceph: conf: client: debug ms: 1 global: mon election default strategy: 3 ms bind msgr1: false ms bind msgr2: true ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd: debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 osd shutdown pgref assert: true log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 507028cb839c25d6666833702df6325fd8569096 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 cephadm: cephadm_mode: root install: ceph: sha1: 507028cb839c25d6666833702df6325fd8569096 workunit: branch: wip-kefu-testing-2021-01-27-1353 sha1: 507028cb839c25d6666833702df6325fd8569096 owner: scheduled_kchai@teuthology priority: 70 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - ceph.rgw.realm.zone.a - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b - ceph.iscsi.iscsi.a sha1: 507028cb839c25d6666833702df6325fd8569096 sleep_before_teardown: 0 suite: rados suite_branch: wip-kefu-testing-2021-01-27-1353 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2021-01-27-1353/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 507028cb839c25d6666833702df6325fd8569096 tasks: - install: null - cephadm: conf: mgr: debug mgr: 20 debug ms: 1 - workunit: clients: client.0: - rados/test.sh - rados/test_pool_quota.sh teuthology_branch: master timestamp: 2021-01-28_03:28:19 tube: smithi user: kchai verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.1438 2021-01-28T03:33:11.986 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2021-01-27-1353/qa; will attempt to use it 2021-01-28T03:33:11.990 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2021-01-27-1353/qa/tasks 2021-01-28T03:33:11.991 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-01-28T03:33:11.993 INFO:teuthology.task.internal:Checking packages... 2021-01-28T03:33:12.053 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'basic' and ceph hash '507028cb839c25d6666833702df6325fd8569096' 2021-01-28T03:33:12.053 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-01-28T03:33:12.054 INFO:teuthology.packaging:ref: None 2021-01-28T03:33:12.054 INFO:teuthology.packaging:tag: None 2021-01-28T03:33:12.055 INFO:teuthology.packaging:branch: wip-kefu-testing-2021-01-27-1353 2021-01-28T03:33:12.055 INFO:teuthology.packaging:sha1: 507028cb839c25d6666833702df6325fd8569096 2021-01-28T03:33:12.055 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-kefu-testing-2021-01-27-1353 2021-01-28T03:33:12.226 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-184-g507028cb-1focal 2021-01-28T03:33:12.226 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-01-28T03:33:12.236 INFO:teuthology.task.internal:no buildpackages task found 2021-01-28T03:33:12.237 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2021-01-28T03:33:12.287 INFO:teuthology.lock.ops:Locking machines... 2021-01-28T03:33:12.287 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-01-28T03:33:12.337 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-28T03:33:22.355 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-28T03:33:32.371 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-28T03:33:42.389 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-28T03:33:52.410 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-28T03:34:02.429 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-28T03:34:12.445 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-28T03:34:22.465 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-28T03:34:32.486 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_kchai@teuthology', 'count': 2, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/kchai-2021-01-28_03:28:19-rados-wip-kefu-testing-2021-01-27-1353-distro-basic-smithi/5834171'} 2021-01-28T03:34:32.514 DEBUG:teuthology.lock.ops:locked ubuntu@smithi100.front.sepia.ceph.com, ubuntu@smithi162.front.sepia.ceph.com 2021-01-28T03:34:32.594 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe0feb74ea0>, signals=[15]) 2021-01-28T03:34:32.598 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi100.front.sepia.ceph.com' reimaging 2021-01-28T03:34:32.599 INFO:teuthology.lock.ops:Updating [ubuntu@smithi100.front.sepia.ceph.com]: reset os type and version on server 2021-01-28T03:34:32.599 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2021-01-28T03:34:32.621 INFO:teuthology.lock.ops:Node 'ubuntu@smithi100.front.sepia.ceph.com' reimaging is complete 2021-01-28T03:34:32.622 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi162.front.sepia.ceph.com' reimaging 2021-01-28T03:34:32.622 INFO:teuthology.lock.ops:Updating [ubuntu@smithi162.front.sepia.ceph.com]: reset os type and version on server 2021-01-28T03:34:32.622 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2021-01-28T03:34:32.640 INFO:teuthology.lock.ops:Node 'ubuntu@smithi162.front.sepia.ceph.com' reimaging is complete 2021-01-28T03:34:32.847 INFO:teuthology.provision.fog.smithi100:Scheduling deploy of ubuntu 20.04 2021-01-28T03:34:32.879 INFO:teuthology.provision.fog.smithi162:Scheduling deploy of ubuntu 20.04 2021-01-28T03:34:33.163 INFO:teuthology.orchestra.console:Power off smithi100 2021-01-28T03:34:33.166 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2021-01-28T03:34:33.204 INFO:teuthology.orchestra.console:Power off smithi162 2021-01-28T03:34:33.205 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2021-01-28T03:34:33.222 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-28T03:34:33.253 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-28T03:34:33.369 INFO:teuthology.orchestra.console:Power off for smithi100 completed 2021-01-28T03:34:33.397 INFO:teuthology.orchestra.console:Power off for smithi162 completed 2021-01-28T03:34:33.472 INFO:teuthology.orchestra.console:Power on smithi100 2021-01-28T03:34:33.472 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2021-01-28T03:34:33.498 INFO:teuthology.orchestra.console:Power on smithi162 2021-01-28T03:34:33.499 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2021-01-28T03:34:33.515 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-28T03:34:33.542 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-28T03:34:37.560 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-28T03:34:37.575 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-28T03:34:37.786 INFO:teuthology.orchestra.console:Power on for smithi162 completed 2021-01-28T03:34:37.887 INFO:teuthology.provision.fog.smithi162:Waiting for deploy to finish 2021-01-28T03:34:41.678 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-28T03:34:41.893 INFO:teuthology.orchestra.console:Power on for smithi100 completed 2021-01-28T03:34:41.999 INFO:teuthology.provision.fog.smithi100:Waiting for deploy to finish 2021-01-28T03:37:43.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:37:52.476 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:37:54.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:38:01.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:38:03.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:38:10.615 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:38:12.275 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:38:19.683 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:38:21.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:38:28.756 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:38:30.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:38:37.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:38:39.444 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:38:46.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:38:48.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:38:57.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:39:24.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:39:30.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:39:35.095 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:39:36.353 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:39:41.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:39:42.356 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:39:47.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:39:48.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:39:48.468 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-01-28T03:39:48.470 DEBUG:teuthology.orchestra.run.smithi100:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2021-01-28T03:39:48.924 INFO:teuthology.provision.fog.smithi100:Node is ready 2021-01-28T03:39:48.924 DEBUG:teuthology.orchestra.run.smithi100:> hostname 2021-01-28T03:39:48.930 INFO:teuthology.orchestra.run.smithi100.stdout:smithi100.front.sepia.ceph.com 2021-01-28T03:39:48.930 DEBUG:teuthology.orchestra.run.smithi100:> grep smithi100.front.sepia.ceph.com /etc/hosts 2021-01-28T03:39:48.937 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.15.100 smithi100.front.sepia.ceph.com smithi100 2021-01-28T03:39:48.938 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname smithi100 2021-01-28T03:39:49.190 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100.front.sepia.ceph.com/smithi100/g' /etc/hosts 2021-01-28T03:39:49.207 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/172.21.15.100/172.21.15.100/g' /etc/hosts 2021-01-28T03:39:49.218 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i -e 's/smithi100.front.sepia.ceph.com/smithi100/g' /etc/hostname 2021-01-28T03:39:49.278 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname smithi100 2021-01-28T03:39:49.288 INFO:teuthology.provision.fog.smithi100:Deploy complete! 2021-01-28T03:39:49.289 DEBUG:teuthology.parallel:result is None 2021-01-28T03:39:53.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:39:59.110 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:39:59.247 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-01-28T03:39:59.247 DEBUG:teuthology.orchestra.run.smithi162:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2021-01-28T03:39:59.757 INFO:teuthology.provision.fog.smithi162:Node is ready 2021-01-28T03:39:59.757 DEBUG:teuthology.orchestra.run.smithi162:> hostname 2021-01-28T03:39:59.764 INFO:teuthology.orchestra.run.smithi162.stdout:smithi162.front.sepia.ceph.com 2021-01-28T03:39:59.764 DEBUG:teuthology.orchestra.run.smithi162:> grep smithi162.front.sepia.ceph.com /etc/hosts 2021-01-28T03:39:59.812 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.15.162 smithi162.front.sepia.ceph.com smithi162 2021-01-28T03:39:59.813 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname smithi162 2021-01-28T03:39:59.942 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/smithi162.front.sepia.ceph.com/smithi162/g' /etc/hosts 2021-01-28T03:39:59.959 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/172.21.15.162/172.21.15.162/g' /etc/hosts 2021-01-28T03:40:00.022 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i -e 's/smithi162.front.sepia.ceph.com/smithi162/g' /etc/hostname 2021-01-28T03:40:00.032 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname smithi162 2021-01-28T03:40:00.042 INFO:teuthology.provision.fog.smithi162:Deploy complete! 2021-01-28T03:40:00.043 DEBUG:teuthology.parallel:result is None 2021-01-28T03:40:00.211 INFO:teuthology.lock.ops:Checking smithi100.front.sepia.ceph.com 2021-01-28T03:40:00.212 INFO:teuthology.lock.ops:New key found. Updating... 2021-01-28T03:40:00.228 INFO:teuthology.lock.ops:Checking smithi162.front.sepia.ceph.com 2021-01-28T03:40:00.229 INFO:teuthology.lock.ops:New key found. Updating... 2021-01-28T03:40:00.244 INFO:teuthology.lock.ops:Updating [smithi100.front.sepia.ceph.com]: set os type and version on server 2021-01-28T03:40:00.245 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-28T03:40:00.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:40:00.298 DEBUG:teuthology.orchestra.run.smithi100:> true 2021-01-28T03:40:00.424 DEBUG:teuthology.orchestra.run.smithi100:> uname -m 2021-01-28T03:40:00.430 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2021-01-28T03:40:00.431 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2021-01-28T03:40:00.479 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="Ubuntu" 2021-01-28T03:40:00.480 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="20.04.1 LTS (Focal Fossa)" 2021-01-28T03:40:00.480 INFO:teuthology.orchestra.run.smithi100.stdout:ID=ubuntu 2021-01-28T03:40:00.480 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE=debian 2021-01-28T03:40:00.481 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="Ubuntu 20.04.1 LTS" 2021-01-28T03:40:00.481 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="20.04" 2021-01-28T03:40:00.481 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://www.ubuntu.com/" 2021-01-28T03:40:00.481 INFO:teuthology.orchestra.run.smithi100.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-01-28T03:40:00.482 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-01-28T03:40:00.482 INFO:teuthology.orchestra.run.smithi100.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-01-28T03:40:00.482 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_CODENAME=focal 2021-01-28T03:40:00.483 INFO:teuthology.orchestra.run.smithi100.stdout:UBUNTU_CODENAME=focal 2021-01-28T03:40:00.484 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2021-01-28T03:40:00.500 INFO:teuthology.lock.ops:Updating [smithi162.front.sepia.ceph.com]: set os type and version on server 2021-01-28T03:40:00.500 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-28T03:40:00.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:40:00.550 DEBUG:teuthology.orchestra.run.smithi162:> true 2021-01-28T03:40:00.664 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2021-01-28T03:40:00.670 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2021-01-28T03:40:00.671 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2021-01-28T03:40:00.677 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="Ubuntu" 2021-01-28T03:40:00.678 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="20.04.1 LTS (Focal Fossa)" 2021-01-28T03:40:00.678 INFO:teuthology.orchestra.run.smithi162.stdout:ID=ubuntu 2021-01-28T03:40:00.678 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE=debian 2021-01-28T03:40:00.678 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="Ubuntu 20.04.1 LTS" 2021-01-28T03:40:00.681 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="20.04" 2021-01-28T03:40:00.681 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://www.ubuntu.com/" 2021-01-28T03:40:00.681 INFO:teuthology.orchestra.run.smithi162.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-01-28T03:40:00.681 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-01-28T03:40:00.682 INFO:teuthology.orchestra.run.smithi162.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-01-28T03:40:00.682 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_CODENAME=focal 2021-01-28T03:40:00.682 INFO:teuthology.orchestra.run.smithi162.stdout:UBUNTU_CODENAME=focal 2021-01-28T03:40:00.683 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2021-01-28T03:40:00.698 INFO:teuthology.lock.ops:2 smithi machines locked this try, 2/2 locked so far 2021-01-28T03:40:00.734 INFO:teuthology.lock.ops:Locked targets: smithi100.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDRDxI5ILJzoCxKQVR6e0VFckINTvJbBXkryT8Rfj9PEx7yHXzN/KIq8I7oi021dHZrvePqSPDkDaH26vxb0jnGZ9OF0Y/UbKSX6A1TykoKUK5C770ppZSmgBUtfRyEtA1DmV/fvWBBdfH+K1pRtNYqxoiJ/4HobIl0Y1Pe0oWT8EX2a7/Y1sPu+emzUktyP6wNkZJdiVwzkq42TX3PvnlIaZx791dF0LHKr9Ygl6wQPFO4LfuyzKz59mt3U3M85u28K5biBWPzcvh5sBiXnG0CTITdFKIYElz7n1ophW152KzXqf8cwwQ3Z9LHIjvWLCcagLdweVt5GtPsAgF7cNt25KQZGsWnt7gqOMVpnGfphSLixCgIgHDBLpEsGl2beegAIjvH0gcFYjMPhZk7hrC3YuzPJG+qTvNWw7g5bjfSDrsX3LcIoC3BAg2yihCUe2D5VVdUShUaHMAs3U83eEy6kt2GvvUgE2/zZWSc+iUtGg9i9uICZZkuKCL/MLlFy9s= smithi162.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCg+FKXUtATfHcbFcbvO/6GAEDZR1P3gDrGqP49z2vWz9ffwlpwMr9NRjj9Vj0+ApozlyY2wfa7wbAHq0inQv6d0azQFJwxshHuQx3wXte30vnblynS22HTy4giYKfrGH/mQp6wP66PZJGY1wQLrzQeXcc5b2mjFuhnjfbxGvIQPDxi2DjOvT2VZ4hfxX8Z12lIDzTmdJGxM49ZK2Bdi8qEDlkYo1zAaWPeLgh4IrrnTF4VkOjxavRBIEMyFCDX1+bteF+CnVc0JP2RVPX+1dUBJe/DWhlxUQqUbm+Akwa8iXUqt3Je0/LccEzuay5duZt+OgsZX1Qvg9jmfKBSVQiIF6ABBDcFEpsC0kFIwXiemb/T8LOBBDw4tVDIIxi8DW5Rw3lnQU6KDKtid/p2kH8Ch+tV9WpNHe0Up8fI/or9jN7LAO60r6OivfOy5wxb8HL6Ub8EGNMnGPjK8yl3dEH7jYwm1xZKEpjbtD6BM1Uw6hfdiKGcTOXm24rKPGo9djU= 2021-01-28T03:40:00.734 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-01-28T03:40:00.785 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-01-28T03:40:00.792 INFO:teuthology.task.internal:Saving configuration 2021-01-28T03:40:00.804 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-01-28T03:40:00.816 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-01-28T03:40:00.834 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-01-28 03:34:32.497337', 'description': '/home/teuthworker/archive/kchai-2021-01-28_03:28:19-rados-wip-kefu-testing-2021-01-27-1353-distro-basic-smithi/5834171', 'locked_by': 'scheduled_kchai@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILfy9recx2BPQpIHdxIFg4AuZuVU+u+OhyDo6ivXqMT0', 'os_version': '20.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi100.front.sepia.ceph.com'} 2021-01-28T03:40:00.850 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-01-28 03:34:32.497357', 'description': '/home/teuthworker/archive/kchai-2021-01-28_03:28:19-rados-wip-kefu-testing-2021-01-27-1353-distro-basic-smithi/5834171', 'locked_by': 'scheduled_kchai@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHoKc8ItUjdXMhBylTdwqLzU7nxjyQ160wj0Q+n3ZaMw', 'os_version': '20.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi162.front.sepia.ceph.com'} 2021-01-28T03:40:00.851 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-01-28T03:40:00.866 INFO:teuthology.task.internal:roles: ubuntu@smithi100.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.realm.zone.a', 'node-exporter.a', 'alertmanager.a'] 2021-01-28T03:40:00.867 INFO:teuthology.task.internal:roles: ubuntu@smithi162.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2021-01-28T03:40:00.867 INFO:teuthology.run_tasks:Running task console_log... 2021-01-28T03:40:00.931 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe0ffaa5840>, signals=[15]) 2021-01-28T03:40:00.933 INFO:teuthology.run_tasks:Running task internal.connect... 2021-01-28T03:40:00.944 INFO:teuthology.task.internal:Opening connections... 2021-01-28T03:40:00.944 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi100.front.sepia.ceph.com 2021-01-28T03:40:00.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:40:01.002 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi162.front.sepia.ceph.com 2021-01-28T03:40:01.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:40:01.053 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-01-28T03:40:01.064 DEBUG:teuthology.orchestra.run.smithi100:> uname -m 2021-01-28T03:40:01.079 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2021-01-28T03:40:01.080 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2021-01-28T03:40:01.127 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="Ubuntu" 2021-01-28T03:40:01.128 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="20.04.1 LTS (Focal Fossa)" 2021-01-28T03:40:01.128 INFO:teuthology.orchestra.run.smithi100.stdout:ID=ubuntu 2021-01-28T03:40:01.128 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE=debian 2021-01-28T03:40:01.128 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="Ubuntu 20.04.1 LTS" 2021-01-28T03:40:01.128 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="20.04" 2021-01-28T03:40:01.129 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://www.ubuntu.com/" 2021-01-28T03:40:01.129 INFO:teuthology.orchestra.run.smithi100.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-01-28T03:40:01.129 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-01-28T03:40:01.129 INFO:teuthology.orchestra.run.smithi100.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-01-28T03:40:01.130 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_CODENAME=focal 2021-01-28T03:40:01.130 INFO:teuthology.orchestra.run.smithi100.stdout:UBUNTU_CODENAME=focal 2021-01-28T03:40:01.130 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2021-01-28T03:40:01.145 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2021-01-28T03:40:01.151 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2021-01-28T03:40:01.151 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2021-01-28T03:40:01.200 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="Ubuntu" 2021-01-28T03:40:01.200 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="20.04.1 LTS (Focal Fossa)" 2021-01-28T03:40:01.200 INFO:teuthology.orchestra.run.smithi162.stdout:ID=ubuntu 2021-01-28T03:40:01.201 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE=debian 2021-01-28T03:40:01.201 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="Ubuntu 20.04.1 LTS" 2021-01-28T03:40:01.201 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="20.04" 2021-01-28T03:40:01.201 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://www.ubuntu.com/" 2021-01-28T03:40:01.202 INFO:teuthology.orchestra.run.smithi162.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-01-28T03:40:01.202 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-01-28T03:40:01.202 INFO:teuthology.orchestra.run.smithi162.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-01-28T03:40:01.202 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_CODENAME=focal 2021-01-28T03:40:01.202 INFO:teuthology.orchestra.run.smithi162.stdout:UBUNTU_CODENAME=focal 2021-01-28T03:40:01.203 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2021-01-28T03:40:01.219 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-01-28T03:40:01.252 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-01-28T03:40:01.288 INFO:teuthology.task.internal:Checking for old test directory... 2021-01-28T03:40:01.289 DEBUG:teuthology.orchestra.run.smithi100:> test '!' -e /home/ubuntu/cephtest 2021-01-28T03:40:01.291 DEBUG:teuthology.orchestra.run.smithi162:> test '!' -e /home/ubuntu/cephtest 2021-01-28T03:40:01.297 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-01-28T03:40:01.310 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-01-28T03:40:01.311 DEBUG:teuthology.orchestra.run.smithi100:> test -z $(ls -A /var/lib/ceph) 2021-01-28T03:40:01.313 DEBUG:teuthology.orchestra.run.smithi162:> test -z $(ls -A /var/lib/ceph) 2021-01-28T03:40:01.355 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-01-28T03:40:01.401 INFO:teuthology.run_tasks:Running task kernel... 2021-01-28T03:40:01.420 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'ceph.rgw.realm.zone.a': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.a': {'kdb': True, 'sha1': 'distro'}, 'alertmanager.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'prometheus.a': {'kdb': True, 'sha1': 'distro'}, 'grafana.a': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.b': {'kdb': True, 'sha1': 'distro'}, 'ceph.iscsi.iscsi.a': {'kdb': True, 'sha1': 'distro'}} 2021-01-28T03:40:01.421 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-01-28T03:40:01.421 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2021-01-28T03:40:01.428 INFO:teuthology.orchestra.run.smithi100.stdout:5.4.0-64-generic 2021-01-28T03:40:01.428 INFO:teuthology.task.kernel:Running kernel on smithi100: 5.4.0-64-generic 2021-01-28T03:40:01.428 DEBUG:teuthology.orchestra.run.smithi100:> sudo apt-get clean 2021-01-28T03:40:01.586 DEBUG:teuthology.orchestra.run.smithi100:> sudo apt-get update 2021-01-28T03:40:01.795 INFO:teuthology.orchestra.run.smithi100.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [109 kB] 2021-01-28T03:40:01.981 INFO:teuthology.orchestra.run.smithi100.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-01-28T03:40:02.060 INFO:teuthology.orchestra.run.smithi100.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-01-28T03:40:02.092 INFO:teuthology.orchestra.run.smithi100.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [180 kB] 2021-01-28T03:40:02.167 INFO:teuthology.orchestra.run.smithi100.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [474 kB] 2021-01-28T03:40:02.198 INFO:teuthology.orchestra.run.smithi100.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [104 kB] 2021-01-28T03:40:02.202 INFO:teuthology.orchestra.run.smithi100.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [6,144 B] 2021-01-28T03:40:02.202 INFO:teuthology.orchestra.run.smithi100.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [118 kB] 2021-01-28T03:40:02.211 INFO:teuthology.orchestra.run.smithi100.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [17.4 kB] 2021-01-28T03:40:02.212 INFO:teuthology.orchestra.run.smithi100.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [420 kB] 2021-01-28T03:40:02.219 INFO:teuthology.orchestra.run.smithi100.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [532 kB] 2021-01-28T03:40:02.230 INFO:teuthology.orchestra.run.smithi100.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [73.9 kB] 2021-01-28T03:40:02.231 INFO:teuthology.orchestra.run.smithi100.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [9,728 B] 2021-01-28T03:40:02.386 INFO:teuthology.orchestra.run.smithi100.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-01-28T03:40:02.515 INFO:teuthology.orchestra.run.smithi100.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [413 kB] 2021-01-28T03:40:02.708 INFO:teuthology.orchestra.run.smithi100.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [789 kB] 2021-01-28T03:40:02.806 INFO:teuthology.orchestra.run.smithi100.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [191 kB] 2021-01-28T03:40:02.822 INFO:teuthology.orchestra.run.smithi100.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [11.7 kB] 2021-01-28T03:40:02.823 INFO:teuthology.orchestra.run.smithi100.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [142 kB] 2021-01-28T03:40:02.835 INFO:teuthology.orchestra.run.smithi100.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [21.2 kB] 2021-01-28T03:40:02.837 INFO:teuthology.orchestra.run.smithi100.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [735 kB] 2021-01-28T03:40:02.881 INFO:teuthology.orchestra.run.smithi100.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [545 kB] 2021-01-28T03:40:02.904 INFO:teuthology.orchestra.run.smithi100.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [149 kB] 2021-01-28T03:40:02.910 INFO:teuthology.orchestra.run.smithi100.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [15.5 kB] 2021-01-28T03:40:02.911 INFO:teuthology.orchestra.run.smithi100.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [16.9 kB] 2021-01-28T03:40:02.912 INFO:teuthology.orchestra.run.smithi100.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [4,992 B] 2021-01-28T03:40:02.963 INFO:teuthology.orchestra.run.smithi100.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [536 B] 2021-01-28T03:40:05.704 INFO:teuthology.orchestra.run.smithi100.stdout:Fetched 5,293 kB in 1s (3,704 kB/s) 2021-01-28T03:40:06.745 INFO:teuthology.orchestra.run.smithi100.stdout:Reading package lists... 2021-01-28T03:40:06.766 DEBUG:teuthology.orchestra.run.smithi100:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-01-28T03:40:06.839 INFO:teuthology.orchestra.run.smithi100.stdout:Reading package lists... 2021-01-28T03:40:06.991 INFO:teuthology.orchestra.run.smithi100.stdout:Building dependency tree... 2021-01-28T03:40:06.992 INFO:teuthology.orchestra.run.smithi100.stdout:Reading state information... 2021-01-28T03:40:07.068 INFO:teuthology.orchestra.run.smithi100.stderr:E: Unable to locate package linux-image-current-generic 2021-01-28T03:40:07.070 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-01-28T03:40:07.071 DEBUG:teuthology.orchestra.run.smithi100:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-01-28T03:40:07.137 INFO:teuthology.orchestra.run.smithi100.stdout:Reading package lists... 2021-01-28T03:40:07.290 INFO:teuthology.orchestra.run.smithi100.stdout:Building dependency tree... 2021-01-28T03:40:07.290 INFO:teuthology.orchestra.run.smithi100.stdout:Reading state information... 2021-01-28T03:40:07.425 INFO:teuthology.orchestra.run.smithi100.stdout:The following additional packages will be installed: 2021-01-28T03:40:07.431 INFO:teuthology.orchestra.run.smithi100.stdout: linux-generic linux-headers-5.4.0-65 linux-headers-5.4.0-65-generic 2021-01-28T03:40:07.431 INFO:teuthology.orchestra.run.smithi100.stdout: linux-headers-generic linux-image-5.4.0-65-generic 2021-01-28T03:40:07.432 INFO:teuthology.orchestra.run.smithi100.stdout: linux-modules-5.4.0-65-generic linux-modules-extra-5.4.0-65-generic 2021-01-28T03:40:07.432 INFO:teuthology.orchestra.run.smithi100.stdout:Suggested packages: 2021-01-28T03:40:07.432 INFO:teuthology.orchestra.run.smithi100.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-01-28T03:40:07.433 INFO:teuthology.orchestra.run.smithi100.stdout:Recommended packages: 2021-01-28T03:40:07.433 INFO:teuthology.orchestra.run.smithi100.stdout: thermald 2021-01-28T03:40:07.455 INFO:teuthology.orchestra.run.smithi100.stdout:The following NEW packages will be installed: 2021-01-28T03:40:07.455 INFO:teuthology.orchestra.run.smithi100.stdout: linux-headers-5.4.0-65 linux-headers-5.4.0-65-generic 2021-01-28T03:40:07.456 INFO:teuthology.orchestra.run.smithi100.stdout: linux-image-5.4.0-65-generic linux-modules-5.4.0-65-generic 2021-01-28T03:40:07.456 INFO:teuthology.orchestra.run.smithi100.stdout: linux-modules-extra-5.4.0-65-generic 2021-01-28T03:40:07.456 INFO:teuthology.orchestra.run.smithi100.stdout:The following packages will be upgraded: 2021-01-28T03:40:07.457 INFO:teuthology.orchestra.run.smithi100.stdout: linux-generic linux-headers-generic linux-image-generic 2021-01-28T03:40:07.629 INFO:teuthology.orchestra.run.smithi100.stdout:3 upgraded, 5 newly installed, 0 to remove and 21 not upgraded. 2021-01-28T03:40:07.629 INFO:teuthology.orchestra.run.smithi100.stdout:Need to get 74.1 MB of archives. 2021-01-28T03:40:07.630 INFO:teuthology.orchestra.run.smithi100.stdout:After this operation, 360 MB of additional disk space will be used. 2021-01-28T03:40:07.630 INFO:teuthology.orchestra.run.smithi100.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-65-generic amd64 5.4.0-65.73 [14.5 MB] 2021-01-28T03:40:08.676 INFO:teuthology.orchestra.run.smithi100.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-65-generic amd64 5.4.0-65.73 [8,898 kB] 2021-01-28T03:40:08.920 INFO:teuthology.orchestra.run.smithi100.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-65-generic amd64 5.4.0-65.73 [38.6 MB] 2021-01-28T03:40:10.080 INFO:teuthology.orchestra.run.smithi100.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.65.68 [1,900 B] 2021-01-28T03:40:10.080 INFO:teuthology.orchestra.run.smithi100.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.65.68 [2,620 B] 2021-01-28T03:40:10.081 INFO:teuthology.orchestra.run.smithi100.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-65 all 5.4.0-65.73 [11.0 MB] 2021-01-28T03:40:10.346 INFO:teuthology.orchestra.run.smithi100.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-65-generic amd64 5.4.0-65.73 [1,233 kB] 2021-01-28T03:40:10.361 INFO:teuthology.orchestra.run.smithi100.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.65.68 [2,492 B] 2021-01-28T03:40:10.806 INFO:teuthology.orchestra.run.smithi100.stdout:Fetched 74.1 MB in 3s (25.5 MB/s) 2021-01-28T03:40:10.976 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package linux-modules-5.4.0-65-generic. 2021-01-28T03:40:13.133 INFO:teuthology.orchestra.run.smithi100.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 114224 files and directories currently installed.) 2021-01-28T03:40:13.139 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../0-linux-modules-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-28T03:40:13.245 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking linux-modules-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-28T03:40:15.121 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package linux-image-5.4.0-65-generic. 2021-01-28T03:40:15.134 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../1-linux-image-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-28T03:40:15.223 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking linux-image-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-28T03:40:16.173 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-65-generic. 2021-01-28T03:40:16.187 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-28T03:40:16.231 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking linux-modules-extra-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-28T03:40:21.389 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../3-linux-generic_5.4.0.65.68_amd64.deb ... 2021-01-28T03:40:21.489 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking linux-generic (5.4.0.65.68) over (5.4.0.64.67) ... 2021-01-28T03:40:21.816 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.65.68_amd64.deb ... 2021-01-28T03:40:21.942 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking linux-image-generic (5.4.0.65.68) over (5.4.0.64.67) ... 2021-01-28T03:40:22.254 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package linux-headers-5.4.0-65. 2021-01-28T03:40:22.269 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../5-linux-headers-5.4.0-65_5.4.0-65.73_all.deb ... 2021-01-28T03:40:22.312 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking linux-headers-5.4.0-65 (5.4.0-65.73) ... 2021-01-28T03:40:27.651 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package linux-headers-5.4.0-65-generic. 2021-01-28T03:40:27.672 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../6-linux-headers-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-28T03:40:27.718 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking linux-headers-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-28T03:40:30.249 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.65.68_amd64.deb ... 2021-01-28T03:40:30.378 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking linux-headers-generic (5.4.0.65.68) over (5.4.0.64.67) ... 2021-01-28T03:40:30.722 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up linux-headers-5.4.0-65 (5.4.0-65.73) ... 2021-01-28T03:40:30.847 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up linux-modules-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-28T03:40:32.024 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up linux-headers-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-28T03:40:32.184 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up linux-headers-generic (5.4.0.65.68) ... 2021-01-28T03:40:32.310 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up linux-image-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-28T03:40:33.388 INFO:teuthology.orchestra.run.smithi100.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.4.0-65-generic 2021-01-28T03:40:33.388 INFO:teuthology.orchestra.run.smithi100.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.4.0-65-generic 2021-01-28T03:40:33.528 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up linux-modules-extra-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-28T03:40:34.622 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up linux-image-generic (5.4.0.65.68) ... 2021-01-28T03:40:34.748 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up linux-generic (5.4.0.65.68) ... 2021-01-28T03:40:34.875 INFO:teuthology.orchestra.run.smithi100.stdout:Processing triggers for linux-image-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-28T03:40:35.056 INFO:teuthology.orchestra.run.smithi100.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-01-28T03:40:35.056 INFO:teuthology.orchestra.run.smithi100.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-65-generic 2021-01-28T03:40:56.546 INFO:teuthology.orchestra.run.smithi100.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-01-28T03:40:56.547 INFO:teuthology.orchestra.run.smithi100.stdout:Sourcing file `/etc/default/grub' 2021-01-28T03:40:56.558 INFO:teuthology.orchestra.run.smithi100.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-01-28T03:40:56.579 INFO:teuthology.orchestra.run.smithi100.stdout:Generating grub configuration file ... 2021-01-28T03:40:56.908 INFO:teuthology.orchestra.run.smithi100.stdout:Found linux image: /boot/vmlinuz-5.4.0-65-generic 2021-01-28T03:40:56.967 INFO:teuthology.orchestra.run.smithi100.stdout:Found initrd image: /boot/initrd.img-5.4.0-65-generic 2021-01-28T03:40:57.392 INFO:teuthology.orchestra.run.smithi100.stdout:Found linux image: /boot/vmlinuz-5.4.0-64-generic 2021-01-28T03:40:57.403 INFO:teuthology.orchestra.run.smithi100.stdout:Found initrd image: /boot/initrd.img-5.4.0-64-generic 2021-01-28T03:41:00.119 INFO:teuthology.orchestra.run.smithi100.stdout:done 2021-01-28T03:41:00.472 DEBUG:teuthology.orchestra.run.smithi100:> dpkg -s linux-image-generic 2021-01-28T03:41:00.512 INFO:teuthology.orchestra.run.smithi100.stdout:Package: linux-image-generic 2021-01-28T03:41:00.513 INFO:teuthology.orchestra.run.smithi100.stdout:Status: install ok installed 2021-01-28T03:41:00.513 INFO:teuthology.orchestra.run.smithi100.stdout:Priority: optional 2021-01-28T03:41:00.514 INFO:teuthology.orchestra.run.smithi100.stdout:Section: kernel 2021-01-28T03:41:00.514 INFO:teuthology.orchestra.run.smithi100.stdout:Installed-Size: 18 2021-01-28T03:41:00.514 INFO:teuthology.orchestra.run.smithi100.stdout:Maintainer: Ubuntu Kernel Team 2021-01-28T03:41:00.514 INFO:teuthology.orchestra.run.smithi100.stdout:Architecture: amd64 2021-01-28T03:41:00.515 INFO:teuthology.orchestra.run.smithi100.stdout:Source: linux-meta 2021-01-28T03:41:00.515 INFO:teuthology.orchestra.run.smithi100.stdout:Version: 5.4.0.65.68 2021-01-28T03:41:00.515 INFO:teuthology.orchestra.run.smithi100.stdout:Provides: virtualbox-guest-modules (= 6.1.10-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.5) 2021-01-28T03:41:00.515 INFO:teuthology.orchestra.run.smithi100.stdout:Depends: linux-image-5.4.0-65-generic, linux-modules-extra-5.4.0-65-generic, linux-firmware, intel-microcode, amd64-microcode 2021-01-28T03:41:00.515 INFO:teuthology.orchestra.run.smithi100.stdout:Recommends: thermald 2021-01-28T03:41:00.516 INFO:teuthology.orchestra.run.smithi100.stdout:Description: Generic Linux kernel image 2021-01-28T03:41:00.516 INFO:teuthology.orchestra.run.smithi100.stdout: This package will always depend on the latest generic kernel image 2021-01-28T03:41:00.516 INFO:teuthology.orchestra.run.smithi100.stdout: available. 2021-01-28T03:41:00.517 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-64-generic Expected: 5.4.0-65-generic 2021-01-28T03:41:00.517 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2021-01-28T03:41:00.528 INFO:teuthology.orchestra.run.smithi162.stdout:5.4.0-64-generic 2021-01-28T03:41:00.529 INFO:teuthology.task.kernel:Running kernel on smithi162: 5.4.0-64-generic 2021-01-28T03:41:00.529 DEBUG:teuthology.orchestra.run.smithi162:> sudo apt-get clean 2021-01-28T03:41:00.770 DEBUG:teuthology.orchestra.run.smithi162:> sudo apt-get update 2021-01-28T03:41:00.937 INFO:teuthology.orchestra.run.smithi162.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [109 kB] 2021-01-28T03:41:01.039 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-01-28T03:41:01.118 INFO:teuthology.orchestra.run.smithi162.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-01-28T03:41:01.239 INFO:teuthology.orchestra.run.smithi162.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [474 kB] 2021-01-28T03:41:01.336 INFO:teuthology.orchestra.run.smithi162.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [180 kB] 2021-01-28T03:41:01.341 INFO:teuthology.orchestra.run.smithi162.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [104 kB] 2021-01-28T03:41:01.343 INFO:teuthology.orchestra.run.smithi162.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [6,144 B] 2021-01-28T03:41:01.343 INFO:teuthology.orchestra.run.smithi162.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [118 kB] 2021-01-28T03:41:01.346 INFO:teuthology.orchestra.run.smithi162.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [17.4 kB] 2021-01-28T03:41:01.347 INFO:teuthology.orchestra.run.smithi162.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [420 kB] 2021-01-28T03:41:01.364 INFO:teuthology.orchestra.run.smithi162.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [532 kB] 2021-01-28T03:41:01.375 INFO:teuthology.orchestra.run.smithi162.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [73.9 kB] 2021-01-28T03:41:01.376 INFO:teuthology.orchestra.run.smithi162.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [9,728 B] 2021-01-28T03:41:01.438 INFO:teuthology.orchestra.run.smithi162.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-01-28T03:41:01.569 INFO:teuthology.orchestra.run.smithi162.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [789 kB] 2021-01-28T03:41:01.830 INFO:teuthology.orchestra.run.smithi162.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [413 kB] 2021-01-28T03:41:01.849 INFO:teuthology.orchestra.run.smithi162.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [191 kB] 2021-01-28T03:41:01.858 INFO:teuthology.orchestra.run.smithi162.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [11.7 kB] 2021-01-28T03:41:01.859 INFO:teuthology.orchestra.run.smithi162.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [142 kB] 2021-01-28T03:41:01.868 INFO:teuthology.orchestra.run.smithi162.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [21.2 kB] 2021-01-28T03:41:01.869 INFO:teuthology.orchestra.run.smithi162.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [545 kB] 2021-01-28T03:41:01.923 INFO:teuthology.orchestra.run.smithi162.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [735 kB] 2021-01-28T03:41:01.957 INFO:teuthology.orchestra.run.smithi162.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [149 kB] 2021-01-28T03:41:01.964 INFO:teuthology.orchestra.run.smithi162.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [15.5 kB] 2021-01-28T03:41:01.965 INFO:teuthology.orchestra.run.smithi162.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [16.9 kB] 2021-01-28T03:41:01.965 INFO:teuthology.orchestra.run.smithi162.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [4,992 B] 2021-01-28T03:41:02.008 INFO:teuthology.orchestra.run.smithi162.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [536 B] 2021-01-28T03:41:04.658 INFO:teuthology.orchestra.run.smithi162.stdout:Fetched 5,293 kB in 1s (4,223 kB/s) 2021-01-28T03:41:05.693 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2021-01-28T03:41:05.714 DEBUG:teuthology.orchestra.run.smithi162:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-01-28T03:41:05.782 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2021-01-28T03:41:05.934 INFO:teuthology.orchestra.run.smithi162.stdout:Building dependency tree... 2021-01-28T03:41:05.934 INFO:teuthology.orchestra.run.smithi162.stdout:Reading state information... 2021-01-28T03:41:06.010 INFO:teuthology.orchestra.run.smithi162.stderr:E: Unable to locate package linux-image-current-generic 2021-01-28T03:41:06.012 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-01-28T03:41:06.013 DEBUG:teuthology.orchestra.run.smithi162:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-01-28T03:41:06.079 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2021-01-28T03:41:06.215 INFO:teuthology.orchestra.run.smithi162.stdout:Building dependency tree... 2021-01-28T03:41:06.216 INFO:teuthology.orchestra.run.smithi162.stdout:Reading state information... 2021-01-28T03:41:06.338 INFO:teuthology.orchestra.run.smithi162.stdout:The following additional packages will be installed: 2021-01-28T03:41:06.339 INFO:teuthology.orchestra.run.smithi162.stdout: linux-generic linux-headers-5.4.0-65 linux-headers-5.4.0-65-generic 2021-01-28T03:41:06.339 INFO:teuthology.orchestra.run.smithi162.stdout: linux-headers-generic linux-image-5.4.0-65-generic 2021-01-28T03:41:06.339 INFO:teuthology.orchestra.run.smithi162.stdout: linux-modules-5.4.0-65-generic linux-modules-extra-5.4.0-65-generic 2021-01-28T03:41:06.340 INFO:teuthology.orchestra.run.smithi162.stdout:Suggested packages: 2021-01-28T03:41:06.340 INFO:teuthology.orchestra.run.smithi162.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-01-28T03:41:06.340 INFO:teuthology.orchestra.run.smithi162.stdout:Recommended packages: 2021-01-28T03:41:06.340 INFO:teuthology.orchestra.run.smithi162.stdout: thermald 2021-01-28T03:41:06.367 INFO:teuthology.orchestra.run.smithi162.stdout:The following NEW packages will be installed: 2021-01-28T03:41:06.368 INFO:teuthology.orchestra.run.smithi162.stdout: linux-headers-5.4.0-65 linux-headers-5.4.0-65-generic 2021-01-28T03:41:06.368 INFO:teuthology.orchestra.run.smithi162.stdout: linux-image-5.4.0-65-generic linux-modules-5.4.0-65-generic 2021-01-28T03:41:06.368 INFO:teuthology.orchestra.run.smithi162.stdout: linux-modules-extra-5.4.0-65-generic 2021-01-28T03:41:06.369 INFO:teuthology.orchestra.run.smithi162.stdout:The following packages will be upgraded: 2021-01-28T03:41:06.369 INFO:teuthology.orchestra.run.smithi162.stdout: linux-generic linux-headers-generic linux-image-generic 2021-01-28T03:41:06.547 INFO:teuthology.orchestra.run.smithi162.stdout:3 upgraded, 5 newly installed, 0 to remove and 21 not upgraded. 2021-01-28T03:41:06.547 INFO:teuthology.orchestra.run.smithi162.stdout:Need to get 74.1 MB of archives. 2021-01-28T03:41:06.547 INFO:teuthology.orchestra.run.smithi162.stdout:After this operation, 360 MB of additional disk space will be used. 2021-01-28T03:41:06.548 INFO:teuthology.orchestra.run.smithi162.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-65-generic amd64 5.4.0-65.73 [14.5 MB] 2021-01-28T03:41:07.646 INFO:teuthology.orchestra.run.smithi162.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-65-generic amd64 5.4.0-65.73 [8,898 kB] 2021-01-28T03:41:07.894 INFO:teuthology.orchestra.run.smithi162.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-65-generic amd64 5.4.0-65.73 [38.6 MB] 2021-01-28T03:41:09.131 INFO:teuthology.orchestra.run.smithi162.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.65.68 [1,900 B] 2021-01-28T03:41:09.131 INFO:teuthology.orchestra.run.smithi162.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.65.68 [2,620 B] 2021-01-28T03:41:09.132 INFO:teuthology.orchestra.run.smithi162.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-65 all 5.4.0-65.73 [11.0 MB] 2021-01-28T03:41:09.999 INFO:teuthology.orchestra.run.smithi162.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-65-generic amd64 5.4.0-65.73 [1,233 kB] 2021-01-28T03:41:10.023 INFO:teuthology.orchestra.run.smithi162.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.65.68 [2,492 B] 2021-01-28T03:41:10.507 INFO:teuthology.orchestra.run.smithi162.stdout:Fetched 74.1 MB in 4s (20.3 MB/s) 2021-01-28T03:41:10.720 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package linux-modules-5.4.0-65-generic. 2021-01-28T03:41:12.660 INFO:teuthology.orchestra.run.smithi162.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 114224 files and directories currently installed.) 2021-01-28T03:41:12.666 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../0-linux-modules-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-28T03:41:12.730 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-modules-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-28T03:41:14.538 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package linux-image-5.4.0-65-generic. 2021-01-28T03:41:14.554 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../1-linux-image-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-28T03:41:14.650 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-image-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-28T03:41:15.607 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-65-generic. 2021-01-28T03:41:15.624 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-28T03:41:15.665 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-modules-extra-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-28T03:41:20.160 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../3-linux-generic_5.4.0.65.68_amd64.deb ... 2021-01-28T03:41:20.285 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-generic (5.4.0.65.68) over (5.4.0.64.67) ... 2021-01-28T03:41:20.620 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.65.68_amd64.deb ... 2021-01-28T03:41:20.748 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-image-generic (5.4.0.65.68) over (5.4.0.64.67) ... 2021-01-28T03:41:21.067 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package linux-headers-5.4.0-65. 2021-01-28T03:41:21.085 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../5-linux-headers-5.4.0-65_5.4.0-65.73_all.deb ... 2021-01-28T03:41:21.126 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-headers-5.4.0-65 (5.4.0-65.73) ... 2021-01-28T03:41:26.827 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package linux-headers-5.4.0-65-generic. 2021-01-28T03:41:26.848 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../6-linux-headers-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-28T03:41:26.892 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-headers-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-28T03:41:29.370 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.65.68_amd64.deb ... 2021-01-28T03:41:29.480 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-headers-generic (5.4.0.65.68) over (5.4.0.64.67) ... 2021-01-28T03:41:29.800 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-headers-5.4.0-65 (5.4.0-65.73) ... 2021-01-28T03:41:29.926 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-modules-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-28T03:41:31.112 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-headers-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-28T03:41:31.241 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-headers-generic (5.4.0.65.68) ... 2021-01-28T03:41:31.364 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-image-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-28T03:41:32.449 INFO:teuthology.orchestra.run.smithi162.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.4.0-65-generic 2021-01-28T03:41:32.450 INFO:teuthology.orchestra.run.smithi162.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.4.0-65-generic 2021-01-28T03:41:32.600 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-modules-extra-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-28T03:41:33.709 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-image-generic (5.4.0.65.68) ... 2021-01-28T03:41:33.860 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-generic (5.4.0.65.68) ... 2021-01-28T03:41:33.987 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for linux-image-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-28T03:41:34.175 INFO:teuthology.orchestra.run.smithi162.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-01-28T03:41:34.176 INFO:teuthology.orchestra.run.smithi162.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-65-generic 2021-01-28T03:41:55.801 INFO:teuthology.orchestra.run.smithi162.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-01-28T03:41:55.802 INFO:teuthology.orchestra.run.smithi162.stdout:Sourcing file `/etc/default/grub' 2021-01-28T03:41:55.809 INFO:teuthology.orchestra.run.smithi162.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-01-28T03:41:55.827 INFO:teuthology.orchestra.run.smithi162.stdout:Generating grub configuration file ... 2021-01-28T03:41:56.141 INFO:teuthology.orchestra.run.smithi162.stdout:Found linux image: /boot/vmlinuz-5.4.0-65-generic 2021-01-28T03:41:56.174 INFO:teuthology.orchestra.run.smithi162.stdout:Found initrd image: /boot/initrd.img-5.4.0-65-generic 2021-01-28T03:41:56.572 INFO:teuthology.orchestra.run.smithi162.stdout:Found linux image: /boot/vmlinuz-5.4.0-64-generic 2021-01-28T03:41:56.583 INFO:teuthology.orchestra.run.smithi162.stdout:Found initrd image: /boot/initrd.img-5.4.0-64-generic 2021-01-28T03:41:59.234 INFO:teuthology.orchestra.run.smithi162.stdout:done 2021-01-28T03:41:59.591 DEBUG:teuthology.orchestra.run.smithi162:> dpkg -s linux-image-generic 2021-01-28T03:41:59.624 INFO:teuthology.orchestra.run.smithi162.stdout:Package: linux-image-generic 2021-01-28T03:41:59.624 INFO:teuthology.orchestra.run.smithi162.stdout:Status: install ok installed 2021-01-28T03:41:59.625 INFO:teuthology.orchestra.run.smithi162.stdout:Priority: optional 2021-01-28T03:41:59.625 INFO:teuthology.orchestra.run.smithi162.stdout:Section: kernel 2021-01-28T03:41:59.625 INFO:teuthology.orchestra.run.smithi162.stdout:Installed-Size: 18 2021-01-28T03:41:59.625 INFO:teuthology.orchestra.run.smithi162.stdout:Maintainer: Ubuntu Kernel Team 2021-01-28T03:41:59.625 INFO:teuthology.orchestra.run.smithi162.stdout:Architecture: amd64 2021-01-28T03:41:59.626 INFO:teuthology.orchestra.run.smithi162.stdout:Source: linux-meta 2021-01-28T03:41:59.626 INFO:teuthology.orchestra.run.smithi162.stdout:Version: 5.4.0.65.68 2021-01-28T03:41:59.626 INFO:teuthology.orchestra.run.smithi162.stdout:Provides: virtualbox-guest-modules (= 6.1.10-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.5) 2021-01-28T03:41:59.626 INFO:teuthology.orchestra.run.smithi162.stdout:Depends: linux-image-5.4.0-65-generic, linux-modules-extra-5.4.0-65-generic, linux-firmware, intel-microcode, amd64-microcode 2021-01-28T03:41:59.627 INFO:teuthology.orchestra.run.smithi162.stdout:Recommends: thermald 2021-01-28T03:41:59.627 INFO:teuthology.orchestra.run.smithi162.stdout:Description: Generic Linux kernel image 2021-01-28T03:41:59.627 INFO:teuthology.orchestra.run.smithi162.stdout: This package will always depend on the latest generic kernel image 2021-01-28T03:41:59.627 INFO:teuthology.orchestra.run.smithi162.stdout: available. 2021-01-28T03:41:59.628 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-64-generic Expected: 5.4.0-65-generic 2021-01-28T03:41:59.628 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-01-28T03:41:59.628 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-01-28T03:41:59.629 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-01-28T03:41:59.629 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2021-01-28T03:41:59.629 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi100.front.sepia.ceph.com, path=None, version=distro) 2021-01-28T03:41:59.630 DEBUG:teuthology.orchestra.run.smithi100:> sudo apt-get clean 2021-01-28T03:41:59.744 DEBUG:teuthology.orchestra.run.smithi100:> sudo apt-get update 2021-01-28T03:41:59.894 INFO:teuthology.orchestra.run.smithi100.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-01-28T03:42:00.000 INFO:teuthology.orchestra.run.smithi100.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-01-28T03:42:00.078 INFO:teuthology.orchestra.run.smithi100.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-01-28T03:42:00.157 INFO:teuthology.orchestra.run.smithi100.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-01-28T03:42:01.309 INFO:teuthology.orchestra.run.smithi100.stdout:Reading package lists... 2021-01-28T03:42:01.330 DEBUG:teuthology.orchestra.run.smithi100:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-01-28T03:42:01.394 INFO:teuthology.orchestra.run.smithi100.stdout:Reading package lists... 2021-01-28T03:42:01.546 INFO:teuthology.orchestra.run.smithi100.stdout:Building dependency tree... 2021-01-28T03:42:01.547 INFO:teuthology.orchestra.run.smithi100.stdout:Reading state information... 2021-01-28T03:42:01.624 INFO:teuthology.orchestra.run.smithi100.stderr:E: Unable to locate package linux-image-current-generic 2021-01-28T03:42:01.625 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-01-28T03:42:01.626 DEBUG:teuthology.orchestra.run.smithi100:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-01-28T03:42:01.695 INFO:teuthology.orchestra.run.smithi100.stdout:Reading package lists... 2021-01-28T03:42:01.846 INFO:teuthology.orchestra.run.smithi100.stdout:Building dependency tree... 2021-01-28T03:42:01.847 INFO:teuthology.orchestra.run.smithi100.stdout:Reading state information... 2021-01-28T03:42:01.995 INFO:teuthology.orchestra.run.smithi100.stdout:linux-image-generic is already the newest version (5.4.0.65.68). 2021-01-28T03:42:01.995 INFO:teuthology.orchestra.run.smithi100.stdout:0 upgraded, 0 newly installed, 0 to remove and 21 not upgraded. 2021-01-28T03:42:01.997 DEBUG:teuthology.orchestra.run.smithi100:> dpkg -s linux-image-generic 2021-01-28T03:42:02.020 INFO:teuthology.orchestra.run.smithi100.stdout:Package: linux-image-generic 2021-01-28T03:42:02.021 INFO:teuthology.orchestra.run.smithi100.stdout:Status: install ok installed 2021-01-28T03:42:02.021 INFO:teuthology.orchestra.run.smithi100.stdout:Priority: optional 2021-01-28T03:42:02.021 INFO:teuthology.orchestra.run.smithi100.stdout:Section: kernel 2021-01-28T03:42:02.021 INFO:teuthology.orchestra.run.smithi100.stdout:Installed-Size: 18 2021-01-28T03:42:02.021 INFO:teuthology.orchestra.run.smithi100.stdout:Maintainer: Ubuntu Kernel Team 2021-01-28T03:42:02.022 INFO:teuthology.orchestra.run.smithi100.stdout:Architecture: amd64 2021-01-28T03:42:02.022 INFO:teuthology.orchestra.run.smithi100.stdout:Source: linux-meta 2021-01-28T03:42:02.022 INFO:teuthology.orchestra.run.smithi100.stdout:Version: 5.4.0.65.68 2021-01-28T03:42:02.022 INFO:teuthology.orchestra.run.smithi100.stdout:Provides: virtualbox-guest-modules (= 6.1.10-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.5) 2021-01-28T03:42:02.023 INFO:teuthology.orchestra.run.smithi100.stdout:Depends: linux-image-5.4.0-65-generic, linux-modules-extra-5.4.0-65-generic, linux-firmware, intel-microcode, amd64-microcode 2021-01-28T03:42:02.023 INFO:teuthology.orchestra.run.smithi100.stdout:Recommends: thermald 2021-01-28T03:42:02.023 INFO:teuthology.orchestra.run.smithi100.stdout:Description: Generic Linux kernel image 2021-01-28T03:42:02.023 INFO:teuthology.orchestra.run.smithi100.stdout: This package will always depend on the latest generic kernel image 2021-01-28T03:42:02.023 INFO:teuthology.orchestra.run.smithi100.stdout: available. 2021-01-28T03:42:02.024 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2021-01-28T03:42:02.028 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.LzYlFxfCZq 2021-01-28T03:42:02.029 DEBUG:teuthology.orchestra.run.smithi100:> sudo cp /boot/grub/grub.cfg /tmp/tmp.LzYlFxfCZq 2021-01-28T03:42:02.039 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.LzYlFxfCZq 2021-01-28T03:42:02.124 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.LzYlFxfCZq is 8KB 2021-01-28T03:42:02.141 DEBUG:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.LzYlFxfCZq 2021-01-28T03:42:02.148 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-01-28T03:42:02.200 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2021-01-28T03:42:02.200 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-01-28T03:42:02.200 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-01-28T03:42:02.242 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-65-generic 2021-01-28T03:42:02.242 DEBUG:teuthology.orchestra.run.smithi100:> sudo update-grub 2021-01-28T03:42:03.299 INFO:teuthology.orchestra.run.smithi100.stderr:Sourcing file `/etc/default/grub' 2021-01-28T03:42:03.301 INFO:teuthology.orchestra.run.smithi100.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-01-28T03:42:03.326 INFO:teuthology.orchestra.run.smithi100.stderr:Generating grub configuration file ... 2021-01-28T03:42:03.557 INFO:teuthology.orchestra.run.smithi100.stderr:Found linux image: /boot/vmlinuz-5.4.0-65-generic 2021-01-28T03:42:03.568 INFO:teuthology.orchestra.run.smithi100.stderr:Found initrd image: /boot/initrd.img-5.4.0-65-generic 2021-01-28T03:42:03.907 INFO:teuthology.orchestra.run.smithi100.stderr:Found linux image: /boot/vmlinuz-5.4.0-64-generic 2021-01-28T03:42:03.919 INFO:teuthology.orchestra.run.smithi100.stderr:Found initrd image: /boot/initrd.img-5.4.0-64-generic 2021-01-28T03:42:05.578 INFO:teuthology.orchestra.run.smithi100.stderr:done 2021-01-28T03:42:05.579 DEBUG:teuthology.orchestra.run.smithi100:> sudo shutdown -r now 2021-01-28T03:42:05.582 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2021-01-28T03:42:05.582 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi162.front.sepia.ceph.com, path=None, version=distro) 2021-01-28T03:42:05.583 DEBUG:teuthology.orchestra.run.smithi162:> sudo apt-get clean 2021-01-28T03:42:05.652 DEBUG:teuthology.orchestra.run.smithi162:> sudo apt-get update 2021-01-28T03:42:05.795 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-01-28T03:42:05.901 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-01-28T03:42:05.982 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-01-28T03:42:06.064 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-01-28T03:42:07.222 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2021-01-28T03:42:07.244 DEBUG:teuthology.orchestra.run.smithi162:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-01-28T03:42:07.309 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2021-01-28T03:42:07.460 INFO:teuthology.orchestra.run.smithi162.stdout:Building dependency tree... 2021-01-28T03:42:07.461 INFO:teuthology.orchestra.run.smithi162.stdout:Reading state information... 2021-01-28T03:42:07.538 INFO:teuthology.orchestra.run.smithi162.stderr:E: Unable to locate package linux-image-current-generic 2021-01-28T03:42:07.539 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-01-28T03:42:07.540 DEBUG:teuthology.orchestra.run.smithi162:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-01-28T03:42:07.605 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2021-01-28T03:42:07.757 INFO:teuthology.orchestra.run.smithi162.stdout:Building dependency tree... 2021-01-28T03:42:07.758 INFO:teuthology.orchestra.run.smithi162.stdout:Reading state information... 2021-01-28T03:42:07.913 INFO:teuthology.orchestra.run.smithi162.stdout:linux-image-generic is already the newest version (5.4.0.65.68). 2021-01-28T03:42:07.913 INFO:teuthology.orchestra.run.smithi162.stdout:0 upgraded, 0 newly installed, 0 to remove and 21 not upgraded. 2021-01-28T03:42:07.915 DEBUG:teuthology.orchestra.run.smithi162:> dpkg -s linux-image-generic 2021-01-28T03:42:07.940 INFO:teuthology.orchestra.run.smithi162.stdout:Package: linux-image-generic 2021-01-28T03:42:07.940 INFO:teuthology.orchestra.run.smithi162.stdout:Status: install ok installed 2021-01-28T03:42:07.941 INFO:teuthology.orchestra.run.smithi162.stdout:Priority: optional 2021-01-28T03:42:07.941 INFO:teuthology.orchestra.run.smithi162.stdout:Section: kernel 2021-01-28T03:42:07.941 INFO:teuthology.orchestra.run.smithi162.stdout:Installed-Size: 18 2021-01-28T03:42:07.941 INFO:teuthology.orchestra.run.smithi162.stdout:Maintainer: Ubuntu Kernel Team 2021-01-28T03:42:07.941 INFO:teuthology.orchestra.run.smithi162.stdout:Architecture: amd64 2021-01-28T03:42:07.942 INFO:teuthology.orchestra.run.smithi162.stdout:Source: linux-meta 2021-01-28T03:42:07.942 INFO:teuthology.orchestra.run.smithi162.stdout:Version: 5.4.0.65.68 2021-01-28T03:42:07.942 INFO:teuthology.orchestra.run.smithi162.stdout:Provides: virtualbox-guest-modules (= 6.1.10-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.5) 2021-01-28T03:42:07.942 INFO:teuthology.orchestra.run.smithi162.stdout:Depends: linux-image-5.4.0-65-generic, linux-modules-extra-5.4.0-65-generic, linux-firmware, intel-microcode, amd64-microcode 2021-01-28T03:42:07.943 INFO:teuthology.orchestra.run.smithi162.stdout:Recommends: thermald 2021-01-28T03:42:07.943 INFO:teuthology.orchestra.run.smithi162.stdout:Description: Generic Linux kernel image 2021-01-28T03:42:07.943 INFO:teuthology.orchestra.run.smithi162.stdout: This package will always depend on the latest generic kernel image 2021-01-28T03:42:07.943 INFO:teuthology.orchestra.run.smithi162.stdout: available. 2021-01-28T03:42:07.944 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2021-01-28T03:42:07.949 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.QpZ8AgWAoA 2021-01-28T03:42:07.949 DEBUG:teuthology.orchestra.run.smithi162:> sudo cp /boot/grub/grub.cfg /tmp/tmp.QpZ8AgWAoA 2021-01-28T03:42:08.011 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.QpZ8AgWAoA 2021-01-28T03:42:08.059 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.QpZ8AgWAoA is 8KB 2021-01-28T03:42:08.157 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.QpZ8AgWAoA 2021-01-28T03:42:08.174 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-01-28T03:42:08.246 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2021-01-28T03:42:08.247 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-01-28T03:42:08.247 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-01-28T03:42:08.353 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-65-generic 2021-01-28T03:42:08.353 DEBUG:teuthology.orchestra.run.smithi162:> sudo update-grub 2021-01-28T03:42:09.661 INFO:teuthology.orchestra.run.smithi162.stderr:Sourcing file `/etc/default/grub' 2021-01-28T03:42:09.662 INFO:teuthology.orchestra.run.smithi162.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-01-28T03:42:09.674 INFO:teuthology.orchestra.run.smithi162.stderr:Generating grub configuration file ... 2021-01-28T03:42:09.935 INFO:teuthology.orchestra.run.smithi162.stderr:Found linux image: /boot/vmlinuz-5.4.0-65-generic 2021-01-28T03:42:09.947 INFO:teuthology.orchestra.run.smithi162.stderr:Found initrd image: /boot/initrd.img-5.4.0-65-generic 2021-01-28T03:42:10.288 INFO:teuthology.orchestra.run.smithi162.stderr:Found linux image: /boot/vmlinuz-5.4.0-64-generic 2021-01-28T03:42:10.298 INFO:teuthology.orchestra.run.smithi162.stderr:Found initrd image: /boot/initrd.img-5.4.0-64-generic 2021-01-28T03:42:12.028 INFO:teuthology.orchestra.run.smithi162.stderr:done 2021-01-28T03:42:12.029 DEBUG:teuthology.orchestra.run.smithi162:> sudo shutdown -r now 2021-01-28T03:42:13.230 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2021-01-28T03:42:42.059 INFO:teuthology.misc:Re-opening connections... 2021-01-28T03:42:42.060 INFO:teuthology.misc:trying to connect to ubuntu@smithi100.front.sepia.ceph.com 2021-01-28T03:42:42.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-28T03:42:42.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:43:00.550 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.100 2021-01-28T03:43:00.551 INFO:teuthology.misc:trying to connect to ubuntu@smithi162.front.sepia.ceph.com 2021-01-28T03:43:00.552 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-28T03:43:00.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:43:18.978 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.162 2021-01-28T03:43:18.979 DEBUG:teuthology.misc:waited 36.91908526420593 2021-01-28T03:43:19.980 INFO:teuthology.misc:trying to connect to ubuntu@smithi100.front.sepia.ceph.com 2021-01-28T03:43:19.981 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-28T03:43:19.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:43:23.042 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.100 2021-01-28T03:43:23.043 INFO:teuthology.misc:trying to connect to ubuntu@smithi162.front.sepia.ceph.com 2021-01-28T03:43:23.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-28T03:43:23.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:44:23.046 DEBUG:teuthology.orchestra.remote:timed out 2021-01-28T03:44:23.050 DEBUG:teuthology.misc:waited 100.99045538902283 2021-01-28T03:44:24.051 INFO:teuthology.misc:trying to connect to ubuntu@smithi100.front.sepia.ceph.com 2021-01-28T03:44:24.052 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-28T03:44:24.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:44:24.160 DEBUG:teuthology.orchestra.run.smithi100:> true 2021-01-28T03:44:24.595 DEBUG:teuthology.misc:waited 102.53522944450378 2021-01-28T03:44:25.597 INFO:teuthology.misc:trying to connect to ubuntu@smithi162.front.sepia.ceph.com 2021-01-28T03:44:25.597 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-28T03:44:25.598 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:44:25.722 DEBUG:teuthology.orchestra.run.smithi162:> true 2021-01-28T03:44:26.172 DEBUG:teuthology.misc:waited 104.11158466339111 2021-01-28T03:44:27.173 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2021-01-28T03:44:27.174 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-65-generic"... 2021-01-28T03:44:27.174 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2021-01-28T03:44:27.182 INFO:teuthology.orchestra.run.smithi100.stdout:5.4.0-65-generic 2021-01-28T03:44:27.183 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-65-generic vs 5.4.0-65-generic 2021-01-28T03:44:27.183 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-01-28T03:44:27.183 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-01-28T03:44:27.184 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2021-01-28T03:44:27.184 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-65-generic"... 2021-01-28T03:44:27.184 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2021-01-28T03:44:27.193 INFO:teuthology.orchestra.run.smithi162.stdout:5.4.0-65-generic 2021-01-28T03:44:27.193 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-65-generic vs 5.4.0-65-generic 2021-01-28T03:44:27.194 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-01-28T03:44:27.194 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-01-28T03:44:28.195 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2021-01-28T03:44:28.197 DEBUG:teuthology.orchestra.run.smithi100:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-01-28T03:44:28.294 INFO:teuthology.orchestra.run.smithi100.stdout:ttyS1 2021-01-28T03:44:28.314 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2021-01-28T03:44:28.314 DEBUG:teuthology.orchestra.run.smithi162:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-01-28T03:44:28.404 INFO:teuthology.orchestra.run.smithi162.stdout:ttyS1 2021-01-28T03:44:28.429 INFO:teuthology.run_tasks:Running task internal.base... 2021-01-28T03:44:28.439 INFO:teuthology.task.internal:Creating test directory... 2021-01-28T03:44:28.442 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-01-28T03:44:28.444 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-01-28T03:44:28.451 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-01-28T03:44:28.462 INFO:teuthology.run_tasks:Running task internal.archive... 2021-01-28T03:44:28.484 INFO:teuthology.task.internal:Creating archive directory... 2021-01-28T03:44:28.484 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-01-28T03:44:28.493 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-01-28T03:44:28.536 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-01-28T03:44:28.544 INFO:teuthology.task.internal:Enabling coredump saving... 2021-01-28T03:44:28.545 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-01-28T03:44:28.547 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-01-28T03:44:28.573 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-01-28T03:44:28.578 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-01-28T03:44:28.583 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-01-28T03:44:28.589 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-01-28T03:44:28.591 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-01-28T03:44:28.602 INFO:teuthology.task.internal:Configuring sudo... 2021-01-28T03:44:28.602 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-01-28T03:44:28.633 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-01-28T03:44:28.651 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-01-28T03:44:28.668 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-01-28T03:44:28.669 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-01-28T03:44:28.671 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-01-28T03:44:28.705 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-01-28T03:44:28.726 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-01-28T03:44:28.732 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2021-01-28T03:44:28.733 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-01-28T03:44:28.757 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-01-28T03:44:28.764 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-01-28T03:44:28.814 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2021-01-28T03:44:28.814 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-01-28T03:44:28.835 DEBUG:teuthology.orchestra.run.smithi100:> sudo service rsyslog restart 2021-01-28T03:44:28.838 DEBUG:teuthology.orchestra.run.smithi162:> sudo service rsyslog restart 2021-01-28T03:44:28.881 INFO:teuthology.run_tasks:Running task internal.timer... 2021-01-28T03:44:28.888 INFO:teuthology.task.internal:Starting timer... 2021-01-28T03:44:28.889 INFO:teuthology.run_tasks:Running task pcp... 2021-01-28T03:44:28.940 INFO:teuthology.run_tasks:Running task selinux... 2021-01-28T03:44:28.977 DEBUG:teuthology.task.selinux:Excluding smithi100: OS 'ubuntu' does not support SELinux 2021-01-28T03:44:28.977 DEBUG:teuthology.task.selinux:Excluding smithi162: OS 'ubuntu' does not support SELinux 2021-01-28T03:44:28.978 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-01-28T03:44:28.978 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2021-01-28T03:44:28.978 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-01-28T03:44:28.978 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-01-28T03:44:29.219 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated or references a specific commit; assuming it is current 2021-01-28T03:44:29.223 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-01-28T03:44:29.420 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2021-01-28T03:44:29.429 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi100.front.sepia.ceph.com,smithi162.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-01-28T03:44:30.597 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-01-28T03:44:33.111 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-01-28T03:44:36.013 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-01-28T03:44:36.049 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:36 +0000 (0:00:00.164) 0:00:00.164 ****** 2021-01-28T03:44:36.068 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:36 +0000 (0:00:00.019) 0:00:00.184 ****** 2021-01-28T03:44:38.373 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi100.front.sepia.ceph.com] 2021-01-28T03:44:38.453 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:38 +0000 (0:00:02.385) 0:00:02.569 ****** 2021-01-28T03:44:38.474 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] 2021-01-28T03:44:38.554 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:38 +0000 (0:00:00.100) 0:00:02.669 ****** 2021-01-28T03:44:38.706 INFO:teuthology.task.ansible.out: 2021-01-28T03:44:38.708 INFO:teuthology.task.ansible.out:TASK [ansible-managed : Create the sudo group.] ******************************** ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-01-28T03:44:38.750 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:38 +0000 (0:00:00.196) 0:00:02.866 ****** 2021-01-28T03:44:38.786 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:38 +0000 (0:00:00.035) 0:00:02.901 ****** 2021-01-28T03:44:39.244 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-01-28T03:44:39.245 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-01-28T03:44:39.281 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:39 +0000 (0:00:00.495) 0:00:03.397 ****** 2021-01-28T03:44:39.288 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-01-28T03:44:39.326 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:39 +0000 (0:00:00.045) 0:00:03.442 ****** 2021-01-28T03:44:39.625 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-01-28T03:44:39.627 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.065504", "end": "2021-01-28 03:44:39.719678", "rc": 0, "start": "2021-01-28 03:44:39.654174", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-01-28T03:44:39.661 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:39 +0000 (0:00:00.334) 0:00:03.776 ****** 2021-01-28T03:44:39.670 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.074586", "end": "2021-01-28 03:44:39.812199", "rc": 0, "start": "2021-01-28 03:44:39.737613", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-01-28T03:44:39.709 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:39 +0000 (0:00:00.047) 0:00:03.824 ****** 2021-01-28T03:44:39.948 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-01-28T03:44:39.950 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-28T03:44:39.994 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:39 +0000 (0:00:00.284) 0:00:04.109 ****** 2021-01-28T03:44:40.002 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-28T03:44:40.049 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:40 +0000 (0:00:00.055) 0:00:04.164 ****** 2021-01-28T03:44:40.912 INFO:teuthology.task.ansible.out: 2021-01-28T03:44:40.914 INFO:teuthology.task.ansible.out:TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** changed: [smithi162.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611805480.0702205-269524911165806/source", "state": "file", "uid": 0} 2021-01-28T03:44:40.949 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:40 +0000 (0:00:00.900) 0:00:05.064 ****** 2021-01-28T03:44:40.957 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611805480.0096335-100114214174356/source", "state": "file", "uid": 0} 2021-01-28T03:44:40.996 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:40 +0000 (0:00:00.047) 0:00:05.112 ****** 2021-01-28T03:44:41.312 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-01-28T03:44:41.314 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-01-28T03:44:41.315 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-01-28T03:44:41.351 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-01-28T03:44:41.353 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-01-28T03:44:41.475 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** 2021-01-28T03:44:41.476 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2021-01-28T03:44:41.497 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-01-28T03:44:41.680 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:41 +0000 (0:00:00.683) 0:00:05.795 ****** 2021-01-28T03:44:41.725 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:41 +0000 (0:00:00.044) 0:00:05.840 ****** 2021-01-28T03:44:42.556 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi100.front.sepia.ceph.com] 2021-01-28T03:44:42.644 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-01-28T03:44:42.645 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:42 +0000 (0:00:00.919) 0:00:06.759 ****** 2021-01-28T03:44:42.655 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] 2021-01-28T03:44:42.741 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:42 +0000 (0:00:00.096) 0:00:06.856 ****** 2021-01-28T03:44:43.023 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** changed: [smithi100.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.159567", "end": "2021-01-28 03:44:42.990787", "rc": 0, "start": "2021-01-28 03:44:42.831220", "stderr": "", "stderr_lines": [], "stdout": "0caff10a478f2674721da1965013b225f3ea5800", "stdout_lines": ["0caff10a478f2674721da1965013b225f3ea5800"]} 2021-01-28T03:44:43.064 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:43 +0000 (0:00:00.323) 0:00:07.180 ****** 2021-01-28T03:44:43.083 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.141657", "end": "2021-01-28 03:44:43.060384", "rc": 0, "start": "2021-01-28 03:44:42.918727", "stderr": "", "stderr_lines": [], "stdout": "0caff10a478f2674721da1965013b225f3ea5800", "stdout_lines": ["0caff10a478f2674721da1965013b225f3ea5800"]} 2021-01-28T03:44:43.085 INFO:teuthology.task.ansible.out: 2021-01-28T03:44:43.122 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:43 +0000 (0:00:00.057) 0:00:07.237 ****** 2021-01-28T03:44:43.201 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-01-28T03:44:43.203 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.011423", "end": "2021-01-28 03:44:43.384658", "failed_when_result": false, "rc": 0, "start": "2021-01-28 03:44:43.373235", "stderr": "", "stderr_lines": [], "stdout": "0caff10a478f2674721da1965013b225f3ea5800", "stdout_lines": ["0caff10a478f2674721da1965013b225f3ea5800"]} 2021-01-28T03:44:43.240 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:43 +0000 (0:00:00.117) 0:00:07.355 ****** 2021-01-28T03:44:43.268 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.015975", "end": "2021-01-28 03:44:43.368517", "failed_when_result": false, "rc": 0, "start": "2021-01-28 03:44:43.352542", "stderr": "", "stderr_lines": [], "stdout": "0caff10a478f2674721da1965013b225f3ea5800", "stdout_lines": ["0caff10a478f2674721da1965013b225f3ea5800"]} 2021-01-28T03:44:43.270 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** ok: [smithi100.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2021-01-28T03:44:43.304 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:43 +0000 (0:00:00.064) 0:00:07.420 ****** 2021-01-28T03:44:43.338 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:43 +0000 (0:00:00.033) 0:00:07.453 ****** 2021-01-28T03:44:43.344 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2021-01-28T03:44:43.346 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:43.382 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:43 +0000 (0:00:00.044) 0:00:07.498 ****** 2021-01-28T03:44:43.390 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2021-01-28T03:44:43.391 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2021-01-28T03:44:43.427 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:43 +0000 (0:00:00.045) 0:00:07.543 ****** 2021-01-28T03:44:43.434 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2021-01-28T03:44:43.436 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:43.473 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:43 +0000 (0:00:00.045) 0:00:07.589 ****** 2021-01-28T03:44:43.481 INFO:teuthology.task.ansible.out: 2021-01-28T03:44:43.483 INFO:teuthology.task.ansible.out:TASK [users : Merge extra_admin_users into managed_admin_users] **************** skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:43.523 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:43 +0000 (0:00:00.049) 0:00:07.638 ****** 2021-01-28T03:44:43.531 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2021-01-28T03:44:43.533 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:43.572 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:43 +0000 (0:00:00.049) 0:00:07.687 ****** 2021-01-28T03:44:43.584 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2021-01-28T03:44:43.586 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:43.621 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:43 +0000 (0:00:00.048) 0:00:07.736 ****** 2021-01-28T03:44:43.628 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2021-01-28T03:44:43.629 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:43.667 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:43 +0000 (0:00:00.046) 0:00:07.782 ****** 2021-01-28T03:44:43.674 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2021-01-28T03:44:43.675 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:43.713 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:43 +0000 (0:00:00.046) 0:00:07.829 ****** 2021-01-28T03:44:43.720 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-01-28T03:44:43.721 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:43.758 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:43 +0000 (0:00:00.044) 0:00:07.873 ****** 2021-01-28T03:44:43.765 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2021-01-28T03:44:43.766 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:43.803 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:43 +0000 (0:00:00.045) 0:00:07.918 ****** 2021-01-28T03:44:43.809 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-01-28T03:44:43.810 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:43.812 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:43.822 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:43.824 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} TASK [users : Set UID_MIN to 1001] ********************************************* skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b037 2021-01-28T03:44:43.826 INFO:teuthology.task.ansible.out:4849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:43.860 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:43 +0000 (0:00:00.057) 0:00:07.975 ****** 2021-01-28T03:44:43.867 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:43.869 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:43.871 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f30 2021-01-28T03:44:43.873 INFO:teuthology.task.ansible.out:09adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6I 2021-01-28T03:44:43.875 INFO:teuthology.task.ansible.out:nynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:43.883 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:43.885 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:43.895 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:43.897 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:43.907 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:43.909 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:43.924 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:43.935 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:43.937 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/ 2021-01-28T03:44:43.938 INFO:teuthology.task.ansible.out:PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:43.948 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:43.950 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:43.950 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:43.961 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:43.963 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:43.973 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:43.974 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:43.975 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:43.975 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'ffilz', ' 2021-01-28T03:44:43.977 INFO:teuthology.task.ansible.out:ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:43.987 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:43.989 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n 2021-01-28T03:44:43.991 INFO:teuthology.task.ansible.out:"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.000 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.002 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.012 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.015 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.015 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.026 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.028 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.030 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.032 INFO:teuthology.task.ansible.out: 2021-01-28T03:44:44.042 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.044 INFO:teuthology.task.ansible.out: skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.046 INFO:teuthology.task.ansible.out: skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.057 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.059 INFO:teuthology.task.ansible.out: skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.061 INFO:teuthology.task.ansible.out: skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.073 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.074 INFO:teuthology.task.ansible.out: 2021-01-28T03:44:44.079 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.082 INFO:teuthology.task.ansible.out: skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.083 INFO:teuthology.task.ansible.out: 2021-01-28T03:44:44.083 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.094 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.097 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.106 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.109 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.118 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.120 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.130 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.132 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.141 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.143 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.153 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.156 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.165 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.167 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.177 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.179 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.179 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.190 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.192 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.202 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.204 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.213 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.216 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.226 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.228 INFO:teuthology.task.ansible.out: skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.228 INFO:teuthology.task.ansible.out: 2021-01-28T03:44:44.229 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.240 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.242 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.251 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.253 INFO:teuthology.task.ansible.out: skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.254 INFO:teuthology.task.ansible.out: skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.265 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.267 INFO:teuthology.task.ansible.out: skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.269 INFO:teuthology.task.ansible.out: skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.279 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.282 INFO:teuthology.task.ansible.out: skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.283 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.293 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.295 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.305 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.306 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.308 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.320 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.331 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.333 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.343 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.346 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.357 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.359 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.360 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.371 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.373 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.383 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.385 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.395 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.398 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.408 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.410 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.420 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.422 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.432 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.434 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.445 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.447 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.458 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.460 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.470 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.472 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.482 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.484 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.494 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.495 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.498 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.499 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.511 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.512 INFO:teuthology.task.ansible.out: skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.514 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.516 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.527 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.529 INFO:teuthology.task.ansible.out: skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.540 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.542 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.553 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.555 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.557 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.568 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.573 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.574 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.576 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.577 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.589 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.591 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.592 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.604 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.606 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.617 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.619 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.620 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.631 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.633 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.633 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.649 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.651 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.668 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.670 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.712 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:44 +0000 (0:00:00.852) 0:00:08.828 ****** 2021-01-28T03:44:44.722 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.724 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.724 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'na 2021-01-28T03:44:44.726 INFO:teuthology.task.ansible.out:me': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.737 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.739 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.751 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.753 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.817 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:44 +0000 (0:00:00.104) 0:00:08.932 ****** 2021-01-28T03:44:44.824 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.827 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.827 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.828 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@z 2021-01-28T03:44:44.829 INFO:teuthology.task.ansible.out:ulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.830 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.830 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvA 2021-01-28T03:44:44.832 INFO:teuthology.task.ansible.out:OJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.842 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.844 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} TASK [users : Merge managed_users and managed_admin users] ********************* skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.884 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:44 +0000 (0:00:00.067) 0:00:08.999 ****** 2021-01-28T03:44:44.891 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-01-28T03:44:44.893 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.894 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.895 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.896 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.896 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"na 2021-01-28T03:44:44.898 INFO:teuthology.task.ansible.out:me": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.908 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.919 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.930 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.932 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.969 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:44 +0000 (0:00:00.085) 0:00:09.085 ****** 2021-01-28T03:44:44.978 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.979 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.981 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.981 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.983 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:44.986 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.002 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-01-28T03:44:45.004 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.038 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:45 +0000 (0:00:00.068) 0:00:09.153 ****** 2021-01-28T03:44:45.074 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:45 +0000 (0:00:00.036) 0:00:09.189 ****** 2021-01-28T03:44:45.082 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-01-28T03:44:45.083 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.121 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:45 +0000 (0:00:00.047) 0:00:09.237 ****** 2021-01-28T03:44:45.130 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2021-01-28T03:44:45.169 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:45 +0000 (0:00:00.047) 0:00:09.284 ****** 2021-01-28T03:44:45.175 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2021-01-28T03:44:45.177 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.214 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:45 +0000 (0:00:00.044) 0:00:09.329 ****** 2021-01-28T03:44:45.222 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2021-01-28T03:44:45.223 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.266 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:45 +0000 (0:00:00.052) 0:00:09.381 ****** 2021-01-28T03:44:45.273 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-01-28T03:44:45.274 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.275 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.276 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.276 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.288 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.289 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.299 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-01-28T03:44:45.301 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi100.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.336 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:45 +0000 (0:00:00.069) 0:00:09.451 ****** 2021-01-28T03:44:45.343 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.345 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.345 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.347 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.347 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.359 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.361 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi100.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.401 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:45 +0000 (0:00:00.065) 0:00:09.516 ****** 2021-01-28T03:44:45.412 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.415 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.416 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.416 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.417 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.417 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.418 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.418 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.418 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.419 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.419 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.430 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.432 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi100.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.469 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:45 +0000 (0:00:00.067) 0:00:09.584 ****** 2021-01-28T03:44:45.476 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.477 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.478 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.489 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.491 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.492 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.529 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:45 +0000 (0:00:00.060) 0:00:09.644 ****** 2021-01-28T03:44:45.535 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-01-28T03:44:45.538 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.582 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:45 +0000 (0:00:00.052) 0:00:09.697 ****** 2021-01-28T03:44:45.594 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.595 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.596 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.598 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.609 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.611 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.622 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.633 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.634 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.644 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.645 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.655 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.657 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.667 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.668 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.679 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.681 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.690 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.692 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.702 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.703 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.713 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.715 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.724 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.726 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.736 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.738 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.747 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.749 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.758 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.760 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.772 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.782 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.784 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.794 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.795 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.805 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.807 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.817 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.819 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.828 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.830 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:45.873 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:45 +0000 (0:00:00.291) 0:00:09.988 ****** 2021-01-28T03:44:46.155 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-01-28T03:44:46.157 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "checksum": "e880c991f1562524752e643d227b8575ac6e2ed1", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "size": 40, "state": "file", "uid": 0} 2021-01-28T03:44:46.195 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:46 +0000 (0:00:00.321) 0:00:10.310 ****** 2021-01-28T03:44:46.201 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "checksum": "e880c991f1562524752e643d227b8575ac6e2ed1", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "size": 40, "state": "file", "uid": 0} 2021-01-28T03:44:46.237 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:46 +0000 (0:00:00.042) 0:00:10.353 ****** 2021-01-28T03:44:46.245 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** ok: [smithi100.front.sepia.ceph.com] => { "msg": "Host smithi100.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-01-28T03:44:46.285 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:46 +0000 (0:00:00.047) 0:00:10.400 ****** 2021-01-28T03:44:46.292 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => { "msg": "Host smithi162.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-01-28T03:44:46.331 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:46 +0000 (0:00:00.046) 0:00:10.446 ****** 2021-01-28T03:44:46.337 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-01-28T03:44:46.339 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-01-28T03:44:46.377 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:46 +0000 (0:00:00.046) 0:00:10.492 ****** 2021-01-28T03:44:46.384 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-01-28T03:44:46.422 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:46 +0000 (0:00:00.044) 0:00:10.537 ****** 2021-01-28T03:44:46.430 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-01-28T03:44:46.432 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:46.467 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:46 +0000 (0:00:00.045) 0:00:10.583 ****** 2021-01-28T03:44:46.475 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:46.512 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:46 +0000 (0:00:00.044) 0:00:10.627 ****** 2021-01-28T03:44:46.519 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-01-28T03:44:46.520 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:46.556 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:46 +0000 (0:00:00.044) 0:00:10.672 ****** 2021-01-28T03:44:46.563 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:46.600 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:46 +0000 (0:00:00.043) 0:00:10.715 ****** 2021-01-28T03:44:46.709 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Thursday 28 January 2021 03:44:46 +0000 (0:00:00.065) 0:00:10.781 ****** skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:46.724 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:46 +0000 (0:00:00.058) 0:00:10.839 ****** 2021-01-28T03:44:46.731 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-01-28T03:44:46.733 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:46.786 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:46 +0000 (0:00:00.061) 0:00:10.901 ****** 2021-01-28T03:44:46.801 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:46.837 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:46 +0000 (0:00:00.051) 0:00:10.952 ****** 2021-01-28T03:44:46.844 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-01-28T03:44:46.846 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:46.893 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:46 +0000 (0:00:00.055) 0:00:11.008 ****** 2021-01-28T03:44:46.903 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:46.949 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:46 +0000 (0:00:00.056) 0:00:11.064 ****** 2021-01-28T03:44:46.956 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-01-28T03:44:46.958 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:46.994 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:46 +0000 (0:00:00.045) 0:00:11.110 ****** 2021-01-28T03:44:47.002 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:47.052 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:47 +0000 (0:00:00.057) 0:00:11.167 ****** 2021-01-28T03:44:47.061 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-01-28T03:44:47.063 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:47.101 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:47 +0000 (0:00:00.048) 0:00:11.216 ****** 2021-01-28T03:44:47.108 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:47.148 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:47 +0000 (0:00:00.046) 0:00:11.263 ****** 2021-01-28T03:44:47.155 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-01-28T03:44:47.157 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:47.193 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:47 +0000 (0:00:00.045) 0:00:11.308 ****** 2021-01-28T03:44:47.200 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:47.240 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:47 +0000 (0:00:00.046) 0:00:11.355 ****** 2021-01-28T03:44:47.246 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-01-28T03:44:47.248 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi100.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-28T03:44:47.285 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:47 +0000 (0:00:00.045) 0:00:11.401 ****** 2021-01-28T03:44:47.292 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-28T03:44:47.293 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-28T03:44:47.330 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:47 +0000 (0:00:00.045) 0:00:11.446 ****** 2021-01-28T03:44:47.337 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-01-28T03:44:47.338 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:47.378 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:47 +0000 (0:00:00.047) 0:00:11.493 ****** 2021-01-28T03:44:47.389 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:47.432 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:47 +0000 (0:00:00.054) 0:00:11.548 ****** 2021-01-28T03:44:47.439 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-01-28T03:44:47.441 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:47.478 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:47 +0000 (0:00:00.046) 0:00:11.594 ****** 2021-01-28T03:44:47.487 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:47.523 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:47 +0000 (0:00:00.044) 0:00:11.638 ****** 2021-01-28T03:44:47.529 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-01-28T03:44:47.531 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-28T03:44:47.567 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:47 +0000 (0:00:00.044) 0:00:11.683 ****** 2021-01-28T03:44:47.574 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-28T03:44:47.613 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:47 +0000 (0:00:00.045) 0:00:11.728 ****** 2021-01-28T03:44:47.619 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-01-28T03:44:47.620 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:47.657 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:47 +0000 (0:00:00.044) 0:00:11.773 ****** 2021-01-28T03:44:47.666 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:47.708 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:47 +0000 (0:00:00.050) 0:00:11.823 ****** 2021-01-28T03:44:47.715 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-01-28T03:44:47.717 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-28T03:44:47.752 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:47 +0000 (0:00:00.044) 0:00:11.868 ****** 2021-01-28T03:44:47.760 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-28T03:44:47.798 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:47 +0000 (0:00:00.045) 0:00:11.913 ****** 2021-01-28T03:44:47.806 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-01-28T03:44:47.808 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:47.843 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:47 +0000 (0:00:00.044) 0:00:11.958 ****** 2021-01-28T03:44:47.850 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:47.888 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:47 +0000 (0:00:00.044) 0:00:12.003 ****** 2021-01-28T03:44:47.894 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-01-28T03:44:47.896 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:47.932 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:47 +0000 (0:00:00.044) 0:00:12.047 ****** 2021-01-28T03:44:47.939 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:47.976 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:47 +0000 (0:00:00.044) 0:00:12.091 ****** 2021-01-28T03:44:47.983 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-01-28T03:44:47.985 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:48.022 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:48 +0000 (0:00:00.045) 0:00:12.137 ****** 2021-01-28T03:44:48.029 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:48.072 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:48 +0000 (0:00:00.047) 0:00:12.185 ****** 2021-01-28T03:44:48.079 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:48.118 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:48 +0000 (0:00:00.048) 0:00:12.233 ****** 2021-01-28T03:44:48.127 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:48.164 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:48 +0000 (0:00:00.046) 0:00:12.279 ****** 2021-01-28T03:44:48.170 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-01-28T03:44:48.172 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-28T03:44:48.208 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:48 +0000 (0:00:00.044) 0:00:12.323 ****** 2021-01-28T03:44:48.217 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-28T03:44:48.254 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:48 +0000 (0:00:00.046) 0:00:12.369 ****** 2021-01-28T03:44:48.261 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-01-28T03:44:48.262 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:48.311 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:48 +0000 (0:00:00.056) 0:00:12.426 ****** 2021-01-28T03:44:48.318 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:48.360 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:48 +0000 (0:00:00.049) 0:00:12.476 ****** 2021-01-28T03:44:48.367 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-01-28T03:44:48.369 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:48.407 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:48 +0000 (0:00:00.047) 0:00:12.523 ****** 2021-01-28T03:44:48.417 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:48.454 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:48 +0000 (0:00:00.046) 0:00:12.570 ****** 2021-01-28T03:44:48.462 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-01-28T03:44:48.464 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:48.500 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:48 +0000 (0:00:00.045) 0:00:12.615 ****** 2021-01-28T03:44:48.508 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:48.547 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:48 +0000 (0:00:00.046) 0:00:12.662 ****** 2021-01-28T03:44:48.553 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-01-28T03:44:48.555 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:48.592 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:48 +0000 (0:00:00.045) 0:00:12.708 ****** 2021-01-28T03:44:48.599 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:48.655 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:48 +0000 (0:00:00.062) 0:00:12.770 ****** 2021-01-28T03:44:48.661 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-01-28T03:44:48.663 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:48.701 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:48 +0000 (0:00:00.046) 0:00:12.817 ****** 2021-01-28T03:44:48.709 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:48.754 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:48 +0000 (0:00:00.052) 0:00:12.869 ****** 2021-01-28T03:44:48.761 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-01-28T03:44:48.762 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:48.799 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:48 +0000 (0:00:00.045) 0:00:12.915 ****** 2021-01-28T03:44:48.814 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:48.857 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:48 +0000 (0:00:00.057) 0:00:12.972 ****** 2021-01-28T03:44:48.864 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-01-28T03:44:48.866 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-28T03:44:48.905 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:48 +0000 (0:00:00.048) 0:00:13.020 ****** 2021-01-28T03:44:48.912 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-28T03:44:48.952 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:48 +0000 (0:00:00.046) 0:00:13.067 ****** 2021-01-28T03:44:48.959 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-01-28T03:44:48.960 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:48.998 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:48 +0000 (0:00:00.046) 0:00:13.113 ****** 2021-01-28T03:44:49.005 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:49.042 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:49 +0000 (0:00:00.044) 0:00:13.158 ****** 2021-01-28T03:44:49.050 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-01-28T03:44:49.052 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:49.088 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:49 +0000 (0:00:00.045) 0:00:13.203 ****** 2021-01-28T03:44:49.096 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:49.133 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:49 +0000 (0:00:00.044) 0:00:13.248 ****** 2021-01-28T03:44:49.141 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-01-28T03:44:49.143 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:49.202 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:49 +0000 (0:00:00.069) 0:00:13.318 ****** 2021-01-28T03:44:49.213 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:49.256 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:49 +0000 (0:00:00.053) 0:00:13.371 ****** 2021-01-28T03:44:49.263 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-01-28T03:44:49.264 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:49.303 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:49 +0000 (0:00:00.047) 0:00:13.418 ****** 2021-01-28T03:44:49.309 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:49.311 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:49.350 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:49 +0000 (0:00:00.046) 0:00:13.465 ****** 2021-01-28T03:44:49.356 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-01-28T03:44:49.358 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:49.399 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:49 +0000 (0:00:00.049) 0:00:13.514 ****** 2021-01-28T03:44:49.406 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:49.408 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:49.449 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:49 +0000 (0:00:00.050) 0:00:13.565 ****** 2021-01-28T03:44:49.456 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-01-28T03:44:49.458 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:49.512 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:49 +0000 (0:00:00.062) 0:00:13.628 ****** 2021-01-28T03:44:49.521 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:49.567 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:49 +0000 (0:00:00.055) 0:00:13.683 ****** 2021-01-28T03:44:49.660 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-01-28T03:44:49.661 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.013651", "end": "2021-01-28 03:44:49.841741", "rc": 0, "start": "2021-01-28 03:44:49.828090", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-01-28T03:44:49.702 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:49 +0000 (0:00:00.134) 0:00:13.817 ****** 2021-01-28T03:44:49.723 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.014157", "end": "2021-01-28 03:44:49.822742", "rc": 0, "start": "2021-01-28 03:44:49.808585", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-01-28T03:44:49.760 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:49 +0000 (0:00:00.058) 0:00:13.876 ****** 2021-01-28T03:44:49.767 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:49.806 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:49 +0000 (0:00:00.045) 0:00:13.921 ****** 2021-01-28T03:44:49.814 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:49.851 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:49 +0000 (0:00:00.044) 0:00:13.966 ****** 2021-01-28T03:44:49.857 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-01-28T03:44:49.859 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:49.902 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:49 +0000 (0:00:00.051) 0:00:14.017 ****** 2021-01-28T03:44:49.910 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:49.950 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:49 +0000 (0:00:00.047) 0:00:14.065 ****** 2021-01-28T03:44:49.958 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-01-28T03:44:49.961 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:50.019 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:50 +0000 (0:00:00.068) 0:00:14.134 ****** 2021-01-28T03:44:50.026 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:50.068 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:50 +0000 (0:00:00.049) 0:00:14.183 ****** 2021-01-28T03:44:50.076 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-01-28T03:44:50.077 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:50.114 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:50 +0000 (0:00:00.045) 0:00:14.229 ****** 2021-01-28T03:44:50.122 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:50.160 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:50 +0000 (0:00:00.046) 0:00:14.275 ****** 2021-01-28T03:44:50.167 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-01-28T03:44:50.169 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:50.206 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:50 +0000 (0:00:00.045) 0:00:14.321 ****** 2021-01-28T03:44:50.213 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:50.255 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:50 +0000 (0:00:00.048) 0:00:14.370 ****** 2021-01-28T03:44:50.262 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-01-28T03:44:50.265 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:50.302 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:50 +0000 (0:00:00.046) 0:00:14.417 ****** 2021-01-28T03:44:50.311 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:50.347 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:50 +0000 (0:00:00.045) 0:00:14.462 ****** 2021-01-28T03:44:50.354 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-01-28T03:44:50.356 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:50.394 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:50 +0000 (0:00:00.044) 0:00:14.507 ****** 2021-01-28T03:44:50.399 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:50.443 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:50 +0000 (0:00:00.051) 0:00:14.558 ****** 2021-01-28T03:44:51.325 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-01-28T03:44:51.326 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.774961", "end": "2021-01-28 03:44:51.500459", "rc": 0, "start": "2021-01-28 03:44:50.725498", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T03:44:51.328 INFO:teuthology.task.ansible.out: 2021-01-28T03:44:51.377 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:51 +0000 (0:00:00.934) 0:00:15.493 ****** 2021-01-28T03:44:51.410 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.798530", "end": "2021-01-28 03:44:51.500444", "rc": 0, "start": "2021-01-28 03:44:50.701914", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T03:44:51.412 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-01-28T03:44:51.412 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:51.475 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:51 +0000 (0:00:00.098) 0:00:15.591 ****** 2021-01-28T03:44:51.513 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:51 +0000 (0:00:00.037) 0:00:15.628 ****** 2021-01-28T03:44:51.580 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:51.625 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:51 +0000 (0:00:00.111) 0:00:15.739 ****** 2021-01-28T03:44:51.704 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-01-28T03:44:51.705 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.090540", "end": "2021-01-28 03:44:51.879979", "rc": 0, "start": "2021-01-28 03:44:51.789439", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T03:44:51.742 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:51 +0000 (0:00:00.117) 0:00:15.857 ****** 2021-01-28T03:44:51.859 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.099917", "end": "2021-01-28 03:44:51.954701", "rc": 0, "start": "2021-01-28 03:44:51.854784", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T03:44:51.899 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:51 +0000 (0:00:00.157) 0:00:16.015 ****** 2021-01-28T03:44:55.234 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-01-28T03:44:55.236 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1611805262, "cache_updated": false, "changed": false} 2021-01-28T03:44:55.271 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:55 +0000 (0:00:03.372) 0:00:19.387 ****** 2021-01-28T03:44:55.320 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1611805203, "cache_updated": false, "changed": false} 2021-01-28T03:44:55.358 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:55 +0000 (0:00:00.086) 0:00:19.473 ****** 2021-01-28T03:44:55.934 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-01-28T03:44:55.936 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"cache_update_time": 1611805262, "cache_updated": false, "changed": false} 2021-01-28T03:44:55.972 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:55 +0000 (0:00:00.613) 0:00:20.087 ****** 2021-01-28T03:44:56.000 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-01-28T03:44:56.002 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:56.045 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:56 +0000 (0:00:00.073) 0:00:20.161 ****** 2021-01-28T03:44:56.052 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-01-28T03:44:56.054 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"cache_update_time": 1611805203, "cache_updated": false, "changed": false} 2021-01-28T03:44:56.096 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:56 +0000 (0:00:00.049) 0:00:20.210 ****** 2021-01-28T03:44:56.122 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-01-28T03:44:56.124 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:56.159 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:56 +0000 (0:00:00.063) 0:00:20.275 ****** 2021-01-28T03:44:56.389 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-01-28T03:44:56.427 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:56 +0000 (0:00:00.267) 0:00:20.542 ****** 2021-01-28T03:44:56.499 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-01-28T03:44:56.536 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:56 +0000 (0:00:00.109) 0:00:20.652 ****** 2021-01-28T03:44:57.075 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** ok: [smithi162.front.sepia.ceph.com] => {"cache_update_time": 1611805262, "cache_updated": false, "changed": false} 2021-01-28T03:44:57.114 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:57 +0000 (0:00:00.577) 0:00:21.230 ****** 2021-01-28T03:44:57.177 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"cache_update_time": 1611805203, "cache_updated": false, "changed": false} 2021-01-28T03:44:57.214 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:57 +0000 (0:00:00.099) 0:00:21.329 ****** 2021-01-28T03:44:57.514 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-01-28T03:44:57.516 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-01-28T03:44:57.662 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-01-28T03:44:57.859 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-01-28T03:44:57.997 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-01-28T03:44:58.145 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-01-28T03:44:58.185 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:58 +0000 (0:00:00.970) 0:00:22.300 ****** 2021-01-28T03:44:58.288 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-01-28T03:44:58.349 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:58 +0000 (0:00:00.164) 0:00:22.464 ****** 2021-01-28T03:44:58.357 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-01-28T03:44:58.358 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-01-28T03:44:58.406 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:58 +0000 (0:00:00.057) 0:00:22.522 ****** 2021-01-28T03:44:58.477 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-01-28T03:44:58.517 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:58 +0000 (0:00:00.109) 0:00:22.632 ****** 2021-01-28T03:44:58.753 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-01-28T03:44:58.755 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-01-28T03:44:58.871 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-01-28T03:44:59.074 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-01-28T03:44:59.171 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-01-28T03:44:59.351 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-01-28T03:44:59.390 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:59 +0000 (0:00:00.873) 0:00:23.505 ****** 2021-01-28T03:44:59.429 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** ok: [smithi162.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-01-28T03:44:59.468 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:59 +0000 (0:00:00.078) 0:00:23.584 ****** 2021-01-28T03:44:59.478 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-01-28T03:44:59.479 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-01-28T03:44:59.518 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:59 +0000 (0:00:00.049) 0:00:23.633 ****** 2021-01-28T03:44:59.524 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:59.564 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:59 +0000 (0:00:00.046) 0:00:23.679 ****** 2021-01-28T03:44:59.571 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-01-28T03:44:59.573 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-01-28T03:44:59.614 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:59 +0000 (0:00:00.050) 0:00:23.729 ****** 2021-01-28T03:44:59.621 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-01-28T03:44:59.623 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-28T03:44:59.659 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:59 +0000 (0:00:00.044) 0:00:23.774 ****** 2021-01-28T03:44:59.667 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-01-28T03:44:59.669 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:59.710 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:59 +0000 (0:00:00.051) 0:00:23.826 ****** 2021-01-28T03:44:59.729 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-01-28T03:44:59.731 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:59.770 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:59 +0000 (0:00:00.059) 0:00:23.885 ****** 2021-01-28T03:44:59.777 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-01-28T03:44:59.779 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-28T03:44:59.816 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:59 +0000 (0:00:00.045) 0:00:23.931 ****** 2021-01-28T03:44:59.823 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-01-28T03:44:59.825 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:44:59.863 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:59 +0000 (0:00:00.047) 0:00:23.978 ****** 2021-01-28T03:44:59.870 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-01-28T03:44:59.872 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:59.883 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:59.885 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-28T03:44:59.928 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:59 +0000 (0:00:00.065) 0:00:24.043 ****** 2021-01-28T03:44:59.957 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-01-28T03:44:59.959 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:00.001 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:44:59 +0000 (0:00:00.073) 0:00:24.116 ****** 2021-01-28T03:45:00.526 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-01-28T03:45:00.528 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"cache_update_time": 1611805262, "cache_updated": false, "changed": false} 2021-01-28T03:45:00.566 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:00 +0000 (0:00:00.564) 0:00:24.681 ****** 2021-01-28T03:45:00.657 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"cache_update_time": 1611805203, "cache_updated": false, "changed": false} 2021-01-28T03:45:00.697 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:00 +0000 (0:00:00.130) 0:00:24.811 ****** 2021-01-28T03:45:00.909 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-01-28T03:45:00.954 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:00 +0000 (0:00:00.256) 0:00:25.067 ****** 2021-01-28T03:45:01.096 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-01-28T03:45:01.138 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:01 +0000 (0:00:00.186) 0:00:25.254 ****** 2021-01-28T03:45:01.336 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-01-28T03:45:01.338 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-01-28T03:45:01.375 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:01 +0000 (0:00:00.237) 0:00:25.491 ****** 2021-01-28T03:45:01.498 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-01-28T03:45:01.535 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:01 +0000 (0:00:00.159) 0:00:25.651 ****** 2021-01-28T03:45:01.542 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-01-28T03:45:01.544 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-01-28T03:45:01.639 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-01-28T03:45:01.683 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:01 +0000 (0:00:00.147) 0:00:25.798 ****** 2021-01-28T03:45:01.691 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-01-28T03:45:01.713 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:01.750 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:01 +0000 (0:00:00.066) 0:00:25.865 ****** 2021-01-28T03:45:01.788 INFO:teuthology.task.ansible.out: 2021-01-28T03:45:01.797 INFO:teuthology.task.ansible.out:TASK [common : Check firewalld status] ***************************************** 2021-01-28T03:45:01.798 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-01-28T03:45:01.799 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-01-28T03:45:01.837 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:01 +0000 (0:00:00.087) 0:00:25.952 ****** 2021-01-28T03:45:01.875 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:01 +0000 (0:00:00.036) 0:00:25.989 ****** 2021-01-28T03:45:01.892 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-01-28T03:45:01.893 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:01.934 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:01 +0000 (0:00:00.060) 0:00:26.049 ****** 2021-01-28T03:45:01.943 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:01.982 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:01 +0000 (0:00:00.048) 0:00:26.098 ****** 2021-01-28T03:45:01.993 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-01-28T03:45:01.997 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-28T03:45:02.037 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:02 +0000 (0:00:00.054) 0:00:26.153 ****** 2021-01-28T03:45:02.107 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-01-28T03:45:02.109 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:02.145 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:02 +0000 (0:00:00.107) 0:00:26.260 ****** 2021-01-28T03:45:02.452 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-01-28T03:45:02.456 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-01-28T03:45:02.525 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:02 +0000 (0:00:00.380) 0:00:26.641 ****** 2021-01-28T03:45:02.618 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-01-28T03:45:02.859 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:02 +0000 (0:00:00.171) 0:00:26.813 ****** 2021-01-28T03:45:03.302 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-01-28T03:45:03.304 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2021-01-28 03:43:58 UTC", "ActiveEnterTimestampMonotonic": "17333335", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "local-fs.target var-run.mount systemd-tmpfiles-setup.service basic.target nss-lookup.target time-sync.target system.slice sysinit.target remote-fs.target network.target systemd-journald.socket -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2021-01-28 03:43:58 UTC", "AssertTimestampMonotonic": "17327138", "Before": "xdm.service multi-user.target shutdown.target plymouth-quit.service getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2021-01-28 03:43:58 UTC", "Co 2021-01-28T03:45:03.306 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "17327137", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "947", "ExecMainStartTimestamp": "Thu 2021-01-28 03:43:58 UTC", "ExecMainStartTimestampMonotonic": "17333170", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Thu 2021-01-28 03:43:58 UTC] ; stop_time=[n/a] ; pid=947 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Thu 2021-01-28 03:43:58 UTC] ; stop_time=[n/a] ; pid=947 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GI 2021-01-28T03:45:03.307 INFO:teuthology.task.ansible.out:D": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2021-01-28 03:43:58 UTC", "InactiveExitTimestampMonotonic": "17333335", "InvocationID": "b0d665ae1dda4cc9a72e9b6f863e3473", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127781", "LimitNPROCSoft": "127781", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127781", "LimitSIGPENDINGSoft": "127781", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "947", "MemoryAccounting": "yes", "MemoryCurrent": "806912", "MemoryDe 2021-01-28T03:45:03.309 INFO:teuthology.task.ansible.out:nyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-01-28 03:43:58 UTC", "StateChangeTimestampMonotonic": "17333335", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", 2021-01-28T03:45:03.310 INFO:teuthology.task.ansible.out: "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38334", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-28T03:45:03.342 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:03 +0000 (0:00:00.644) 0:00:27.457 ****** 2021-01-28T03:45:03.352 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2021-01-28 03:43:41 UTC", "ActiveEnterTimestampMonotonic": "15188792", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "local-fs.target nss-lookup.target network.target var-run.mount time-sync.target basic.target systemd-tmpfiles-setup.service sysinit.target remote-fs.target systemd-journald.socket system.slice -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2021-01-28 03:43:41 UTC", "AssertTimestampMonotonic": "15159719", "Before": "multi-user.target plymouth-quit.service shutdown.target getty@tty1.service xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2021-01-28 03:43:41 UTC", "Co 2021-01-28T03:45:03.354 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "15159718", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "911", "ExecMainStartTimestamp": "Thu 2021-01-28 03:43:41 UTC", "ExecMainStartTimestampMonotonic": "15188666", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Thu 2021-01-28 03:43:41 UTC] ; stop_time=[n/a] ; pid=911 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Thu 2021-01-28 03:43:41 UTC] ; stop_time=[n/a] ; pid=911 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GI 2021-01-28T03:45:03.356 INFO:teuthology.task.ansible.out:D": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2021-01-28 03:43:41 UTC", "InactiveExitTimestampMonotonic": "15188792", "InvocationID": "85fc0c41c3394546a42ba5a4d4e62c8d", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127779", "LimitNPROCSoft": "127779", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127779", "LimitSIGPENDINGSoft": "127779", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "911", "MemoryAccounting": "yes", "MemoryCurrent": "864256", "MemoryDe 2021-01-28T03:45:03.358 INFO:teuthology.task.ansible.out:nyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-01-28 03:43:41 UTC", "StateChangeTimestampMonotonic": "15188792", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", 2021-01-28T03:45:03.360 INFO:teuthology.task.ansible.out: "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38333", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-28T03:45:03.405 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:03 +0000 (0:00:00.063) 0:00:27.521 ****** 2021-01-28T03:45:03.412 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-01-28T03:45:03.414 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:03.457 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:03 +0000 (0:00:00.051) 0:00:27.572 ****** 2021-01-28T03:45:03.465 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:03.509 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:03 +0000 (0:00:00.051) 0:00:27.624 ****** 2021-01-28T03:45:03.516 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-01-28T03:45:03.518 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:03.555 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:03 +0000 (0:00:00.046) 0:00:27.670 ****** 2021-01-28T03:45:03.563 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:03.603 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:03 +0000 (0:00:00.048) 0:00:27.718 ****** 2021-01-28T03:45:03.611 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-01-28T03:45:03.613 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:03.651 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:03 +0000 (0:00:00.048) 0:00:27.767 ****** 2021-01-28T03:45:03.680 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:03.682 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:03.739 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:03 +0000 (0:00:00.086) 0:00:27.854 ****** 2021-01-28T03:45:03.776 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:03 +0000 (0:00:00.037) 0:00:27.892 ****** 2021-01-28T03:45:03.783 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:03.823 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:03 +0000 (0:00:00.047) 0:00:27.939 ****** 2021-01-28T03:45:03.837 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-01-28T03:45:03.839 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:03.877 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:03 +0000 (0:00:00.053) 0:00:27.992 ****** 2021-01-28T03:45:03.886 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:03.925 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:03 +0000 (0:00:00.048) 0:00:28.040 ****** 2021-01-28T03:45:03.934 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-01-28T03:45:03.935 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:03.981 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:03 +0000 (0:00:00.055) 0:00:28.096 ****** 2021-01-28T03:45:03.992 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:04.040 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:04 +0000 (0:00:00.058) 0:00:28.155 ****** 2021-01-28T03:45:04.047 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-01-28T03:45:04.048 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:04.087 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:04 +0000 (0:00:00.047) 0:00:28.203 ****** 2021-01-28T03:45:04.094 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:04.134 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:04 +0000 (0:00:00.047) 0:00:28.250 ****** 2021-01-28T03:45:04.142 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-01-28T03:45:04.144 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:04.180 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:04 +0000 (0:00:00.045) 0:00:28.296 ****** 2021-01-28T03:45:04.188 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:04.226 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:04 +0000 (0:00:00.045) 0:00:28.341 ****** 2021-01-28T03:45:04.234 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-01-28T03:45:04.237 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:04.276 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:04 +0000 (0:00:00.049) 0:00:28.391 ****** 2021-01-28T03:45:04.283 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:04.324 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:04 +0000 (0:00:00.048) 0:00:28.439 ****** 2021-01-28T03:45:04.331 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-01-28T03:45:04.331 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:04.387 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:04 +0000 (0:00:00.063) 0:00:28.502 ****** 2021-01-28T03:45:04.393 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:04.436 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:04 +0000 (0:00:00.049) 0:00:28.552 ****** 2021-01-28T03:45:04.446 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-01-28T03:45:04.448 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-01-28T03:45:04.486 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:04 +0000 (0:00:00.049) 0:00:28.601 ****** 2021-01-28T03:45:04.493 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-01-28T03:45:04.538 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:04 +0000 (0:00:00.051) 0:00:28.653 ****** 2021-01-28T03:45:04.558 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-01-28T03:45:04.560 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-01-28T03:45:04.598 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:04 +0000 (0:00:00.059) 0:00:28.713 ****** 2021-01-28T03:45:04.606 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-01-28T03:45:04.646 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:04 +0000 (0:00:00.047) 0:00:28.761 ****** 2021-01-28T03:45:04.655 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-01-28T03:45:04.656 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-01-28T03:45:04.658 INFO:teuthology.task.ansible.out: 2021-01-28T03:45:04.699 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:04 +0000 (0:00:00.053) 0:00:28.815 ****** 2021-01-28T03:45:04.701 INFO:teuthology.task.ansible.out: 2021-01-28T03:45:04.709 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-01-28T03:45:04.752 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:04 +0000 (0:00:00.052) 0:00:28.867 ****** 2021-01-28T03:45:04.759 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-01-28T03:45:04.761 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-01-28T03:45:04.798 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:04 +0000 (0:00:00.046) 0:00:28.914 ****** 2021-01-28T03:45:04.806 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-01-28T03:45:04.861 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:04 +0000 (0:00:00.062) 0:00:28.976 ****** 2021-01-28T03:45:04.937 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-01-28T03:45:04.939 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-01-28T03:45:04.976 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:04 +0000 (0:00:00.115) 0:00:29.092 ****** 2021-01-28T03:45:04.994 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-01-28T03:45:05.031 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:05 +0000 (0:00:00.055) 0:00:29.147 ****** 2021-01-28T03:45:05.124 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-01-28T03:45:05.126 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-01-28T03:45:05.169 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:05 +0000 (0:00:00.137) 0:00:29.284 ****** 2021-01-28T03:45:05.176 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-01-28T03:45:05.215 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:05 +0000 (0:00:00.046) 0:00:29.331 ****** 2021-01-28T03:45:05.223 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-01-28T03:45:05.225 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:05.261 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:05 +0000 (0:00:00.045) 0:00:29.376 ****** 2021-01-28T03:45:05.268 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:05.312 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:05 +0000 (0:00:00.050) 0:00:29.427 ****** 2021-01-28T03:45:05.320 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-01-28T03:45:05.323 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:05.374 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:05 +0000 (0:00:00.062) 0:00:29.490 ****** 2021-01-28T03:45:05.384 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:05.556 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:05 +0000 (0:00:00.181) 0:00:29.672 ****** 2021-01-28T03:45:05.660 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-01-28T03:45:05.662 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-01-28T03:45:05.698 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:05 +0000 (0:00:00.141) 0:00:29.814 ****** 2021-01-28T03:45:05.726 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-01-28T03:45:05.788 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:05 +0000 (0:00:00.090) 0:00:29.904 ****** 2021-01-28T03:45:06.128 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-01-28T03:45:06.130 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-01-28T03:45:06.166 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:06 +0000 (0:00:00.377) 0:00:30.282 ****** 2021-01-28T03:45:06.173 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-01-28T03:45:06.210 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:06 +0000 (0:00:00.044) 0:00:30.326 ****** 2021-01-28T03:45:06.217 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-01-28T03:45:06.219 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi162"}, "changed": false} 2021-01-28T03:45:06.255 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:06 +0000 (0:00:00.044) 0:00:30.371 ****** 2021-01-28T03:45:06.262 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi100"}, "changed": false} 2021-01-28T03:45:06.300 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:06 +0000 (0:00:00.044) 0:00:30.416 ****** 2021-01-28T03:45:07.039 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-01-28T03:45:07.041 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi100.front.sepia.ceph.com", "ansible_hostname": "smithi100", "ansible_nodename": "smithi100"}, "changed": true, "name": "smithi100"} 2021-01-28T03:45:07.075 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:07 +0000 (0:00:00.774) 0:00:31.190 ****** 2021-01-28T03:45:07.083 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi162.front.sepia.ceph.com", "ansible_hostname": "smithi162", "ansible_nodename": "smithi162"}, "changed": true, "name": "smithi162"} 2021-01-28T03:45:07.125 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:07 +0000 (0:00:00.049) 0:00:31.240 ****** 2021-01-28T03:45:07.395 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-01-28T03:45:07.397 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-01-28T03:45:07.434 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:07 +0000 (0:00:00.308) 0:00:31.549 ****** 2021-01-28T03:45:07.453 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-01-28T03:45:07.493 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:07 +0000 (0:00:00.059) 0:00:31.609 ****** 2021-01-28T03:45:07.765 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-01-28T03:45:07.767 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-01-28T03:45:07.808 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:07 +0000 (0:00:00.314) 0:00:31.924 ****** 2021-01-28T03:45:07.840 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-01-28T03:45:07.886 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:07 +0000 (0:00:00.078) 0:00:32.002 ****** 2021-01-28T03:45:08.446 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** ok: [smithi100.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-01-28T03:45:08.488 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:08 +0000 (0:00:00.601) 0:00:32.603 ****** 2021-01-28T03:45:08.495 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-01-28T03:45:08.533 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:08 +0000 (0:00:00.045) 0:00:32.648 ****** 2021-01-28T03:45:08.539 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-01-28T03:45:08.541 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:08.580 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:08 +0000 (0:00:00.046) 0:00:32.695 ****** 2021-01-28T03:45:08.588 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:08.625 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:08 +0000 (0:00:00.045) 0:00:32.740 ****** 2021-01-28T03:45:08.632 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-01-28T03:45:08.633 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:08.674 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:08 +0000 (0:00:00.049) 0:00:32.790 ****** 2021-01-28T03:45:08.684 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:08.720 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:08 +0000 (0:00:00.045) 0:00:32.836 ****** 2021-01-28T03:45:08.728 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-01-28T03:45:08.730 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:08.767 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:08 +0000 (0:00:00.047) 0:00:32.883 ****** 2021-01-28T03:45:08.775 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:08.827 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:08 +0000 (0:00:00.059) 0:00:32.942 ****** 2021-01-28T03:45:08.834 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-01-28T03:45:08.836 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:08.889 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:08 +0000 (0:00:00.061) 0:00:33.004 ****** 2021-01-28T03:45:08.900 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:08.949 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:08 +0000 (0:00:00.059) 0:00:33.064 ****** 2021-01-28T03:45:08.956 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-01-28T03:45:08.958 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:08.996 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:08 +0000 (0:00:00.047) 0:00:33.111 ****** 2021-01-28T03:45:09.004 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:09.043 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:09 +0000 (0:00:00.047) 0:00:33.159 ****** 2021-01-28T03:45:09.115 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:09.119 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:09 +0000 (0:00:00.075) 0:00:33.234 ****** 2021-01-28T03:45:09.130 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:09.168 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:09 +0000 (0:00:00.048) 0:00:33.283 ****** 2021-01-28T03:45:09.175 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-01-28T03:45:09.177 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:09.217 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:09 +0000 (0:00:00.049) 0:00:33.333 ****** 2021-01-28T03:45:09.226 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:09.283 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:09 +0000 (0:00:00.065) 0:00:33.398 ****** 2021-01-28T03:45:09.295 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-01-28T03:45:09.300 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:09.360 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:09 +0000 (0:00:00.076) 0:00:33.475 ****** 2021-01-28T03:45:09.372 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:09.438 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:09 +0000 (0:00:00.077) 0:00:33.553 ****** 2021-01-28T03:45:09.440 INFO:teuthology.task.ansible.out: 2021-01-28T03:45:09.452 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-01-28T03:45:09.549 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:09 +0000 (0:00:00.110) 0:00:33.664 ****** 2021-01-28T03:45:09.626 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:09 +0000 (0:00:00.076) 0:00:33.741 ****** 2021-01-28T03:45:09.637 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-01-28T03:45:09.692 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:09 +0000 (0:00:00.066) 0:00:33.807 ****** 2021-01-28T03:45:09.743 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:09 +0000 (0:00:00.049) 0:00:33.857 ****** 2021-01-28T03:45:09.749 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-01-28T03:45:09.790 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:09 +0000 (0:00:00.048) 0:00:33.906 ****** 2021-01-28T03:45:09.834 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:09 +0000 (0:00:00.043) 0:00:33.949 ****** 2021-01-28T03:45:09.841 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-01-28T03:45:09.843 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:09.879 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:09 +0000 (0:00:00.045) 0:00:33.995 ****** 2021-01-28T03:45:09.888 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:09.924 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:09 +0000 (0:00:00.045) 0:00:34.040 ****** 2021-01-28T03:45:09.943 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-01-28T03:45:09.945 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-01-28T03:45:09.981 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:09 +0000 (0:00:00.056) 0:00:34.096 ****** 2021-01-28T03:45:09.988 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-01-28T03:45:09.990 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-01-28T03:45:10.028 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:10 +0000 (0:00:00.046) 0:00:34.143 ****** 2021-01-28T03:45:10.034 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-01-28T03:45:10.036 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:10.076 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:10 +0000 (0:00:00.048) 0:00:34.191 ****** 2021-01-28T03:45:10.083 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:10.122 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:10 +0000 (0:00:00.045) 0:00:34.237 ****** 2021-01-28T03:45:10.128 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-28T03:45:10.130 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:10.165 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:10 +0000 (0:00:00.043) 0:00:34.281 ****** 2021-01-28T03:45:10.173 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:10.215 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:10 +0000 (0:00:00.050) 0:00:34.331 ****** 2021-01-28T03:45:10.222 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-01-28T03:45:10.224 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:10.264 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:10 +0000 (0:00:00.049) 0:00:34.380 ****** 2021-01-28T03:45:10.272 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:10.311 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:10 +0000 (0:00:00.047) 0:00:34.427 ****** 2021-01-28T03:45:10.320 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-01-28T03:45:10.321 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:10.357 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:10 +0000 (0:00:00.045) 0:00:34.473 ****** 2021-01-28T03:45:10.365 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:10.429 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:10 +0000 (0:00:00.072) 0:00:34.545 ****** 2021-01-28T03:45:10.443 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-01-28T03:45:10.445 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:10.511 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:10 +0000 (0:00:00.081) 0:00:34.626 ****** 2021-01-28T03:45:10.519 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:10.567 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:10 +0000 (0:00:00.056) 0:00:34.683 ****** 2021-01-28T03:45:10.574 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-01-28T03:45:10.576 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:10.613 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:10 +0000 (0:00:00.045) 0:00:34.728 ****** 2021-01-28T03:45:10.620 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:10.657 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:10 +0000 (0:00:00.044) 0:00:34.773 ****** 2021-01-28T03:45:10.671 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:10.707 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:10 +0000 (0:00:00.049) 0:00:34.822 ****** 2021-01-28T03:45:10.722 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:10.762 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:10 +0000 (0:00:00.054) 0:00:34.877 ****** 2021-01-28T03:45:10.771 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:10.809 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:10 +0000 (0:00:00.047) 0:00:34.925 ****** 2021-01-28T03:45:10.819 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:10.858 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:10 +0000 (0:00:00.048) 0:00:34.973 ****** 2021-01-28T03:45:10.864 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-28T03:45:10.866 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:10.903 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:10 +0000 (0:00:00.045) 0:00:35.018 ****** 2021-01-28T03:45:10.911 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:10.953 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:10 +0000 (0:00:00.049) 0:00:35.068 ****** 2021-01-28T03:45:10.960 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-01-28T03:45:10.962 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:11.004 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:10 +0000 (0:00:00.051) 0:00:35.119 ****** 2021-01-28T03:45:11.012 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:11.051 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:11 +0000 (0:00:00.046) 0:00:35.166 ****** 2021-01-28T03:45:11.060 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-01-28T03:45:11.061 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:11.100 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:11 +0000 (0:00:00.049) 0:00:35.215 ****** 2021-01-28T03:45:11.108 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:11.150 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:11 +0000 (0:00:00.050) 0:00:35.265 ****** 2021-01-28T03:45:11.157 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:11.197 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:11 +0000 (0:00:00.047) 0:00:35.313 ****** 2021-01-28T03:45:11.205 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:11.250 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:11 +0000 (0:00:00.051) 0:00:35.364 ****** 2021-01-28T03:45:11.258 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-01-28T03:45:11.260 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:11.305 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:11 +0000 (0:00:00.055) 0:00:35.420 ****** 2021-01-28T03:45:11.313 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:11.353 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:11 +0000 (0:00:00.047) 0:00:35.468 ****** 2021-01-28T03:45:11.360 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-01-28T03:45:11.361 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:11.429 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:11 +0000 (0:00:00.076) 0:00:35.544 ****** 2021-01-28T03:45:11.441 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:11.491 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:11 +0000 (0:00:00.062) 0:00:35.606 ****** 2021-01-28T03:45:11.499 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-01-28T03:45:11.501 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:11.560 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:11 +0000 (0:00:00.068) 0:00:35.675 ****** 2021-01-28T03:45:11.578 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:11.643 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:11 +0000 (0:00:00.082) 0:00:35.758 ****** 2021-01-28T03:45:11.659 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-01-28T03:45:11.661 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:11.740 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:11 +0000 (0:00:00.096) 0:00:35.855 ****** 2021-01-28T03:45:11.748 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:11.817 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:11 +0000 (0:00:00.075) 0:00:35.931 ****** 2021-01-28T03:45:11.856 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-01-28T03:45:11.858 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:11.895 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:11 +0000 (0:00:00.079) 0:00:36.010 ****** 2021-01-28T03:45:11.913 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:11.951 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:11 +0000 (0:00:00.056) 0:00:36.066 ****** 2021-01-28T03:45:11.980 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-01-28T03:45:11.988 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:12.024 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:12 +0000 (0:00:00.073) 0:00:36.140 ****** 2021-01-28T03:45:12.031 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:12.084 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:12 +0000 (0:00:00.059) 0:00:36.199 ****** 2021-01-28T03:45:12.097 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-01-28T03:45:12.103 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:12.191 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:12 +0000 (0:00:00.106) 0:00:36.306 ****** 2021-01-28T03:45:12.203 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:12.255 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:12 +0000 (0:00:00.064) 0:00:36.371 ****** 2021-01-28T03:45:12.263 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-01-28T03:45:12.264 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:12.309 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:12 +0000 (0:00:00.053) 0:00:36.424 ****** 2021-01-28T03:45:12.318 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:12.361 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:12 +0000 (0:00:00.052) 0:00:36.476 ****** 2021-01-28T03:45:12.477 INFO:teuthology.task.ansible.out: 2021-01-28T03:45:12.479 INFO:teuthology.task.ansible.out:TASK [testnode : Check for custom repos] *************************************** ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005104", "end": "2021-01-28 03:45:12.652731", "rc": 0, "start": "2021-01-28 03:45:12.647627", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T03:45:12.522 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:12 +0000 (0:00:00.160) 0:00:36.637 ****** 2021-01-28T03:45:12.524 INFO:teuthology.task.ansible.out: 2021-01-28T03:45:12.548 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.003323", "end": "2021-01-28 03:45:12.613525", "rc": 0, "start": "2021-01-28 03:45:12.610202", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T03:45:12.549 INFO:teuthology.task.ansible.out: 2021-01-28T03:45:12.592 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:12 +0000 (0:00:00.069) 0:00:36.707 ****** 2021-01-28T03:45:12.600 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-01-28T03:45:12.649 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:12 +0000 (0:00:00.057) 0:00:36.764 ****** 2021-01-28T03:45:12.717 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:12 +0000 (0:00:00.067) 0:00:36.832 ****** 2021-01-28T03:45:13.232 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-01-28T03:45:13.234 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-01-28T03:45:13.279 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:13 +0000 (0:00:00.561) 0:00:37.394 ****** 2021-01-28T03:45:13.300 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-01-28T03:45:13.363 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:13 +0000 (0:00:00.084) 0:00:37.478 ****** 2021-01-28T03:45:13.374 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:13.408 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:13 +0000 (0:00:00.045) 0:00:37.524 ****** 2021-01-28T03:45:13.417 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:13.456 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:13 +0000 (0:00:00.048) 0:00:37.572 ****** 2021-01-28T03:45:14.882 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-01-28T03:45:14.892 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-01-28T03:45:14.909 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-01-28T03:45:15.890 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-01-28T03:45:15.952 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:15 +0000 (0:00:02.495) 0:00:40.068 ****** 2021-01-28T03:45:15.976 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-01-28T03:45:16.016 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:16 +0000 (0:00:00.063) 0:00:40.131 ****** 2021-01-28T03:45:16.643 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-01-28T03:45:16.645 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"cache_update_time": 1611805262, "cache_updated": false, "changed": false} 2021-01-28T03:45:16.683 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:16 +0000 (0:00:00.667) 0:00:40.798 ****** 2021-01-28T03:45:16.690 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"cache_update_time": 1611805203, "cache_updated": false, "changed": false} 2021-01-28T03:45:16.729 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:16 +0000 (0:00:00.045) 0:00:40.844 ****** 2021-01-28T03:45:16.736 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-01-28T03:45:16.773 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:16 +0000 (0:00:00.044) 0:00:40.888 ****** 2021-01-28T03:45:16.819 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:16 +0000 (0:00:00.045) 0:00:40.934 ****** 2021-01-28T03:45:16.953 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-01-28T03:45:16.955 INFO:teuthology.task.ansible.out:[WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [smithi162.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.030259", "end": "2021-01-28 03:45:17.053408", "rc": 0, "start": "2021-01-28 03:45:17.023149", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T03:45:16.991 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:16 +0000 (0:00:00.172) 0:00:41.107 ****** 2021-01-28T03:45:16.999 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.030072", "end": "2021-01-28 03:45:17.170039", "rc": 0, "start": "2021-01-28 03:45:17.139967", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T03:45:17.051 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:17 +0000 (0:00:00.060) 0:00:41.167 ****** 2021-01-28T03:45:19.092 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-01-28T03:45:19.094 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"cache_update_time": 1611805262, "cache_updated": false, "changed": false} 2021-01-28T03:45:19.137 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:19 +0000 (0:00:02.079) 0:00:43.252 ****** 2021-01-28T03:45:19.262 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"cache_update_time": 1611805203, "cache_updated": false, "changed": false} 2021-01-28T03:45:19.303 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:19 +0000 (0:00:00.165) 0:00:43.418 ****** 2021-01-28T03:45:31.875 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-01-28T03:45:31.877 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker ipxe-qemu ipxe-qemu-256k-compat-efi-roms\n libboost-iostreams1.71.0 libbrlapi0.7 libcacard0 libiscsi7 libpmem1\n libslirp0 libspice-server1 libusbredirparser1 libvirglrenderer1 msr-tools\n ovmf qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 19 not upgraded.\nAfter this operation, 62.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 150606 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.11) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.11) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.11) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...\r\nRemoving librbd1 (15.2.7-0ubuntu0.20.04.1) ...\r\nRemoving librados2 (15.2.7-0ubuntu0.20.04.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\ 2021-01-28T03:45:31.878 INFO:teuthology.task.ansible.out:r\nProcessing triggers for libc-bin (2.31-0ubuntu9.1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker ipxe-qemu ipxe-qemu-256k-compat-efi-roms", " libboost-iostreams1.71.0 libbrlapi0.7 libcacard0 libiscsi7 libpmem1", " libslirp0 libspice-server1 libusbredirparser1 libvirglrenderer1 msr-tools", " ovmf qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 19 not upgraded.", "After this operation, 62.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 150606 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.11) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.11) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.11) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...", "Removing librbd1 (15.2.7-0ubuntu0.20.04.1) ...", "Removing librados2 (15.2.7-0ubuntu0.20.04.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.1) ..."]} 2021-01-28T03:45:31.916 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:31 +0000 (0:00:12.613) 0:00:56.032 ****** 2021-01-28T03:45:31.966 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker ipxe-qemu ipxe-qemu-256k-compat-efi-roms\n libboost-iostreams1.71.0 libbrlapi0.7 libcacard0 libiscsi7 libpmem1\n libslirp0 libspice-server1 libusbredirparser1 libvirglrenderer1 msr-tools\n ovmf qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 19 not upgraded.\nAfter this operation, 62.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 150606 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.11) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.11) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.11) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...\r\nRemoving librbd1 (15.2.7-0ubuntu0.20.04.1) ...\r\nRemoving librados2 (15.2.7-0ubuntu0.20.04.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\ 2021-01-28T03:45:31.968 INFO:teuthology.task.ansible.out:r\nProcessing triggers for libc-bin (2.31-0ubuntu9.1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker ipxe-qemu ipxe-qemu-256k-compat-efi-roms", " libboost-iostreams1.71.0 libbrlapi0.7 libcacard0 libiscsi7 libpmem1", " libslirp0 libspice-server1 libusbredirparser1 libvirglrenderer1 msr-tools", " ovmf qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 19 not upgraded.", "After this operation, 62.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 150606 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.11) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.11) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.11) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...", "Removing librbd1 (15.2.7-0ubuntu0.20.04.1) ...", "Removing librados2 (15.2.7-0ubuntu0.20.04.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.1) ..."]} 2021-01-28T03:45:32.008 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:32 +0000 (0:00:00.092) 0:00:56.124 ****** 2021-01-28T03:45:32.579 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-01-28T03:45:32.580 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"cache_update_time": 1611805203, "cache_updated": false, "changed": false} 2021-01-28T03:45:32.621 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:32 +0000 (0:00:00.612) 0:00:56.737 ****** 2021-01-28T03:45:32.652 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:32.695 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:32 +0000 (0:00:00.073) 0:00:56.810 ****** 2021-01-28T03:45:32.740 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-01-28T03:45:32.743 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"cache_update_time": 1611805262, "cache_updated": false, "changed": false} 2021-01-28T03:45:32.785 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:32 +0000 (0:00:00.089) 0:00:56.900 ****** 2021-01-28T03:45:32.823 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-01-28T03:45:32.825 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:32.861 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:32 +0000 (0:00:00.076) 0:00:56.976 ****** 2021-01-28T03:45:42.151 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-28T03:45:42.153 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => {"cache_update_time": 1611805262, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 19 not upgraded.\nNeed to get 13.6 MB of archives.\nAfter this operation, 62.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.7-0ubuntu0.20.04.2 [3204 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.7-0ubuntu0.20.04.2 [1609 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.11 [53.6 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.11 [1055 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.11 [6732 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.11 [972 kB]\nFetched 13.6 MB in 1s (11.9 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading da 2021-01-28T03:45:42.154 INFO:teuthology.task.ansible.out:tabase ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 150534 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.7-0ubuntu0.20.04.2_amd64.deb ...\r\nUnpacking librados2 (15.2.7-0ubuntu0.20.04.2) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.7-0ubuntu0.20.04.2_amd64.deb ...\r\nUnpacking librbd1 (15.2.7-0ubuntu0.20.04.2) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.11) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.11) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.11) ...\r\nSetting up librados2 (15.2.7-0ubuntu0.20.04.2) ...\r\nSetting up librbd1 (15.2.7-0ubuntu0.20.04.2) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.11) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.11) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.11) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is 2021-01-28T03:45:42.156 INFO:teuthology.task.ansible.out:already the newest version (1:2.25.1-1ubuntu3).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 19 not upgraded.", "Need to get 13.6 MB of archives.", "After this operation, 62.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.7-0ubuntu0.20.04.2 [3204 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.7-0ubuntu0.20.04.2 [1609 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.11 [53.6 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.11 [1055 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.11 [6732 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.11 [972 kB]", "Fetched 13.6 MB in 1s (11.9 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 150534 files and directories currently i 2021-01-28T03:45:42.157 INFO:teuthology.task.ansible.out:nstalled.)", "Preparing to unpack .../0-librados2_15.2.7-0ubuntu0.20.04.2_amd64.deb ...", "Unpacking librados2 (15.2.7-0ubuntu0.20.04.2) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.7-0ubuntu0.20.04.2_amd64.deb ...", "Unpacking librbd1 (15.2.7-0ubuntu0.20.04.2) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.11) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.11) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.11) ...", "Setting up librados2 (15.2.7-0ubuntu0.20.04.2) ...", "Setting up librbd1 (15.2.7-0ubuntu0.20.04.2) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.11) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.11) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.11) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.1) ..."]} 2021-01-28T03:45:42.191 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:42 +0000 (0:00:09.329) 0:01:06.306 ****** 2021-01-28T03:45:42.220 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"cache_update_time": 1611805203, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 19 not upgraded.\nNeed to get 13.6 MB of archives.\nAfter this operation, 62.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.7-0ubuntu0.20.04.2 [3204 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.7-0ubuntu0.20.04.2 [1609 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.11 [53.6 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.11 [1055 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.11 [6732 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.11 [972 kB]\nFetched 13.6 MB in 1s (11.8 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading da 2021-01-28T03:45:42.221 INFO:teuthology.task.ansible.out:tabase ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 150534 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.7-0ubuntu0.20.04.2_amd64.deb ...\r\nUnpacking librados2 (15.2.7-0ubuntu0.20.04.2) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.7-0ubuntu0.20.04.2_amd64.deb ...\r\nUnpacking librbd1 (15.2.7-0ubuntu0.20.04.2) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.11) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.11) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.11) ...\r\nSetting up librados2 (15.2.7-0ubuntu0.20.04.2) ...\r\nSetting up librbd1 (15.2.7-0ubuntu0.20.04.2) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.11) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.11) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.11) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is 2021-01-28T03:45:42.223 INFO:teuthology.task.ansible.out:already the newest version (1:2.25.1-1ubuntu3).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 19 not upgraded.", "Need to get 13.6 MB of archives.", "After this operation, 62.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.7-0ubuntu0.20.04.2 [3204 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.7-0ubuntu0.20.04.2 [1609 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.11 [53.6 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.11 [1055 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.11 [6732 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.11 [972 kB]", "Fetched 13.6 MB in 1s (11.8 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 150534 files and directories currently i 2021-01-28T03:45:42.225 INFO:teuthology.task.ansible.out:nstalled.)", "Preparing to unpack .../0-librados2_15.2.7-0ubuntu0.20.04.2_amd64.deb ...", "Unpacking librados2 (15.2.7-0ubuntu0.20.04.2) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.7-0ubuntu0.20.04.2_amd64.deb ...", "Unpacking librbd1 (15.2.7-0ubuntu0.20.04.2) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.11) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.11) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.11) ...", "Setting up librados2 (15.2.7-0ubuntu0.20.04.2) ...", "Setting up librbd1 (15.2.7-0ubuntu0.20.04.2) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.11) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.11) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.11) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.1) ..."]} 2021-01-28T03:45:42.258 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:42 +0000 (0:00:00.067) 0:01:06.373 ****** 2021-01-28T03:45:42.822 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-01-28T03:45:42.824 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"cache_update_time": 1611805262, "cache_updated": false, "changed": false} 2021-01-28T03:45:42.862 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:42 +0000 (0:00:00.603) 0:01:06.977 ****** 2021-01-28T03:45:42.902 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"cache_update_time": 1611805203, "cache_updated": false, "changed": false} 2021-01-28T03:45:42.944 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:42 +0000 (0:00:00.082) 0:01:07.060 ****** 2021-01-28T03:45:43.004 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-01-28T03:45:43.006 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-01-28T03:45:43.043 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:43 +0000 (0:00:00.099) 0:01:07.159 ****** 2021-01-28T03:45:43.071 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-01-28T03:45:43.073 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:43.107 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:43 +0000 (0:00:00.063) 0:01:07.223 ****** 2021-01-28T03:45:43.115 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-01-28T03:45:43.117 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-01-28T03:45:43.158 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:43 +0000 (0:00:00.050) 0:01:07.274 ****** 2021-01-28T03:45:43.160 INFO:teuthology.task.ansible.out: 2021-01-28T03:45:43.197 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-01-28T03:45:43.200 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:43.234 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:43 +0000 (0:00:00.075) 0:01:07.349 ****** 2021-01-28T03:45:43.251 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-01-28T03:45:43.253 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-01-28T03:45:43.289 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:43 +0000 (0:00:00.055) 0:01:07.404 ****** 2021-01-28T03:45:43.369 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-01-28T03:45:43.409 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:43 +0000 (0:00:00.120) 0:01:07.525 ****** 2021-01-28T03:45:43.666 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-01-28T03:45:43.668 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-01-28T03:45:43.715 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:43 +0000 (0:00:00.305) 0:01:07.830 ****** 2021-01-28T03:45:43.848 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-01-28T03:45:43.892 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:43 +0000 (0:00:00.177) 0:01:08.007 ****** 2021-01-28T03:45:43.900 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-01-28T03:45:43.902 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-01-28T03:45:43.952 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:43 +0000 (0:00:00.059) 0:01:08.067 ****** 2021-01-28T03:45:44.058 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-01-28T03:45:44.122 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:44 +0000 (0:00:00.170) 0:01:08.237 ****** 2021-01-28T03:45:44.134 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-01-28T03:45:44.135 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-28T03:45:44.182 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:44 +0000 (0:00:00.059) 0:01:08.297 ****** 2021-01-28T03:45:44.277 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-28T03:45:44.323 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:44 +0000 (0:00:00.141) 0:01:08.439 ****** 2021-01-28T03:45:44.471 INFO:teuthology.task.ansible.out: 2021-01-28T03:45:44.474 INFO:teuthology.task.ansible.out:TASK [testnode : Stop apache2] ************************************************* 2021-01-28T03:45:44.475 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Thu 2021-01-28 03:43:59 UTC", "ActiveEnterTimestampMonotonic": "17762488", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target -.mount basic.target system.slice remote-fs.target nss-lookup.target systemd-tmpfiles-setup.service systemd-journald.socket sysinit.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2021-01-28 03:43:58 UTC", "AssertTimestampMonotonic": "17214993", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2021-01-28 03:43:58 UTC", "ConditionTimestampMonotonic": "17214993", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup" 2021-01-28T03:45:44.477 INFO:teuthology.task.ansible.out:: "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1083", "ExecMainStartTimestamp": "Thu 2021-01-28 03:43:59 UTC", "ExecMainStartTimestampMonotonic": "17762450", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "1844674407370 2021-01-28T03:45:44.479 INFO:teuthology.task.ansible.out:9551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2021-01-28 03:43:58 UTC", "InactiveExitTimestampMonotonic": "17216159", "InvocationID": "37cbfa6e84284099a4ac2bd65d36b5b0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127781", "LimitNPROCSoft": "127781", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127781", "LimitSIGPENDINGSoft": "127781", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1083", "MemoryAccounting": "yes", "MemoryCurrent": "10031104", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPol 2021-01-28T03:45:44.480 INFO:teuthology.task.ansible.out:icy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-01-28 03:43:59 UTC", "StateChangeTimestampMonotonic": "17762488", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38334", "TimeoutAbortUSec" 2021-01-28T03:45:44.482 INFO:teuthology.task.ansible.out:: "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-28T03:45:44.518 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:44 +0000 (0:00:00.194) 0:01:08.633 ****** 2021-01-28T03:45:44.557 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-01-28T03:45:44.558 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:44.594 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:44 +0000 (0:00:00.075) 0:01:08.709 ****** 2021-01-28T03:45:44.602 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-01-28T03:45:44.604 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Thu 2021-01-28 03:43:42 UTC", "ActiveEnterTimestampMonotonic": "15928662", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service nss-lookup.target -.mount sysinit.target systemd-journald.socket network.target system.slice basic.target remote-fs.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2021-01-28 03:43:41 UTC", "AssertTimestampMonotonic": "15059625", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2021-01-28 03:43:41 UTC", "ConditionTimestampMonotonic": "15059624", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup" 2021-01-28T03:45:44.606 INFO:teuthology.task.ansible.out:: "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1053", "ExecMainStartTimestamp": "Thu 2021-01-28 03:43:42 UTC", "ExecMainStartTimestampMonotonic": "15928647", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "1844674407370 2021-01-28T03:45:44.607 INFO:teuthology.task.ansible.out:9551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2021-01-28 03:43:41 UTC", "InactiveExitTimestampMonotonic": "15060557", "InvocationID": "5012d8136eea424c891a21e0227bd466", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127779", "LimitNPROCSoft": "127779", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127779", "LimitSIGPENDINGSoft": "127779", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1053", "MemoryAccounting": "yes", "MemoryCurrent": "10194944", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPol 2021-01-28T03:45:44.609 INFO:teuthology.task.ansible.out:icy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-01-28 03:43:42 UTC", "StateChangeTimestampMonotonic": "15928662", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38333", "TimeoutAbortUSec" 2021-01-28T03:45:44.611 INFO:teuthology.task.ansible.out:: "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-28T03:45:44.645 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:44 +0000 (0:00:00.051) 0:01:08.760 ****** 2021-01-28T03:45:44.652 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-01-28T03:45:44.654 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:44.691 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:44 +0000 (0:00:00.045) 0:01:08.806 ****** 2021-01-28T03:45:44.700 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-01-28T03:45:44.701 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:44.762 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:44 +0000 (0:00:00.070) 0:01:08.877 ****** 2021-01-28T03:45:44.773 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-01-28T03:45:44.775 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:44.811 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:44 +0000 (0:00:00.049) 0:01:08.927 ****** 2021-01-28T03:45:44.818 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-01-28T03:45:44.820 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:44.856 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:44 +0000 (0:00:00.044) 0:01:08.971 ****** 2021-01-28T03:45:44.863 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-01-28T03:45:44.865 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:44.910 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:44 +0000 (0:00:00.053) 0:01:09.025 ****** 2021-01-28T03:45:44.917 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-01-28T03:45:44.919 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:44.957 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:44 +0000 (0:00:00.047) 0:01:09.073 ****** 2021-01-28T03:45:44.966 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-01-28T03:45:44.968 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:45.007 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:45 +0000 (0:00:00.049) 0:01:09.122 ****** 2021-01-28T03:45:45.013 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-01-28T03:45:45.015 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:45.055 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:45 +0000 (0:00:00.047) 0:01:09.170 ****** 2021-01-28T03:45:45.074 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-01-28T03:45:45.076 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:45.123 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:45 +0000 (0:00:00.068) 0:01:09.238 ****** 2021-01-28T03:45:45.131 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-01-28T03:45:45.133 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:45.172 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:45 +0000 (0:00:00.048) 0:01:09.287 ****** 2021-01-28T03:45:45.179 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-01-28T03:45:45.181 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:45.221 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:45 +0000 (0:00:00.049) 0:01:09.336 ****** 2021-01-28T03:45:45.228 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-01-28T03:45:45.230 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:45.274 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:45 +0000 (0:00:00.053) 0:01:09.389 ****** 2021-01-28T03:45:45.282 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-01-28T03:45:45.284 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:45.322 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:45 +0000 (0:00:00.047) 0:01:09.437 ****** 2021-01-28T03:45:45.331 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-01-28T03:45:45.333 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:45.385 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:45 +0000 (0:00:00.062) 0:01:09.500 ****** 2021-01-28T03:45:45.395 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-28T03:45:45.400 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:45.442 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:45 +0000 (0:00:00.056) 0:01:09.557 ****** 2021-01-28T03:45:45.450 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-01-28T03:45:45.452 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:45.493 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:45 +0000 (0:00:00.052) 0:01:09.609 ****** 2021-01-28T03:45:45.500 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-01-28T03:45:45.502 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:45.544 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:45 +0000 (0:00:00.050) 0:01:09.660 ****** 2021-01-28T03:45:45.551 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-28T03:45:45.553 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:45.590 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:45 +0000 (0:00:00.045) 0:01:09.705 ****** 2021-01-28T03:45:45.598 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-28T03:45:45.599 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:45.643 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:45 +0000 (0:00:00.052) 0:01:09.758 ****** 2021-01-28T03:45:45.657 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-01-28T03:45:45.659 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:45.724 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:45 +0000 (0:00:00.081) 0:01:09.840 ****** 2021-01-28T03:45:45.733 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-01-28T03:45:45.735 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:45.774 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:45 +0000 (0:00:00.050) 0:01:09.890 ****** 2021-01-28T03:45:45.782 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-28T03:45:45.783 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:45.829 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:45 +0000 (0:00:00.054) 0:01:09.944 ****** 2021-01-28T03:45:45.839 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-01-28T03:45:45.841 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:45.878 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:45 +0000 (0:00:00.049) 0:01:09.993 ****** 2021-01-28T03:45:45.885 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-01-28T03:45:45.887 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:45.926 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:45 +0000 (0:00:00.047) 0:01:10.041 ****** 2021-01-28T03:45:45.932 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-28T03:45:45.934 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:45.972 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:45 +0000 (0:00:00.046) 0:01:10.088 ****** 2021-01-28T03:45:45.980 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-01-28T03:45:45.982 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:46.018 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:46 +0000 (0:00:00.045) 0:01:10.133 ****** 2021-01-28T03:45:46.024 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-28T03:45:46.026 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:46.061 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:46 +0000 (0:00:00.043) 0:01:10.176 ****** 2021-01-28T03:45:46.067 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-28T03:45:46.069 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:46.107 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:46 +0000 (0:00:00.046) 0:01:10.223 ****** 2021-01-28T03:45:46.114 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-28T03:45:46.116 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:46.152 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:46 +0000 (0:00:00.044) 0:01:10.267 ****** 2021-01-28T03:45:46.160 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-28T03:45:46.162 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:46.199 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:46 +0000 (0:00:00.046) 0:01:10.314 ****** 2021-01-28T03:45:46.205 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-01-28T03:45:46.207 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:46.248 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:46 +0000 (0:00:00.048) 0:01:10.363 ****** 2021-01-28T03:45:46.254 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-28T03:45:46.256 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:46.298 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:46 +0000 (0:00:00.050) 0:01:10.413 ****** 2021-01-28T03:45:46.305 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-01-28T03:45:46.307 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:46.345 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:46 +0000 (0:00:00.047) 0:01:10.461 ****** 2021-01-28T03:45:46.354 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-01-28T03:45:46.356 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:46.406 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:46 +0000 (0:00:00.060) 0:01:10.521 ****** 2021-01-28T03:45:46.414 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-01-28T03:45:46.416 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:46.458 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:46 +0000 (0:00:00.052) 0:01:10.574 ****** 2021-01-28T03:45:46.467 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-01-28T03:45:46.469 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:46.505 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:46 +0000 (0:00:00.046) 0:01:10.620 ****** 2021-01-28T03:45:46.514 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-28T03:45:46.516 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:46.553 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:46 +0000 (0:00:00.047) 0:01:10.668 ****** 2021-01-28T03:45:46.560 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-01-28T03:45:46.561 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:46.604 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:46 +0000 (0:00:00.051) 0:01:10.720 ****** 2021-01-28T03:45:46.612 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-28T03:45:46.614 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:46.653 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:46 +0000 (0:00:00.048) 0:01:10.768 ****** 2021-01-28T03:45:46.666 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-28T03:45:46.668 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:46.706 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:46 +0000 (0:00:00.052) 0:01:10.821 ****** 2021-01-28T03:45:46.713 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-28T03:45:46.715 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:46.754 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:46 +0000 (0:00:00.048) 0:01:10.869 ****** 2021-01-28T03:45:46.761 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-28T03:45:46.763 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:46.810 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:46 +0000 (0:00:00.055) 0:01:10.925 ****** 2021-01-28T03:45:46.818 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-28T03:45:46.820 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:46.859 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:46 +0000 (0:00:00.049) 0:01:10.974 ****** 2021-01-28T03:45:46.870 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-28T03:45:46.872 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:46.907 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:46 +0000 (0:00:00.048) 0:01:11.023 ****** 2021-01-28T03:45:46.918 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:46.973 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:46 +0000 (0:00:00.064) 0:01:11.088 ****** 2021-01-28T03:45:46.983 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-28T03:45:46.985 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:47.025 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:47 +0000 (0:00:00.052) 0:01:11.140 ****** 2021-01-28T03:45:47.032 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-28T03:45:47.034 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:47.070 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:47 +0000 (0:00:00.045) 0:01:11.185 ****** 2021-01-28T03:45:47.077 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-28T03:45:47.079 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:47.117 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:47 +0000 (0:00:00.046) 0:01:11.232 ****** 2021-01-28T03:45:47.124 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-01-28T03:45:47.126 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:47.167 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:47 +0000 (0:00:00.049) 0:01:11.282 ****** 2021-01-28T03:45:47.175 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:47.214 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:47 +0000 (0:00:00.047) 0:01:11.329 ****** 2021-01-28T03:45:47.275 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:47.294 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:47 +0000 (0:00:00.080) 0:01:11.410 ****** 2021-01-28T03:45:47.344 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-01-28T03:45:47.348 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-01-28T03:45:47.385 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:47 +0000 (0:00:00.090) 0:01:11.500 ****** 2021-01-28T03:45:47.506 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-01-28T03:45:47.543 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:47 +0000 (0:00:00.157) 0:01:11.658 ****** 2021-01-28T03:45:47.766 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-01-28T03:45:47.768 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-01-28T03:45:47.807 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:47 +0000 (0:00:00.264) 0:01:11.922 ****** 2021-01-28T03:45:47.836 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:47.910 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:47 +0000 (0:00:00.102) 0:01:12.025 ****** 2021-01-28T03:45:47.959 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-01-28T03:45:47.961 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-01-28T03:45:48.031 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:48 +0000 (0:00:00.121) 0:01:12.147 ****** 2021-01-28T03:45:48.094 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-01-28T03:45:48.095 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:48.148 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:48 +0000 (0:00:00.116) 0:01:12.263 ****** 2021-01-28T03:45:48.326 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-01-28T03:45:48.328 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-01-28T03:45:48.365 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:48 +0000 (0:00:00.217) 0:01:12.480 ****** 2021-01-28T03:45:48.553 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-01-28T03:45:48.590 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:48 +0000 (0:00:00.225) 0:01:12.706 ****** 2021-01-28T03:45:48.740 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-01-28T03:45:48.742 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-01-28T03:45:48.777 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:48 +0000 (0:00:00.186) 0:01:12.893 ****** 2021-01-28T03:45:48.977 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-01-28T03:45:49.033 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:49 +0000 (0:00:00.255) 0:01:13.149 ****** 2021-01-28T03:45:49.117 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-01-28T03:45:49.118 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-01-28T03:45:49.157 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:49 +0000 (0:00:00.123) 0:01:13.273 ****** 2021-01-28T03:45:49.300 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-01-28T03:45:49.302 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-28T03:45:49.337 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:49 +0000 (0:00:00.179) 0:01:13.452 ****** 2021-01-28T03:45:49.364 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-01-28T03:45:49.366 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable kernel modules to load at boot time.] ****************** ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-01-28T03:45:49.401 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:49 +0000 (0:00:00.064) 0:01:13.516 ****** 2021-01-28T03:45:49.436 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:49 +0000 (0:00:00.034) 0:01:13.551 ****** 2021-01-28T03:45:49.464 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-01-28T03:45:49.466 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:49.500 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:49 +0000 (0:00:00.064) 0:01:13.616 ****** 2021-01-28T03:45:49.528 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-01-28T03:45:49.530 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:49.571 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:49 +0000 (0:00:00.070) 0:01:13.686 ****** 2021-01-28T03:45:49.608 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:49 +0000 (0:00:00.036) 0:01:13.723 ****** 2021-01-28T03:45:49.616 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-01-28T03:45:49.618 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:49.656 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:49 +0000 (0:00:00.048) 0:01:13.772 ****** 2021-01-28T03:45:49.664 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-01-28T03:45:49.666 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:49.703 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:49 +0000 (0:00:00.046) 0:01:13.818 ****** 2021-01-28T03:45:49.709 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-01-28T03:45:49.711 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:49.750 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:49 +0000 (0:00:00.047) 0:01:13.866 ****** 2021-01-28T03:45:49.758 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-01-28T03:45:49.760 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:49.801 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:49 +0000 (0:00:00.050) 0:01:13.916 ****** 2021-01-28T03:45:49.820 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-01-28T03:45:49.822 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:49.860 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:49 +0000 (0:00:00.058) 0:01:13.975 ****** 2021-01-28T03:45:49.869 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-28T03:45:49.871 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-01-28T03:45:49.908 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:49 +0000 (0:00:00.047) 0:01:14.023 ****** 2021-01-28T03:45:49.915 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:49.956 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:49 +0000 (0:00:00.048) 0:01:14.071 ****** 2021-01-28T03:45:49.966 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-01-28T03:45:49.969 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-01-28T03:45:49.980 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-01-28T03:45:49.994 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-01-28T03:45:49.996 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi162.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-01-28T03:45:50.033 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:50 +0000 (0:00:00.077) 0:01:14.148 ****** 2021-01-28T03:45:50.042 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-01-28T03:45:50.044 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} ok: [smithi162.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi162.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-01-28T03:45:50.055 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-01-28T03:45:50.067 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-01-28T03:45:50.077 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi100.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-01-28T03:45:50.079 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi162.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-01-28T03:45:50.115 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:50 +0000 (0:00:00.081) 0:01:14.230 ****** 2021-01-28T03:45:50.122 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-01-28T03:45:50.124 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-01-28T03:45:50.177 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:50 +0000 (0:00:00.062) 0:01:14.293 ****** 2021-01-28T03:45:50.185 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-01-28T03:45:50.187 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-01-28T03:45:50.198 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-01-28T03:45:50.200 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-01-28T03:45:50.210 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-01-28T03:45:50.221 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-01-28T03:45:50.233 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-01-28T03:45:50.244 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-01-28T03:45:50.267 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-01-28T03:45:50.269 INFO:teuthology.task.ansible.out: 2021-01-28T03:45:50.271 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-01-28T03:45:50.281 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-01-28T03:45:50.292 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-01-28T03:45:50.303 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-01-28T03:45:50.305 INFO:teuthology.task.ansible.out: 2021-01-28T03:45:50.315 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-01-28T03:45:50.317 INFO:teuthology.task.ansible.out: 2021-01-28T03:45:50.360 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:50 +0000 (0:00:00.182) 0:01:14.475 ****** 2021-01-28T03:45:50.433 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-01-28T03:45:50.434 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.020492", "end": "2021-01-28 03:45:50.400490", "rc": 0, "start": "2021-01-28 03:45:50.379998", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2021-01-28T03:45:50.476 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:50 +0000 (0:00:00.115) 0:01:14.591 ****** 2021-01-28T03:45:50.514 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:50.561 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:50 +0000 (0:00:00.085) 0:01:14.677 ****** 2021-01-28T03:45:50.583 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-01-28T03:45:50.584 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.005857", "end": "2021-01-28 03:45:50.544993", "rc": 0, "start": "2021-01-28 03:45:50.539136", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2021-01-28T03:45:50.635 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:50 +0000 (0:00:00.073) 0:01:14.750 ****** 2021-01-28T03:45:50.644 INFO:teuthology.task.ansible.out: 2021-01-28T03:45:50.646 INFO:teuthology.task.ansible.out:TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:50.699 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:50 +0000 (0:00:00.064) 0:01:14.815 ****** 2021-01-28T03:45:50.709 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-01-28T03:45:50.711 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:50.758 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:50 +0000 (0:00:00.058) 0:01:14.873 ****** 2021-01-28T03:45:50.766 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-01-28T03:45:50.768 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:50.811 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:50 +0000 (0:00:00.052) 0:01:14.926 ****** 2021-01-28T03:45:50.817 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-01-28T03:45:50.818 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:50.857 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:50 +0000 (0:00:00.046) 0:01:14.972 ****** 2021-01-28T03:45:50.885 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-01-28T03:45:50.887 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:50.921 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:50 +0000 (0:00:00.064) 0:01:15.037 ****** 2021-01-28T03:45:51.455 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-01-28T03:45:51.457 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"cache_update_time": 1611805262, "cache_updated": false, "changed": false} 2021-01-28T03:45:51.496 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:51 +0000 (0:00:00.574) 0:01:15.611 ****** 2021-01-28T03:45:51.523 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-01-28T03:45:51.525 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:51.559 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:51 +0000 (0:00:00.063) 0:01:15.675 ****** 2021-01-28T03:45:51.577 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-01-28T03:45:51.578 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"cache_update_time": 1611805203, "cache_updated": false, "changed": false} 2021-01-28T03:45:51.614 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:51 +0000 (0:00:00.054) 0:01:15.729 ****** 2021-01-28T03:45:51.621 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-01-28T03:45:51.623 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => (item={'block_used': 13965201, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226129907, 'size_available': 926228099072, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 165079, 'block_size': 4096, 'inode_available': 60889897}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226129907, "block_size": 4096, "block_total": 240095108, "block_used": 13965201, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60889897, "inode_total": 61054976, "inode_used": 165079, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926228099072, "size_total": 983429562368, "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}} 2021-01-28T03:45:51.661 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:51 +0000 (0:00:00.046) 0:01:15.776 ****** 2021-01-28T03:45:51.668 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-01-28T03:45:51.669 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:51.714 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:51 +0000 (0:00:00.053) 0:01:15.830 ****** 2021-01-28T03:45:51.775 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-01-28T03:45:51.777 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item={'block_used': 13965203, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226129905, 'size_available': 926228090880, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 165079, 'block_size': 4096, 'inode_available': 60889897}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226129905, "block_size": 4096, "block_total": 240095108, "block_used": 13965203, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60889897, "inode_total": 61054976, "inode_used": 165079, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926228090880, "size_total": 983429562368, "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}} 2021-01-28T03:45:51.819 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:51 +0000 (0:00:00.104) 0:01:15.934 ****** 2021-01-28T03:45:51.826 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-01-28T03:45:51.827 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009227", "end": "2021-01-28 03:45:51.907266", "rc": 0, "start": "2021-01-28 03:45:51.898039", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T03:45:51.865 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:51 +0000 (0:00:00.045) 0:01:15.980 ****** 2021-01-28T03:45:51.913 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-01-28T03:45:51.915 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'block_used': 13965201, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226129907, 'size_available': 926228099072, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 165079, 'block_size': 4096, 'inode_available': 60889897}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226129907, "block_size": 4096, "block_total": 240095108, "block_used": 13965201, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60889897, "inode_total": 61054976, "inode_used": 165079, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926228099072, "size_total": 983429562368, "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:51.953 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:51 +0000 (0:00:00.088) 0:01:16.068 ****** 2021-01-28T03:45:51.959 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-01-28T03:45:51.961 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009100", "end": "2021-01-28 03:45:52.141559", "rc": 0, "start": "2021-01-28 03:45:52.132459", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T03:45:51.997 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:51 +0000 (0:00:00.044) 0:01:16.113 ****** 2021-01-28T03:45:52.004 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-01-28T03:45:52.044 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:52 +0000 (0:00:00.046) 0:01:16.159 ****** 2021-01-28T03:45:52.050 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-01-28T03:45:52.051 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'block_used': 13965203, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226129905, 'size_available': 926228090880, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 165079, 'block_size': 4096, 'inode_available': 60889897}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226129905, "block_size": 4096, "block_total": 240095108, "block_used": 13965203, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60889897, "inode_total": 61054976, "inode_used": 165079, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926228090880, "size_total": 983429562368, "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:52.096 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:52 +0000 (0:00:00.052) 0:01:16.211 ****** 2021-01-28T03:45:52.115 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-01-28T03:45:52.117 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:52.127 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-01-28T03:45:52.165 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:45:52 +0000 (0:00:00.069) 0:01:16.281 ****** 2021-01-28T03:45:52.215 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-01-28T03:45:52.217 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:53.914 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-jC9ZRNPhSmohj2wpYCxL2Mkgm5zrIbE2Zsq7XeiAq26KYaBqe1sSUUTap2TclM0z'], 'uuids': ['29766780-55c1-4912-889a-5c816dc77d81']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.676600", "end": "2021-01-28 03:45:54.001006", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-jC9ZRNPhSmohj2wpYCxL2Mkgm5zrIbE2Zsq7XeiAq26KYaBqe1sSUUTap2TclM0z"], "labels": [], "masters": [], "uuids": ["29766780-55c1-4912-889a-5c816dc77d81"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 03:45:52.324406", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-28T03:45:53.916 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:53.927 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:53.960 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-Lyde6nMdb5Zev5N4dC5dtaRjaxoipioAeawC1k7H8EuTCs0yfsirhhsDBLihMrUv'], 'uuids': ['7820db0b-9ac8-405b-906b-65bcbccad04f']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.622208", "end": "2021-01-28 03:45:54.136176", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-Lyde6nMdb5Zev5N4dC5dtaRjaxoipioAeawC1k7H8EuTCs0yfsirhhsDBLihMrUv"], "labels": [], "masters": [], "uuids": ["7820db0b-9ac8-405b-906b-65bcbccad04f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 03:45:52.513968", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-28T03:45:53.971 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:53.983 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:55.217 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-jC9ZRNPhSmohj2wpYCxL2Mkgm5zrIbE2lcQFo5kTy2a1U8KADzxaIrOkZeNyPrNP'], 'uuids': ['2c61029b-57f1-4836-9a91-4bef3f3f5201']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.163410", "end": "2021-01-28 03:45:55.308960", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-jC9ZRNPhSmohj2wpYCxL2Mkgm5zrIbE2lcQFo5kTy2a1U8KADzxaIrOkZeNyPrNP"], "labels": [], "masters": [], "uuids": ["2c61029b-57f1-4836-9a91-4bef3f3f5201"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 03:45:54.145550", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-28T03:45:55.229 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTKR', 'wwn-0x5000c5009293e333'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTKR-part1', 'wwn-0x5000c5009293e333-part1'], 'uuids': ['ae02d76a-c1bf-47f7-9641-985fab1b2f70']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c5009293e333', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XTKR', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTKR", "wwn-0x5000c5009293e333"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTKR-part1", "wwn-0x5000c5009293e333-part1"], "labels": [], "masters": [], "uuids": ["ae02d76a-c1bf-47f7-9641-985fab1b2f70"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XTKR", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009293e333"}}, 2021-01-28T03:45:55.231 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-01-28T03:45:55.262 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-Lyde6nMdb5Zev5N4dC5dtaRjaxoipioALq20FVDcD3EGFyv2g8Z7i8NLjIa0fxrH'], 'uuids': ['2b1e0f1f-5b48-4e4b-b022-0b64cc69e7c3']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.147196", "end": "2021-01-28 03:45:55.435031", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-Lyde6nMdb5Zev5N4dC5dtaRjaxoipioALq20FVDcD3EGFyv2g8Z7i8NLjIa0fxrH"], "labels": [], "masters": [], "uuids": ["2b1e0f1f-5b48-4e4b-b022-0b64cc69e7c3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 03:45:54.287835", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-28T03:45:55.274 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QKL1', 'wwn-0x5000c50091e1a316'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QKL1-part1', 'wwn-0x5000c50091e1a316-part1'], 'uuids': ['ae02d76a-c1bf-47f7-9641-985fab1b2f70']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091e1a316', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5QKL1', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QKL1", "wwn-0x5000c50091e1a316"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QKL1-part1", "wwn-0x5000c50091e1a316-part1"], "labels": [], "masters": [], "uuids": ["ae02d76a-c1bf-47f7-9641-985fab1b2f70"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QKL1", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e1a316"}}, 2021-01-28T03:45:55.275 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-01-28T03:45:56.540 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-cc0IeZ-kwOK-T7xt-rnzd-P83U-k8Vr-sWxLmw', 'nvme-INTEL_SSDPEDMD400G4_CVFT623300JU400BGN', 'nvme-nvme.8086-435646543632333330304a5534303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.177338", "end": "2021-01-28 03:45:56.622013", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-cc0IeZ-kwOK-T7xt-rnzd-P83U-k8Vr-sWxLmw", "nvme-INTEL_SSDPEDMD400G4_CVFT623300JU400BGN", "nvme-nvme.8086-435646543632333330304a5534303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 03:45:55.444675", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2021-01-28T03:45:56.542 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-28T03:45:56.560 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:56.572 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:56.617 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-LdWrZU-grfU-bEbg-6pPE-coOg-WoZ5-ienVTB', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400WR400BGN', 'nvme-nvme.8086-50484654363230343030575234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.220136", "end": "2021-01-28 03:45:56.785688", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-LdWrZU-grfU-bEbg-6pPE-coOg-WoZ5-ienVTB", "nvme-INTEL_SSDPEDMD400G4_PHFT620400WR400BGN", "nvme-nvme.8086-50484654363230343030575234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 03:45:55.565552", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2021-01-28T03:45:56.618 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi100.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:56.630 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:57.850 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-jC9ZRNPhSmohj2wpYCxL2Mkgm5zrIbE27RCOUdKTxGfRPM4bUxrJmdg5sD4IvAgW'], 'uuids': ['63a73124-453a-4726-8224-36e555f96295']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.145743", "end": "2021-01-28 03:45:57.935099", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-jC9ZRNPhSmohj2wpYCxL2Mkgm5zrIbE27RCOUdKTxGfRPM4bUxrJmdg5sD4IvAgW"], "labels": [], "masters": [], "uuids": ["63a73124-453a-4726-8224-36e555f96295"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 03:45:56.789356", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-28T03:45:57.851 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:57.862 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:57.905 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-Lyde6nMdb5Zev5N4dC5dtaRjaxoipioAshT0dZYHTmcJviRO6idpd3xPMHsAJz0s'], 'uuids': ['361a2326-213c-4f9b-9664-2cc6a9e77672']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.136445", "end": "2021-01-28 03:45:58.078005", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-Lyde6nMdb5Zev5N4dC5dtaRjaxoipioAshT0dZYHTmcJviRO6idpd3xPMHsAJz0s"], "labels": [], "masters": [], "uuids": ["361a2326-213c-4f9b-9664-2cc6a9e77672"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 03:45:56.941560", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-28T03:45:57.906 INFO:teuthology.task.ansible.out: 2021-01-28T03:45:57.918 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:57.930 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:59.162 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-jC9ZRNPhSmohj2wpYCxL2Mkgm5zrIbE2JlcWQ9CVKHyTuG2yZvlufw5GBB8BBLgF'], 'uuids': ['b3e7cb3f-af67-4f4b-8bc4-565285e3bb4c']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.160891", "end": "2021-01-28 03:45:59.245925", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-jC9ZRNPhSmohj2wpYCxL2Mkgm5zrIbE2JlcWQ9CVKHyTuG2yZvlufw5GBB8BBLgF"], "labels": [], "masters": [], "uuids": ["b3e7cb3f-af67-4f4b-8bc4-565285e3bb4c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 03:45:58.085034", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-28T03:45:59.216 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:45:59.249 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-Lyde6nMdb5Zev5N4dC5dtaRjaxoipioA8vxJDrcz8zYhlJ23kPAtQIQpIKFxLFmf'], 'uuids': ['cca27cb2-89ed-469c-94dc-24fcef497d77']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.197258", "end": "2021-01-28 03:45:59.416638", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-Lyde6nMdb5Zev5N4dC5dtaRjaxoipioA8vxJDrcz8zYhlJ23kPAtQIQpIKFxLFmf"], "labels": [], "masters": [], "uuids": ["cca27cb2-89ed-469c-94dc-24fcef497d77"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 03:45:58.219380", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-28T03:45:59.252 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:00.558 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-Lyde6nMdb5Zev5N4dC5dtaRjaxoipioAZtfqAO0JYHCrNrfED3n8lPzVpd1hB8q9'], 'uuids': ['5cec6ed2-b3fb-445b-843f-3d3c83f6ab60']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.132025", "end": "2021-01-28 03:46:00.735805", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-Lyde6nMdb5Zev5N4dC5dtaRjaxoipioAZtfqAO0JYHCrNrfED3n8lPzVpd1hB8q9"], "labels": [], "masters": [], "uuids": ["5cec6ed2-b3fb-445b-843f-3d3c83f6ab60"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 03:45:59.603780", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-28T03:46:00.608 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:00 +0000 (0:00:08.442) 0:01:24.724 ****** 2021-01-28T03:46:00.616 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-jC9ZRNPhSmohj2wpYCxL2Mkgm5zrIbE21wPynhkGF7HGn48BSXw0RSz2TZLrE05I'], 'uuids': ['1df7a5a1-c283-4ce1-9bd8-bbae0274143b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.163545", "end": "2021-01-28 03:46:00.677671", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-jC9ZRNPhSmohj2wpYCxL2Mkgm5zrIbE21wPynhkGF7HGn48BSXw0RSz2TZLrE05I"], "labels": [], "masters": [], "uuids": ["1df7a5a1-c283-4ce1-9bd8-bbae0274143b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 03:45:59.514126", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-28T03:46:00.667 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:00 +0000 (0:00:00.059) 0:01:24.783 ****** 2021-01-28T03:46:00.677 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-28T03:46:00.679 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:00.722 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:00.955 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-Lyde6nMdb5Zev5N4dC5dtaRjaxoipioAeawC1k7H8EuTCs0yfsirhhsDBLihMrUv'], 'uuids': ['7820db0b-9ac8-405b-906b-65bcbccad04f']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.163873", "end": "2021-01-28 03:46:01.132114", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-Lyde6nMdb5Zev5N4dC5dtaRjaxoipioAeawC1k7H8EuTCs0yfsirhhsDBLihMrUv"], "labels": [], "masters": [], "uuids": ["7820db0b-9ac8-405b-906b-65bcbccad04f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 03:46:00.968241", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.158893 s, 726 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.158893 s, 726 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-28T03:46:00.968 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:00.979 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:01.012 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-jC9ZRNPhSmohj2wpYCxL2Mkgm5zrIbE2Zsq7XeiAq26KYaBqe1sSUUTap2TclM0z'], 'uuids': ['29766780-55c1-4912-889a-5c816dc77d81']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.162480", "end": "2021-01-28 03:46:01.100612", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-jC9ZRNPhSmohj2wpYCxL2Mkgm5zrIbE2Zsq7XeiAq26KYaBqe1sSUUTap2TclM0z"], "labels": [], "masters": [], "uuids": ["29766780-55c1-4912-889a-5c816dc77d81"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 03:46:00.938132", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.157611 s, 732 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.157611 s, 732 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-28T03:46:01.024 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:01.025 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:01.268 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-Lyde6nMdb5Zev5N4dC5dtaRjaxoipioALq20FVDcD3EGFyv2g8Z7i8NLjIa0fxrH'], 'uuids': ['2b1e0f1f-5b48-4e4b-b022-0b64cc69e7c3']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.160940", "end": "2021-01-28 03:46:01.441466", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-Lyde6nMdb5Zev5N4dC5dtaRjaxoipioALq20FVDcD3EGFyv2g8Z7i8NLjIa0fxrH"], "labels": [], "masters": [], "uuids": ["2b1e0f1f-5b48-4e4b-b022-0b64cc69e7c3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 03:46:01.280526", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.155924 s, 740 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.155924 s, 740 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-28T03:46:01.280 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QKL1', 'wwn-0x5000c50091e1a316'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QKL1-part1', 'wwn-0x5000c50091e1a316-part1'], 'uuids': ['ae02d76a-c1bf-47f7-9641-985fab1b2f70']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091e1a316', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5QKL1', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QKL1", "wwn-0x5000c50091e1a316"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QKL1-part1", "wwn-0x5000c50091e1a316-part1"], "labels": [], "masters": [], "uuids": ["ae02d76a-c1bf-47f7-9641-985fab1b2f70"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QKL1", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e1a316"}}, 2021-01-28T03:46:01.282 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-01-28T03:46:01.314 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-jC9ZRNPhSmohj2wpYCxL2Mkgm5zrIbE2lcQFo5kTy2a1U8KADzxaIrOkZeNyPrNP'], 'uuids': ['2c61029b-57f1-4836-9a91-4bef3f3f5201']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.163301", "end": "2021-01-28 03:46:01.409241", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-jC9ZRNPhSmohj2wpYCxL2Mkgm5zrIbE2lcQFo5kTy2a1U8KADzxaIrOkZeNyPrNP"], "labels": [], "masters": [], "uuids": ["2c61029b-57f1-4836-9a91-4bef3f3f5201"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 03:46:01.245940", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.158506 s, 728 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.158506 s, 728 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-28T03:46:01.327 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTKR', 'wwn-0x5000c5009293e333'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTKR-part1', 'wwn-0x5000c5009293e333-part1'], 'uuids': ['ae02d76a-c1bf-47f7-9641-985fab1b2f70']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c5009293e333', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XTKR', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTKR", "wwn-0x5000c5009293e333"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTKR-part1", "wwn-0x5000c5009293e333-part1"], "labels": [], "masters": [], "uuids": ["ae02d76a-c1bf-47f7-9641-985fab1b2f70"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XTKR", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009293e333"}}, 2021-01-28T03:46:01.329 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-01-28T03:46:01.468 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-LdWrZU-grfU-bEbg-6pPE-coOg-WoZ5-ienVTB', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400WR400BGN', 'nvme-nvme.8086-50484654363230343030575234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.058790", "end": "2021-01-28 03:46:01.636975", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-LdWrZU-grfU-bEbg-6pPE-coOg-WoZ5-ienVTB", "nvme-INTEL_SSDPEDMD400G4_PHFT620400WR400BGN", "nvme-nvme.8086-50484654363230343030575234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 03:46:01.578185", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0545696 s, 2.1 GB/s", "std 2021-01-28T03:46:01.470 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0545696 s, 2.1 GB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi100.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:01.481 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:01.514 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-cc0IeZ-kwOK-T7xt-rnzd-P83U-k8Vr-sWxLmw', 'nvme-INTEL_SSDPEDMD400G4_CVFT623300JU400BGN', 'nvme-nvme.8086-435646543632333330304a5534303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.058310", "end": "2021-01-28 03:46:01.599500", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-cc0IeZ-kwOK-T7xt-rnzd-P83U-k8Vr-sWxLmw", "nvme-INTEL_SSDPEDMD400G4_CVFT623300JU400BGN", "nvme-nvme.8086-435646543632333330304a5534303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 03:46:01.541190", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0533697 s, 2.2 GB/s", "std 2021-01-28T03:46:01.516 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0533697 s, 2.2 GB/s"], "stdout": "", "stdout_lines": []} 2021-01-28T03:46:01.526 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:01.527 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:01.769 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-Lyde6nMdb5Zev5N4dC5dtaRjaxoipioAshT0dZYHTmcJviRO6idpd3xPMHsAJz0s'], 'uuids': ['361a2326-213c-4f9b-9664-2cc6a9e77672']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.155847", "end": "2021-01-28 03:46:01.946989", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-Lyde6nMdb5Zev5N4dC5dtaRjaxoipioAshT0dZYHTmcJviRO6idpd3xPMHsAJz0s"], "labels": [], "masters": [], "uuids": ["361a2326-213c-4f9b-9664-2cc6a9e77672"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 03:46:01.791142", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.151191 s, 763 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.151191 s, 763 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-28T03:46:01.791 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:01.792 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:01.814 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-jC9ZRNPhSmohj2wpYCxL2Mkgm5zrIbE27RCOUdKTxGfRPM4bUxrJmdg5sD4IvAgW'], 'uuids': ['63a73124-453a-4726-8224-36e555f96295']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.158276", "end": "2021-01-28 03:46:01.907486", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-jC9ZRNPhSmohj2wpYCxL2Mkgm5zrIbE27RCOUdKTxGfRPM4bUxrJmdg5sD4IvAgW"], "labels": [], "masters": [], "uuids": ["63a73124-453a-4726-8224-36e555f96295"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 03:46:01.749210", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.154356 s, 747 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.154356 s, 747 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-28T03:46:01.825 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:01.837 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:02.083 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-Lyde6nMdb5Zev5N4dC5dtaRjaxoipioA8vxJDrcz8zYhlJ23kPAtQIQpIKFxLFmf'], 'uuids': ['cca27cb2-89ed-469c-94dc-24fcef497d77']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.166568", "end": "2021-01-28 03:46:02.260456", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-Lyde6nMdb5Zev5N4dC5dtaRjaxoipioA8vxJDrcz8zYhlJ23kPAtQIQpIKFxLFmf"], "labels": [], "masters": [], "uuids": ["cca27cb2-89ed-469c-94dc-24fcef497d77"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 03:46:02.093888", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.16174 s, 713 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.16174 s, 713 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-28T03:46:02.095 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:02.129 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-jC9ZRNPhSmohj2wpYCxL2Mkgm5zrIbE2JlcWQ9CVKHyTuG2yZvlufw5GBB8BBLgF'], 'uuids': ['b3e7cb3f-af67-4f4b-8bc4-565285e3bb4c']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.165771", "end": "2021-01-28 03:46:02.217757", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-jC9ZRNPhSmohj2wpYCxL2Mkgm5zrIbE2JlcWQ9CVKHyTuG2yZvlufw5GBB8BBLgF"], "labels": [], "masters": [], "uuids": ["b3e7cb3f-af67-4f4b-8bc4-565285e3bb4c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 03:46:02.051986", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.160627 s, 718 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.160627 s, 718 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-28T03:46:02.162 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:02.164 INFO:teuthology.task.ansible.out: 2021-01-28T03:46:02.417 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-Lyde6nMdb5Zev5N4dC5dtaRjaxoipioAZtfqAO0JYHCrNrfED3n8lPzVpd1hB8q9'], 'uuids': ['5cec6ed2-b3fb-445b-843f-3d3c83f6ab60']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.171565", "end": "2021-01-28 03:46:02.583303", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-Lyde6nMdb5Zev5N4dC5dtaRjaxoipioAZtfqAO0JYHCrNrfED3n8lPzVpd1hB8q9"], "labels": [], "masters": [], "uuids": ["5cec6ed2-b3fb-445b-843f-3d3c83f6ab60"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 03:46:02.411738", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.166814 s, 691 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.166814 s, 691 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-28T03:46:02.478 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:02 +0000 (0:00:01.809) 0:01:26.593 ****** 2021-01-28T03:46:02.487 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-jC9ZRNPhSmohj2wpYCxL2Mkgm5zrIbE21wPynhkGF7HGn48BSXw0RSz2TZLrE05I'], 'uuids': ['1df7a5a1-c283-4ce1-9bd8-bbae0274143b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.157738", "end": "2021-01-28 03:46:02.557953", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-jC9ZRNPhSmohj2wpYCxL2Mkgm5zrIbE21wPynhkGF7HGn48BSXw0RSz2TZLrE05I"], "labels": [], "masters": [], "uuids": ["1df7a5a1-c283-4ce1-9bd8-bbae0274143b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 03:46:02.400215", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.15298 s, 754 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.15298 s, 754 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-28T03:46:02.538 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:02 +0000 (0:00:00.061) 0:01:26.654 ****** 2021-01-28T03:46:02.786 INFO:teuthology.task.ansible.out: 2021-01-28T03:46:02.788 INFO:teuthology.task.ansible.out:TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi100.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.138274", "end": "2021-01-28 03:46:02.953878", "rc": 0, "start": "2021-01-28 03:46:02.815604", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T03:46:02.837 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:02 +0000 (0:00:00.299) 0:01:26.953 ****** 2021-01-28T03:46:02.848 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.132436", "end": "2021-01-28 03:46:02.914317", "rc": 0, "start": "2021-01-28 03:46:02.781881", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T03:46:02.898 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:02 +0000 (0:00:00.060) 0:01:27.013 ****** 2021-01-28T03:46:03.079 INFO:teuthology.task.ansible.out: 2021-01-28T03:46:03.081 INFO:teuthology.task.ansible.out:TASK [testnode : Check for physical volumes] *********************************** changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.100291", "end": "2021-01-28 03:46:03.258567", "rc": 0, "start": "2021-01-28 03:46:03.158276", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T03:46:03.118 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:03 +0000 (0:00:00.219) 0:01:27.233 ****** 2021-01-28T03:46:03.147 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.097584", "end": "2021-01-28 03:46:03.234874", "rc": 0, "start": "2021-01-28 03:46:03.137290", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T03:46:03.148 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-01-28T03:46:03.192 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:03 +0000 (0:00:00.074) 0:01:27.308 ****** 2021-01-28T03:46:03.227 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:03 +0000 (0:00:00.034) 0:01:27.342 ****** 2021-01-28T03:46:03.233 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-01-28T03:46:03.235 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:03.278 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:03 +0000 (0:00:00.050) 0:01:27.393 ****** 2021-01-28T03:46:03.285 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-01-28T03:46:03.325 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:03 +0000 (0:00:00.047) 0:01:27.441 ****** 2021-01-28T03:46:03.333 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-01-28T03:46:03.334 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:03.372 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:03 +0000 (0:00:00.046) 0:01:27.488 ****** 2021-01-28T03:46:03.381 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-01-28T03:46:03.382 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:03.434 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:03 +0000 (0:00:00.061) 0:01:27.550 ****** 2021-01-28T03:46:03.443 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-01-28T03:46:03.444 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:03.487 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:03 +0000 (0:00:00.052) 0:01:27.603 ****** 2021-01-28T03:46:03.495 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-01-28T03:46:03.497 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:03.534 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:03 +0000 (0:00:00.046) 0:01:27.649 ****** 2021-01-28T03:46:03.541 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-01-28T03:46:03.543 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:03.577 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:03 +0000 (0:00:00.043) 0:01:27.693 ****** 2021-01-28T03:46:03.584 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-01-28T03:46:03.586 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:03.627 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:03 +0000 (0:00:00.049) 0:01:27.742 ****** 2021-01-28T03:46:03.654 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:03.691 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:03 +0000 (0:00:00.064) 0:01:27.806 ****** 2021-01-28T03:46:03.708 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-01-28T03:46:03.710 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-28T03:46:03.747 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:03 +0000 (0:00:00.056) 0:01:27.862 ****** 2021-01-28T03:46:03.797 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-01-28T03:46:03.798 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'block_used': 13965203, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226129905, 'size_available': 926228090880, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 165079, 'block_size': 4096, 'inode_available': 60889897}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226129905, "block_size": 4096, "block_total": 240095108, "block_used": 13965203, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60889897, "inode_total": 61054976, "inode_used": 165079, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926228090880, "size_total": 983429562368, "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:03.840 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:03 +0000 (0:00:00.093) 0:01:27.955 ****** 2021-01-28T03:46:03.849 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-01-28T03:46:03.851 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-28T03:46:03.894 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:03 +0000 (0:00:00.054) 0:01:28.010 ****** 2021-01-28T03:46:03.904 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-01-28T03:46:03.905 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:03.943 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:03 +0000 (0:00:00.048) 0:01:28.058 ****** 2021-01-28T03:46:03.949 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-01-28T03:46:03.951 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'block_used': 13965201, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226129907, 'size_available': 926228099072, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 165079, 'block_size': 4096, 'inode_available': 60889897}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226129907, "block_size": 4096, "block_total": 240095108, "block_used": 13965201, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60889897, "inode_total": 61054976, "inode_used": 165079, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926228099072, "size_total": 983429562368, "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:03.991 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:03 +0000 (0:00:00.048) 0:01:28.107 ****** 2021-01-28T03:46:03.998 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-28T03:46:04.000 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:04.037 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:04 +0000 (0:00:00.045) 0:01:28.152 ****** 2021-01-28T03:46:04.046 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-01-28T03:46:04.048 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:04.086 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:04 +0000 (0:00:00.049) 0:01:28.202 ****** 2021-01-28T03:46:04.093 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-28T03:46:04.095 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:04.133 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:04 +0000 (0:00:00.046) 0:01:28.249 ****** 2021-01-28T03:46:04.141 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-28T03:46:04.143 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:04.184 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:04 +0000 (0:00:00.050) 0:01:28.299 ****** 2021-01-28T03:46:04.191 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-01-28T03:46:04.193 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:04.229 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:04 +0000 (0:00:00.045) 0:01:28.345 ****** 2021-01-28T03:46:04.236 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-28T03:46:04.237 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:04.276 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:04 +0000 (0:00:00.046) 0:01:28.391 ****** 2021-01-28T03:46:04.284 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-01-28T03:46:04.285 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:04.324 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:04 +0000 (0:00:00.048) 0:01:28.440 ****** 2021-01-28T03:46:04.334 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:04.374 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:04 +0000 (0:00:00.049) 0:01:28.489 ****** 2021-01-28T03:46:04.382 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:04.421 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:04 +0000 (0:00:00.047) 0:01:28.536 ****** 2021-01-28T03:46:04.428 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-01-28T03:46:04.430 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:04.469 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:04 +0000 (0:00:00.047) 0:01:28.584 ****** 2021-01-28T03:46:04.498 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-01-28T03:46:04.500 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:04.537 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:04 +0000 (0:00:00.068) 0:01:28.652 ****** 2021-01-28T03:46:05.269 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-01-28T03:46:05.271 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} changed: [smithi162.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-01-28T03:46:05.310 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:05 +0000 (0:00:00.772) 0:01:29.425 ****** 2021-01-28T03:46:05.344 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:05 +0000 (0:00:00.034) 0:01:29.459 ****** 2021-01-28T03:46:05.984 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-01-28T03:46:05.985 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-28T03:46:06.027 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-28T03:46:06.374 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-28T03:46:06.857 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} changed: [smithi162.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-28T03:46:07.172 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-28T03:46:07.183 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-28T03:46:07.559 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-28T03:46:07.596 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:07 +0000 (0:00:02.252) 0:01:31.712 ****** 2021-01-28T03:46:07.604 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-28T03:46:07.645 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:07 +0000 (0:00:00.048) 0:01:31.761 ****** 2021-01-28T03:46:07.726 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-01-28T03:46:07.727 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-01-28T03:46:07.767 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:07 +0000 (0:00:00.122) 0:01:31.883 ****** 2021-01-28T03:46:07.786 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-01-28T03:46:07.833 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:07 +0000 (0:00:00.065) 0:01:31.948 ****** 2021-01-28T03:46:07.914 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-01-28T03:46:07.916 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-28T03:46:07.990 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-28T03:46:08.033 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-28T03:46:08.098 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-28T03:46:08.144 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-28T03:46:08.209 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-28T03:46:08.262 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-28T03:46:08.274 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:08.314 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:08 +0000 (0:00:00.481) 0:01:32.430 ****** 2021-01-28T03:46:08.334 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-28T03:46:08.346 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:08.349 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-01-28T03:46:08.350 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:08.385 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:08 +0000 (0:00:00.070) 0:01:32.500 ****** 2021-01-28T03:46:08.420 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:08 +0000 (0:00:00.035) 0:01:32.536 ****** 2021-01-28T03:46:08.426 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-01-28T03:46:08.429 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:08.465 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:08 +0000 (0:00:00.045) 0:01:32.581 ****** 2021-01-28T03:46:08.474 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-01-28T03:46:08.475 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:08.516 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:08 +0000 (0:00:00.050) 0:01:32.631 ****** 2021-01-28T03:46:08.551 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-01-28T03:46:08.553 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:08.591 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:08 +0000 (0:00:00.074) 0:01:32.706 ****** 2021-01-28T03:46:08.609 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-01-28T03:46:08.611 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-01-28T03:46:08.649 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:08 +0000 (0:00:00.057) 0:01:32.764 ****** 2021-01-28T03:46:08.687 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi100.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-01-28T03:46:08.725 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:08 +0000 (0:00:00.076) 0:01:32.841 ****** 2021-01-28T03:46:08.754 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-01-28T03:46:08.755 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-01-28T03:46:08.794 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:08 +0000 (0:00:00.069) 0:01:32.910 ****** 2021-01-28T03:46:08.837 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-01-28T03:46:08.838 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-01-28T03:46:08.873 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:08 +0000 (0:00:00.078) 0:01:32.989 ****** 2021-01-28T03:46:09.254 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-01-28T03:46:09.256 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"changed": true} changed: [smithi162.front.sepia.ceph.com] => {"changed": true} 2021-01-28T03:46:09.299 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:09 +0000 (0:00:00.426) 0:01:33.415 ****** 2021-01-28T03:46:09.347 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:09 +0000 (0:00:00.047) 0:01:33.462 ****** 2021-01-28T03:46:09.775 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-01-28T03:46:09.777 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-01-28T03:46:09.811 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:09 +0000 (0:00:00.464) 0:01:33.927 ****** 2021-01-28T03:46:09.819 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-01-28T03:46:09.856 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:09 +0000 (0:00:00.044) 0:01:33.972 ****** 2021-01-28T03:46:09.863 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-01-28T03:46:09.864 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:09.900 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:09 +0000 (0:00:00.043) 0:01:34.015 ****** 2021-01-28T03:46:09.908 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:09.944 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:09 +0000 (0:00:00.044) 0:01:34.060 ****** 2021-01-28T03:46:09.951 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-01-28T03:46:09.953 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:09.989 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:09 +0000 (0:00:00.044) 0:01:34.104 ****** 2021-01-28T03:46:09.996 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:10.033 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:10 +0000 (0:00:00.043) 0:01:34.148 ****** 2021-01-28T03:46:10.039 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-01-28T03:46:10.041 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:10.083 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:10 +0000 (0:00:00.050) 0:01:34.199 ****** 2021-01-28T03:46:10.092 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:10.142 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:10 +0000 (0:00:00.058) 0:01:34.257 ****** 2021-01-28T03:46:10.149 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-01-28T03:46:10.151 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:10.192 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:10 +0000 (0:00:00.049) 0:01:34.307 ****** 2021-01-28T03:46:10.200 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:10.241 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:10 +0000 (0:00:00.049) 0:01:34.356 ****** 2021-01-28T03:46:10.344 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-01-28T03:46:10.345 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-01-28T03:46:10.384 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:10 +0000 (0:00:00.142) 0:01:34.499 ****** 2021-01-28T03:46:10.405 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-01-28T03:46:10.445 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:10 +0000 (0:00:00.061) 0:01:34.561 ****** 2021-01-28T03:46:10.535 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-01-28T03:46:10.537 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-01-28T03:46:10.572 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:10 +0000 (0:00:00.126) 0:01:34.687 ****** 2021-01-28T03:46:10.600 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-01-28T03:46:10.641 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:10 +0000 (0:00:00.068) 0:01:34.756 ****** 2021-01-28T03:46:10.944 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-01-28T03:46:10.946 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-01-28T03:46:10.982 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:10 +0000 (0:00:00.340) 0:01:35.097 ****** 2021-01-28T03:46:11.010 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-01-28T03:46:11.012 INFO:teuthology.task.ansible.out: 2021-01-28T03:46:11.048 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:11 +0000 (0:00:00.066) 0:01:35.163 ****** 2021-01-28T03:46:11.399 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-01-28T03:46:11.402 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-01-28T03:46:11.456 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:11 +0000 (0:00:00.408) 0:01:35.572 ****** 2021-01-28T03:46:11.468 INFO:teuthology.task.ansible.out: 2021-01-28T03:46:11.487 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-01-28T03:46:11.522 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:11 +0000 (0:00:00.065) 0:01:35.637 ****** 2021-01-28T03:46:12.141 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** ok: [smithi162.front.sepia.ceph.com] => {"cache_update_time": 1611805262, "cache_updated": false, "changed": false} 2021-01-28T03:46:12.192 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:12 +0000 (0:00:00.669) 0:01:36.306 ****** 2021-01-28T03:46:12.200 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"cache_update_time": 1611805203, "cache_updated": false, "changed": false} 2021-01-28T03:46:12.251 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:12 +0000 (0:00:00.059) 0:01:36.366 ****** 2021-01-28T03:46:12.464 INFO:teuthology.task.ansible.out: 2021-01-28T03:46:12.465 INFO:teuthology.task.ansible.out:TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.119826", "end": "2021-01-28 03:46:12.557742", "rc": 0, "start": "2021-01-28 03:46:12.437916", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-01-28T03:46:12.504 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:12 +0000 (0:00:00.253) 0:01:36.620 ****** 2021-01-28T03:46:12.506 INFO:teuthology.task.ansible.out: 2021-01-28T03:46:12.546 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.112384", "end": "2021-01-28 03:46:12.718954", "rc": 0, "start": "2021-01-28 03:46:12.606570", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-01-28T03:46:12.584 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:12 +0000 (0:00:00.079) 0:01:36.699 ****** 2021-01-28T03:46:12.591 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-01-28T03:46:12.593 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:12.644 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:12 +0000 (0:00:00.060) 0:01:36.760 ****** 2021-01-28T03:46:12.654 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:12.694 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:12 +0000 (0:00:00.049) 0:01:36.809 ****** 2021-01-28T03:46:12.701 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-01-28T03:46:12.704 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:12.751 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:12 +0000 (0:00:00.057) 0:01:36.867 ****** 2021-01-28T03:46:12.766 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:12.807 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:12 +0000 (0:00:00.055) 0:01:36.922 ****** 2021-01-28T03:46:13.412 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-01-28T03:46:13.414 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"cache_update_time": 1611805262, "cache_updated": false, "changed": false} 2021-01-28T03:46:13.451 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:13 +0000 (0:00:00.643) 0:01:37.566 ****** 2021-01-28T03:46:13.468 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"cache_update_time": 1611805203, "cache_updated": false, "changed": false} 2021-01-28T03:46:13.506 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:13 +0000 (0:00:00.055) 0:01:37.622 ****** 2021-01-28T03:46:13.513 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-01-28T03:46:13.515 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:13.553 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:13 +0000 (0:00:00.045) 0:01:37.667 ****** 2021-01-28T03:46:13.559 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:13.602 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:13 +0000 (0:00:00.050) 0:01:37.717 ****** 2021-01-28T03:46:13.885 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-01-28T03:46:13.934 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:13 +0000 (0:00:00.331) 0:01:38.049 ****** 2021-01-28T03:46:13.942 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-01-28T03:46:13.980 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:13 +0000 (0:00:00.046) 0:01:38.096 ****** 2021-01-28T03:46:13.988 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-01-28T03:46:13.990 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:14.025 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:14 +0000 (0:00:00.044) 0:01:38.140 ****** 2021-01-28T03:46:14.032 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:14.071 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:14 +0000 (0:00:00.046) 0:01:38.187 ****** 2021-01-28T03:46:14.246 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-01-28T03:46:14.247 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2021-01-28 03:43:56 UTC", "ActiveEnterTimestampMonotonic": "14772536", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice basic.target systemd-journald.socket network.target sysinit.target -.mount systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2021-01-28 03:43:55 UTC", "AssertTimestampMonotonic": "14462921", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2021-01-28 03:43:55 UTC", "ConditionTimestampMonotonic": "14462920", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": 2021-01-28T03:46:14.249 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "871", "ExecMainStartTimestamp": "Thu 2021-01-28 03:43:56 UTC", "ExecMainStartTimestampMonotonic": "14772520", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2021-01-28 03:43:55 UTC", "InactiveExitTimestampMonotonic": "14464012", "InvocationID": "c67c523a6b924e5d8ade42bf7aa2e5a0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-01-28T03:46:14.250 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127781", "LimitNPROCSoft": "127781", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127781", "LimitSIGPENDINGSoft": "127781", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "871", "MemoryAccounting": "yes", "MemoryCurrent": "3694592", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "Requi 2021-01-28T03:46:14.252 INFO:teuthology.task.ansible.out:resMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-01-28 03:43:56 UTC", "StateChangeTimestampMonotonic": "14772536", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38334", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-28T03:46:14.286 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:14 +0000 (0:00:00.215) 0:01:38.402 ****** 2021-01-28T03:46:14.298 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2021-01-28 03:43:41 UTC", "ActiveEnterTimestampMonotonic": "14779817", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target basic.target -.mount systemd-tmpfiles-setup.service system.slice sysinit.target systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2021-01-28 03:43:40 UTC", "AssertTimestampMonotonic": "14399644", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2021-01-28 03:43:40 UTC", "ConditionTimestampMonotonic": "14399642", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": 2021-01-28T03:46:14.299 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "875", "ExecMainStartTimestamp": "Thu 2021-01-28 03:43:41 UTC", "ExecMainStartTimestampMonotonic": "14779803", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2021-01-28 03:43:40 UTC", "InactiveExitTimestampMonotonic": "14400780", "InvocationID": "99203e100cc640128713d3457a3357e4", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-01-28T03:46:14.301 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127779", "LimitNPROCSoft": "127779", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127779", "LimitSIGPENDINGSoft": "127779", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "875", "MemoryAccounting": "yes", "MemoryCurrent": "3989504", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "Requi 2021-01-28T03:46:14.303 INFO:teuthology.task.ansible.out:resMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-01-28 03:43:41 UTC", "StateChangeTimestampMonotonic": "14779817", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38333", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-28T03:46:14.337 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:14 +0000 (0:00:00.050) 0:01:38.452 ****** 2021-01-28T03:46:14.347 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-28T03:46:14.348 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-01-28T03:46:14.386 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:14 +0000 (0:00:00.047) 0:01:38.500 ****** 2021-01-28T03:46:14.393 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-01-28T03:46:14.432 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:14 +0000 (0:00:00.047) 0:01:38.548 ****** 2021-01-28T03:46:14.439 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-28T03:46:14.441 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-01-28T03:46:14.481 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:14 +0000 (0:00:00.048) 0:01:38.596 ****** 2021-01-28T03:46:14.488 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-01-28T03:46:14.526 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:14 +0000 (0:00:00.045) 0:01:38.642 ****** 2021-01-28T03:46:14.534 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-01-28T03:46:14.535 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:14.571 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:14 +0000 (0:00:00.044) 0:01:38.686 ****** 2021-01-28T03:46:14.577 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:14.620 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:14 +0000 (0:00:00.048) 0:01:38.735 ****** 2021-01-28T03:46:14.622 INFO:teuthology.task.ansible.out: 2021-01-28T03:46:15.796 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-01-28T03:46:15.798 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"cache_update_time": 1611805262, "cache_updated": false, "changed": false} 2021-01-28T03:46:15.837 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:15 +0000 (0:00:01.216) 0:01:39.952 ****** 2021-01-28T03:46:15.864 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-01-28T03:46:15.865 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install python-pip on apt based systems.] ********************* ok: [smithi100.front.sepia.ceph.com] => {"cache_update_time": 1611805203, "cache_updated": false, "changed": false} 2021-01-28T03:46:15.911 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:15 +0000 (0:00:00.074) 0:01:40.026 ****** 2021-01-28T03:46:15.957 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:15 +0000 (0:00:00.046) 0:01:40.072 ****** 2021-01-28T03:46:15.963 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-01-28T03:46:15.966 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:16.013 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:16 +0000 (0:00:00.055) 0:01:40.128 ****** 2021-01-28T03:46:16.138 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-01-28T03:46:16.140 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-01-28T03:46:16.178 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:16 +0000 (0:00:00.165) 0:01:40.293 ****** 2021-01-28T03:46:16.207 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-01-28T03:46:16.251 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:16 +0000 (0:00:00.071) 0:01:40.365 ****** 2021-01-28T03:46:16.636 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-01-28T03:46:16.638 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-01-28T03:46:16.687 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:16 +0000 (0:00:00.437) 0:01:40.802 ****** 2021-01-28T03:46:16.732 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-01-28T03:46:16.776 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:16 +0000 (0:00:00.089) 0:01:40.892 ****** 2021-01-28T03:46:19.650 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-01-28T03:46:19.652 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.7.1)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.7.1)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-01-28T03:46:19.686 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:19 +0000 (0:00:02.909) 0:01:43.801 ****** 2021-01-28T03:46:19.693 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.7.1)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.7.1)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-01-28T03:46:19.733 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:19 +0000 (0:00:00.046) 0:01:43.848 ****** 2021-01-28T03:46:20.225 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* ok: [smithi100.front.sepia.ceph.com] => {"changed": false} 2021-01-28T03:46:20.261 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:20 +0000 (0:00:00.528) 0:01:44.377 ****** 2021-01-28T03:46:20.280 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"changed": false} 2021-01-28T03:46:20.325 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:20 +0000 (0:00:00.063) 0:01:44.440 ****** 2021-01-28T03:46:20.331 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-01-28T03:46:20.333 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-01-28T03:46:20.369 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:20 +0000 (0:00:00.044) 0:01:44.485 ****** 2021-01-28T03:46:20.378 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-01-28T03:46:20.433 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:20 +0000 (0:00:00.064) 0:01:44.549 ****** 2021-01-28T03:46:20.570 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-01-28T03:46:20.573 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1611805176.3590953, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1611805176.3550954, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 67510, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1611805176.3550954, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1828121574", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-01-28T03:46:20.612 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:20 +0000 (0:00:00.178) 0:01:44.727 ****** 2021-01-28T03:46:20.653 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1611805186.6806252, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1611805186.676625, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 67510, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1611805186.676625, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1828121574", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-01-28T03:46:20.692 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:20 +0000 (0:00:00.078) 0:01:44.806 ****** 2021-01-28T03:46:20.989 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-01-28T03:46:20.992 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "msg": ""} ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-01-28T03:46:21.044 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:21 +0000 (0:00:00.352) 0:01:45.159 ****** 2021-01-28T03:46:21.079 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:21 +0000 (0:00:00.035) 0:01:45.195 ****** 2021-01-28T03:46:21.088 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-01-28T03:46:21.090 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-01-28T03:46:21.125 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:21 +0000 (0:00:00.045) 0:01:45.240 ****** 2021-01-28T03:46:21.133 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-01-28T03:46:21.172 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:21 +0000 (0:00:00.047) 0:01:45.287 ****** 2021-01-28T03:46:21.178 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-01-28T03:46:21.180 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:21.219 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:21 +0000 (0:00:00.047) 0:01:45.334 ****** 2021-01-28T03:46:21.227 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:21.270 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:21 +0000 (0:00:00.050) 0:01:45.385 ****** 2021-01-28T03:46:21.419 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-01-28T03:46:21.421 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-01-28T03:46:21.459 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:21 +0000 (0:00:00.189) 0:01:45.574 ****** 2021-01-28T03:46:21.488 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-01-28T03:46:21.527 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:21 +0000 (0:00:00.068) 0:01:45.643 ****** 2021-01-28T03:46:21.675 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-01-28T03:46:21.677 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-01-28T03:46:21.713 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:21 +0000 (0:00:00.185) 0:01:45.828 ****** 2021-01-28T03:46:21.730 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-01-28T03:46:21.767 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:21 +0000 (0:00:00.054) 0:01:45.883 ****** 2021-01-28T03:46:21.781 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-01-28T03:46:21.783 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:21.819 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:21 +0000 (0:00:00.051) 0:01:45.934 ****** 2021-01-28T03:46:21.826 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:21.874 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:21 +0000 (0:00:00.055) 0:01:45.989 ****** 2021-01-28T03:46:21.881 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-01-28T03:46:21.883 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-01-28T03:46:21.896 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-01-28T03:46:21.941 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:21 +0000 (0:00:00.066) 0:01:46.056 ****** 2021-01-28T03:46:21.949 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2021-01-28T03:46:21.951 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-01-28T03:46:21.951 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-01-28T03:46:21.992 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:21 +0000 (0:00:00.051) 0:01:46.108 ****** 2021-01-28T03:46:22.001 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-01-28T03:46:22.003 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi100.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:22.015 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:22.016 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:22.059 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:22 +0000 (0:00:00.066) 0:01:46.174 ****** 2021-01-28T03:46:22.069 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:22.070 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:22.071 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:22.072 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi162.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:22.109 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:22 +0000 (0:00:00.050) 0:01:46.224 ****** 2021-01-28T03:46:22.116 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-28T03:46:22.117 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:22.159 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:22 +0000 (0:00:00.050) 0:01:46.275 ****** 2021-01-28T03:46:22.166 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:22.209 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:22 +0000 (0:00:00.049) 0:01:46.324 ****** 2021-01-28T03:46:22.217 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-01-28T03:46:22.225 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:22.263 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:22 +0000 (0:00:00.054) 0:01:46.378 ****** 2021-01-28T03:46:22.270 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:22.308 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:22 +0000 (0:00:00.045) 0:01:46.424 ****** 2021-01-28T03:46:22.315 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-01-28T03:46:22.317 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:22.355 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:22 +0000 (0:00:00.046) 0:01:46.470 ****** 2021-01-28T03:46:22.362 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:22.408 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:22 +0000 (0:00:00.052) 0:01:46.523 ****** 2021-01-28T03:46:22.415 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-01-28T03:46:22.417 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:22.455 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:22 +0000 (0:00:00.047) 0:01:46.571 ****** 2021-01-28T03:46:22.464 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:22.502 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:22 +0000 (0:00:00.047) 0:01:46.618 ****** 2021-01-28T03:46:22.508 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-01-28T03:46:22.510 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:22.548 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:22 +0000 (0:00:00.046) 0:01:46.664 ****** 2021-01-28T03:46:22.555 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:22.594 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:22 +0000 (0:00:00.045) 0:01:46.710 ****** 2021-01-28T03:46:22.601 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-01-28T03:46:22.603 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:22.641 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:22 +0000 (0:00:00.047) 0:01:46.757 ****** 2021-01-28T03:46:22.649 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:22.691 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:22 +0000 (0:00:00.049) 0:01:46.806 ****** 2021-01-28T03:46:22.698 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-01-28T03:46:22.700 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:22.739 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:22 +0000 (0:00:00.047) 0:01:46.854 ****** 2021-01-28T03:46:22.746 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:22.792 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:22 +0000 (0:00:00.052) 0:01:46.907 ****** 2021-01-28T03:46:22.801 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-01-28T03:46:22.803 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:22.856 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:22 +0000 (0:00:00.064) 0:01:46.971 ****** 2021-01-28T03:46:22.866 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:22.916 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:22 +0000 (0:00:00.060) 0:01:47.032 ****** 2021-01-28T03:46:23.191 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-01-28T03:46:23.193 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.011071", "end": "2021-01-28 03:46:23.322116", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-01-28 03:46:23.311045", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T03:46:23.218 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010930", "end": "2021-01-28 03:46:23.247623", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-01-28 03:46:23.236693", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T03:46:23.409 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.026576", "end": "2021-01-28 03:46:23.580000", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-01-28 03:46:23.553424", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T03:46:23.442 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.010623", "end": "2021-01-28 03:46:23.507196", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-01-28 03:46:23.496573", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T03:46:23.582 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005415", "end": "2021-01-28 03:46:23.753243", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-01-28 03:46:23.747828", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-01-28T03:46:23.650 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005403", "end": "2021-01-28 03:46:23.731253", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-01-28 03:46:23.725850", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-01-28T03:46:23.841 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.019191", "end": "2021-01-28 03:46:23.960429", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-01-28 03:46:23.941238", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T03:46:23.883 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:23 +0000 (0:00:00.967) 0:01:47.999 ****** 2021-01-28T03:46:23.891 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.016155", "end": "2021-01-28 03:46:23.947825", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-01-28 03:46:23.931670", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T03:46:23.932 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:23 +0000 (0:00:00.049) 0:01:48.048 ****** 2021-01-28T03:46:23.939 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-01-28T03:46:23.994 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:23 +0000 (0:00:00.057) 0:01:48.106 ****** 2021-01-28T03:46:24.054 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:24 +0000 (0:00:00.063) 0:01:48.169 ****** 2021-01-28T03:46:24.209 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-01-28T03:46:24.213 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-01-28T03:46:24.285 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-01-28T03:46:24.425 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-01-28T03:46:24.494 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:24 +0000 (0:00:00.435) 0:01:48.604 ****** 2021-01-28T03:46:24.532 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:24 +0000 (0:00:00.042) 0:01:48.647 ****** 2021-01-28T03:46:25.585 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi100.front.sepia.ceph.com] 2021-01-28T03:46:25.639 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] 2021-01-28T03:46:25.686 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:25 +0000 (0:00:01.154) 0:01:49.802 ****** 2021-01-28T03:46:25.730 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-28T03:46:25.731 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-01-28T03:46:25.773 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:25 +0000 (0:00:00.086) 0:01:49.888 ****** 2021-01-28T03:46:25.816 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:25 +0000 (0:00:00.043) 0:01:49.932 ****** 2021-01-28T03:46:25.823 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-28T03:46:25.825 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:25.868 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:25 +0000 (0:00:00.051) 0:01:49.983 ****** 2021-01-28T03:46:25.876 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-28T03:46:25.878 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-01-28T03:46:25.916 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:25 +0000 (0:00:00.048) 0:01:50.032 ****** 2021-01-28T03:46:25.924 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-01-28T03:46:25.926 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-01-28T03:46:25.963 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:25 +0000 (0:00:00.046) 0:01:50.078 ****** 2021-01-28T03:46:25.970 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-28T03:46:25.972 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:26.024 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:26 +0000 (0:00:00.061) 0:01:50.140 ****** 2021-01-28T03:46:26.074 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-01-28T03:46:26.076 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-01-28T03:46:26.115 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:26 +0000 (0:00:00.091) 0:01:50.231 ****** 2021-01-28T03:46:26.723 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-01-28T03:46:26.725 INFO:teuthology.task.ansible.out:ok: [smithi100.front.sepia.ceph.com] => {"cache_update_time": 1611805203, "cache_updated": false, "changed": false} 2021-01-28T03:46:26.769 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:26 +0000 (0:00:00.653) 0:01:50.885 ****** 2021-01-28T03:46:26.800 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-28T03:46:26.802 INFO:teuthology.task.ansible.out:skipping: [smithi100.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:26.839 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:26 +0000 (0:00:00.069) 0:01:50.955 ****** 2021-01-28T03:46:26.878 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-01-28T03:46:26.881 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"cache_update_time": 1611805262, "cache_updated": false, "changed": false} TASK [container-host : set_fact] *********************************************** ok: [smithi100.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-01-28T03:46:26.917 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:26 +0000 (0:00:00.077) 0:01:51.032 ****** 2021-01-28T03:46:26.957 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:26 +0000 (0:00:00.039) 0:01:51.072 ****** 2021-01-28T03:46:26.989 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-28T03:46:26.991 INFO:teuthology.task.ansible.out:skipping: [smithi162.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:46:27.031 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:27 +0000 (0:00:00.074) 0:01:51.146 ****** 2021-01-28T03:46:27.080 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-28T03:46:27.082 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-01-28T03:46:27.119 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:27 +0000 (0:00:00.088) 0:01:51.235 ****** 2021-01-28T03:46:27.152 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-01-28T03:46:27.153 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-01-28T03:46:27.317 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-01-28T03:46:27.360 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:27 +0000 (0:00:00.240) 0:01:51.475 ****** 2021-01-28T03:46:27.367 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-01-28T03:46:27.517 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-01-28T03:46:27.558 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:27 +0000 (0:00:00.198) 0:01:51.673 ****** 2021-01-28T03:46:27.874 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-01-28T03:46:27.876 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611805587.3994777-82999397460913/source", "state": "file", "uid": 0} 2021-01-28T03:46:28.034 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611805587.6061404-189411738972569/source", "state": "file", "uid": 0} 2021-01-28T03:46:28.277 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611805587.8832865-195030100574195/source", "state": "file", "uid": 0} 2021-01-28T03:46:28.321 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:28 +0000 (0:00:00.763) 0:01:52.437 ****** 2021-01-28T03:46:28.457 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611805588.0404382-170537454202130/source", "state": "file", "uid": 0} 2021-01-28T03:46:28.516 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:28 +0000 (0:00:00.194) 0:01:52.631 ****** 2021-01-28T03:46:33.159 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-ugrhvwg8\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-ugrhvwg8"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-ugrhvwg8\nCollecting docopt\n Downloading docopt-0.6.2.tar.gz (25 kB)\nCollecting toml\n Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)\nBuilding wheels for collected packages: registries-conf-ctl, docopt\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=5333 sha256=880d8e84bb3d211402bbb840cf4ea075f32fdf0e0a4eb080856ce38146ae4b48\n Stored in directory: /tmp/pip-ephem-wheel-cache-cmkkxcmr/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\n Building wheel for docopt (setup.py): started\n Building wheel for docopt (setup.py): finished with status 'done'\n Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=dfda94a5eade80563191805a54e9b46ba047118604f9275aafc488eed3018d2a\n Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c\nSuccessfully built registries-conf-ctl docopt\nInstalling collected packages: docopt, toml, registries-conf-ctl\nSuccessfully installed docopt-0.6.2 regi 2021-01-28T03:46:33.161 INFO:teuthology.task.ansible.out:stries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-ugrhvwg8", "Collecting docopt", " Downloading docopt-0.6.2.tar.gz (25 kB)", "Collecting toml", " Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)", "Building wheels for collected packages: registries-conf-ctl, docopt", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=5333 sha256=880d8e84bb3d211402bbb840cf4ea075f32fdf0e0a4eb080856ce38146ae4b48", " Stored in directory: /tmp/pip-ephem-wheel-cache-cmkkxcmr/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", " Building wheel for docopt (setup.py): started", " Building wheel for docopt (setup.py): finished with status 'done'", " Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=dfda94a5eade80563191805a54e9b46ba047118604f9275aafc488eed3018d2a", " Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c", "Successfully built registries-conf-ctl docopt", "Installing collected packages: docopt, toml, registries-conf-ctl", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-01-28T03:46:33.203 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:33 +0000 (0:00:04.687) 0:01:57.319 ****** 2021-01-28T03:46:33.416 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* ok: [smithi100.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-01-28T03:46:33.462 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:33 +0000 (0:00:00.258) 0:01:57.577 ****** 2021-01-28T03:46:33.469 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-01-28T03:46:33.471 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-da80qwe1\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-da80qwe1"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-da80qwe1\nCollecting docopt\n Downloading docopt-0.6.2.tar.gz (25 kB)\nCollecting toml\n Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)\nBuilding wheels for collected packages: registries-conf-ctl, docopt\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=5333 sha256=880d8e84bb3d211402bbb840cf4ea075f32fdf0e0a4eb080856ce38146ae4b48\n Stored in directory: /tmp/pip-ephem-wheel-cache-m1l7hr0q/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\n Building wheel for docopt (setup.py): started\n Building wheel for docopt (setup.py): finished with status 'done'\n Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=dfda94a5eade80563191805a54e9b46ba047118604f9275aafc488eed3018d2a\n Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c\nSuccessfully built registries-conf-ctl docopt\nInstalling collected packages: docopt, toml, registries-conf-ctl\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github. 2021-01-28T03:46:33.473 INFO:teuthology.task.ansible.out:com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-da80qwe1", "Collecting docopt", " Downloading docopt-0.6.2.tar.gz (25 kB)", "Collecting toml", " Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)", "Building wheels for collected packages: registries-conf-ctl, docopt", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=5333 sha256=880d8e84bb3d211402bbb840cf4ea075f32fdf0e0a4eb080856ce38146ae4b48", " Stored in directory: /tmp/pip-ephem-wheel-cache-m1l7hr0q/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", " Building wheel for docopt (setup.py): started", " Building wheel for docopt (setup.py): finished with status 'done'", " Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=dfda94a5eade80563191805a54e9b46ba047118604f9275aafc488eed3018d2a", " Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c", "Successfully built registries-conf-ctl docopt", "Installing collected packages: docopt, toml, registries-conf-ctl", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-01-28T03:46:33.514 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:33 +0000 (0:00:00.051) 0:01:57.629 ****** 2021-01-28T03:46:33.814 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-01-28T03:46:33.816 INFO:teuthology.task.ansible.out:ok: [smithi162.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-01-28T03:46:33.896 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:33 +0000 (0:00:00.382) 0:01:58.011 ****** 2021-01-28T03:46:34.330 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-01-28T03:46:34.332 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611805593.5084882-207432753596464/source", "state": "file", "uid": 0} 2021-01-28T03:46:34.377 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:34 +0000 (0:00:00.480) 0:01:58.492 ****** 2021-01-28T03:46:34.747 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-01-28T03:46:34.748 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.036987", "end": "2021-01-28 03:46:34.877438", "rc": 0, "start": "2021-01-28 03:46:34.840451", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T03:46:34.820 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:34 +0000 (0:00:00.442) 0:01:58.935 ****** 2021-01-28T03:46:34.831 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-01-28T03:46:34.833 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611805594.0527408-188342030044032/source", "state": "file", "uid": 0} 2021-01-28T03:46:34.876 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:34 +0000 (0:00:00.055) 0:01:58.991 ****** 2021-01-28T03:46:35.201 INFO:teuthology.task.ansible.out: 2021-01-28T03:46:35.203 INFO:teuthology.task.ansible.out:TASK [container-host : Add local docker.io registry mirror] ******************** changed: [smithi162.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.034649", "end": "2021-01-28 03:46:35.289089", "rc": 0, "start": "2021-01-28 03:46:35.254440", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T03:46:35.257 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:46:35 +0000 (0:00:00.378) 0:01:59.370 ****** 2021-01-28T03:46:38.602 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-01-28T03:46:38.604 INFO:teuthology.task.ansible.out:changed: [smithi100.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "systemd-journald.socket system.slice firewalld.service docker.socket network-online.target containerd.service sysinit.target basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-fir 2021-01-28T03:46:38.605 INFO:teuthology.task.ansible.out:ewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", 2021-01-28T03:46:38.607 INFO:teuthology.task.ansible.out:"LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127779", "LimitSIGPENDINGSoft": "127779", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", 2021-01-28T03:46:38.609 INFO:teuthology.task.ansible.out: "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice docker.socket", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-01-28 03:45:24 UTC", "StateChangeTimestampMonotonic": "118481219", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "containerd.service network-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-28T03:46:38.798 INFO:teuthology.task.ansible.out:changed: [smithi162.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "docker.socket sysinit.target containerd.service network-online.target firewalld.service basic.target system.slice systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-fir 2021-01-28T03:46:38.800 INFO:teuthology.task.ansible.out:ewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", 2021-01-28T03:46:38.802 INFO:teuthology.task.ansible.out:"LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127781", "LimitSIGPENDINGSoft": "127781", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", 2021-01-28T03:46:38.804 INFO:teuthology.task.ansible.out: "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice docker.socket sysinit.target", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-01-28 03:45:24 UTC", "StateChangeTimestampMonotonic": "102898202", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "containerd.service network-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-28T03:46:38.911 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-01-28T03:46:38.918 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-01-28T03:46:38.924 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** 2021-01-28T03:46:38.926 INFO:teuthology.task.ansible.out:skipping: no hosts matched PLAY RECAP ********************************************************************* smithi100.front.sepia.ceph.com : ok=121 changed=33 unreachable=0 failed=0 skipped=188 rescued=0 ignored=0 smithi162.front.sepia.ceph.com : ok=121 changed=33 unreachable=0 failed=0 skipped=188 rescued=0 ignored=0 Thursday 28 January 2021 03:46:38 +0000 (0:00:03.670) 0:02:03.041 ****** =============================================================================== 2021-01-28T03:46:38.927 INFO:teuthology.task.ansible.out:testnode : Ensure packages are not present. ---------------------------- 12.61s testnode : Install packages --------------------------------------------- 9.33s testnode : Zap all non-root disks --------------------------------------- 8.44s container-host : Install registries-conf-ctl ---------------------------- 4.69s container-host : Restart docker service --------------------------------- 3.67s common : Update apt cache ----------------------------------------------- 3.37s testnode : Install packages via pip ------------------------------------- 2.91s testnode : Install apt keys --------------------------------------------- 2.49s 2021-01-28T03:46:38.927 INFO:teuthology.task.ansible.out:Gathering Facts --------------------------------------------------------- 2.39s testnode : Create logical volume(s) ------------------------------------- 2.25s testnode : Update apt cache. -------------------------------------------- 2.09s testnode : Blow away lingering OSD data and FSIDs ----------------------- 1.81s testnode : Install python-pip on apt based systems. --------------------- 1.22s Gathering Facts --------------------------------------------------------- 1.15s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 0.97s testnode : List any leftover Ceph artifacts from previous jobs ---------- 0.97s common : Set the hardware clock ----------------------------------------- 0.93s 2021-01-28T03:46:38.927 INFO:teuthology.task.ansible.out:Gathering Facts --------------------------------------------------------- 0.92s ansibl 2021-01-28T03:46:38.929 INFO:teuthology.task.ansible.out:e-managed : Create the cephlab_sudo sudoers.d file. --------------- 0.90s common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/. --- 0.87s 2021-01-28T03:46:39.299 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi100.front.sepia.ceph.com'), Remote(name='ubuntu@smithi162.front.sepia.ceph.com')] 2021-01-28T03:46:39.300 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-28T03:46:39.301 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:46:39.349 DEBUG:teuthology.orchestra.run.smithi100:> true 2021-01-28T03:46:39.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-28T03:46:39.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:46:39.562 DEBUG:teuthology.orchestra.run.smithi162:> true 2021-01-28T03:46:39.727 INFO:teuthology.run_tasks:Running task clock... 2021-01-28T03:46:39.744 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-01-28T03:46:39.745 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-01-28T03:46:39.745 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-01-28T03:46:39.780 INFO:teuthology.orchestra.run.smithi100.stdout:28 Jan 03:46:39 ntpd[5459]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-01-28T03:46:39.780 INFO:teuthology.orchestra.run.smithi100.stdout:28 Jan 03:46:39 ntpd[5459]: Command line: ntpd -gq 2021-01-28T03:46:39.782 INFO:teuthology.orchestra.run.smithi100.stdout:28 Jan 03:46:39 ntpd[5459]: proto: precision = 0.238 usec (-22) 2021-01-28T03:46:39.782 INFO:teuthology.orchestra.run.smithi100.stdout:28 Jan 03:46:39 ntpd[5459]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-01-28T03:46:39.782 INFO:teuthology.orchestra.run.smithi100.stdout:28 Jan 03:46:39 ntpd[5459]: restrict ::: KOD does nothing without LIMITED. 2021-01-28T03:46:39.782 INFO:teuthology.orchestra.run.smithi100.stdout:28 Jan 03:46:39 ntpd[5459]: Listen and drop on 0 v6wildcard [::]:123 2021-01-28T03:46:39.783 INFO:teuthology.orchestra.run.smithi100.stdout:28 Jan 03:46:39 ntpd[5459]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-01-28T03:46:39.783 INFO:teuthology.orchestra.run.smithi100.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-01-28T03:46:39.783 INFO:teuthology.orchestra.run.smithi100.stderr:restrict ::: KOD does nothing without LIMITED. 2021-01-28T03:46:39.784 INFO:teuthology.orchestra.run.smithi100.stdout:28 Jan 03:46:39 ntpd[5459]: Listen normally on 2 lo 127.0.0.1:123 2021-01-28T03:46:39.784 INFO:teuthology.orchestra.run.smithi100.stdout:28 Jan 03:46:39 ntpd[5459]: Listen normally on 3 enp3s0f1 172.21.15.100:123 2021-01-28T03:46:39.784 INFO:teuthology.orchestra.run.smithi100.stdout:28 Jan 03:46:39 ntpd[5459]: Listen normally on 4 lo [::1]:123 2021-01-28T03:46:39.785 INFO:teuthology.orchestra.run.smithi100.stdout:28 Jan 03:46:39 ntpd[5459]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d733%5]:123 2021-01-28T03:46:39.785 INFO:teuthology.orchestra.run.smithi100.stdout:28 Jan 03:46:39 ntpd[5459]: Listening on routing socket on fd #22 for interface updates 2021-01-28T03:46:42.780 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:42 ntpd[5459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:42.781 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:42 ntpd[5459]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:42.781 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:42 ntpd[5459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:42.781 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:42 ntpd[5459]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:42.782 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:42 ntpd[5459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T03:46:42.782 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:42 ntpd[5459]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T03:46:43.781 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:43 ntpd[5459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:43.781 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:43 ntpd[5459]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:43.782 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:43 ntpd[5459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:43.782 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:43 ntpd[5459]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:43.782 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:43 ntpd[5459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:43.782 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:43 ntpd[5459]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:43.782 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:43 ntpd[5459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T03:46:43.783 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:43 ntpd[5459]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T03:46:43.783 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:43 ntpd[5459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:43.783 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:43 ntpd[5459]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:43.783 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:43 ntpd[5459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T03:46:43.784 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:43 ntpd[5459]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T03:46:44.781 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:44 ntpd[5459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:44.781 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:44 ntpd[5459]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:44.781 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:44 ntpd[5459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:44.781 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:44 ntpd[5459]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:44.782 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:44 ntpd[5459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:44.782 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:44 ntpd[5459]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:44.782 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:44 ntpd[5459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T03:46:44.782 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:44 ntpd[5459]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T03:46:44.783 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:44 ntpd[5459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:44.783 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:44 ntpd[5459]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:44.783 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:44 ntpd[5459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T03:46:44.784 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:44 ntpd[5459]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T03:46:45.781 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:45 ntpd[5459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:45.781 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:45 ntpd[5459]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:45.781 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:45 ntpd[5459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:45.782 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:45 ntpd[5459]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:45.782 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:45 ntpd[5459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:45.782 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:45 ntpd[5459]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:45.782 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:45 ntpd[5459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T03:46:45.783 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:45 ntpd[5459]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T03:46:45.783 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:45 ntpd[5459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:45.783 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:45 ntpd[5459]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:45.783 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:45 ntpd[5459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T03:46:45.783 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:45 ntpd[5459]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T03:46:46.780 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:46 ntpd[5459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:46.781 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:46 ntpd[5459]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:46.781 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:46 ntpd[5459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:46.781 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:46 ntpd[5459]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:46.781 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:46 ntpd[5459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:46.782 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:46 ntpd[5459]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:46.782 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:46 ntpd[5459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T03:46:46.782 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:46 ntpd[5459]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T03:46:46.782 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:46 ntpd[5459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:46.783 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:46 ntpd[5459]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:46.783 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:46 ntpd[5459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T03:46:46.783 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:46 ntpd[5459]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T03:46:47.781 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:47 ntpd[5459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:47.781 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:47 ntpd[5459]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:47.782 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:47 ntpd[5459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:47.782 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:47 ntpd[5459]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:47.782 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:47 ntpd[5459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:47.782 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:47 ntpd[5459]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:47.783 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:47 ntpd[5459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T03:46:47.783 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:47 ntpd[5459]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T03:46:47.783 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:47 ntpd[5459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:47.783 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:47 ntpd[5459]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:47.783 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:47 ntpd[5459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T03:46:47.784 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:47 ntpd[5459]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T03:46:48.781 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:48 ntpd[5459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:48.781 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:48 ntpd[5459]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:48.781 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:48 ntpd[5459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:48.782 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:48 ntpd[5459]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:48.782 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:48 ntpd[5459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:48.782 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:48 ntpd[5459]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:48.782 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:48 ntpd[5459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T03:46:48.782 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:48 ntpd[5459]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T03:46:48.783 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:48 ntpd[5459]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:48.783 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:48 ntpd[5459]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:48.783 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:48 ntpd[5459]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T03:46:48.783 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:48 ntpd[5459]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T03:46:48.783 INFO:teuthology.orchestra.run.smithi100.stderr:28 Jan 03:46:48 ntpd[5459]: can't open /var/log/ntpstats/loopstats.20210128: Permission denied 2021-01-28T03:46:48.784 INFO:teuthology.orchestra.run.smithi100.stdout:28 Jan 03:46:48 ntpd[5459]: ntpd: time set -0.201289 s 2021-01-28T03:46:48.784 INFO:teuthology.orchestra.run.smithi100.stdout:ntpd: time set -0.201289s 2021-01-28T03:46:48.865 INFO:teuthology.orchestra.run.smithi100.stdout: remote refid st t when poll reach delay offset jitter 2021-01-28T03:46:48.866 INFO:teuthology.orchestra.run.smithi100.stdout:============================================================================== 2021-01-28T03:46:48.866 INFO:teuthology.orchestra.run.smithi100.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-28T03:46:48.866 INFO:teuthology.orchestra.run.smithi100.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-28T03:46:48.867 INFO:teuthology.orchestra.run.smithi100.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-28T03:46:48.867 INFO:teuthology.orchestra.run.smithi100.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-28T03:46:48.868 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-01-28T03:46:48.868 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-01-28T03:46:48.901 INFO:teuthology.orchestra.run.smithi162.stdout:28 Jan 03:46:49 ntpd[5445]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-01-28T03:46:48.901 INFO:teuthology.orchestra.run.smithi162.stdout:28 Jan 03:46:49 ntpd[5445]: Command line: ntpd -gq 2021-01-28T03:46:48.902 INFO:teuthology.orchestra.run.smithi162.stdout:28 Jan 03:46:49 ntpd[5445]: proto: precision = 0.095 usec (-23) 2021-01-28T03:46:48.903 INFO:teuthology.orchestra.run.smithi162.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-01-28T03:46:48.904 INFO:teuthology.orchestra.run.smithi162.stderr:restrict ::: KOD does nothing without LIMITED. 2021-01-28T03:46:48.904 INFO:teuthology.orchestra.run.smithi162.stdout:28 Jan 03:46:49 ntpd[5445]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-01-28T03:46:48.904 INFO:teuthology.orchestra.run.smithi162.stdout:28 Jan 03:46:49 ntpd[5445]: restrict ::: KOD does nothing without LIMITED. 2021-01-28T03:46:48.905 INFO:teuthology.orchestra.run.smithi162.stdout:28 Jan 03:46:49 ntpd[5445]: Listen and drop on 0 v6wildcard [::]:123 2021-01-28T03:46:48.905 INFO:teuthology.orchestra.run.smithi162.stdout:28 Jan 03:46:49 ntpd[5445]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-01-28T03:46:48.905 INFO:teuthology.orchestra.run.smithi162.stdout:28 Jan 03:46:49 ntpd[5445]: Listen normally on 2 lo 127.0.0.1:123 2021-01-28T03:46:48.905 INFO:teuthology.orchestra.run.smithi162.stdout:28 Jan 03:46:49 ntpd[5445]: Listen normally on 3 enp3s0f1 172.21.15.162:123 2021-01-28T03:46:48.905 INFO:teuthology.orchestra.run.smithi162.stdout:28 Jan 03:46:49 ntpd[5445]: Listen normally on 4 lo [::1]:123 2021-01-28T03:46:48.906 INFO:teuthology.orchestra.run.smithi162.stdout:28 Jan 03:46:49 ntpd[5445]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f41%5]:123 2021-01-28T03:46:48.906 INFO:teuthology.orchestra.run.smithi162.stdout:28 Jan 03:46:49 ntpd[5445]: Listening on routing socket on fd #22 for interface updates 2021-01-28T03:46:50.903 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:51 ntpd[5445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:50.903 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:51 ntpd[5445]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:50.903 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:51 ntpd[5445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:50.904 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:51 ntpd[5445]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:50.904 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:51 ntpd[5445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:50.904 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:51 ntpd[5445]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:50.904 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:51 ntpd[5445]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T03:46:50.905 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:51 ntpd[5445]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T03:46:50.905 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:51 ntpd[5445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:50.905 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:51 ntpd[5445]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:50.905 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:51 ntpd[5445]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T03:46:50.905 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:51 ntpd[5445]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T03:46:51.902 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:52 ntpd[5445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:51.902 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:52 ntpd[5445]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:51.903 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:52 ntpd[5445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:51.903 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:52 ntpd[5445]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:51.903 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:52 ntpd[5445]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T03:46:51.903 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:52 ntpd[5445]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T03:46:52.903 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:53 ntpd[5445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:52.903 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:53 ntpd[5445]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:52.903 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:53 ntpd[5445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:52.903 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:53 ntpd[5445]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:52.904 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:53 ntpd[5445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:52.904 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:53 ntpd[5445]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:52.904 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:53 ntpd[5445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:52.904 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:53 ntpd[5445]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:52.904 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:53 ntpd[5445]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T03:46:52.905 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:53 ntpd[5445]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T03:46:52.905 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:53 ntpd[5445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:52.905 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:53 ntpd[5445]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:52.905 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:53 ntpd[5445]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T03:46:52.906 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:53 ntpd[5445]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T03:46:52.906 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:53 ntpd[5445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:52.906 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:53 ntpd[5445]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:52.906 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:53 ntpd[5445]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T03:46:52.907 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:53 ntpd[5445]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T03:46:53.902 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:54 ntpd[5445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:53.902 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:54 ntpd[5445]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:53.902 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:54 ntpd[5445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:53.902 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:54 ntpd[5445]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:53.903 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:54 ntpd[5445]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T03:46:53.903 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:54 ntpd[5445]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T03:46:54.904 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:55 ntpd[5445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:54.904 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:55 ntpd[5445]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:54.905 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:55 ntpd[5445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:54.905 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:55 ntpd[5445]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:54.906 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:55 ntpd[5445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:54.906 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:55 ntpd[5445]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:54.906 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:55 ntpd[5445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:54.907 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:55 ntpd[5445]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:54.907 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:55 ntpd[5445]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T03:46:54.908 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:55 ntpd[5445]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T03:46:54.908 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:55 ntpd[5445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:54.908 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:55 ntpd[5445]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:54.909 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:55 ntpd[5445]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T03:46:54.909 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:55 ntpd[5445]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T03:46:54.910 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:55 ntpd[5445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:54.910 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:55 ntpd[5445]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:54.911 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:55 ntpd[5445]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T03:46:54.911 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:55 ntpd[5445]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T03:46:55.902 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:56 ntpd[5445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:55.902 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:56 ntpd[5445]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:55.902 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:56 ntpd[5445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:55.902 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:56 ntpd[5445]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:55.903 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:56 ntpd[5445]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T03:46:55.903 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:56 ntpd[5445]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T03:46:56.902 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:57 ntpd[5445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:56.903 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:57 ntpd[5445]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:56.903 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:57 ntpd[5445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:56.903 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:57 ntpd[5445]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:56.903 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:57 ntpd[5445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:56.904 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:57 ntpd[5445]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:56.904 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:57 ntpd[5445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:56.904 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:57 ntpd[5445]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:56.904 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:57 ntpd[5445]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T03:46:56.904 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:57 ntpd[5445]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T03:46:56.905 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:57 ntpd[5445]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T03:46:56.905 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:57 ntpd[5445]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T03:46:56.905 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:57 ntpd[5445]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T03:46:56.905 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:57 ntpd[5445]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T03:46:56.905 INFO:teuthology.orchestra.run.smithi162.stderr:28 Jan 03:46:56 ntpd[5445]: can't open /var/log/ntpstats/loopstats.20210128: Permission denied 2021-01-28T03:46:56.906 INFO:teuthology.orchestra.run.smithi162.stdout:28 Jan 03:46:56 ntpd[5445]: ntpd: time set -0.121424 s 2021-01-28T03:46:56.906 INFO:teuthology.orchestra.run.smithi162.stdout:ntpd: time set -0.121424s 2021-01-28T03:46:56.982 INFO:teuthology.orchestra.run.smithi162.stdout: remote refid st t when poll reach delay offset jitter 2021-01-28T03:46:56.983 INFO:teuthology.orchestra.run.smithi162.stdout:============================================================================== 2021-01-28T03:46:56.983 INFO:teuthology.orchestra.run.smithi162.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-28T03:46:56.983 INFO:teuthology.orchestra.run.smithi162.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-28T03:46:56.984 INFO:teuthology.orchestra.run.smithi162.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-28T03:46:56.984 INFO:teuthology.orchestra.run.smithi162.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-28T03:46:56.985 INFO:teuthology.run_tasks:Running task install... 2021-01-28T03:46:56.997 DEBUG:teuthology.task.install:project ceph 2021-01-28T03:46:56.998 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '507028cb839c25d6666833702df6325fd8569096'}} 2021-01-28T03:46:56.998 DEBUG:teuthology.task.install:config {'sha1': '507028cb839c25d6666833702df6325fd8569096'} 2021-01-28T03:46:56.999 INFO:teuthology.task.install:Using flavor: basic 2021-01-28T03:46:57.007 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-01-28T03:46:57.007 INFO:teuthology.task.install:extra packages: [] 2021-01-28T03:46:57.008 DEBUG:teuthology.orchestra.run.smithi100:> sudo lsb_release -is 2021-01-28T03:46:57.067 INFO:teuthology.orchestra.run.smithi100.stdout:Ubuntu 2021-01-28T03:46:57.072 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-28T03:46:57.073 DEBUG:teuthology.orchestra.run.smithi162:> sudo lsb_release -is 2021-01-28T03:46:57.074 DEBUG:teuthology.orchestra.run.smithi100:> sudo apt-key list | grep Ceph 2021-01-28T03:46:57.118 INFO:teuthology.orchestra.run.smithi162.stdout:Ubuntu 2021-01-28T03:46:57.123 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-28T03:46:57.123 DEBUG:teuthology.orchestra.run.smithi162:> sudo apt-key list | grep Ceph 2021-01-28T03:46:57.188 INFO:teuthology.orchestra.run.smithi100.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-01-28T03:46:57.257 INFO:teuthology.orchestra.run.smithi100.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-01-28T03:46:57.258 INFO:teuthology.orchestra.run.smithi100.stdout:uid [ unknown] Ceph.com (release key) 2021-01-28T03:46:57.259 DEBUG:teuthology.orchestra.run.smithi100:> sudo lsb_release -is 2021-01-28T03:46:57.262 INFO:teuthology.orchestra.run.smithi162.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-01-28T03:46:57.321 INFO:teuthology.orchestra.run.smithi100.stdout:Ubuntu 2021-01-28T03:46:57.327 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-28T03:46:57.329 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2021-01-28T03:46:57.331 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=507028cb839c25d6666833702df6325fd8569096 2021-01-28T03:46:57.339 INFO:teuthology.orchestra.run.smithi162.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-01-28T03:46:57.339 INFO:teuthology.orchestra.run.smithi162.stdout:uid [ unknown] Ceph.com (release key) 2021-01-28T03:46:57.340 DEBUG:teuthology.orchestra.run.smithi162:> sudo lsb_release -is 2021-01-28T03:46:57.384 INFO:teuthology.orchestra.run.smithi162.stdout:Ubuntu 2021-01-28T03:46:57.390 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-28T03:46:57.392 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2021-01-28T03:46:57.392 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=507028cb839c25d6666833702df6325fd8569096 2021-01-28T03:46:57.517 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default/ 2021-01-28T03:46:57.518 INFO:teuthology.task.install.deb:Package version is 17.0.0-184-g507028cb-1focal 2021-01-28T03:46:57.562 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default/ 2021-01-28T03:46:57.563 INFO:teuthology.task.install.deb:Package version is 17.0.0-184-g507028cb-1focal 2021-01-28T03:46:57.657 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2021-01-28T03:46:57.658 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-01-28T03:46:57.690 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2021-01-28T03:46:57.691 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-01-28T03:46:57.708 DEBUG:teuthology.orchestra.run.smithi162:> sudo apt-get update 2021-01-28T03:46:57.710 DEBUG:teuthology.orchestra.run.smithi100:> sudo apt-get update 2021-01-28T03:46:57.872 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-01-28T03:46:57.872 INFO:teuthology.orchestra.run.smithi100.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-01-28T03:46:57.928 INFO:teuthology.orchestra.run.smithi162.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal InRelease 2021-01-28T03:46:57.928 INFO:teuthology.orchestra.run.smithi100.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal InRelease 2021-01-28T03:46:57.953 INFO:teuthology.orchestra.run.smithi162.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-01-28T03:46:57.954 INFO:teuthology.orchestra.run.smithi100.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-01-28T03:46:57.975 INFO:teuthology.orchestra.run.smithi100.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal InRelease 2021-01-28T03:46:57.975 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal InRelease 2021-01-28T03:46:57.978 INFO:teuthology.orchestra.run.smithi162.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal Release.gpg 2021-01-28T03:46:57.978 INFO:teuthology.orchestra.run.smithi100.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal Release.gpg 2021-01-28T03:46:58.006 INFO:teuthology.orchestra.run.smithi162.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 Packages [16.6 kB] 2021-01-28T03:46:58.008 INFO:teuthology.orchestra.run.smithi100.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 Packages [16.6 kB] 2021-01-28T03:46:58.044 INFO:teuthology.orchestra.run.smithi162.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main i386 Packages [3,097 B] 2021-01-28T03:46:58.048 INFO:teuthology.orchestra.run.smithi100.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main i386 Packages [3,097 B] 2021-01-28T03:46:58.053 INFO:teuthology.orchestra.run.smithi100.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-01-28T03:46:58.054 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-01-28T03:46:58.132 INFO:teuthology.orchestra.run.smithi100.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-01-28T03:46:58.133 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-01-28T03:46:58.508 INFO:teuthology.orchestra.run.smithi162.stdout:Fetched 27.3 kB in 1s (42.7 kB/s) 2021-01-28T03:46:58.511 INFO:teuthology.orchestra.run.smithi100.stdout:Fetched 27.3 kB in 1s (43.1 kB/s) 2021-01-28T03:46:59.217 INFO:teuthology.orchestra.run.smithi100.stdout:Reading package lists... 2021-01-28T03:46:59.227 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2021-01-28T03:46:59.239 DEBUG:teuthology.orchestra.run.smithi100:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-184-g507028cb-1focal cephadm=17.0.0-184-g507028cb-1focal ceph-mds=17.0.0-184-g507028cb-1focal ceph-mgr=17.0.0-184-g507028cb-1focal ceph-common=17.0.0-184-g507028cb-1focal ceph-fuse=17.0.0-184-g507028cb-1focal ceph-test=17.0.0-184-g507028cb-1focal radosgw=17.0.0-184-g507028cb-1focal python3-rados=17.0.0-184-g507028cb-1focal python3-rgw=17.0.0-184-g507028cb-1focal python3-cephfs=17.0.0-184-g507028cb-1focal python3-rbd=17.0.0-184-g507028cb-1focal libcephfs2=17.0.0-184-g507028cb-1focal libcephfs-dev=17.0.0-184-g507028cb-1focal librados2=17.0.0-184-g507028cb-1focal librbd1=17.0.0-184-g507028cb-1focal rbd-fuse=17.0.0-184-g507028cb-1focal 2021-01-28T03:46:59.249 DEBUG:teuthology.orchestra.run.smithi162:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-184-g507028cb-1focal cephadm=17.0.0-184-g507028cb-1focal ceph-mds=17.0.0-184-g507028cb-1focal ceph-mgr=17.0.0-184-g507028cb-1focal ceph-common=17.0.0-184-g507028cb-1focal ceph-fuse=17.0.0-184-g507028cb-1focal ceph-test=17.0.0-184-g507028cb-1focal radosgw=17.0.0-184-g507028cb-1focal python3-rados=17.0.0-184-g507028cb-1focal python3-rgw=17.0.0-184-g507028cb-1focal python3-cephfs=17.0.0-184-g507028cb-1focal python3-rbd=17.0.0-184-g507028cb-1focal libcephfs2=17.0.0-184-g507028cb-1focal libcephfs-dev=17.0.0-184-g507028cb-1focal librados2=17.0.0-184-g507028cb-1focal librbd1=17.0.0-184-g507028cb-1focal rbd-fuse=17.0.0-184-g507028cb-1focal 2021-01-28T03:46:59.302 INFO:teuthology.orchestra.run.smithi100.stdout:Reading package lists... 2021-01-28T03:46:59.316 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2021-01-28T03:46:59.453 INFO:teuthology.orchestra.run.smithi100.stdout:Building dependency tree... 2021-01-28T03:46:59.454 INFO:teuthology.orchestra.run.smithi100.stdout:Reading state information... 2021-01-28T03:46:59.466 INFO:teuthology.orchestra.run.smithi162.stdout:Building dependency tree... 2021-01-28T03:46:59.467 INFO:teuthology.orchestra.run.smithi162.stdout:Reading state information... 2021-01-28T03:46:59.586 INFO:teuthology.orchestra.run.smithi162.stdout:The following package was automatically installed and is no longer required: 2021-01-28T03:46:59.588 INFO:teuthology.orchestra.run.smithi162.stdout: libboost-iostreams1.71.0 2021-01-28T03:46:59.588 INFO:teuthology.orchestra.run.smithi162.stdout:Use 'sudo apt autoremove' to remove it. 2021-01-28T03:46:59.589 INFO:teuthology.orchestra.run.smithi162.stdout:The following additional packages will be installed: 2021-01-28T03:46:59.589 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2021-01-28T03:46:59.589 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mgr-rook ceph-mon ceph-osd jq 2021-01-28T03:46:59.589 INFO:teuthology.orchestra.run.smithi162.stdout: libjaeger libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-01-28T03:46:59.589 INFO:teuthology.orchestra.run.smithi162.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-01-28T03:46:59.590 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2 nvme-cli python-pastedeploy-tpl python3-atomicwrites python3-attr 2021-01-28T03:46:59.590 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt python3-bs4 python3-cachetools python3-ceph-argparse 2021-01-28T03:46:59.590 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common python3-cherrypy3 python3-decorator python3-google-auth 2021-01-28T03:46:59.590 INFO:teuthology.orchestra.run.smithi162.stdout: python3-html5lib python3-jinja2 python3-joblib python3-json-pointer 2021-01-28T03:46:59.590 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch python3-kubernetes python3-logutils python3-lxml 2021-01-28T03:46:59.591 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako python3-markupsafe python3-openssl python3-packaging 2021-01-28T03:46:59.591 INFO:teuthology.orchestra.run.smithi162.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-01-28T03:46:59.591 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-01-28T03:46:59.592 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-repoze.lru 2021-01-28T03:46:59.592 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2021-01-28T03:46:59.592 INFO:teuthology.orchestra.run.smithi162.stdout: python3-simplegeneric python3-singledispatch python3-sklearn 2021-01-28T03:46:59.592 INFO:teuthology.orchestra.run.smithi162.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-01-28T03:46:59.593 INFO:teuthology.orchestra.run.smithi162.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-01-28T03:46:59.593 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2021-01-28T03:46:59.594 INFO:teuthology.orchestra.run.smithi162.stdout:Suggested packages: 2021-01-28T03:46:59.594 INFO:teuthology.orchestra.run.smithi162.stdout: python3-influxdb python-attr-doc python3-genshi python-jinja2-doc 2021-01-28T03:46:59.594 INFO:teuthology.orchestra.run.smithi162.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-01-28T03:46:59.595 INFO:teuthology.orchestra.run.smithi162.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-01-28T03:46:59.595 INFO:teuthology.orchestra.run.smithi162.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-01-28T03:46:59.595 INFO:teuthology.orchestra.run.smithi162.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-01-28T03:46:59.596 INFO:teuthology.orchestra.run.smithi162.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-01-28T03:46:59.596 INFO:teuthology.orchestra.run.smithi162.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-01-28T03:46:59.596 INFO:teuthology.orchestra.run.smithi162.stdout:Recommended packages: 2021-01-28T03:46:59.596 INFO:teuthology.orchestra.run.smithi162.stdout: btrfs-tools 2021-01-28T03:46:59.598 INFO:teuthology.orchestra.run.smithi100.stdout:The following package was automatically installed and is no longer required: 2021-01-28T03:46:59.598 INFO:teuthology.orchestra.run.smithi100.stdout: libboost-iostreams1.71.0 2021-01-28T03:46:59.598 INFO:teuthology.orchestra.run.smithi100.stdout:Use 'sudo apt autoremove' to remove it. 2021-01-28T03:46:59.598 INFO:teuthology.orchestra.run.smithi100.stdout:The following additional packages will be installed: 2021-01-28T03:46:59.599 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2021-01-28T03:46:59.599 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mgr-rook ceph-mon ceph-osd jq 2021-01-28T03:46:59.599 INFO:teuthology.orchestra.run.smithi100.stdout: libjaeger libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-01-28T03:46:59.599 INFO:teuthology.orchestra.run.smithi100.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-01-28T03:46:59.599 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2 nvme-cli python-pastedeploy-tpl python3-atomicwrites python3-attr 2021-01-28T03:46:59.600 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt python3-bs4 python3-cachetools python3-ceph-argparse 2021-01-28T03:46:59.600 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common python3-cherrypy3 python3-decorator python3-google-auth 2021-01-28T03:46:59.600 INFO:teuthology.orchestra.run.smithi100.stdout: python3-html5lib python3-jinja2 python3-joblib python3-json-pointer 2021-01-28T03:46:59.600 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch python3-kubernetes python3-logutils python3-lxml 2021-01-28T03:46:59.600 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako python3-markupsafe python3-openssl python3-packaging 2021-01-28T03:46:59.601 INFO:teuthology.orchestra.run.smithi100.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-01-28T03:46:59.601 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-01-28T03:46:59.601 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-repoze.lru 2021-01-28T03:46:59.601 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2021-01-28T03:46:59.602 INFO:teuthology.orchestra.run.smithi100.stdout: python3-simplegeneric python3-singledispatch python3-sklearn 2021-01-28T03:46:59.602 INFO:teuthology.orchestra.run.smithi100.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-01-28T03:46:59.602 INFO:teuthology.orchestra.run.smithi100.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-01-28T03:46:59.603 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2021-01-28T03:46:59.603 INFO:teuthology.orchestra.run.smithi100.stdout:Suggested packages: 2021-01-28T03:46:59.603 INFO:teuthology.orchestra.run.smithi100.stdout: python3-influxdb python-attr-doc python3-genshi python-jinja2-doc 2021-01-28T03:46:59.603 INFO:teuthology.orchestra.run.smithi100.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-01-28T03:46:59.603 INFO:teuthology.orchestra.run.smithi100.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-01-28T03:46:59.604 INFO:teuthology.orchestra.run.smithi100.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-01-28T03:46:59.604 INFO:teuthology.orchestra.run.smithi100.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-01-28T03:46:59.604 INFO:teuthology.orchestra.run.smithi100.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-01-28T03:46:59.604 INFO:teuthology.orchestra.run.smithi100.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-01-28T03:46:59.605 INFO:teuthology.orchestra.run.smithi100.stdout:Recommended packages: 2021-01-28T03:46:59.605 INFO:teuthology.orchestra.run.smithi100.stdout: btrfs-tools 2021-01-28T03:46:59.677 INFO:teuthology.orchestra.run.smithi162.stdout:The following NEW packages will be installed: 2021-01-28T03:46:59.678 INFO:teuthology.orchestra.run.smithi162.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-01-28T03:46:59.678 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2021-01-28T03:46:59.679 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm jq 2021-01-28T03:46:59.679 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-dev libcephfs2 libjaeger libjq1 libjs-sphinxdoc libjs-underscore 2021-01-28T03:46:59.679 INFO:teuthology.orchestra.run.smithi162.stdout: liblbfgsb0 libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 2021-01-28T03:46:59.680 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1 librdkafka1 librgw2 nvme-cli python-pastedeploy-tpl 2021-01-28T03:46:59.680 INFO:teuthology.orchestra.run.smithi162.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-bs4 2021-01-28T03:46:59.681 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2021-01-28T03:46:59.681 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy3 python3-decorator python3-google-auth python3-html5lib 2021-01-28T03:46:59.681 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2021-01-28T03:46:59.682 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2021-01-28T03:46:59.682 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe python3-openssl python3-packaging python3-paste 2021-01-28T03:46:59.683 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pluggy 2021-01-28T03:46:59.683 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2021-01-28T03:46:59.683 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-rados 2021-01-28T03:46:59.684 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd python3-repoze.lru python3-requests-oauthlib python3-rgw 2021-01-28T03:46:59.684 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-01-28T03:46:59.685 INFO:teuthology.orchestra.run.smithi162.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-01-28T03:46:59.685 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-01-28T03:46:59.685 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug radosgw 2021-01-28T03:46:59.686 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse socat xmlstarlet 2021-01-28T03:46:59.688 INFO:teuthology.orchestra.run.smithi100.stdout:The following NEW packages will be installed: 2021-01-28T03:46:59.689 INFO:teuthology.orchestra.run.smithi100.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-01-28T03:46:59.689 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2021-01-28T03:46:59.690 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm jq 2021-01-28T03:46:59.690 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-dev libcephfs2 libjaeger libjq1 libjs-sphinxdoc libjs-underscore 2021-01-28T03:46:59.691 INFO:teuthology.orchestra.run.smithi100.stdout: liblbfgsb0 libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 2021-01-28T03:46:59.691 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1 librdkafka1 librgw2 nvme-cli python-pastedeploy-tpl 2021-01-28T03:46:59.691 INFO:teuthology.orchestra.run.smithi100.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-bs4 2021-01-28T03:46:59.692 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2021-01-28T03:46:59.692 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy3 python3-decorator python3-google-auth python3-html5lib 2021-01-28T03:46:59.693 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2021-01-28T03:46:59.693 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2021-01-28T03:46:59.693 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe python3-openssl python3-packaging python3-paste 2021-01-28T03:46:59.694 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pluggy 2021-01-28T03:46:59.694 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2021-01-28T03:46:59.695 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-rados 2021-01-28T03:46:59.695 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd python3-repoze.lru python3-requests-oauthlib python3-rgw 2021-01-28T03:46:59.695 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-01-28T03:46:59.696 INFO:teuthology.orchestra.run.smithi100.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-01-28T03:46:59.696 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-01-28T03:46:59.697 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug radosgw 2021-01-28T03:46:59.697 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse socat xmlstarlet 2021-01-28T03:46:59.698 INFO:teuthology.orchestra.run.smithi162.stdout:The following packages will be upgraded: 2021-01-28T03:46:59.698 INFO:teuthology.orchestra.run.smithi162.stdout: librados2 librbd1 2021-01-28T03:46:59.699 INFO:teuthology.orchestra.run.smithi100.stdout:The following packages will be upgraded: 2021-01-28T03:46:59.700 INFO:teuthology.orchestra.run.smithi100.stdout: librados2 librbd1 2021-01-28T03:46:59.818 INFO:teuthology.orchestra.run.smithi162.stdout:2 upgraded, 94 newly installed, 0 to remove and 19 not upgraded. 2021-01-28T03:46:59.818 INFO:teuthology.orchestra.run.smithi162.stdout:Need to get 169 MB of archives. 2021-01-28T03:46:59.819 INFO:teuthology.orchestra.run.smithi162.stdout:After this operation, 781 MB of additional disk space will be used. 2021-01-28T03:46:59.819 INFO:teuthology.orchestra.run.smithi162.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 libjaeger amd64 17.0.0-184-g507028cb-1focal [3,716 B] 2021-01-28T03:46:59.824 INFO:teuthology.orchestra.run.smithi100.stdout:2 upgraded, 94 newly installed, 0 to remove and 19 not upgraded. 2021-01-28T03:46:59.825 INFO:teuthology.orchestra.run.smithi100.stdout:Need to get 169 MB of archives. 2021-01-28T03:46:59.825 INFO:teuthology.orchestra.run.smithi100.stdout:After this operation, 781 MB of additional disk space will be used. 2021-01-28T03:46:59.825 INFO:teuthology.orchestra.run.smithi100.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 libjaeger amd64 17.0.0-184-g507028cb-1focal [3,716 B] 2021-01-28T03:46:59.861 INFO:teuthology.orchestra.run.smithi162.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-01-28T03:46:59.879 INFO:teuthology.orchestra.run.smithi100.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-01-28T03:46:59.904 INFO:teuthology.orchestra.run.smithi100.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.0.0-184-g507028cb-1focal [3,291 kB] 2021-01-28T03:46:59.904 INFO:teuthology.orchestra.run.smithi162.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.0.0-184-g507028cb-1focal [3,291 kB] 2021-01-28T03:47:00.171 INFO:teuthology.orchestra.run.smithi100.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.0.0-184-g507028cb-1focal [3,345 kB] 2021-01-28T03:47:00.180 INFO:teuthology.orchestra.run.smithi162.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.0.0-184-g507028cb-1focal [3,345 kB] 2021-01-28T03:47:00.215 INFO:teuthology.orchestra.run.smithi162.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-01-28T03:47:00.232 INFO:teuthology.orchestra.run.smithi162.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-01-28T03:47:00.233 INFO:teuthology.orchestra.run.smithi162.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-01-28T03:47:00.259 INFO:teuthology.orchestra.run.smithi100.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-01-28T03:47:00.267 INFO:teuthology.orchestra.run.smithi100.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-01-28T03:47:00.278 INFO:teuthology.orchestra.run.smithi100.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-01-28T03:47:00.366 INFO:teuthology.orchestra.run.smithi162.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-01-28T03:47:00.392 INFO:teuthology.orchestra.run.smithi162.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.0.0-184-g507028cb-1focal [705 kB] 2021-01-28T03:47:00.398 INFO:teuthology.orchestra.run.smithi162.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-01-28T03:47:00.399 INFO:teuthology.orchestra.run.smithi100.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.0.0-184-g507028cb-1focal [705 kB] 2021-01-28T03:47:00.404 INFO:teuthology.orchestra.run.smithi100.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-01-28T03:47:00.405 INFO:teuthology.orchestra.run.smithi162.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-01-28T03:47:00.412 INFO:teuthology.orchestra.run.smithi162.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-01-28T03:47:00.416 INFO:teuthology.orchestra.run.smithi162.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-01-28T03:47:00.440 INFO:teuthology.orchestra.run.smithi162.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-01-28T03:47:00.441 INFO:teuthology.orchestra.run.smithi100.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.0.0-184-g507028cb-1focal [409 kB] 2021-01-28T03:47:00.441 INFO:teuthology.orchestra.run.smithi100.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-01-28T03:47:00.443 INFO:teuthology.orchestra.run.smithi162.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-01-28T03:47:00.443 INFO:teuthology.orchestra.run.smithi162.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.0.0-184-g507028cb-1focal [409 kB] 2021-01-28T03:47:00.446 INFO:teuthology.orchestra.run.smithi162.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-01-28T03:47:00.449 INFO:teuthology.orchestra.run.smithi100.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-01-28T03:47:00.453 INFO:teuthology.orchestra.run.smithi162.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-01-28T03:47:00.454 INFO:teuthology.orchestra.run.smithi100.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-01-28T03:47:00.454 INFO:teuthology.orchestra.run.smithi162.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-01-28T03:47:00.458 INFO:teuthology.orchestra.run.smithi100.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-01-28T03:47:00.467 INFO:teuthology.orchestra.run.smithi162.stdout:Get:20 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.0.0-184-g507028cb-1focal [21.7 kB] 2021-01-28T03:47:00.467 INFO:teuthology.orchestra.run.smithi162.stdout:Get:21 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.0.0-184-g507028cb-1focal [197 kB] 2021-01-28T03:47:00.473 INFO:teuthology.orchestra.run.smithi100.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.0.0-184-g507028cb-1focal [21.7 kB] 2021-01-28T03:47:00.473 INFO:teuthology.orchestra.run.smithi100.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.0.0-184-g507028cb-1focal [197 kB] 2021-01-28T03:47:00.480 INFO:teuthology.orchestra.run.smithi100.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-01-28T03:47:00.481 INFO:teuthology.orchestra.run.smithi100.stdout:Get:18 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.0.0-184-g507028cb-1focal [29.4 kB] 2021-01-28T03:47:00.482 INFO:teuthology.orchestra.run.smithi100.stdout:Get:19 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.0.0-184-g507028cb-1focal [385 kB] 2021-01-28T03:47:00.483 INFO:teuthology.orchestra.run.smithi100.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-01-28T03:47:00.484 INFO:teuthology.orchestra.run.smithi100.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-01-28T03:47:00.485 INFO:teuthology.orchestra.run.smithi162.stdout:Get:22 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.0.0-184-g507028cb-1focal [29.4 kB] 2021-01-28T03:47:00.486 INFO:teuthology.orchestra.run.smithi162.stdout:Get:23 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.0.0-184-g507028cb-1focal [385 kB] 2021-01-28T03:47:00.491 INFO:teuthology.orchestra.run.smithi100.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-01-28T03:47:00.499 INFO:teuthology.orchestra.run.smithi162.stdout:Get:24 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.0.0-184-g507028cb-1focal [3,501 kB] 2021-01-28T03:47:00.502 INFO:teuthology.orchestra.run.smithi100.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-01-28T03:47:00.512 INFO:teuthology.orchestra.run.smithi100.stdout:Get:24 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.0.0-184-g507028cb-1focal [3,501 kB] 2021-01-28T03:47:00.530 INFO:teuthology.orchestra.run.smithi162.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-01-28T03:47:00.553 INFO:teuthology.orchestra.run.smithi162.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-01-28T03:47:00.554 INFO:teuthology.orchestra.run.smithi162.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-01-28T03:47:00.559 INFO:teuthology.orchestra.run.smithi162.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-01-28T03:47:00.564 INFO:teuthology.orchestra.run.smithi162.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-01-28T03:47:00.565 INFO:teuthology.orchestra.run.smithi162.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-01-28T03:47:00.573 INFO:teuthology.orchestra.run.smithi100.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-01-28T03:47:00.578 INFO:teuthology.orchestra.run.smithi100.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-01-28T03:47:00.580 INFO:teuthology.orchestra.run.smithi100.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-01-28T03:47:00.584 INFO:teuthology.orchestra.run.smithi100.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-01-28T03:47:00.588 INFO:teuthology.orchestra.run.smithi100.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-01-28T03:47:00.589 INFO:teuthology.orchestra.run.smithi100.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-01-28T03:47:00.592 INFO:teuthology.orchestra.run.smithi162.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-01-28T03:47:00.609 INFO:teuthology.orchestra.run.smithi162.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-01-28T03:47:00.610 INFO:teuthology.orchestra.run.smithi162.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-01-28T03:47:00.611 INFO:teuthology.orchestra.run.smithi162.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-01-28T03:47:00.615 INFO:teuthology.orchestra.run.smithi100.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-01-28T03:47:00.616 INFO:teuthology.orchestra.run.smithi100.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-01-28T03:47:00.616 INFO:teuthology.orchestra.run.smithi100.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-01-28T03:47:00.668 INFO:teuthology.orchestra.run.smithi100.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-01-28T03:47:00.671 INFO:teuthology.orchestra.run.smithi100.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-01-28T03:47:00.682 INFO:teuthology.orchestra.run.smithi100.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-01-28T03:47:00.687 INFO:teuthology.orchestra.run.smithi100.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-01-28T03:47:00.687 INFO:teuthology.orchestra.run.smithi162.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-01-28T03:47:00.692 INFO:teuthology.orchestra.run.smithi162.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-01-28T03:47:00.695 INFO:teuthology.orchestra.run.smithi162.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-01-28T03:47:00.695 INFO:teuthology.orchestra.run.smithi162.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-underscore all 1.9.1~dfsg-1 [98.6 kB] 2021-01-28T03:47:00.698 INFO:teuthology.orchestra.run.smithi162.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-01-28T03:47:00.700 INFO:teuthology.orchestra.run.smithi162.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-01-28T03:47:00.701 INFO:teuthology.orchestra.run.smithi162.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-01-28T03:47:00.746 INFO:teuthology.orchestra.run.smithi100.stdout:Get:38 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.0.0-184-g507028cb-1focal [116 kB] 2021-01-28T03:47:00.747 INFO:teuthology.orchestra.run.smithi100.stdout:Get:39 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.0.0-184-g507028cb-1focal [446 kB] 2021-01-28T03:47:00.748 INFO:teuthology.orchestra.run.smithi100.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-underscore all 1.9.1~dfsg-1 [98.6 kB] 2021-01-28T03:47:00.752 INFO:teuthology.orchestra.run.smithi100.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-01-28T03:47:00.757 INFO:teuthology.orchestra.run.smithi100.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-01-28T03:47:00.758 INFO:teuthology.orchestra.run.smithi162.stdout:Get:42 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.0.0-184-g507028cb-1focal [116 kB] 2021-01-28T03:47:00.760 INFO:teuthology.orchestra.run.smithi162.stdout:Get:43 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.0.0-184-g507028cb-1focal [446 kB] 2021-01-28T03:47:00.760 INFO:teuthology.orchestra.run.smithi100.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-01-28T03:47:00.761 INFO:teuthology.orchestra.run.smithi100.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-01-28T03:47:00.762 INFO:teuthology.orchestra.run.smithi100.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-01-28T03:47:00.765 INFO:teuthology.orchestra.run.smithi162.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-01-28T03:47:00.766 INFO:teuthology.orchestra.run.smithi162.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-01-28T03:47:00.773 INFO:teuthology.orchestra.run.smithi162.stdout:Get:46 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.0.0-184-g507028cb-1focal [22.0 MB] 2021-01-28T03:47:00.778 INFO:teuthology.orchestra.run.smithi100.stdout:Get:46 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.0.0-184-g507028cb-1focal [22.0 MB] 2021-01-28T03:47:01.098 INFO:teuthology.orchestra.run.smithi162.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-01-28T03:47:01.138 INFO:teuthology.orchestra.run.smithi162.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-01-28T03:47:01.140 INFO:teuthology.orchestra.run.smithi162.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-01-28T03:47:01.172 INFO:teuthology.orchestra.run.smithi100.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-01-28T03:47:01.194 INFO:teuthology.orchestra.run.smithi100.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-01-28T03:47:01.196 INFO:teuthology.orchestra.run.smithi100.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-01-28T03:47:01.196 INFO:teuthology.orchestra.run.smithi162.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-01-28T03:47:01.197 INFO:teuthology.orchestra.run.smithi162.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-01-28T03:47:01.197 INFO:teuthology.orchestra.run.smithi162.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-01-28T03:47:01.198 INFO:teuthology.orchestra.run.smithi162.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-01-28T03:47:01.199 INFO:teuthology.orchestra.run.smithi162.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-01-28T03:47:01.199 INFO:teuthology.orchestra.run.smithi162.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-01-28T03:47:01.199 INFO:teuthology.orchestra.run.smithi162.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-01-28T03:47:01.262 INFO:teuthology.orchestra.run.smithi162.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-01-28T03:47:01.272 INFO:teuthology.orchestra.run.smithi162.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-json-pointer all 2.0-0ubuntu1 [8,320 B] 2021-01-28T03:47:01.278 INFO:teuthology.orchestra.run.smithi100.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-01-28T03:47:01.279 INFO:teuthology.orchestra.run.smithi100.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-01-28T03:47:01.279 INFO:teuthology.orchestra.run.smithi100.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-01-28T03:47:01.281 INFO:teuthology.orchestra.run.smithi100.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-01-28T03:47:01.282 INFO:teuthology.orchestra.run.smithi100.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-01-28T03:47:01.283 INFO:teuthology.orchestra.run.smithi100.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-01-28T03:47:01.283 INFO:teuthology.orchestra.run.smithi100.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-01-28T03:47:01.337 INFO:teuthology.orchestra.run.smithi100.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-01-28T03:47:01.340 INFO:teuthology.orchestra.run.smithi162.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jsonpatch all 1.23-3 [12.0 kB] 2021-01-28T03:47:01.340 INFO:teuthology.orchestra.run.smithi162.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-01-28T03:47:01.342 INFO:teuthology.orchestra.run.smithi100.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-json-pointer all 2.0-0ubuntu1 [8,320 B] 2021-01-28T03:47:01.344 INFO:teuthology.orchestra.run.smithi162.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-01-28T03:47:01.347 INFO:teuthology.orchestra.run.smithi162.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-01-28T03:47:01.349 INFO:teuthology.orchestra.run.smithi162.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-01-28T03:47:01.353 INFO:teuthology.orchestra.run.smithi162.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-01-28T03:47:01.355 INFO:teuthology.orchestra.run.smithi162.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-01-28T03:47:01.358 INFO:teuthology.orchestra.run.smithi162.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-01-28T03:47:01.418 INFO:teuthology.orchestra.run.smithi100.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jsonpatch all 1.23-3 [12.0 kB] 2021-01-28T03:47:01.419 INFO:teuthology.orchestra.run.smithi162.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-01-28T03:47:01.419 INFO:teuthology.orchestra.run.smithi100.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-01-28T03:47:01.420 INFO:teuthology.orchestra.run.smithi162.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-01-28T03:47:01.422 INFO:teuthology.orchestra.run.smithi100.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-01-28T03:47:01.425 INFO:teuthology.orchestra.run.smithi100.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-01-28T03:47:01.427 INFO:teuthology.orchestra.run.smithi100.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-01-28T03:47:01.433 INFO:teuthology.orchestra.run.smithi100.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-01-28T03:47:01.435 INFO:teuthology.orchestra.run.smithi100.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-01-28T03:47:01.437 INFO:teuthology.orchestra.run.smithi100.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-01-28T03:47:01.497 INFO:teuthology.orchestra.run.smithi162.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-01-28T03:47:01.498 INFO:teuthology.orchestra.run.smithi162.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.2 [1,382 kB] 2021-01-28T03:47:01.499 INFO:teuthology.orchestra.run.smithi100.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-01-28T03:47:01.500 INFO:teuthology.orchestra.run.smithi100.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-01-28T03:47:01.519 INFO:teuthology.orchestra.run.smithi162.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-01-28T03:47:01.520 INFO:teuthology.orchestra.run.smithi162.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-01-28T03:47:01.521 INFO:teuthology.orchestra.run.smithi162.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-01-28T03:47:01.521 INFO:teuthology.orchestra.run.smithi162.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-01-28T03:47:01.522 INFO:teuthology.orchestra.run.smithi162.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2021-01-28T03:47:01.522 INFO:teuthology.orchestra.run.smithi162.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-01-28T03:47:01.575 INFO:teuthology.orchestra.run.smithi162.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-01-28T03:47:01.575 INFO:teuthology.orchestra.run.smithi162.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-01-28T03:47:01.580 INFO:teuthology.orchestra.run.smithi100.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-01-28T03:47:01.582 INFO:teuthology.orchestra.run.smithi100.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.2 [1,382 kB] 2021-01-28T03:47:01.600 INFO:teuthology.orchestra.run.smithi100.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-01-28T03:47:01.601 INFO:teuthology.orchestra.run.smithi100.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-01-28T03:47:01.601 INFO:teuthology.orchestra.run.smithi100.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-01-28T03:47:01.602 INFO:teuthology.orchestra.run.smithi100.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-01-28T03:47:01.602 INFO:teuthology.orchestra.run.smithi100.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2021-01-28T03:47:01.603 INFO:teuthology.orchestra.run.smithi100.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-01-28T03:47:01.661 INFO:teuthology.orchestra.run.smithi100.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-01-28T03:47:01.662 INFO:teuthology.orchestra.run.smithi100.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-01-28T03:47:02.761 INFO:teuthology.orchestra.run.smithi162.stdout:Get:79 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.0.0-184-g507028cb-1focal [5,866 kB] 2021-01-28T03:47:02.764 INFO:teuthology.orchestra.run.smithi100.stdout:Get:79 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.0.0-184-g507028cb-1focal [5,866 kB] 2021-01-28T03:47:03.049 INFO:teuthology.orchestra.run.smithi162.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.0.0-184-g507028cb-1focal [181 kB] 2021-01-28T03:47:03.065 INFO:teuthology.orchestra.run.smithi100.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.0.0-184-g507028cb-1focal [181 kB] 2021-01-28T03:47:03.070 INFO:teuthology.orchestra.run.smithi100.stdout:Get:81 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.0.0-184-g507028cb-1focal [1,460 kB] 2021-01-28T03:47:03.088 INFO:teuthology.orchestra.run.smithi162.stdout:Get:81 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.0.0-184-g507028cb-1focal [1,460 kB] 2021-01-28T03:47:03.156 INFO:teuthology.orchestra.run.smithi100.stdout:Get:82 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.0.0-184-g507028cb-1focal [6,916 kB] 2021-01-28T03:47:03.171 INFO:teuthology.orchestra.run.smithi162.stdout:Get:82 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.0.0-184-g507028cb-1focal [6,916 kB] 2021-01-28T03:47:03.639 INFO:teuthology.orchestra.run.smithi100.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.0.0-184-g507028cb-1focal [25.9 MB] 2021-01-28T03:47:03.646 INFO:teuthology.orchestra.run.smithi162.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.0.0-184-g507028cb-1focal [25.9 MB] 2021-01-28T03:47:05.606 INFO:teuthology.orchestra.run.smithi162.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.0.0-184-g507028cb-1focal [3,804 B] 2021-01-28T03:47:05.685 INFO:teuthology.orchestra.run.smithi162.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.0.0-184-g507028cb-1focal [808 kB] 2021-01-28T03:47:05.698 INFO:teuthology.orchestra.run.smithi162.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.0.0-184-g507028cb-1focal [2,304 kB] 2021-01-28T03:47:05.711 INFO:teuthology.orchestra.run.smithi100.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.0.0-184-g507028cb-1focal [3,804 B] 2021-01-28T03:47:05.712 INFO:teuthology.orchestra.run.smithi100.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.0.0-184-g507028cb-1focal [808 kB] 2021-01-28T03:47:05.724 INFO:teuthology.orchestra.run.smithi100.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.0.0-184-g507028cb-1focal [2,304 kB] 2021-01-28T03:47:05.849 INFO:teuthology.orchestra.run.smithi100.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.0.0-184-g507028cb-1focal [61.6 kB] 2021-01-28T03:47:05.850 INFO:teuthology.orchestra.run.smithi162.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.0.0-184-g507028cb-1focal [61.6 kB] 2021-01-28T03:47:05.853 INFO:teuthology.orchestra.run.smithi162.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.0.0-184-g507028cb-1focal [63.9 kB] 2021-01-28T03:47:05.854 INFO:teuthology.orchestra.run.smithi100.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.0.0-184-g507028cb-1focal [63.9 kB] 2021-01-28T03:47:05.857 INFO:teuthology.orchestra.run.smithi100.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.0.0-184-g507028cb-1focal [2,327 kB] 2021-01-28T03:47:05.858 INFO:teuthology.orchestra.run.smithi162.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.0.0-184-g507028cb-1focal [2,327 kB] 2021-01-28T03:47:05.986 INFO:teuthology.orchestra.run.smithi162.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.0.0-184-g507028cb-1focal [7,896 kB] 2021-01-28T03:47:06.048 INFO:teuthology.orchestra.run.smithi100.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.0.0-184-g507028cb-1focal [7,896 kB] 2021-01-28T03:47:06.430 INFO:teuthology.orchestra.run.smithi162.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.0.0-184-g507028cb-1focal [3,920 B] 2021-01-28T03:47:06.430 INFO:teuthology.orchestra.run.smithi162.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-rook all 17.0.0-184-g507028cb-1focal [22.6 kB] 2021-01-28T03:47:06.484 INFO:teuthology.orchestra.run.smithi162.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.0.0-184-g507028cb-1focal [48.1 MB] 2021-01-28T03:47:06.631 INFO:teuthology.orchestra.run.smithi100.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.0.0-184-g507028cb-1focal [3,920 B] 2021-01-28T03:47:06.631 INFO:teuthology.orchestra.run.smithi100.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-rook all 17.0.0-184-g507028cb-1focal [22.6 kB] 2021-01-28T03:47:06.685 INFO:teuthology.orchestra.run.smithi100.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.0.0-184-g507028cb-1focal [48.1 MB] 2021-01-28T03:47:16.575 INFO:teuthology.orchestra.run.smithi162.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.0.0-184-g507028cb-1focal [19.8 kB] 2021-01-28T03:47:16.576 INFO:teuthology.orchestra.run.smithi162.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.0.0-184-g507028cb-1focal [10.7 MB] 2021-01-28T03:47:16.876 INFO:teuthology.orchestra.run.smithi100.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.0.0-184-g507028cb-1focal [19.8 kB] 2021-01-28T03:47:16.877 INFO:teuthology.orchestra.run.smithi100.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.0.0-184-g507028cb-1focal [10.7 MB] 2021-01-28T03:47:17.044 INFO:teuthology.orchestra.run.smithi162.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.0.0-184-g507028cb-1focal [77.7 kB] 2021-01-28T03:47:17.233 INFO:teuthology.orchestra.run.smithi100.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.0.0-184-g507028cb-1focal [77.7 kB] 2021-01-28T03:47:17.656 INFO:teuthology.orchestra.run.smithi162.stdout:Fetched 169 MB in 17s (9,739 kB/s) 2021-01-28T03:47:17.733 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libjaeger. 2021-01-28T03:47:17.791 INFO:teuthology.orchestra.run.smithi162.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 150606 files and directories currently installed.) 2021-01-28T03:47:17.796 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../00-libjaeger_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:17.825 INFO:teuthology.orchestra.run.smithi100.stdout:Fetched 169 MB in 18s (9,641 kB/s) 2021-01-28T03:47:17.831 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libjaeger (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:17.924 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libjaeger. 2021-01-28T03:47:17.981 INFO:teuthology.orchestra.run.smithi100.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 150606 files and directories currently installed.) 2021-01-28T03:47:17.985 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../00-libjaeger_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:18.021 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libjaeger (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:18.184 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-01-28T03:47:18.200 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../01-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-01-28T03:47:18.267 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-01-28T03:47:18.360 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-01-28T03:47:18.377 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../01-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-01-28T03:47:18.476 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-01-28T03:47:18.605 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../02-librbd1_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:18.754 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking librbd1 (17.0.0-184-g507028cb-1focal) over (15.2.7-0ubuntu0.20.04.2) ... 2021-01-28T03:47:18.839 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../02-librbd1_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:18.963 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking librbd1 (17.0.0-184-g507028cb-1focal) over (15.2.7-0ubuntu0.20.04.2) ... 2021-01-28T03:47:19.402 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../03-librados2_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:19.558 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking librados2 (17.0.0-184-g507028cb-1focal) over (15.2.7-0ubuntu0.20.04.2) ... 2021-01-28T03:47:19.629 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../03-librados2_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:19.776 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking librados2 (17.0.0-184-g507028cb-1focal) over (15.2.7-0ubuntu0.20.04.2) ... 2021-01-28T03:47:20.238 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libcephfs2. 2021-01-28T03:47:20.253 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../04-libcephfs2_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:20.304 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libcephfs2 (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:20.422 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libcephfs2. 2021-01-28T03:47:20.442 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../04-libcephfs2_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:20.479 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libcephfs2 (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:20.631 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-rados. 2021-01-28T03:47:20.650 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../05-python3-rados_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:20.689 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-rados (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:20.774 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-rados. 2021-01-28T03:47:20.791 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../05-python3-rados_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:20.849 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-rados (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:21.018 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-01-28T03:47:21.036 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../06-python3-ceph-argparse_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-28T03:47:21.076 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-ceph-argparse (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:21.202 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-01-28T03:47:21.222 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../06-python3-ceph-argparse_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-28T03:47:21.260 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-ceph-argparse (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:21.294 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-cephfs. 2021-01-28T03:47:21.313 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../07-python3-cephfs_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:21.352 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-cephfs (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:21.537 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-cephfs. 2021-01-28T03:47:21.555 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../07-python3-cephfs_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:21.595 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-cephfs (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:21.705 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-ceph-common. 2021-01-28T03:47:21.723 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../08-python3-ceph-common_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-28T03:47:21.763 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-ceph-common (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:21.915 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-ceph-common. 2021-01-28T03:47:21.932 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../08-python3-ceph-common_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-28T03:47:21.973 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-ceph-common (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:22.057 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-prettytable. 2021-01-28T03:47:22.078 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../09-python3-prettytable_0.7.2-5_all.deb ... 2021-01-28T03:47:22.115 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-01-28T03:47:22.285 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-prettytable. 2021-01-28T03:47:22.305 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../09-python3-prettytable_0.7.2-5_all.deb ... 2021-01-28T03:47:22.368 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-01-28T03:47:22.410 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-rbd. 2021-01-28T03:47:22.427 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../10-python3-rbd_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:22.468 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-rbd (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:22.604 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-rbd. 2021-01-28T03:47:22.620 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../10-python3-rbd_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:22.678 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-rbd (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:22.796 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-01-28T03:47:22.815 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../11-librabbitmq4_0.10.0-1_amd64.deb ... 2021-01-28T03:47:22.854 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-01-28T03:47:23.081 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-01-28T03:47:23.099 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../11-librabbitmq4_0.10.0-1_amd64.deb ... 2021-01-28T03:47:23.139 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-01-28T03:47:23.207 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-01-28T03:47:23.225 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../12-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-01-28T03:47:23.265 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-01-28T03:47:23.468 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-01-28T03:47:23.484 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../12-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-01-28T03:47:23.526 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-01-28T03:47:23.609 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package librgw2. 2021-01-28T03:47:23.630 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../13-librgw2_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:23.692 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking librgw2 (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:23.912 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package librgw2. 2021-01-28T03:47:23.929 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../13-librgw2_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:23.970 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking librgw2 (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:24.262 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-rgw. 2021-01-28T03:47:24.282 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../14-python3-rgw_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:24.311 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-rgw (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:24.589 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-rgw. 2021-01-28T03:47:24.609 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../14-python3-rgw_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:24.647 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-rgw (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:24.648 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-01-28T03:47:24.664 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../15-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-01-28T03:47:24.706 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-01-28T03:47:24.967 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-01-28T03:47:24.985 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../15-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-01-28T03:47:25.017 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-01-28T03:47:25.079 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package liboath0. 2021-01-28T03:47:25.099 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../16-liboath0_2.6.1-1.3_amd64.deb ... 2021-01-28T03:47:25.142 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-01-28T03:47:25.420 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package liboath0. 2021-01-28T03:47:25.438 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../16-liboath0_2.6.1-1.3_amd64.deb ... 2021-01-28T03:47:25.453 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libradosstriper1. 2021-01-28T03:47:25.473 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../17-libradosstriper1_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:25.478 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-01-28T03:47:25.511 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libradosstriper1 (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:25.823 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libradosstriper1. 2021-01-28T03:47:25.839 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../17-libradosstriper1_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:25.881 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libradosstriper1 (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:25.956 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-common. 2021-01-28T03:47:25.975 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../18-ceph-common_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:26.014 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-common (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:26.351 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-common. 2021-01-28T03:47:26.370 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../18-ceph-common_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:26.401 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-common (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:28.144 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-base. 2021-01-28T03:47:28.163 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../19-ceph-base_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:28.204 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-base (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:28.723 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-base. 2021-01-28T03:47:28.740 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../19-ceph-base_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:28.792 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-base (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:29.143 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-openssl. 2021-01-28T03:47:29.159 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../20-python3-openssl_19.0.0-1build1_all.deb ... 2021-01-28T03:47:29.190 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-01-28T03:47:29.459 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-01-28T03:47:29.476 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../21-ceph-mgr-modules-core_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-28T03:47:29.859 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-modules-core (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:30.311 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-openssl. 2021-01-28T03:47:30.328 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../20-python3-openssl_19.0.0-1build1_all.deb ... 2021-01-28T03:47:30.385 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-01-28T03:47:30.539 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-bcrypt. 2021-01-28T03:47:30.558 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../22-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-01-28T03:47:30.597 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-01-28T03:47:30.680 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-01-28T03:47:30.699 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../21-ceph-mgr-modules-core_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-28T03:47:30.738 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-mgr-modules-core (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:30.925 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-cherrypy3. 2021-01-28T03:47:30.943 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../23-python3-cherrypy3_8.9.1-6_all.deb ... 2021-01-28T03:47:30.983 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-01-28T03:47:31.126 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-bcrypt. 2021-01-28T03:47:31.146 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../22-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-01-28T03:47:31.176 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-01-28T03:47:31.328 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-logutils. 2021-01-28T03:47:31.345 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../24-python3-logutils_0.3.3-7_all.deb ... 2021-01-28T03:47:31.395 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-01-28T03:47:31.470 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-cherrypy3. 2021-01-28T03:47:31.488 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../23-python3-cherrypy3_8.9.1-6_all.deb ... 2021-01-28T03:47:31.562 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-01-28T03:47:31.697 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-markupsafe. 2021-01-28T03:47:31.714 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../25-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-01-28T03:47:31.755 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-01-28T03:47:31.874 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-logutils. 2021-01-28T03:47:31.894 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../24-python3-logutils_0.3.3-7_all.deb ... 2021-01-28T03:47:31.923 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-01-28T03:47:32.067 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-mako. 2021-01-28T03:47:32.086 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../26-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-01-28T03:47:32.125 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-01-28T03:47:32.269 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-markupsafe. 2021-01-28T03:47:32.289 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../25-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-01-28T03:47:32.326 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-01-28T03:47:32.503 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-simplegeneric. 2021-01-28T03:47:32.520 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../27-python3-simplegeneric_0.8.1-3_all.deb ... 2021-01-28T03:47:32.569 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-01-28T03:47:32.679 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-mako. 2021-01-28T03:47:32.696 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../26-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-01-28T03:47:32.737 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-01-28T03:47:32.864 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-singledispatch. 2021-01-28T03:47:32.883 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../28-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-01-28T03:47:32.922 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-01-28T03:47:33.124 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-simplegeneric. 2021-01-28T03:47:33.142 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../27-python3-simplegeneric_0.8.1-3_all.deb ... 2021-01-28T03:47:33.182 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-01-28T03:47:33.216 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-webob. 2021-01-28T03:47:33.235 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../29-python3-webob_1%3a1.8.5-2_all.deb ... 2021-01-28T03:47:33.274 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-01-28T03:47:33.518 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-singledispatch. 2021-01-28T03:47:33.535 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../28-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-01-28T03:47:33.576 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-01-28T03:47:33.585 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-soupsieve. 2021-01-28T03:47:33.603 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../30-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-01-28T03:47:33.668 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-01-28T03:47:33.871 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-webob. 2021-01-28T03:47:33.890 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../29-python3-webob_1%3a1.8.5-2_all.deb ... 2021-01-28T03:47:33.920 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-01-28T03:47:33.974 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-bs4. 2021-01-28T03:47:33.991 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../31-python3-bs4_4.8.2-1_all.deb ... 2021-01-28T03:47:34.031 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-01-28T03:47:34.248 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-soupsieve. 2021-01-28T03:47:34.269 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../30-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-01-28T03:47:34.340 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-01-28T03:47:34.409 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-waitress. 2021-01-28T03:47:34.426 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../32-python3-waitress_1.4.1-1_all.deb ... 2021-01-28T03:47:34.471 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-01-28T03:47:34.685 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-bs4. 2021-01-28T03:47:34.701 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../31-python3-bs4_4.8.2-1_all.deb ... 2021-01-28T03:47:34.743 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-01-28T03:47:34.796 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-tempita. 2021-01-28T03:47:34.812 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../33-python3-tempita_0.5.2-6_all.deb ... 2021-01-28T03:47:34.854 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-01-28T03:47:35.071 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-waitress. 2021-01-28T03:47:35.087 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../32-python3-waitress_1.4.1-1_all.deb ... 2021-01-28T03:47:35.124 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-01-28T03:47:35.190 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-paste. 2021-01-28T03:47:35.208 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../34-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-01-28T03:47:35.248 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-01-28T03:47:35.432 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-tempita. 2021-01-28T03:47:35.449 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../33-python3-tempita_0.5.2-6_all.deb ... 2021-01-28T03:47:35.499 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-01-28T03:47:35.793 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-paste. 2021-01-28T03:47:35.810 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-01-28T03:47:35.811 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../34-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-01-28T03:47:35.827 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../35-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-01-28T03:47:35.860 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-01-28T03:47:35.867 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-01-28T03:47:36.172 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pastedeploy. 2021-01-28T03:47:36.180 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-01-28T03:47:36.187 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../36-python3-pastedeploy_2.1.0-1_all.deb ... 2021-01-28T03:47:36.197 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../35-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-01-28T03:47:36.228 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-01-28T03:47:36.229 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-01-28T03:47:36.536 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-pastedeploy. 2021-01-28T03:47:36.549 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-webtest. 2021-01-28T03:47:36.553 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../36-python3-pastedeploy_2.1.0-1_all.deb ... 2021-01-28T03:47:36.569 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../37-python3-webtest_2.0.32-2_all.deb ... 2021-01-28T03:47:36.590 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-01-28T03:47:36.606 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-01-28T03:47:36.909 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pecan. 2021-01-28T03:47:36.927 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-webtest. 2021-01-28T03:47:36.929 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../38-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-01-28T03:47:36.945 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../37-python3-webtest_2.0.32-2_all.deb ... 2021-01-28T03:47:36.967 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-01-28T03:47:37.007 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-01-28T03:47:37.339 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-werkzeug. 2021-01-28T03:47:37.355 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-pecan. 2021-01-28T03:47:37.356 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../39-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-01-28T03:47:37.372 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../38-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-01-28T03:47:37.397 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-01-28T03:47:37.413 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-01-28T03:47:37.750 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr. 2021-01-28T03:47:37.770 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../40-ceph-mgr_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:37.808 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:37.809 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-werkzeug. 2021-01-28T03:47:37.827 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../39-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-01-28T03:47:37.867 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-01-28T03:47:38.246 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-mgr. 2021-01-28T03:47:38.266 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../40-ceph-mgr_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:38.287 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mon. 2021-01-28T03:47:38.303 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../41-ceph-mon_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:38.320 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-mgr (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:38.344 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mon (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:38.824 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-mon. 2021-01-28T03:47:38.843 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../41-ceph-mon_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:38.907 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-mon (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:39.465 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-osd. 2021-01-28T03:47:39.481 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../42-ceph-osd_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:39.523 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-osd (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:40.286 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-osd. 2021-01-28T03:47:40.306 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../42-ceph-osd_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:40.352 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-osd (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:42.095 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph. 2021-01-28T03:47:42.114 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../43-ceph_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:42.177 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:42.506 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-fuse. 2021-01-28T03:47:42.523 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../44-ceph-fuse_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:42.563 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-fuse (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:42.967 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mds. 2021-01-28T03:47:42.984 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../45-ceph-mds_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:43.025 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mds (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:43.074 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph. 2021-01-28T03:47:43.091 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../43-ceph_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:43.132 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:43.502 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-fuse. 2021-01-28T03:47:43.519 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../44-ceph-fuse_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:43.559 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-fuse (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:43.578 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package cephadm. 2021-01-28T03:47:43.598 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../46-cephadm_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:43.636 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking cephadm (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:43.922 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-jinja2. 2021-01-28T03:47:43.940 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../47-python3-jinja2_2.10.1-2_all.deb ... 2021-01-28T03:47:43.971 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-mds. 2021-01-28T03:47:43.980 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-01-28T03:47:43.990 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../45-ceph-mds_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:44.058 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-mds (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:44.250 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-01-28T03:47:44.271 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../48-ceph-mgr-cephadm_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-28T03:47:44.316 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-cephadm (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:44.618 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package cephadm. 2021-01-28T03:47:44.636 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-repoze.lru. 2021-01-28T03:47:44.638 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../46-cephadm_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:44.658 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../49-python3-repoze.lru_0.7-2_all.deb ... 2021-01-28T03:47:44.682 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking cephadm (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:44.694 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-01-28T03:47:44.939 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libjs-underscore. 2021-01-28T03:47:44.956 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../50-libjs-underscore_1.9.1~dfsg-1_all.deb ... 2021-01-28T03:47:45.012 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-jinja2. 2021-01-28T03:47:45.025 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1) ... 2021-01-28T03:47:45.032 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../47-python3-jinja2_2.10.1-2_all.deb ... 2021-01-28T03:47:45.068 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-01-28T03:47:45.291 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-01-28T03:47:45.311 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../51-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-01-28T03:47:45.350 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-01-28T03:47:45.414 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-01-28T03:47:45.431 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../48-ceph-mgr-cephadm_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-28T03:47:45.471 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-mgr-cephadm (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:45.660 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-routes. 2021-01-28T03:47:45.677 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../52-python3-routes_2.4.1-2_all.deb ... 2021-01-28T03:47:45.726 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-01-28T03:47:45.826 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-repoze.lru. 2021-01-28T03:47:45.843 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../49-python3-repoze.lru_0.7-2_all.deb ... 2021-01-28T03:47:45.908 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-01-28T03:47:46.063 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-01-28T03:47:46.082 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../53-ceph-mgr-dashboard_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-28T03:47:46.121 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-dashboard (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:46.186 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libjs-underscore. 2021-01-28T03:47:46.203 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../50-libjs-underscore_1.9.1~dfsg-1_all.deb ... 2021-01-28T03:47:46.244 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1) ... 2021-01-28T03:47:46.538 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-01-28T03:47:46.556 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../51-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-01-28T03:47:46.588 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-01-28T03:47:46.907 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-routes. 2021-01-28T03:47:46.924 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../52-python3-routes_2.4.1-2_all.deb ... 2021-01-28T03:47:46.965 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-01-28T03:47:46.995 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-decorator. 2021-01-28T03:47:47.012 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../54-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-01-28T03:47:47.053 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-01-28T03:47:47.277 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-01-28T03:47:47.295 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../53-ceph-mgr-dashboard_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-28T03:47:47.335 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-mgr-dashboard (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:47.381 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-01-28T03:47:47.401 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../55-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-01-28T03:47:47.439 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-01-28T03:47:47.726 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-scipy. 2021-01-28T03:47:47.742 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../56-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-01-28T03:47:47.803 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-01-28T03:47:48.269 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-decorator. 2021-01-28T03:47:48.286 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../54-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-01-28T03:47:48.326 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-01-28T03:47:48.688 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-01-28T03:47:48.703 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../55-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-01-28T03:47:48.754 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-01-28T03:47:49.099 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-scipy. 2021-01-28T03:47:49.116 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../56-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-01-28T03:47:49.157 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-01-28T03:47:49.169 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-01-28T03:47:49.187 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../57-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-01-28T03:47:49.243 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-01-28T03:47:49.772 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-joblib. 2021-01-28T03:47:49.791 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../58-python3-joblib_0.14.0-3_all.deb ... 2021-01-28T03:47:49.830 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-01-28T03:47:50.175 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-sklearn. 2021-01-28T03:47:50.194 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../59-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-01-28T03:47:50.233 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-01-28T03:47:50.601 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-01-28T03:47:50.619 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../57-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-01-28T03:47:50.667 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-01-28T03:47:50.900 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-01-28T03:47:50.918 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../60-ceph-mgr-diskprediction-local_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-28T03:47:50.958 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-diskprediction-local (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:51.246 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-joblib. 2021-01-28T03:47:51.266 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../58-python3-joblib_0.14.0-3_all.deb ... 2021-01-28T03:47:51.304 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-01-28T03:47:51.724 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-sklearn. 2021-01-28T03:47:51.744 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../59-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-01-28T03:47:51.782 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-01-28T03:47:52.086 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-cachetools. 2021-01-28T03:47:52.106 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../61-python3-cachetools_4.0.0-1_all.deb ... 2021-01-28T03:47:52.144 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-01-28T03:47:52.456 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pyasn1. 2021-01-28T03:47:52.473 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../62-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-01-28T03:47:52.513 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-01-28T03:47:52.582 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-01-28T03:47:52.602 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../60-ceph-mgr-diskprediction-local_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-28T03:47:52.682 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-mgr-diskprediction-local (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:52.884 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-01-28T03:47:52.901 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../63-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-01-28T03:47:52.950 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-01-28T03:47:53.295 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-rsa. 2021-01-28T03:47:53.312 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../64-python3-rsa_4.0-3_all.deb ... 2021-01-28T03:47:53.361 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-rsa (4.0-3) ... 2021-01-28T03:47:53.689 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-google-auth. 2021-01-28T03:47:53.711 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../65-python3-google-auth_1.5.1-2_all.deb ... 2021-01-28T03:47:53.748 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-01-28T03:47:53.877 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-cachetools. 2021-01-28T03:47:53.895 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../61-python3-cachetools_4.0.0-1_all.deb ... 2021-01-28T03:47:53.935 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-01-28T03:47:54.067 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-01-28T03:47:54.084 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../66-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-01-28T03:47:54.150 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-01-28T03:47:54.272 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-pyasn1. 2021-01-28T03:47:54.290 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../62-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-01-28T03:47:54.329 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-01-28T03:47:54.445 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-websocket. 2021-01-28T03:47:54.461 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../67-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-01-28T03:47:54.503 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-01-28T03:47:54.674 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-01-28T03:47:54.694 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../63-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-01-28T03:47:54.757 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-01-28T03:47:54.814 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-kubernetes. 2021-01-28T03:47:54.832 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../68-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-01-28T03:47:54.881 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-01-28T03:47:55.077 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-rsa. 2021-01-28T03:47:55.095 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../64-python3-rsa_4.0-3_all.deb ... 2021-01-28T03:47:55.135 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-rsa (4.0-3) ... 2021-01-28T03:47:55.411 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-01-28T03:47:55.429 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../69-ceph-mgr-k8sevents_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-28T03:47:55.439 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-google-auth. 2021-01-28T03:47:55.456 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../65-python3-google-auth_1.5.1-2_all.deb ... 2021-01-28T03:47:55.468 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-k8sevents (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:55.497 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-01-28T03:47:55.821 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-json-pointer. 2021-01-28T03:47:55.840 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../70-python3-json-pointer_2.0-0ubuntu1_all.deb ... 2021-01-28T03:47:55.850 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-01-28T03:47:55.870 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../66-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-01-28T03:47:55.879 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-json-pointer (2.0-0ubuntu1) ... 2021-01-28T03:47:55.908 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-01-28T03:47:56.208 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-jsonpatch. 2021-01-28T03:47:56.227 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../71-python3-jsonpatch_1.23-3_all.deb ... 2021-01-28T03:47:56.253 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-websocket. 2021-01-28T03:47:56.270 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../67-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-01-28T03:47:56.297 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-jsonpatch (1.23-3) ... 2021-01-28T03:47:56.329 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-01-28T03:47:56.577 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-01-28T03:47:56.598 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../72-ceph-mgr-rook_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-28T03:47:56.635 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-rook (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:56.672 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-kubernetes. 2021-01-28T03:47:56.693 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../68-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-01-28T03:47:56.730 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-01-28T03:47:56.963 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libonig5:amd64. 2021-01-28T03:47:56.982 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../73-libonig5_6.9.4-1_amd64.deb ... 2021-01-28T03:47:57.021 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-01-28T03:47:57.327 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-01-28T03:47:57.346 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../69-ceph-mgr-k8sevents_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-28T03:47:57.393 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-mgr-k8sevents (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:57.399 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libjq1:amd64. 2021-01-28T03:47:57.419 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../74-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-01-28T03:47:57.465 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-01-28T03:47:57.738 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-json-pointer. 2021-01-28T03:47:57.755 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../70-python3-json-pointer_2.0-0ubuntu1_all.deb ... 2021-01-28T03:47:57.768 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package jq. 2021-01-28T03:47:57.787 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../75-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-01-28T03:47:57.796 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-json-pointer (2.0-0ubuntu1) ... 2021-01-28T03:47:57.826 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-01-28T03:47:58.079 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package socat. 2021-01-28T03:47:58.097 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../76-socat_1.7.3.3-2_amd64.deb ... 2021-01-28T03:47:58.146 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking socat (1.7.3.3-2) ... 2021-01-28T03:47:58.158 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-jsonpatch. 2021-01-28T03:47:58.178 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../71-python3-jsonpatch_1.23-3_all.deb ... 2021-01-28T03:47:58.215 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-jsonpatch (1.23-3) ... 2021-01-28T03:47:58.482 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package xmlstarlet. 2021-01-28T03:47:58.500 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../77-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-01-28T03:47:58.540 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-01-28T03:47:58.577 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-01-28T03:47:58.595 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../72-ceph-mgr-rook_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-28T03:47:58.635 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-mgr-rook (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:58.878 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-test. 2021-01-28T03:47:58.895 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../78-ceph-test_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:47:58.935 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-test (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:47:59.013 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libonig5:amd64. 2021-01-28T03:47:59.031 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../73-libonig5_6.9.4-1_amd64.deb ... 2021-01-28T03:47:59.071 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-01-28T03:47:59.483 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libjq1:amd64. 2021-01-28T03:47:59.500 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../74-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-01-28T03:47:59.541 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-01-28T03:47:59.836 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package jq. 2021-01-28T03:47:59.852 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../75-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-01-28T03:47:59.894 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-01-28T03:48:00.180 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package socat. 2021-01-28T03:48:00.200 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../76-socat_1.7.3.3-2_amd64.deb ... 2021-01-28T03:48:00.238 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking socat (1.7.3.3-2) ... 2021-01-28T03:48:00.583 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package xmlstarlet. 2021-01-28T03:48:00.602 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../77-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-01-28T03:48:00.649 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-01-28T03:48:01.047 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package ceph-test. 2021-01-28T03:48:01.066 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../78-ceph-test_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:48:01.105 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking ceph-test (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:03.106 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libcephfs-dev. 2021-01-28T03:48:03.123 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../79-libcephfs-dev_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:48:03.163 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libcephfs-dev (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:03.609 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package nvme-cli. 2021-01-28T03:48:03.626 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../80-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-01-28T03:48:03.684 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-01-28T03:48:04.240 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-atomicwrites. 2021-01-28T03:48:04.257 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../81-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-01-28T03:48:04.298 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-01-28T03:48:04.609 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-attr. 2021-01-28T03:48:04.627 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../82-python3-attr_19.3.0-2_all.deb ... 2021-01-28T03:48:04.667 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-01-28T03:48:05.011 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-webencodings. 2021-01-28T03:48:05.029 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../83-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-01-28T03:48:05.069 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-01-28T03:48:05.339 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-html5lib. 2021-01-28T03:48:05.358 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../84-python3-html5lib_1.0.1-2_all.deb ... 2021-01-28T03:48:05.389 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-01-28T03:48:05.392 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package libcephfs-dev. 2021-01-28T03:48:05.409 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../79-libcephfs-dev_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:48:05.475 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking libcephfs-dev (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:05.751 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-01-28T03:48:05.769 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../85-python3-lxml_4.5.0-1ubuntu0.2_amd64.deb ... 2021-01-28T03:48:05.808 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.2) ... 2021-01-28T03:48:05.862 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package nvme-cli. 2021-01-28T03:48:05.879 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../80-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-01-28T03:48:05.938 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-01-28T03:48:06.320 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-packaging. 2021-01-28T03:48:06.341 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../86-python3-packaging_20.3-1_all.deb ... 2021-01-28T03:48:06.476 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-atomicwrites. 2021-01-28T03:48:06.493 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../81-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-01-28T03:48:06.534 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-01-28T03:48:06.838 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-attr. 2021-01-28T03:48:06.853 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-packaging (20.3-1) ... 2021-01-28T03:48:06.855 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../82-python3-attr_19.3.0-2_all.deb ... 2021-01-28T03:48:06.899 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-01-28T03:48:07.173 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pastescript. 2021-01-28T03:48:07.193 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../87-python3-pastescript_2.0.2-4_all.deb ... 2021-01-28T03:48:07.215 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-webencodings. 2021-01-28T03:48:07.231 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-01-28T03:48:07.234 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../83-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-01-28T03:48:07.273 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-01-28T03:48:07.559 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pluggy. 2021-01-28T03:48:07.576 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../88-python3-pluggy_0.13.0-2_all.deb ... 2021-01-28T03:48:07.627 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-html5lib. 2021-01-28T03:48:07.634 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-01-28T03:48:07.645 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../84-python3-html5lib_1.0.1-2_all.deb ... 2021-01-28T03:48:07.684 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-01-28T03:48:07.937 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-psutil. 2021-01-28T03:48:07.958 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../89-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-01-28T03:48:07.995 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-01-28T03:48:08.055 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-01-28T03:48:08.073 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../85-python3-lxml_4.5.0-1ubuntu0.2_amd64.deb ... 2021-01-28T03:48:08.113 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.2) ... 2021-01-28T03:48:08.340 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-py. 2021-01-28T03:48:08.361 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../90-python3-py_1.8.1-1_all.deb ... 2021-01-28T03:48:08.398 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-py (1.8.1-1) ... 2021-01-28T03:48:08.625 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-packaging. 2021-01-28T03:48:08.643 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../86-python3-packaging_20.3-1_all.deb ... 2021-01-28T03:48:08.682 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-packaging (20.3-1) ... 2021-01-28T03:48:08.726 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pyinotify. 2021-01-28T03:48:08.743 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../91-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-01-28T03:48:08.784 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-01-28T03:48:09.019 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-pastescript. 2021-01-28T03:48:09.038 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../87-python3-pastescript_2.0.2-4_all.deb ... 2021-01-28T03:48:09.077 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-01-28T03:48:09.129 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-wcwidth. 2021-01-28T03:48:09.147 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../92-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-01-28T03:48:09.187 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-01-28T03:48:09.489 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-pluggy. 2021-01-28T03:48:09.490 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pytest. 2021-01-28T03:48:09.507 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../88-python3-pluggy_0.13.0-2_all.deb ... 2021-01-28T03:48:09.507 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../93-python3-pytest_4.6.9-1_all.deb ... 2021-01-28T03:48:09.547 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-01-28T03:48:09.548 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-01-28T03:48:09.885 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-psutil. 2021-01-28T03:48:09.905 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../89-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-01-28T03:48:09.942 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-01-28T03:48:10.027 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package radosgw. 2021-01-28T03:48:10.044 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../94-radosgw_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:48:10.086 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking radosgw (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:10.312 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-py. 2021-01-28T03:48:10.329 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../90-python3-py_1.8.1-1_all.deb ... 2021-01-28T03:48:10.386 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-py (1.8.1-1) ... 2021-01-28T03:48:10.732 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-pyinotify. 2021-01-28T03:48:10.753 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../91-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-01-28T03:48:10.798 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-01-28T03:48:11.239 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package rbd-fuse. 2021-01-28T03:48:11.257 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../95-rbd-fuse_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:48:11.296 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking rbd-fuse (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:11.601 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-attr (19.3.0-2) ... 2021-01-28T03:48:11.701 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-wcwidth. 2021-01-28T03:48:11.719 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../92-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-01-28T03:48:11.759 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-01-28T03:48:11.959 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-01-28T03:48:12.085 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-01-28T03:48:12.154 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package python3-pytest. 2021-01-28T03:48:12.174 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../93-python3-pytest_4.6.9-1_all.deb ... 2021-01-28T03:48:12.211 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-01-28T03:48:12.212 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-01-28T03:48:12.405 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up cephadm (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:12.675 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package radosgw. 2021-01-28T03:48:12.692 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../94-radosgw_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:48:12.757 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking radosgw (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:13.032 INFO:teuthology.orchestra.run.smithi162.stdout:Adding system user cephadm....done 2021-01-28T03:48:13.211 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-01-28T03:48:13.622 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-01-28T03:48:13.853 INFO:teuthology.orchestra.run.smithi100.stdout:Selecting previously unselected package rbd-fuse. 2021-01-28T03:48:13.870 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing to unpack .../95-rbd-fuse_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T03:48:13.905 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-01-28T03:48:13.934 INFO:teuthology.orchestra.run.smithi100.stdout:Unpacking rbd-fuse (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:14.064 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-py (1.8.1-1) ... 2021-01-28T03:48:14.240 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-attr (19.3.0-2) ... 2021-01-28T03:48:14.391 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-01-28T03:48:14.574 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-01-28T03:48:14.710 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-01-28T03:48:14.826 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-01-28T03:48:14.876 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-01-28T03:48:15.070 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up cephadm (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:15.102 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-01-28T03:48:15.420 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-01-28T03:48:15.688 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-01-28T03:48:15.756 INFO:teuthology.orchestra.run.smithi100.stdout:Adding system user cephadm....done 2021-01-28T03:48:15.926 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-01-28T03:48:15.980 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-ceph-argparse (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:16.281 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-01-28T03:48:16.344 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-01-28T03:48:16.407 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-01-28T03:48:16.654 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-01-28T03:48:16.708 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-01-28T03:48:16.805 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-py (1.8.1-1) ... 2021-01-28T03:48:17.026 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-01-28T03:48:17.148 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-01-28T03:48:17.413 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-01-28T03:48:17.566 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-01-28T03:48:17.714 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-01-28T03:48:17.900 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-01-28T03:48:18.015 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libjaeger (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:18.141 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-01-28T03:48:18.219 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-01-28T03:48:18.484 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-01-28T03:48:18.520 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-01-28T03:48:18.785 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-packaging (20.3-1) ... 2021-01-28T03:48:18.805 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-ceph-argparse (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:19.123 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-01-28T03:48:19.128 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-01-28T03:48:19.249 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-01-28T03:48:19.262 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-01-28T03:48:19.547 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-01-28T03:48:19.550 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-01-28T03:48:19.868 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-01-28T03:48:19.980 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-01-28T03:48:20.297 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-01-28T03:48:20.342 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up socat (1.7.3.3-2) ... 2021-01-28T03:48:20.468 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-ceph-common (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:20.612 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-01-28T03:48:20.769 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-01-28T03:48:20.938 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libjaeger (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:21.064 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-01-28T03:48:21.104 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-01-28T03:48:21.230 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-01-28T03:48:21.356 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-01-28T03:48:21.415 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-01-28T03:48:21.649 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-json-pointer (2.0-0ubuntu1) ... 2021-01-28T03:48:21.742 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-packaging (20.3-1) ... 2021-01-28T03:48:21.966 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.2) ... 2021-01-28T03:48:22.060 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-01-28T03:48:22.202 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-01-28T03:48:22.312 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-01-28T03:48:22.512 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-01-28T03:48:22.645 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-01-28T03:48:22.922 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-01-28T03:48:22.930 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-01-28T03:48:23.222 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-modules-core (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:23.290 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up socat (1.7.3.3-2) ... 2021-01-28T03:48:23.349 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-01-28T03:48:23.441 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-ceph-common (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:23.474 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-01-28T03:48:23.751 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-01-28T03:48:23.758 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-01-28T03:48:24.068 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-01-28T03:48:24.102 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-01-28T03:48:24.228 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-01-28T03:48:24.377 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-01-28T03:48:24.379 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-01-28T03:48:24.672 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-json-pointer (2.0-0ubuntu1) ... 2021-01-28T03:48:24.749 INFO:teuthology.orchestra.run.smithi162.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-01-28T03:48:24.965 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.2) ... 2021-01-28T03:48:25.030 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-01-28T03:48:25.156 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-01-28T03:48:25.308 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-01-28T03:48:25.482 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-01-28T03:48:25.626 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-01-28T03:48:25.808 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-01-28T03:48:25.919 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-01-28T03:48:26.193 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libjs-underscore (1.9.1~dfsg-1) ... 2021-01-28T03:48:26.229 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-mgr-modules-core (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:26.310 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-01-28T03:48:26.355 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-01-28T03:48:26.420 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-01-28T03:48:26.481 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-01-28T03:48:26.755 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up librados2 (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:26.782 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-01-28T03:48:26.881 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-01-28T03:48:27.116 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-01-28T03:48:27.435 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-01-28T03:48:27.782 INFO:teuthology.orchestra.run.smithi100.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-01-28T03:48:28.087 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-01-28T03:48:28.213 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-01-28T03:48:28.346 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up librgw2 (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:28.471 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-01-28T03:48:28.514 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-01-28T03:48:28.622 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-01-28T03:48:28.857 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-01-28T03:48:29.024 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-jsonpatch (1.23-3) ... 2021-01-28T03:48:29.114 INFO:teuthology.orchestra.run.smithi162.stdout:update-alternatives: using /usr/bin/jsonpatch-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2021-01-28T03:48:29.283 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libjs-underscore (1.9.1~dfsg-1) ... 2021-01-28T03:48:29.342 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-01-28T03:48:29.384 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-01-28T03:48:29.502 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-01-28T03:48:29.668 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-01-28T03:48:29.902 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up librados2 (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:29.994 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libcephfs2 (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:30.088 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-01-28T03:48:30.136 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libradosstriper1 (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:30.263 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-01-28T03:48:30.598 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-01-28T03:48:31.502 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up librgw2 (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:31.636 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-01-28T03:48:31.645 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up librbd1 (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:31.771 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-01-28T03:48:31.787 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-01-28T03:48:31.897 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-01-28T03:48:32.023 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-rsa (4.0-3) ... 2021-01-28T03:48:32.172 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-jsonpatch (1.23-3) ... 2021-01-28T03:48:32.268 INFO:teuthology.orchestra.run.smithi100.stdout:update-alternatives: using /usr/bin/jsonpatch-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2021-01-28T03:48:32.326 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-01-28T03:48:32.509 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-01-28T03:48:32.635 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-fuse (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:32.800 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-01-28T03:48:32.858 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-01-28T03:48:32.858 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-01-28T03:48:33.143 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libcephfs2 (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:33.294 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libradosstriper1 (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:33.344 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libcephfs-dev (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:33.420 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-01-28T03:48:33.462 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-01-28T03:48:33.763 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-01-28T03:48:33.779 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-01-28T03:48:34.115 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-rados (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:34.241 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-rbd (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:34.392 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up rbd-fuse (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:34.518 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-routes (2.4.1-2) ... 2021-01-28T03:48:34.828 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-01-28T03:48:34.851 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up librbd1 (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:34.978 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-01-28T03:48:35.121 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-rgw (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:35.139 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-01-28T03:48:35.247 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-cephfs (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:35.263 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-rsa (4.0-3) ... 2021-01-28T03:48:35.373 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-01-28T03:48:35.636 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-01-28T03:48:36.016 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-fuse (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:36.238 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-01-28T03:48:36.238 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-01-28T03:48:36.301 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-common (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:36.701 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up libcephfs-dev (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:36.801 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-01-28T03:48:36.956 INFO:teuthology.orchestra.run.smithi162.stdout:Adding group ceph....done 2021-01-28T03:48:37.178 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-01-28T03:48:37.555 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-rados (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:37.681 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-rbd (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:37.773 INFO:teuthology.orchestra.run.smithi162.stdout:Adding system user ceph....done 2021-01-28T03:48:37.832 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up rbd-fuse (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:37.950 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-routes (2.4.1-2) ... 2021-01-28T03:48:38.083 INFO:teuthology.orchestra.run.smithi162.stdout:Setting system user ceph properties....done 2021-01-28T03:48:38.234 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-01-28T03:48:38.255 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-01-28T03:48:38.528 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-rgw (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:38.582 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-01-28T03:48:38.654 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-cephfs (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:38.813 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-01-28T03:48:39.088 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-test (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:39.214 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up radosgw (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:39.512 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-01-28T03:48:39.512 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-01-28T03:48:39.724 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-common (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:40.233 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-base (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:40.388 INFO:teuthology.orchestra.run.smithi100.stdout:Adding group ceph....done 2021-01-28T03:48:40.566 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-01-28T03:48:40.789 INFO:teuthology.orchestra.run.smithi100.stdout:Adding system user ceph....done 2021-01-28T03:48:41.008 INFO:teuthology.orchestra.run.smithi100.stdout:Setting system user ceph properties....done 2021-01-28T03:48:41.076 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mds (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:41.226 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-01-28T03:48:41.301 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-01-28T03:48:41.302 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-01-28T03:48:41.554 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-01-28T03:48:41.786 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:42.005 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-01-28T03:48:42.005 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-01-28T03:48:42.045 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-test (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:42.283 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up radosgw (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:42.479 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-rook (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:42.630 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-osd (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:43.045 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-01-28T03:48:43.045 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-01-28T03:48:43.218 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-01-28T03:48:43.219 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-01-28T03:48:43.716 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-k8sevents (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:43.782 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-base (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:43.842 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-diskprediction-local (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:43.984 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mon (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:44.122 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-01-28T03:48:44.211 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-01-28T03:48:44.211 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-01-28T03:48:44.621 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-mds (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:44.703 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-cephadm (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:44.845 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:44.847 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-01-28T03:48:44.848 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-01-28T03:48:44.997 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-dashboard (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:45.140 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for systemd (245.4-4ubuntu3.4) ... 2021-01-28T03:48:45.328 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-mgr (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:45.474 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-01-28T03:48:45.550 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-01-28T03:48:45.551 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-01-28T03:48:46.028 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-mgr-rook (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:46.188 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-osd (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:46.756 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-01-28T03:48:46.757 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-01-28T03:48:47.223 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-mgr-k8sevents (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:47.373 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-mgr-diskprediction-local (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:47.517 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-mon (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:47.740 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-01-28T03:48:47.740 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-01-28T03:48:48.211 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-mgr-cephadm (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:48.387 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:48.513 INFO:teuthology.orchestra.run.smithi100.stdout:Setting up ceph-mgr-dashboard (17.0.0-184-g507028cb-1focal) ... 2021-01-28T03:48:48.577 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.1) ... 2021-01-28T03:48:48.682 INFO:teuthology.orchestra.run.smithi100.stdout:Processing triggers for systemd (245.4-4ubuntu3.4) ... 2021-01-28T03:48:48.988 INFO:teuthology.orchestra.run.smithi162.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-01-28T03:48:48.991 DEBUG:teuthology.parallel:result is None 2021-01-28T03:48:48.994 INFO:teuthology.orchestra.run.smithi100.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-01-28T03:48:59.295 INFO:teuthology.orchestra.run.smithi100.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.1) ... 2021-01-28T03:49:00.373 INFO:teuthology.orchestra.run.smithi100.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-01-28T03:49:00.394 DEBUG:teuthology.parallel:result is None 2021-01-28T03:49:00.395 DEBUG:teuthology.orchestra.run.smithi100:> sudo lsb_release -is 2021-01-28T03:49:00.462 INFO:teuthology.orchestra.run.smithi100.stdout:Ubuntu 2021-01-28T03:49:00.466 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-28T03:49:00.467 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=507028cb839c25d6666833702df6325fd8569096 2021-01-28T03:49:00.642 DEBUG:teuthology.orchestra.run.smithi100:> dpkg-query -W -f '${Version}' ceph 2021-01-28T03:49:00.667 INFO:teuthology.orchestra.run.smithi100.stdout:17.0.0-184-g507028cb-1focal 2021-01-28T03:49:00.668 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-184-g507028cb-1focal 2021-01-28T03:49:00.668 INFO:teuthology.task.install:The correct ceph version 17.0.0-184-g507028cb-1focal is installed. 2021-01-28T03:49:00.669 DEBUG:teuthology.orchestra.run.smithi162:> sudo lsb_release -is 2021-01-28T03:49:00.714 INFO:teuthology.orchestra.run.smithi162.stdout:Ubuntu 2021-01-28T03:49:00.718 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-28T03:49:00.719 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=507028cb839c25d6666833702df6325fd8569096 2021-01-28T03:49:00.882 DEBUG:teuthology.orchestra.run.smithi162:> dpkg-query -W -f '${Version}' ceph 2021-01-28T03:49:00.909 INFO:teuthology.orchestra.run.smithi162.stdout:17.0.0-184-g507028cb-1focal 2021-01-28T03:49:00.910 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-184-g507028cb-1focal 2021-01-28T03:49:00.910 INFO:teuthology.task.install:The correct ceph version 17.0.0-184-g507028cb-1focal is installed. 2021-01-28T03:49:00.911 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-01-28T03:49:00.913 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2021-01-28T03:49:00.914 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-01-28T03:49:00.930 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2021-01-28T03:49:00.931 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-01-28T03:49:00.965 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-01-28T03:49:00.966 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2021-01-28T03:49:00.967 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/daemon-helper 2021-01-28T03:49:00.980 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-01-28T03:49:01.034 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2021-01-28T03:49:01.035 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/daemon-helper 2021-01-28T03:49:01.051 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-01-28T03:49:01.061 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-01-28T03:49:01.062 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2021-01-28T03:49:01.063 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/adjust-ulimits 2021-01-28T03:49:01.079 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-01-28T03:49:01.094 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2021-01-28T03:49:01.095 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/adjust-ulimits 2021-01-28T03:49:01.111 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-01-28T03:49:01.169 INFO:teuthology.run_tasks:Running task cephadm... 2021-01-28T03:49:01.327 INFO:tasks.cephadm:Config: {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'client': {'debug ms': 1}, 'global': {'mon election default strategy': 3, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms type': 'async'}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'osd shutdown pgref assert': True}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '507028cb839c25d6666833702df6325fd8569096', 'cephadm_mode': 'root'} 2021-01-28T03:49:01.327 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 2021-01-28T03:49:01.329 INFO:tasks.cephadm:Cluster fsid is c217df96-611b-11eb-8f9e-001a4aab830c 2021-01-28T03:49:01.329 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2021-01-28T03:49:01.330 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.100', 'mon.c': '[v2:172.21.15.100:3301,v1:172.21.15.100:6790]', 'mon.b': '172.21.15.162'} 2021-01-28T03:49:01.330 INFO:tasks.cephadm:First mon is mon.a on smithi100 2021-01-28T03:49:01.330 INFO:tasks.cephadm:First mgr is y 2021-01-28T03:49:01.331 INFO:tasks.cephadm:Normalizing hostnames... 2021-01-28T03:49:01.331 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname $(hostname -s) 2021-01-28T03:49:01.353 DEBUG:teuthology.orchestra.run.smithi162:> sudo hostname $(hostname -s) 2021-01-28T03:49:01.369 INFO:tasks.cephadm:Downloading cephadm (repo git://git.ceph.com/ceph-ci.git ref 507028cb839c25d6666833702df6325fd8569096)... 2021-01-28T03:49:01.370 DEBUG:teuthology.orchestra.run.smithi100:> git archive --remote=git://git.ceph.com/ceph-ci.git 507028cb839c25d6666833702df6325fd8569096 src/cephadm/cephadm | tar -xO src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm 2021-01-28T03:49:01.498 DEBUG:teuthology.orchestra.run.smithi162:> git archive --remote=git://git.ceph.com/ceph-ci.git 507028cb839c25d6666833702df6325fd8569096 src/cephadm/cephadm | tar -xO src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm 2021-01-28T03:49:01.624 DEBUG:teuthology.orchestra.run.smithi100:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2021-01-28T03:49:01.633 DEBUG:teuthology.orchestra.run.smithi162:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2021-01-28T03:49:01.683 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /etc/ceph 2021-01-28T03:49:01.703 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /etc/ceph 2021-01-28T03:49:01.718 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 777 /etc/ceph 2021-01-28T03:49:01.762 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 777 /etc/ceph 2021-01-28T03:49:01.777 INFO:tasks.cephadm:Adding local image mirror docker-mirror.front.sepia.ceph.com:5000 2021-01-28T03:49:01.777 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2021-01-28T03:49:01.778 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/containers/registries.conf of=/dev/stdout 2021-01-28T03:49:01.784 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-28T03:49:01.785 INFO:tasks.cephadm:Failed to add mirror: [Errno 2] Cannot find file on the remote 'ubuntu@smithi100.front.sepia.ceph.com': '/etc/containers/registries.conf' 2021-01-28T03:49:01.785 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2021-01-28T03:49:01.786 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/etc/containers/registries.conf of=/dev/stdout 2021-01-28T03:49:01.792 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-28T03:49:01.793 INFO:tasks.cephadm:Failed to add mirror: [Errno 2] Cannot find file on the remote 'ubuntu@smithi162.front.sepia.ceph.com': '/etc/containers/registries.conf' 2021-01-28T03:49:01.794 INFO:tasks.cephadm:Writing seed config... 2021-01-28T03:49:01.796 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2021-01-28T03:49:01.797 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2021-01-28T03:49:01.797 INFO:tasks.cephadm: override: [client] debug ms = 1 2021-01-28T03:49:01.798 INFO:tasks.cephadm: override: [global] mon election default strategy = 3 2021-01-28T03:49:01.798 INFO:tasks.cephadm: override: [global] ms bind msgr1 = False 2021-01-28T03:49:01.799 INFO:tasks.cephadm: override: [global] ms bind msgr2 = True 2021-01-28T03:49:01.799 INFO:tasks.cephadm: override: [global] ms type = async 2021-01-28T03:49:01.799 INFO:tasks.cephadm: override: [mon] debug mon = 20 2021-01-28T03:49:01.800 INFO:tasks.cephadm: override: [mon] debug ms = 1 2021-01-28T03:49:01.800 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2021-01-28T03:49:01.800 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2021-01-28T03:49:01.801 INFO:tasks.cephadm: override: [osd] debug filestore = 20 2021-01-28T03:49:01.801 INFO:tasks.cephadm: override: [osd] debug journal = 20 2021-01-28T03:49:01.801 INFO:tasks.cephadm: override: [osd] debug ms = 20 2021-01-28T03:49:01.802 INFO:tasks.cephadm: override: [osd] debug osd = 25 2021-01-28T03:49:01.802 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2021-01-28T03:49:01.803 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2021-01-28T03:49:01.804 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2021-01-28T03:49:01.831 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = c217df96-611b-11eb-8f9e-001a4aab830c mon election default strategy = 3 ms bind msgr1 = False ms bind msgr2 = True ms type = async [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug filestore = 20 debug journal = 20 debug ms = 20 debug osd = 25 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 debug mon = 20 debug ms = 1 debug paxos = 20 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] debug ms = 1 2021-01-28T03:49:01.832 DEBUG:teuthology.orchestra.run.smithi100:mon.a> sudo journalctl -f -n 0 -u ceph-c217df96-611b-11eb-8f9e-001a4aab830c@mon.a.service 2021-01-28T03:49:01.835 DEBUG:teuthology.orchestra.run.smithi100:mgr.y> sudo journalctl -f -n 0 -u ceph-c217df96-611b-11eb-8f9e-001a4aab830c@mgr.y.service 2021-01-28T03:49:01.838 INFO:tasks.cephadm:Bootstrapping... 2021-01-28T03:49:01.839 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -v bootstrap --fsid c217df96-611b-11eb-8f9e-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.100 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2021-01-28T03:49:01.886 INFO:journalctl@ceph.mon.a.smithi100.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T03:49:01.892 INFO:journalctl@ceph.mgr.y.smithi100.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T03:49:02.130 INFO:teuthology.orchestra.run.smithi100.stderr:Could not locate podman: podman not found 2021-01-28T03:49:02.131 INFO:teuthology.orchestra.run.smithi100.stderr:Verifying podman|docker is present... 2021-01-28T03:49:02.131 INFO:teuthology.orchestra.run.smithi100.stderr:Verifying lvm2 is present... 2021-01-28T03:49:02.132 INFO:teuthology.orchestra.run.smithi100.stderr:Verifying time synchronization is in place... 2021-01-28T03:49:02.132 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: systemctl is-enabled chrony.service 2021-01-28T03:49:02.138 INFO:teuthology.orchestra.run.smithi100.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2021-01-28T03:49:02.139 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: systemctl is-active chrony.service 2021-01-28T03:49:02.145 INFO:teuthology.orchestra.run.smithi100.stderr:systemctl: inactive 2021-01-28T03:49:02.146 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: systemctl is-enabled chronyd.service 2021-01-28T03:49:02.152 INFO:teuthology.orchestra.run.smithi100.stderr:systemctl: Failed to get unit file state for chronyd.service: No such file or directory 2021-01-28T03:49:02.153 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: systemctl is-active chronyd.service 2021-01-28T03:49:02.160 INFO:teuthology.orchestra.run.smithi100.stderr:systemctl: inactive 2021-01-28T03:49:02.162 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: systemctl is-enabled systemd-timesyncd.service 2021-01-28T03:49:02.166 INFO:teuthology.orchestra.run.smithi100.stderr:systemctl: masked 2021-01-28T03:49:02.167 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: systemctl is-active systemd-timesyncd.service 2021-01-28T03:49:02.180 INFO:teuthology.orchestra.run.smithi100.stderr:systemctl: inactive 2021-01-28T03:49:02.180 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: systemctl is-enabled ntpd.service 2021-01-28T03:49:02.181 INFO:teuthology.orchestra.run.smithi100.stderr:systemctl: Failed to get unit file state for ntpd.service: No such file or directory 2021-01-28T03:49:02.181 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: systemctl is-active ntpd.service 2021-01-28T03:49:02.183 INFO:teuthology.orchestra.run.smithi100.stderr:systemctl: inactive 2021-01-28T03:49:02.183 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: systemctl is-enabled ntp.service 2021-01-28T03:49:02.190 INFO:teuthology.orchestra.run.smithi100.stderr:systemctl: enabled 2021-01-28T03:49:02.191 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: systemctl is-active ntp.service 2021-01-28T03:49:02.196 INFO:teuthology.orchestra.run.smithi100.stderr:systemctl: active 2021-01-28T03:49:02.198 INFO:teuthology.orchestra.run.smithi100.stderr:Unit ntp.service is enabled and running 2021-01-28T03:49:02.198 INFO:teuthology.orchestra.run.smithi100.stderr:Repeating the final host check... 2021-01-28T03:49:02.198 INFO:teuthology.orchestra.run.smithi100.stderr:podman|docker (/usr/bin/docker) is present 2021-01-28T03:49:02.198 INFO:teuthology.orchestra.run.smithi100.stderr:systemctl is present 2021-01-28T03:49:02.199 INFO:teuthology.orchestra.run.smithi100.stderr:lvcreate is present 2021-01-28T03:49:02.199 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: systemctl is-enabled chrony.service 2021-01-28T03:49:02.204 INFO:teuthology.orchestra.run.smithi100.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2021-01-28T03:49:02.205 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: systemctl is-active chrony.service 2021-01-28T03:49:02.210 INFO:teuthology.orchestra.run.smithi100.stderr:systemctl: inactive 2021-01-28T03:49:02.211 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: systemctl is-enabled chronyd.service 2021-01-28T03:49:02.217 INFO:teuthology.orchestra.run.smithi100.stderr:systemctl: Failed to get unit file state for chronyd.service: No such file or directory 2021-01-28T03:49:02.218 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: systemctl is-active chronyd.service 2021-01-28T03:49:02.227 INFO:teuthology.orchestra.run.smithi100.stderr:systemctl: inactive 2021-01-28T03:49:02.227 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: systemctl is-enabled systemd-timesyncd.service 2021-01-28T03:49:02.238 INFO:teuthology.orchestra.run.smithi100.stderr:systemctl: masked 2021-01-28T03:49:02.239 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: systemctl is-active systemd-timesyncd.service 2021-01-28T03:49:02.240 INFO:teuthology.orchestra.run.smithi100.stderr:systemctl: inactive 2021-01-28T03:49:02.244 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: systemctl is-enabled ntpd.service 2021-01-28T03:49:02.247 INFO:teuthology.orchestra.run.smithi100.stderr:systemctl: Failed to get unit file state for ntpd.service: No such file or directory 2021-01-28T03:49:02.248 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: systemctl is-active ntpd.service 2021-01-28T03:49:02.264 INFO:teuthology.orchestra.run.smithi100.stderr:systemctl: inactive 2021-01-28T03:49:02.264 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: systemctl is-enabled ntp.service 2021-01-28T03:49:02.264 INFO:teuthology.orchestra.run.smithi100.stderr:systemctl: enabled 2021-01-28T03:49:02.265 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: systemctl is-active ntp.service 2021-01-28T03:49:02.269 INFO:teuthology.orchestra.run.smithi100.stderr:systemctl: active 2021-01-28T03:49:02.272 INFO:teuthology.orchestra.run.smithi100.stderr:Unit ntp.service is enabled and running 2021-01-28T03:49:02.274 INFO:teuthology.orchestra.run.smithi100.stderr:Host looks OK 2021-01-28T03:49:02.275 INFO:teuthology.orchestra.run.smithi100.stderr:Cluster fsid: c217df96-611b-11eb-8f9e-001a4aab830c 2021-01-28T03:49:02.275 INFO:teuthology.orchestra.run.smithi100.stderr:Acquiring lock 139858668714064 on /run/cephadm/c217df96-611b-11eb-8f9e-001a4aab830c.lock 2021-01-28T03:49:02.276 INFO:teuthology.orchestra.run.smithi100.stderr:Lock 139858668714064 acquired on /run/cephadm/c217df96-611b-11eb-8f9e-001a4aab830c.lock 2021-01-28T03:49:02.276 INFO:teuthology.orchestra.run.smithi100.stderr:Verifying IP 172.21.15.100 port 3300 ... 2021-01-28T03:49:02.277 INFO:teuthology.orchestra.run.smithi100.stderr:Verifying IP 172.21.15.100 port 6789 ... 2021-01-28T03:49:02.277 INFO:teuthology.orchestra.run.smithi100.stderr:Base mon IP is 172.21.15.100, final addrv is [v2:172.21.15.100:3300,v1:172.21.15.100:6789] 2021-01-28T03:49:02.278 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/sbin/ip route ls 2021-01-28T03:49:02.281 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/sbin/ip: default via 172.21.15.254 dev enp3s0f1 2021-01-28T03:49:02.283 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/sbin/ip: default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.100 metric 100 2021-01-28T03:49:02.283 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/sbin/ip: 172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 2021-01-28T03:49:02.285 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/sbin/ip: 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.100 2021-01-28T03:49:02.285 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/sbin/ip: 172.21.15.254 dev enp3s0f1 proto dhcp scope link src 172.21.15.100 metric 100 2021-01-28T03:49:02.286 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/sbin/ip -6 route ls 2021-01-28T03:49:02.286 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/sbin/ip: ::1 dev lo proto kernel metric 256 pref medium 2021-01-28T03:49:02.287 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/sbin/ip: fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2021-01-28T03:49:02.287 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/sbin/ip: default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 expires 1774sec pref medium 2021-01-28T03:49:02.287 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/sbin/ip -6 addr ls 2021-01-28T03:49:02.290 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/sbin/ip: 1: lo: mtu 65536 state UNKNOWN qlen 1000 2021-01-28T03:49:02.290 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/sbin/ip: inet6 ::1/128 scope host 2021-01-28T03:49:02.295 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/sbin/ip: valid_lft forever preferred_lft forever 2021-01-28T03:49:02.295 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/sbin/ip: 5: enp3s0f1: mtu 1500 state UP qlen 1000 2021-01-28T03:49:02.296 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/sbin/ip: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link 2021-01-28T03:49:02.296 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/sbin/ip: valid_lft forever preferred_lft forever 2021-01-28T03:49:02.296 INFO:teuthology.orchestra.run.smithi100.stderr:Mon IP 172.21.15.100 is in CIDR network 172.21.0.0/20 2021-01-28T03:49:02.296 INFO:teuthology.orchestra.run.smithi100.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096... 2021-01-28T03:49:02.297 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/docker pull quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 2021-01-28T03:49:03.280 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/docker: 507028cb839c25d6666833702df6325fd8569096: Pulling from ceph-ci/ceph 2021-01-28T03:49:03.281 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/docker: 889524391d55: Pulling fs layer 2021-01-28T03:49:03.281 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/docker: 4c303d906d85: Pulling fs layer 2021-01-28T03:49:04.001 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/docker: 889524391d55: Download complete 2021-01-28T03:49:06.548 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/docker: 889524391d55: Pull complete 2021-01-28T03:49:10.758 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/docker: 4c303d906d85: Verifying Checksum 2021-01-28T03:49:10.758 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/docker: 4c303d906d85: Download complete 2021-01-28T03:49:20.410 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/docker: 4c303d906d85: Pull complete 2021-01-28T03:49:20.485 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/docker: Digest: sha256:c489442ef6855dff2d8ef5c2bf059a3e3799787d2dd370f561e71fe7fd43e3ef 2021-01-28T03:49:20.535 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/docker: Status: Downloaded newer image for quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 2021-01-28T03:49:20.536 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/docker: quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 2021-01-28T03:49:20.541 INFO:teuthology.orchestra.run.smithi100.stderr:Extracting ceph user uid/gid from container image... 2021-01-28T03:49:20.542 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint stat -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi100 quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -c %u %g /var/lib/ceph 2021-01-28T03:49:31.972 INFO:teuthology.orchestra.run.smithi100.stderr:stat: 167 167 2021-01-28T03:49:32.583 INFO:teuthology.orchestra.run.smithi100.stderr:Creating initial keys... 2021-01-28T03:49:32.583 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph-authtool -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi100 quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 --gen-print-key 2021-01-28T03:49:33.653 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-authtool: AQBNNBJgPkVRJxAAdNBEB+ftLPniPxnAHEpNUg== 2021-01-28T03:49:34.238 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph-authtool -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi100 quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 --gen-print-key 2021-01-28T03:49:35.373 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-authtool: AQBPNBJgnfejFhAA4+YsREU3EQdjxBu7dB2jLQ== 2021-01-28T03:49:35.977 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph-authtool -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi100 quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 --gen-print-key 2021-01-28T03:49:37.048 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-authtool: AQBRNBJgQX48AxAATWVAjkUeZEWBaclsMRdC1w== 2021-01-28T03:49:37.634 INFO:teuthology.orchestra.run.smithi100.stderr:Creating initial monmap... 2021-01-28T03:49:37.634 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/monmaptool -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi100 -v /tmp/ceph-tmpfnwfarvx:/tmp/monmap:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 --create --clobber --fsid c217df96-611b-11eb-8f9e-001a4aab830c --addv a [v2:172.21.15.100:3300,v1:172.21.15.100:6789] /tmp/monmap 2021-01-28T03:49:38.769 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: monmap file /tmp/monmap 2021-01-28T03:49:38.769 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: set fsid to c217df96-611b-11eb-8f9e-001a4aab830c 2021-01-28T03:49:38.769 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2021-01-28T03:49:39.357 INFO:teuthology.orchestra.run.smithi100.stderr:monmaptool for a [v2:172.21.15.100:3300,v1:172.21.15.100:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2021-01-28T03:49:39.357 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/monmaptool: set fsid to c217df96-611b-11eb-8f9e-001a4aab830c 2021-01-28T03:49:39.357 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2021-01-28T03:49:39.357 INFO:teuthology.orchestra.run.smithi100.stderr: 2021-01-28T03:49:39.358 INFO:teuthology.orchestra.run.smithi100.stderr:Creating mon... 2021-01-28T03:49:39.358 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph-mon -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi100 -v /var/log/ceph/c217df96-611b-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /var/lib/ceph/c217df96-611b-11eb-8f9e-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmp1950aemm:/tmp/keyring:z -v /tmp/ceph-tmpfnwfarvx:/tmp/monmap:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 --mkfs -i a --fsid c217df96-611b-11eb-8f9e-001a4aab830c -c /dev/null --monmap /tmp/monmap --keyring /tmp/keyring --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix="debug " --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true 2021-01-28T03:49:40.519 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 0 set uid:gid to 167:167 (ceph:ceph) 2021-01-28T03:49:40.587 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 1 imported monmap: 2021-01-28T03:49:40.588 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: epoch 0 2021-01-28T03:49:40.588 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: fsid c217df96-611b-11eb-8f9e-001a4aab830c 2021-01-28T03:49:40.588 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: last_changed 2021-01-28T03:49:38.774756+0000 2021-01-28T03:49:40.588 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: created 2021-01-28T03:49:38.774756+0000 2021-01-28T03:49:40.589 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: min_mon_release 0 (unknown) 2021-01-28T03:49:40.589 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: election_strategy: 1 2021-01-28T03:49:40.589 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: 0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2021-01-28T03:49:40.589 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: 2021-01-28T03:49:40.589 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 0 /usr/bin/ceph-mon: set fsid to c217df96-611b-11eb-8f9e-001a4aab830c 2021-01-28T03:49:40.590 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: RocksDB version: 6.8.1 2021-01-28T03:49:40.590 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: 2021-01-28T03:49:40.590 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-01-28T03:49:40.590 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Compile date Jan 27 2021 2021-01-28T03:49:40.590 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: DB SUMMARY 2021-01-28T03:49:40.591 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: 2021-01-28T03:49:40.591 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2021-01-28T03:49:40.591 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: 2021-01-28T03:49:40.591 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2021-01-28T03:49:40.591 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: 2021-01-28T03:49:40.592 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.error_if_exists: 0 2021-01-28T03:49:40.592 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.create_if_missing: 1 2021-01-28T03:49:40.592 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.paranoid_checks: 1 2021-01-28T03:49:40.592 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.env: 0x5595675401c0 2021-01-28T03:49:40.592 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.fs: Posix File System 2021-01-28T03:49:40.593 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.info_log: 0x5595687c2920 2021-01-28T03:49:40.593 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.max_file_opening_threads: 16 2021-01-28T03:49:40.593 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.statistics: (nil) 2021-01-28T03:49:40.593 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.use_fsync: 0 2021-01-28T03:49:40.593 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.max_log_file_size: 0 2021-01-28T03:49:40.594 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-01-28T03:49:40.594 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-01-28T03:49:40.594 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.keep_log_file_num: 1000 2021-01-28T03:49:40.594 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.recycle_log_file_num: 0 2021-01-28T03:49:40.594 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.allow_fallocate: 1 2021-01-28T03:49:40.595 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.allow_mmap_reads: 0 2021-01-28T03:49:40.595 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.allow_mmap_writes: 0 2021-01-28T03:49:40.595 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.use_direct_reads: 0 2021-01-28T03:49:40.595 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-01-28T03:49:40.595 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.create_missing_column_families: 0 2021-01-28T03:49:40.596 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.db_log_dir: 2021-01-28T03:49:40.596 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2021-01-28T03:49:40.596 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-01-28T03:49:40.596 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.max_subcompactions: 1 2021-01-28T03:49:40.596 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.max_background_flushes: -1 2021-01-28T03:49:40.597 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-01-28T03:49:40.597 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-01-28T03:49:40.597 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-01-28T03:49:40.597 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-01-28T03:49:40.597 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-01-28T03:49:40.598 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.advise_random_on_open: 1 2021-01-28T03:49:40.598 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.db_write_buffer_size: 0 2021-01-28T03:49:40.599 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.write_buffer_manager: 0x5595687891d0 2021-01-28T03:49:40.599 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-01-28T03:49:40.599 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-01-28T03:49:40.599 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-01-28T03:49:40.599 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-01-28T03:49:40.600 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.rate_limiter: (nil) 2021-01-28T03:49:40.600 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-01-28T03:49:40.600 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.wal_recovery_mode: 2 2021-01-28T03:49:40.600 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.enable_thread_tracking: 0 2021-01-28T03:49:40.600 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.enable_pipelined_write: 0 2021-01-28T03:49:40.601 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.unordered_write: 0 2021-01-28T03:49:40.601 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-01-28T03:49:40.601 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-01-28T03:49:40.601 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-01-28T03:49:40.601 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-01-28T03:49:40.602 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.row_cache: None 2021-01-28T03:49:40.602 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.wal_filter: None 2021-01-28T03:49:40.602 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-01-28T03:49:40.602 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.allow_ingest_behind: 0 2021-01-28T03:49:40.602 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.preserve_deletes: 0 2021-01-28T03:49:40.603 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.two_write_queues: 0 2021-01-28T03:49:40.603 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.manual_wal_flush: 0 2021-01-28T03:49:40.603 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.atomic_flush: 0 2021-01-28T03:49:40.603 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-01-28T03:49:40.603 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-01-28T03:49:40.604 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-01-28T03:49:40.604 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.log_readahead_size: 0 2021-01-28T03:49:40.604 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-01-28T03:49:40.604 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.max_background_jobs: 2 2021-01-28T03:49:40.604 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.max_background_compactions: -1 2021-01-28T03:49:40.605 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-01-28T03:49:40.605 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-01-28T03:49:40.605 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-01-28T03:49:40.605 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.max_total_wal_size: 0 2021-01-28T03:49:40.605 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-01-28T03:49:40.606 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-01-28T03:49:40.606 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-01-28T03:49:40.606 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-01-28T03:49:40.606 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.max_open_files: -1 2021-01-28T03:49:40.606 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.bytes_per_sync: 0 2021-01-28T03:49:40.607 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-01-28T03:49:40.607 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-01-28T03:49:40.607 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Options.compaction_readahead_size: 0 2021-01-28T03:49:40.607 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Compression algorithms supported: 2021-01-28T03:49:40.607 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-01-28T03:49:40.608 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: kZSTD supported: 0 2021-01-28T03:49:40.608 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: kXpressCompression supported: 0 2021-01-28T03:49:40.608 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: kLZ4HCCompression supported: 1 2021-01-28T03:49:40.608 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: kLZ4Compression supported: 1 2021-01-28T03:49:40.608 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: kBZip2Compression supported: 0 2021-01-28T03:49:40.609 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: kZlibCompression supported: 1 2021-01-28T03:49:40.609 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: kSnappyCompression supported: 1 2021-01-28T03:49:40.609 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-01-28T03:49:40.609 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.431+0000 7f6281f4a700 4 rocksdb: [db_impl/db_impl_open.cc:273] Creating manifest 1 2021-01-28T03:49:40.609 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: 2021-01-28T03:49:40.610 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2021-01-28T03:49:40.610 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: 2021-01-28T03:49:40.610 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-01-28T03:49:40.610 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: 2021-01-28T03:49:40.610 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-01-28T03:49:40.611 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.merge_operator: 2021-01-28T03:49:40.611 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.compaction_filter: None 2021-01-28T03:49:40.611 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.compaction_filter_factory: None 2021-01-28T03:49:40.611 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-01-28T03:49:40.611 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-01-28T03:49:40.612 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5595686d81c8) 2021-01-28T03:49:40.612 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks: 1 2021-01-28T03:49:40.612 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks_with_high_priority: 0 2021-01-28T03:49:40.612 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: pin_l0_filter_and_index_blocks_in_cache: 0 2021-01-28T03:49:40.612 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: pin_top_level_index_and_filter: 1 2021-01-28T03:49:40.613 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: index_type: 0 2021-01-28T03:49:40.613 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: data_block_index_type: 0 2021-01-28T03:49:40.613 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: index_shortening: 1 2021-01-28T03:49:40.613 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: data_block_hash_table_util_ratio: 0.750000 2021-01-28T03:49:40.613 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: hash_index_allow_collision: 1 2021-01-28T03:49:40.614 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: checksum: 1 2021-01-28T03:49:40.614 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: no_block_cache: 0 2021-01-28T03:49:40.627 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: block_cache: 0x559568710110 2021-01-28T03:49:40.628 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: block_cache_name: BinnedLRUCache 2021-01-28T03:49:40.628 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: block_cache_options: 2021-01-28T03:49:40.629 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: capacity : 536870912 2021-01-28T03:49:40.629 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: num_shard_bits : 4 2021-01-28T03:49:40.636 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: strict_capacity_limit : 0 2021-01-28T03:49:40.649 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: high_pri_pool_ratio: 0.000 2021-01-28T03:49:40.650 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: block_cache_compressed: (nil) 2021-01-28T03:49:40.650 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: persistent_cache: (nil) 2021-01-28T03:49:40.650 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: block_size: 4096 2021-01-28T03:49:40.651 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: block_size_deviation: 10 2021-01-28T03:49:40.651 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: block_restart_interval: 16 2021-01-28T03:49:40.651 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: index_block_restart_interval: 1 2021-01-28T03:49:40.651 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: metadata_block_size: 4096 2021-01-28T03:49:40.651 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: partition_filters: 0 2021-01-28T03:49:40.652 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: use_delta_encoding: 1 2021-01-28T03:49:40.652 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: filter_policy: rocksdb.BuiltinBloomFilter 2021-01-28T03:49:40.652 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: whole_key_filtering: 1 2021-01-28T03:49:40.652 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: verify_compression: 0 2021-01-28T03:49:40.652 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: read_amp_bytes_per_bit: 0 2021-01-28T03:49:40.653 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: format_version: 2 2021-01-28T03:49:40.653 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: enable_index_compression: 1 2021-01-28T03:49:40.653 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: block_align: 0 2021-01-28T03:49:40.654 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: 2021-01-28T03:49:40.654 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.write_buffer_size: 33554432 2021-01-28T03:49:40.655 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.max_write_buffer_number: 2 2021-01-28T03:49:40.655 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.compression: NoCompression 2021-01-28T03:49:40.655 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.bottommost_compression: Disabled 2021-01-28T03:49:40.656 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.prefix_extractor: nullptr 2021-01-28T03:49:40.656 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-01-28T03:49:40.685 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.num_levels: 7 2021-01-28T03:49:40.685 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-01-28T03:49:40.686 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-01-28T03:49:40.686 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-01-28T03:49:40.687 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-01-28T03:49:40.687 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-01-28T03:49:40.687 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-01-28T03:49:40.688 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-01-28T03:49:40.688 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-01-28T03:49:40.688 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-01-28T03:49:40.689 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-01-28T03:49:40.689 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.compression_opts.level: 32767 2021-01-28T03:49:40.689 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.compression_opts.strategy: 0 2021-01-28T03:49:40.690 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-01-28T03:49:40.690 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-01-28T03:49:40.692 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.compression_opts.enabled: false 2021-01-28T03:49:40.692 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-01-28T03:49:40.701 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-01-28T03:49:40.702 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-01-28T03:49:40.702 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.target_file_size_base: 67108864 2021-01-28T03:49:40.702 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-01-28T03:49:40.702 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-01-28T03:49:40.703 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-01-28T03:49:40.703 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-01-28T03:49:40.703 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-01-28T03:49:40.704 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-01-28T03:49:40.704 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-01-28T03:49:40.705 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-01-28T03:49:40.705 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-01-28T03:49:40.705 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-01-28T03:49:40.705 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-01-28T03:49:40.705 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-01-28T03:49:40.706 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-01-28T03:49:40.706 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.arena_block_size: 4194304 2021-01-28T03:49:40.706 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-01-28T03:49:40.706 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-01-28T03:49:40.707 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-01-28T03:49:40.707 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.disable_auto_compactions: 0 2021-01-28T03:49:40.707 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-01-28T03:49:40.707 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-01-28T03:49:40.707 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-01-28T03:49:40.708 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-01-28T03:49:40.708 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-01-28T03:49:40.708 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-01-28T03:49:40.708 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-01-28T03:49:40.709 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-01-28T03:49:40.709 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-01-28T03:49:40.709 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-01-28T03:49:40.710 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.table_properties_collectors: 2021-01-28T03:49:40.710 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.inplace_update_support: 0 2021-01-28T03:49:40.710 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-01-28T03:49:40.710 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-01-28T03:49:40.711 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-01-28T03:49:40.711 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-01-28T03:49:40.712 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.bloom_locality: 0 2021-01-28T03:49:40.712 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.max_successive_merges: 0 2021-01-28T03:49:40.712 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-01-28T03:49:40.713 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.paranoid_file_checks: 0 2021-01-28T03:49:40.714 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.force_consistency_checks: 0 2021-01-28T03:49:40.714 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.report_bg_io_stats: 0 2021-01-28T03:49:40.714 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.ttl: 2592000 2021-01-28T03:49:40.715 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.435+0000 7f6281f4a700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-01-28T03:49:40.715 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.439+0000 7f6281f4a700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-01-28T03:49:40.715 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: 2021-01-28T03:49:40.715 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.439+0000 7f6281f4a700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2021-01-28T03:49:40.716 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: 2021-01-28T03:49:40.716 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.439+0000 7f6281f4a700 4 rocksdb: DB pointer 0x5595687cf800 2021-01-28T03:49:40.716 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.439+0000 7f626adec700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-01-28T03:49:40.716 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.439+0000 7f626adec700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-01-28T03:49:40.716 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: ** DB Stats ** 2021-01-28T03:49:40.717 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2021-01-28T03:49:40.717 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-01-28T03:49:40.717 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-01-28T03:49:40.717 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-28T03:49:40.718 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-01-28T03:49:40.718 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-01-28T03:49:40.718 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-28T03:49:40.718 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: 2021-01-28T03:49:40.718 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2021-01-28T03:49:40.719 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-28T03:49:40.719 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-28T03:49:40.719 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-01-28T03:49:40.719 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-01-28T03:49:40.719 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: 2021-01-28T03:49:40.720 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2021-01-28T03:49:40.720 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-28T03:49:40.720 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-28T03:49:40.720 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2021-01-28T03:49:40.720 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2021-01-28T03:49:40.721 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-28T03:49:40.721 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2021-01-28T03:49:40.721 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2021-01-28T03:49:40.721 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2021-01-28T03:49:40.721 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-28T03:49:40.722 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-28T03:49:40.722 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-28T03:49:40.722 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: 2021-01-28T03:49:40.722 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2021-01-28T03:49:40.723 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: 2021-01-28T03:49:40.723 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2021-01-28T03:49:40.723 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-28T03:49:40.723 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-28T03:49:40.723 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-01-28T03:49:40.724 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-01-28T03:49:40.724 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: 2021-01-28T03:49:40.724 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2021-01-28T03:49:40.724 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-28T03:49:40.724 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-28T03:49:40.725 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2021-01-28T03:49:40.726 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2021-01-28T03:49:40.727 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-28T03:49:40.727 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2021-01-28T03:49:40.727 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2021-01-28T03:49:40.727 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2021-01-28T03:49:40.728 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-28T03:49:40.728 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-28T03:49:40.728 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-28T03:49:40.728 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: 2021-01-28T03:49:40.728 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2021-01-28T03:49:40.729 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: 2021-01-28T03:49:40.729 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.443+0000 7f6281f4a700 4 rocksdb: [db_impl/db_impl.cc:397] Shutdown: canceling all background work 2021-01-28T03:49:40.729 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.443+0000 7f6281f4a700 4 rocksdb: [db_impl/db_impl.cc:573] Shutdown complete 2021-01-28T03:49:40.729 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T03:49:40.443+0000 7f6281f4a700 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2021-01-28T03:49:41.138 INFO:teuthology.orchestra.run.smithi100.stderr:create mon.a on 2021-01-28T03:49:41.139 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: install -d -m0770 -o 167 -g 167 /var/run/ceph/c217df96-611b-11eb-8f9e-001a4aab830c 2021-01-28T03:49:41.146 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: systemctl disable ceph.target 2021-01-28T03:49:41.164 INFO:teuthology.orchestra.run.smithi100.stderr:systemctl: Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2021-01-28T03:49:41.374 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: systemctl enable ceph.target 2021-01-28T03:49:41.381 INFO:teuthology.orchestra.run.smithi100.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /etc/systemd/system/ceph.target. 2021-01-28T03:49:41.585 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: systemctl start ceph.target 2021-01-28T03:49:41.592 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: systemctl enable ceph-c217df96-611b-11eb-8f9e-001a4aab830c.target 2021-01-28T03:49:41.619 INFO:teuthology.orchestra.run.smithi100.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph-c217df96-611b-11eb-8f9e-001a4aab830c.target -> /etc/systemd/system/ceph-c217df96-611b-11eb-8f9e-001a4aab830c.target. 2021-01-28T03:49:41.619 INFO:teuthology.orchestra.run.smithi100.stderr:systemctl: Created symlink /etc/systemd/system/ceph.target.wants/ceph-c217df96-611b-11eb-8f9e-001a4aab830c.target -> /etc/systemd/system/ceph-c217df96-611b-11eb-8f9e-001a4aab830c.target. 2021-01-28T03:49:41.828 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: systemctl start ceph-c217df96-611b-11eb-8f9e-001a4aab830c.target 2021-01-28T03:49:41.837 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: systemctl daemon-reload 2021-01-28T03:49:42.057 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: systemctl stop ceph-c217df96-611b-11eb-8f9e-001a4aab830c@mon.a 2021-01-28T03:49:42.069 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: systemctl reset-failed ceph-c217df96-611b-11eb-8f9e-001a4aab830c@mon.a 2021-01-28T03:49:42.074 INFO:teuthology.orchestra.run.smithi100.stderr:systemctl: Failed to reset failed state of unit ceph-c217df96-611b-11eb-8f9e-001a4aab830c@mon.a.service: Unit ceph-c217df96-611b-11eb-8f9e-001a4aab830c@mon.a.service not loaded. 2021-01-28T03:49:42.075 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: systemctl enable ceph-c217df96-611b-11eb-8f9e-001a4aab830c@mon.a 2021-01-28T03:49:42.084 INFO:teuthology.orchestra.run.smithi100.stderr:systemctl: Created symlink /etc/systemd/system/ceph-c217df96-611b-11eb-8f9e-001a4aab830c.target.wants/ceph-c217df96-611b-11eb-8f9e-001a4aab830c@mon.a.service -> /etc/systemd/system/ceph-c217df96-611b-11eb-8f9e-001a4aab830c@.service. 2021-01-28T03:49:42.286 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: systemctl start ceph-c217df96-611b-11eb-8f9e-001a4aab830c@mon.a 2021-01-28T03:49:42.302 INFO:teuthology.orchestra.run.smithi100.stderr:firewalld does not appear to be present 2021-01-28T03:49:42.303 INFO:teuthology.orchestra.run.smithi100.stderr:Not possible to enable service . firewalld.service is not available 2021-01-28T03:49:42.303 INFO:teuthology.orchestra.run.smithi100.stderr:Not possible to open ports <[]>. firewalld.service is not available 2021-01-28T03:49:42.303 INFO:teuthology.orchestra.run.smithi100.stderr:Waiting for mon to start... 2021-01-28T03:49:42.303 INFO:teuthology.orchestra.run.smithi100.stderr:Waiting for mon... 2021-01-28T03:49:42.303 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi100 -v /var/lib/ceph/c217df96-611b-11eb-8f9e-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmpp3pxhmbk:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpih1yxits:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 status 2021-01-28T03:49:42.354 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:42 smithi100 systemd[1]: Started Ceph mon.a for c217df96-611b-11eb-8f9e-001a4aab830c. 2021-01-28T03:49:44.033 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.031+0000 7ff77f88b700 1 Processor -- start 2021-01-28T03:49:44.033 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.031+0000 7ff77f88b700 1 -- start start 2021-01-28T03:49:44.034 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.031+0000 7ff77f88b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff77806d450 0x7ff7780fe480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T03:49:44.034 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.031+0000 7ff77f88b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7780f9e70 con 0x7ff77806d450 2021-01-28T03:49:44.034 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.031+0000 7ff77d627700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff77806d450 0x7ff7780fe480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:49:44.035 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.031+0000 7ff77d627700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff77806d450 0x7ff7780fe480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58794/0 (socket says 172.21.15.100:58794) 2021-01-28T03:49:44.035 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.031+0000 7ff77d627700 1 -- 172.21.15.100:0/1487794681 learned_addr learned my addr 172.21.15.100:0/1487794681 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:49:44.036 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.035+0000 7ff77d627700 1 -- 172.21.15.100:0/1487794681 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7780fe970 con 0x7ff77806d450 2021-01-28T03:49:44.036 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.035+0000 7ff77d627700 1 --2- 172.21.15.100:0/1487794681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff77806d450 0x7ff7780fe480 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7ff76800b950 tx=0x7ff768006ee0).ready entity=mon.0 client_cookie=bd2c0aac3833e90 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:49:44.042 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.035+0000 7ff76ffff700 1 -- 172.21.15.100:0/1487794681 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff768009840 con 0x7ff77806d450 2021-01-28T03:49:44.042 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.035+0000 7ff76ffff700 1 -- 172.21.15.100:0/1487794681 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7680099a0 con 0x7ff77806d450 2021-01-28T03:49:44.042 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.035+0000 7ff76ffff700 1 -- 172.21.15.100:0/1487794681 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff768009c50 con 0x7ff77806d450 2021-01-28T03:49:44.043 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.035+0000 7ff77f88b700 1 -- 172.21.15.100:0/1487794681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff77806d450 msgr2=0x7ff7780fe480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:49:44.043 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.035+0000 7ff77f88b700 1 --2- 172.21.15.100:0/1487794681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff77806d450 0x7ff7780fe480 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7ff76800b950 tx=0x7ff768006ee0).stop 2021-01-28T03:49:44.043 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.035+0000 7ff77f88b700 1 -- 172.21.15.100:0/1487794681 shutdown_connections 2021-01-28T03:49:44.044 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.035+0000 7ff77f88b700 1 --2- 172.21.15.100:0/1487794681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff77806d450 0x7ff7780fe480 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:49:44.044 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.035+0000 7ff77f88b700 1 -- 172.21.15.100:0/1487794681 >> 172.21.15.100:0/1487794681 conn(0x7ff7780f3ae0 msgr2=0x7ff7780f5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:49:44.045 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.035+0000 7ff77f88b700 1 -- 172.21.15.100:0/1487794681 shutdown_connections 2021-01-28T03:49:44.045 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.035+0000 7ff77f88b700 1 -- 172.21.15.100:0/1487794681 wait complete. 2021-01-28T03:49:44.045 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.035+0000 7ff77f88b700 1 Processor -- start 2021-01-28T03:49:44.046 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.035+0000 7ff77f88b700 1 -- start start 2021-01-28T03:49:44.046 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.039+0000 7ff77f88b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff77806d450 0x7ff778109610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:49:44.047 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.039+0000 7ff77f88b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff778109b00 con 0x7ff77806d450 2021-01-28T03:49:44.047 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.039+0000 7ff77d627700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff77806d450 0x7ff778109610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:49:44.047 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.039+0000 7ff77d627700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff77806d450 0x7ff778109610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58796/0 (socket says 172.21.15.100:58796) 2021-01-28T03:49:44.048 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.039+0000 7ff77d627700 1 -- 172.21.15.100:0/3221488195 learned_addr learned my addr 172.21.15.100:0/3221488195 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:49:44.048 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.039+0000 7ff77d627700 1 -- 172.21.15.100:0/3221488195 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff778109c40 con 0x7ff77806d450 2021-01-28T03:49:44.048 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.039+0000 7ff77d627700 1 --2- 172.21.15.100:0/3221488195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff77806d450 0x7ff778109610 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7ff768006c70 tx=0x7ff768016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:49:44.048 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.039+0000 7ff76dffb700 1 -- 172.21.15.100:0/3221488195 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff768009840 con 0x7ff77806d450 2021-01-28T03:49:44.049 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.039+0000 7ff76dffb700 1 -- 172.21.15.100:0/3221488195 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76801c5a0 con 0x7ff77806d450 2021-01-28T03:49:44.049 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.039+0000 7ff77f88b700 1 -- 172.21.15.100:0/3221488195 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff778109e90 con 0x7ff77806d450 2021-01-28T03:49:44.050 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.039+0000 7ff76dffb700 1 -- 172.21.15.100:0/3221488195 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff76801c870 con 0x7ff77806d450 2021-01-28T03:49:44.050 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.039+0000 7ff77f88b700 1 -- 172.21.15.100:0/3221488195 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff77810a9f0 con 0x7ff77806d450 2021-01-28T03:49:44.050 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.039+0000 7ff77f88b700 1 -- 172.21.15.100:0/3221488195 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7780581f0 con 0x7ff77806d450 2021-01-28T03:49:44.050 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.039+0000 7ff76dffb700 1 -- 172.21.15.100:0/3221488195 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) v1 ==== 623+0+0 (secure 0 0 0) 0x7ff76800f070 con 0x7ff77806d450 2021-01-28T03:49:44.051 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.039+0000 7ff76dffb700 1 -- 172.21.15.100:0/3221488195 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7ff768027a70 con 0x7ff77806d450 2021-01-28T03:49:44.051 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.043+0000 7ff76dffb700 1 -- 172.21.15.100:0/3221488195 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72015 (secure 0 0 0) 0x7ff768016070 con 0x7ff77806d450 2021-01-28T03:49:44.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:43 smithi100 bash[9451]: cluster 2021-01-28T03:49:43.978030+0000 mon.a (mon.0) 0 : [INF] mkfs c217df96-611b-11eb-8f9e-001a4aab830c 2021-01-28T03:49:44.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:43 smithi100 bash[9451]: cluster 2021-01-28T03:49:43.962056+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2021-01-28T03:49:44.173 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.175+0000 7ff77f88b700 1 -- 172.21.15.100:0/3221488195 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7ff7780feb60 con 0x7ff77806d450 2021-01-28T03:49:44.174 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.175+0000 7ff76dffb700 1 -- 172.21.15.100:0/3221488195 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7ff768006970 con 0x7ff77806d450 2021-01-28T03:49:44.174 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: cluster: 2021-01-28T03:49:44.175 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: id: c217df96-611b-11eb-8f9e-001a4aab830c 2021-01-28T03:49:44.177 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: health: HEALTH_OK 2021-01-28T03:49:44.177 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.177 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: services: 2021-01-28T03:49:44.177 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: mon: 1 daemons, quorum a (age 0.207616s) 2021-01-28T03:49:44.178 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: mgr: no daemons active 2021-01-28T03:49:44.178 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: osd: 0 osds: 0 up, 0 in 2021-01-28T03:49:44.179 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.179 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: data: 2021-01-28T03:49:44.179 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: pools: 0 pools, 0 pgs 2021-01-28T03:49:44.180 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: objects: 0 objects, 0 B 2021-01-28T03:49:44.180 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: usage: 0 B used, 0 B / 0 B avail 2021-01-28T03:49:44.180 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: pgs: 2021-01-28T03:49:44.180 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.181 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.175+0000 7ff77f88b700 1 -- 172.21.15.100:0/3221488195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff77806d450 msgr2=0x7ff778109610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:49:44.181 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.175+0000 7ff77f88b700 1 --2- 172.21.15.100:0/3221488195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff77806d450 0x7ff778109610 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7ff768006c70 tx=0x7ff768016000).stop 2021-01-28T03:49:44.182 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.175+0000 7ff77f88b700 1 -- 172.21.15.100:0/3221488195 shutdown_connections 2021-01-28T03:49:44.182 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.175+0000 7ff77f88b700 1 --2- 172.21.15.100:0/3221488195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff77806d450 0x7ff778109610 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:49:44.182 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.175+0000 7ff77f88b700 1 -- 172.21.15.100:0/3221488195 >> 172.21.15.100:0/3221488195 conn(0x7ff7780f3ae0 msgr2=0x7ff7780f5500 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:49:44.182 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.175+0000 7ff77f88b700 1 -- 172.21.15.100:0/3221488195 shutdown_connections 2021-01-28T03:49:44.183 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:44.175+0000 7ff77f88b700 1 -- 172.21.15.100:0/3221488195 wait complete. 2021-01-28T03:49:44.959 INFO:teuthology.orchestra.run.smithi100.stderr:mon is available 2021-01-28T03:49:44.960 INFO:teuthology.orchestra.run.smithi100.stderr:Assimilating anything we can from ceph.conf... 2021-01-28T03:49:44.960 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi100 -v /var/log/ceph/c217df96-611b-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp3pxhmbk:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpih1yxits:/etc/ceph/ceph.conf:z -v /var/lib/ceph/c217df96-611b-11eb-8f9e-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 config assimilate-conf -i /var/lib/ceph/mon/ceph-a/config 2021-01-28T03:49:45.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:44 smithi100 bash[9451]: cluster 2021-01-28T03:49:43.972962+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2021-01-28T03:49:45.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:44 smithi100 bash[9451]: cluster 2021-01-28T03:49:43.974710+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0]} 2021-01-28T03:49:45.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:44 smithi100 bash[9451]: cluster 2021-01-28T03:49:43.983572+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2021-01-28T03:49:45.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:44 smithi100 bash[9451]: cluster 2021-01-28T03:49:43.988395+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2021-01-28T03:49:45.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:44 smithi100 bash[9451]: cluster 2021-01-28T03:49:43.989209+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2021-01-28T03:49:45.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:44 smithi100 bash[9451]: audit 2021-01-28T03:49:44.180493+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.15.100:0/3221488195' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2021-01-28T03:49:46.166 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.167+0000 7f29db27b700 1 Processor -- start 2021-01-28T03:49:46.167 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.167+0000 7f29db27b700 1 -- start start 2021-01-28T03:49:46.167 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.167+0000 7f29db27b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29d406d440 0x7f29d40f9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T03:49:46.167 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.167+0000 7f29db27b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d40fa2f0 con 0x7f29d406d440 2021-01-28T03:49:46.168 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.167+0000 7f29d9017700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29d406d440 0x7f29d40f9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:49:46.168 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.167+0000 7f29d9017700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29d406d440 0x7f29d40f9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58798/0 (socket says 172.21.15.100:58798) 2021-01-28T03:49:46.168 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.167+0000 7f29d9017700 1 -- 172.21.15.100:0/926890609 learned_addr learned my addr 172.21.15.100:0/926890609 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:49:46.168 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.167+0000 7f29d9017700 1 -- 172.21.15.100:0/926890609 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d40fa430 con 0x7f29d406d440 2021-01-28T03:49:46.170 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.167+0000 7f29d9017700 1 --2- 172.21.15.100:0/926890609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29d406d440 0x7f29d40f9e00 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f29cc009cc0 tx=0x7f29cc0092d0).ready entity=mon.0 client_cookie=7d56de672eed093b server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:49:46.170 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.167+0000 7f29c7fff700 1 -- 172.21.15.100:0/926890609 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29cc00bbf0 con 0x7f29d406d440 2021-01-28T03:49:46.170 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.167+0000 7f29c7fff700 1 -- 172.21.15.100:0/926890609 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29cc00bd50 con 0x7f29d406d440 2021-01-28T03:49:46.171 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.167+0000 7f29c7fff700 1 -- 172.21.15.100:0/926890609 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29cc011400 con 0x7f29d406d440 2021-01-28T03:49:46.171 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.167+0000 7f29db27b700 1 -- 172.21.15.100:0/926890609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29d406d440 msgr2=0x7f29d40f9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:49:46.171 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.167+0000 7f29db27b700 1 --2- 172.21.15.100:0/926890609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29d406d440 0x7f29d40f9e00 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f29cc009cc0 tx=0x7f29cc0092d0).stop 2021-01-28T03:49:46.171 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.167+0000 7f29db27b700 1 -- 172.21.15.100:0/926890609 shutdown_connections 2021-01-28T03:49:46.171 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.167+0000 7f29db27b700 1 --2- 172.21.15.100:0/926890609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29d406d440 0x7f29d40f9e00 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:49:46.172 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.167+0000 7f29db27b700 1 -- 172.21.15.100:0/926890609 >> 172.21.15.100:0/926890609 conn(0x7f29d40f3ad0 msgr2=0x7f29d40f5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:49:46.172 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.171+0000 7f29db27b700 1 -- 172.21.15.100:0/926890609 shutdown_connections 2021-01-28T03:49:46.172 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.171+0000 7f29db27b700 1 -- 172.21.15.100:0/926890609 wait complete. 2021-01-28T03:49:46.175 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.171+0000 7f29db27b700 1 Processor -- start 2021-01-28T03:49:46.175 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.171+0000 7f29db27b700 1 -- start start 2021-01-28T03:49:46.176 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.171+0000 7f29db27b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29d406d440 0x7f29d410d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:49:46.176 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.171+0000 7f29db27b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d410ded0 con 0x7f29d406d440 2021-01-28T03:49:46.176 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.171+0000 7f29d9017700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29d406d440 0x7f29d410d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:49:46.176 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.171+0000 7f29d9017700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29d406d440 0x7f29d410d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58800/0 (socket says 172.21.15.100:58800) 2021-01-28T03:49:46.177 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.171+0000 7f29d9017700 1 -- 172.21.15.100:0/3596006592 learned_addr learned my addr 172.21.15.100:0/3596006592 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:49:46.177 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.171+0000 7f29d9017700 1 -- 172.21.15.100:0/3596006592 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d410e010 con 0x7f29d406d440 2021-01-28T03:49:46.177 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.171+0000 7f29d9017700 1 --2- 172.21.15.100:0/3596006592 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29d406d440 0x7f29d410d9e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f29cc009130 tx=0x7f29cc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:49:46.177 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.175+0000 7f29c5ffb700 1 -- 172.21.15.100:0/3596006592 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29cc00bec0 con 0x7f29d406d440 2021-01-28T03:49:46.178 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.175+0000 7f29c5ffb700 1 -- 172.21.15.100:0/3596006592 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29cc011400 con 0x7f29d406d440 2021-01-28T03:49:46.178 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.175+0000 7f29c5ffb700 1 -- 172.21.15.100:0/3596006592 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29cc010b00 con 0x7f29d406d440 2021-01-28T03:49:46.178 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.175+0000 7f29db27b700 1 -- 172.21.15.100:0/3596006592 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d410e260 con 0x7f29d406d440 2021-01-28T03:49:46.178 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.175+0000 7f29db27b700 1 -- 172.21.15.100:0/3596006592 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d410edc0 con 0x7f29d406d440 2021-01-28T03:49:46.179 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.175+0000 7f29c5ffb700 1 -- 172.21.15.100:0/3596006592 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) v1 ==== 623+0+0 (secure 0 0 0) 0x7f29cc022030 con 0x7f29d406d440 2021-01-28T03:49:46.179 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.175+0000 7f29c5ffb700 1 -- 172.21.15.100:0/3596006592 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f29cc025a70 con 0x7f29d406d440 2021-01-28T03:49:46.179 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.175+0000 7f29db27b700 1 -- 172.21.15.100:0/3596006592 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29d40581f0 con 0x7f29d406d440 2021-01-28T03:49:46.180 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.179+0000 7f29c5ffb700 1 -- 172.21.15.100:0/3596006592 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72015 (secure 0 0 0) 0x7f29cc02a060 con 0x7f29d406d440 2021-01-28T03:49:46.306 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.307+0000 7f29db27b700 1 -- 172.21.15.100:0/3596006592 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f29d4027100 con 0x7f29d406d440 2021-01-28T03:49:46.311 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.311+0000 7f29c5ffb700 1 -- 172.21.15.100:0/3596006592 <== mon.0 v2:172.21.15.100:3300/0 7 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f29cc010cb0 con 0x7f29d406d440 2021-01-28T03:49:46.311 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.311+0000 7f29c5ffb700 1 -- 172.21.15.100:0/3596006592 <== mon.0 v2:172.21.15.100:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+340 (secure 0 0 0) 0x7f29cc020070 con 0x7f29d406d440 2021-01-28T03:49:46.312 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.313 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: [global] 2021-01-28T03:49:46.313 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: fsid = c217df96-611b-11eb-8f9e-001a4aab830c 2021-01-28T03:49:46.313 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: mon_host = [v2:172.21.15.100:3300,v1:172.21.15.100:6789] 2021-01-28T03:49:46.313 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2021-01-28T03:49:46.314 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2021-01-28T03:49:46.314 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2021-01-28T03:49:46.315 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2021-01-28T03:49:46.316 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.316 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: [mgr] 2021-01-28T03:49:46.316 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2021-01-28T03:49:46.316 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.317 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: [osd] 2021-01-28T03:49:46.317 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2021-01-28T03:49:46.317 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2021-01-28T03:49:46.317 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.315+0000 7f29db27b700 1 -- 172.21.15.100:0/3596006592 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29d406d440 msgr2=0x7f29d410d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:49:46.317 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.315+0000 7f29db27b700 1 --2- 172.21.15.100:0/3596006592 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29d406d440 0x7f29d410d9e0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f29cc009130 tx=0x7f29cc017000).stop 2021-01-28T03:49:46.318 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.315+0000 7f29db27b700 1 -- 172.21.15.100:0/3596006592 shutdown_connections 2021-01-28T03:49:46.318 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.315+0000 7f29db27b700 1 --2- 172.21.15.100:0/3596006592 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29d406d440 0x7f29d410d9e0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:49:46.318 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.315+0000 7f29db27b700 1 -- 172.21.15.100:0/3596006592 >> 172.21.15.100:0/3596006592 conn(0x7f29d40f3ad0 msgr2=0x7f29d40f5430 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:49:46.318 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.315+0000 7f29db27b700 1 -- 172.21.15.100:0/3596006592 shutdown_connections 2021-01-28T03:49:46.318 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:46.315+0000 7f29db27b700 1 -- 172.21.15.100:0/3596006592 wait complete. 2021-01-28T03:49:46.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:46 smithi100 bash[9451]: audit 2021-01-28T03:49:46.313350+0000 mon.a (mon.0) 8 : audit [INF] from='client.? 172.21.15.100:0/3596006592' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2021-01-28T03:49:46.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:46 smithi100 bash[9451]: audit 2021-01-28T03:49:46.317837+0000 mon.a (mon.0) 9 : audit [INF] from='client.? 172.21.15.100:0/3596006592' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2021-01-28T03:49:46.979 INFO:teuthology.orchestra.run.smithi100.stderr:Generating new minimal ceph.conf... 2021-01-28T03:49:46.980 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi100 -v /var/log/ceph/c217df96-611b-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp3pxhmbk:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpih1yxits:/etc/ceph/ceph.conf:z -v /var/lib/ceph/c217df96-611b-11eb-8f9e-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 config generate-minimal-conf -o /var/lib/ceph/mon/ceph-a/config 2021-01-28T03:49:48.123 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.123+0000 7f3bd78f6700 1 Processor -- start 2021-01-28T03:49:48.123 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.123+0000 7f3bd78f6700 1 -- start start 2021-01-28T03:49:48.124 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.123+0000 7f3bd78f6700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bd00f93b0 0x7f3bd00f97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T03:49:48.124 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.123+0000 7f3bd78f6700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd00f9cc0 con 0x7f3bd00f93b0 2021-01-28T03:49:48.125 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.123+0000 7f3bd5692700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bd00f93b0 0x7f3bd00f97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:49:48.125 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.123+0000 7f3bd5692700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bd00f93b0 0x7f3bd00f97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58802/0 (socket says 172.21.15.100:58802) 2021-01-28T03:49:48.125 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.123+0000 7f3bd5692700 1 -- 172.21.15.100:0/2054525681 learned_addr learned my addr 172.21.15.100:0/2054525681 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:49:48.125 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.123+0000 7f3bd5692700 1 -- 172.21.15.100:0/2054525681 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd00f9e00 con 0x7f3bd00f93b0 2021-01-28T03:49:48.127 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.123+0000 7f3bd5692700 1 --2- 172.21.15.100:0/2054525681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bd00f93b0 0x7f3bd00f97d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f3bc4009cc0 tx=0x7f3bc40092d0).ready entity=mon.0 client_cookie=9af3009c2390ad39 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:49:48.127 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.123+0000 7f3bbbfff700 1 -- 172.21.15.100:0/2054525681 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3bc400bbf0 con 0x7f3bd00f93b0 2021-01-28T03:49:48.127 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.123+0000 7f3bbbfff700 1 -- 172.21.15.100:0/2054525681 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f3bc400bd50 con 0x7f3bd00f93b0 2021-01-28T03:49:48.127 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.127+0000 7f3bbbfff700 1 -- 172.21.15.100:0/2054525681 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3bc4010560 con 0x7f3bd00f93b0 2021-01-28T03:49:48.127 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.127+0000 7f3bd78f6700 1 -- 172.21.15.100:0/2054525681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bd00f93b0 msgr2=0x7f3bd00f97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:49:48.128 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.127+0000 7f3bd78f6700 1 --2- 172.21.15.100:0/2054525681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bd00f93b0 0x7f3bd00f97d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f3bc4009cc0 tx=0x7f3bc40092d0).stop 2021-01-28T03:49:48.128 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.127+0000 7f3bd78f6700 1 -- 172.21.15.100:0/2054525681 shutdown_connections 2021-01-28T03:49:48.128 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.127+0000 7f3bd78f6700 1 --2- 172.21.15.100:0/2054525681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bd00f93b0 0x7f3bd00f97d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:49:48.128 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.127+0000 7f3bd78f6700 1 -- 172.21.15.100:0/2054525681 >> 172.21.15.100:0/2054525681 conn(0x7f3bd00f4bd0 msgr2=0x7f3bd00f6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:49:48.129 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.127+0000 7f3bd78f6700 1 -- 172.21.15.100:0/2054525681 shutdown_connections 2021-01-28T03:49:48.130 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.127+0000 7f3bd78f6700 1 -- 172.21.15.100:0/2054525681 wait complete. 2021-01-28T03:49:48.130 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.127+0000 7f3bd78f6700 1 Processor -- start 2021-01-28T03:49:48.131 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.127+0000 7f3bd78f6700 1 -- start start 2021-01-28T03:49:48.131 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.127+0000 7f3bd78f6700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bd0107cb0 0x7f3bd01080d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:49:48.131 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.127+0000 7f3bd78f6700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bd01085c0 con 0x7f3bd0107cb0 2021-01-28T03:49:48.131 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.127+0000 7f3bd5692700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bd0107cb0 0x7f3bd01080d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:49:48.132 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.127+0000 7f3bd5692700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bd0107cb0 0x7f3bd01080d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58804/0 (socket says 172.21.15.100:58804) 2021-01-28T03:49:48.132 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.127+0000 7f3bd5692700 1 -- 172.21.15.100:0/4044053355 learned_addr learned my addr 172.21.15.100:0/4044053355 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:49:48.132 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.127+0000 7f3bd5692700 1 -- 172.21.15.100:0/4044053355 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd0108700 con 0x7f3bd0107cb0 2021-01-28T03:49:48.132 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.131+0000 7f3bd5692700 1 --2- 172.21.15.100:0/4044053355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bd0107cb0 0x7f3bd01080d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f3bc4009c90 tx=0x7f3bc40092d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:49:48.132 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.131+0000 7f3bc27fc700 1 -- 172.21.15.100:0/4044053355 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3bc400bbf0 con 0x7f3bd0107cb0 2021-01-28T03:49:48.133 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.131+0000 7f3bc27fc700 1 -- 172.21.15.100:0/4044053355 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f3bc400bec0 con 0x7f3bd0107cb0 2021-01-28T03:49:48.133 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.131+0000 7f3bd78f6700 1 -- 172.21.15.100:0/4044053355 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bd0108f90 con 0x7f3bd0107cb0 2021-01-28T03:49:48.133 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.131+0000 7f3bc27fc700 1 -- 172.21.15.100:0/4044053355 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3bc40233b0 con 0x7f3bd0107cb0 2021-01-28T03:49:48.133 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.131+0000 7f3bd78f6700 1 -- 172.21.15.100:0/4044053355 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bd01093a0 con 0x7f3bd0107cb0 2021-01-28T03:49:48.133 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.131+0000 7f3bc27fc700 1 -- 172.21.15.100:0/4044053355 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) v1 ==== 623+0+0 (secure 0 0 0) 0x7f3bc402b070 con 0x7f3bd0107cb0 2021-01-28T03:49:48.134 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.131+0000 7f3bc27fc700 1 -- 172.21.15.100:0/4044053355 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f3bc40247c0 con 0x7f3bd0107cb0 2021-01-28T03:49:48.134 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.131+0000 7f3bd78f6700 1 -- 172.21.15.100:0/4044053355 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bd00581f0 con 0x7f3bd0107cb0 2021-01-28T03:49:48.136 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.135+0000 7f3bc27fc700 1 -- 172.21.15.100:0/4044053355 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72015 (secure 0 0 0) 0x7f3bc4029060 con 0x7f3bd0107cb0 2021-01-28T03:49:48.260 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.259+0000 7f3bd78f6700 1 -- 172.21.15.100:0/4044053355 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f3bd0109a00 con 0x7f3bd0107cb0 2021-01-28T03:49:48.261 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.263+0000 7f3bc27fc700 1 -- 172.21.15.100:0/4044053355 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+177 (secure 0 0 0) 0x7f3bc401f070 con 0x7f3bd0107cb0 2021-01-28T03:49:48.261 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.263+0000 7f3bd78f6700 1 -- 172.21.15.100:0/4044053355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bd0107cb0 msgr2=0x7f3bd01080d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:49:48.262 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.263+0000 7f3bd78f6700 1 --2- 172.21.15.100:0/4044053355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bd0107cb0 0x7f3bd01080d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f3bc4009c90 tx=0x7f3bc40092d0).stop 2021-01-28T03:49:48.263 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.263+0000 7f3bd78f6700 1 -- 172.21.15.100:0/4044053355 shutdown_connections 2021-01-28T03:49:48.263 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.263+0000 7f3bd78f6700 1 --2- 172.21.15.100:0/4044053355 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bd0107cb0 0x7f3bd01080d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:49:48.263 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.263+0000 7f3bd78f6700 1 -- 172.21.15.100:0/4044053355 >> 172.21.15.100:0/4044053355 conn(0x7f3bd00f4bd0 msgr2=0x7f3bd00f6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:49:48.263 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.263+0000 7f3bd78f6700 1 -- 172.21.15.100:0/4044053355 shutdown_connections 2021-01-28T03:49:48.263 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:48.263+0000 7f3bd78f6700 1 -- 172.21.15.100:0/4044053355 wait complete. 2021-01-28T03:49:48.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:48 smithi100 bash[9451]: audit 2021-01-28T03:49:48.266952+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.100:0/4044053355' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:49:48.910 INFO:teuthology.orchestra.run.smithi100.stderr:Restarting the monitor... 2021-01-28T03:49:48.911 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: systemctl restart ceph-c217df96-611b-11eb-8f9e-001a4aab830c@mon.a 2021-01-28T03:49:49.262 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:48 smithi100 systemd[1]: Stopping Ceph mon.a for c217df96-611b-11eb-8f9e-001a4aab830c... 2021-01-28T03:49:49.263 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:49 smithi100 bash[9451]: debug 2021-01-28T03:49:49.039+0000 7fd1011bd700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-01-28T03:49:49.263 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:49 smithi100 bash[9451]: debug 2021-01-28T03:49:49.039+0000 7fd1011bd700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2021-01-28T03:49:49.794 INFO:teuthology.orchestra.run.smithi100.stderr:Setting mon public_network... 2021-01-28T03:49:49.795 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi100 -v /var/log/ceph/c217df96-611b-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp3pxhmbk:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpih1yxits:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 config set mon public_network 172.21.0.0/20 2021-01-28T03:49:50.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:49 smithi100 docker[9771]: ceph-c217df96-611b-11eb-8f9e-001a4aab830c-mon.a 2021-01-28T03:49:50.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:49 smithi100 systemd[1]: ceph-c217df96-611b-11eb-8f9e-001a4aab830c@mon.a.service: Succeeded. 2021-01-28T03:49:50.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:49 smithi100 systemd[1]: Stopped Ceph mon.a for c217df96-611b-11eb-8f9e-001a4aab830c. 2021-01-28T03:49:50.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:49 smithi100 systemd[1]: Started Ceph mon.a for c217df96-611b-11eb-8f9e-001a4aab830c. 2021-01-28T03:49:51.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.435+0000 7f484f693700 0 set uid:gid to 167:167 (ceph:ceph) 2021-01-28T03:49:51.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.435+0000 7f484f693700 0 ceph version 17.0.0-184-g507028cb (507028cb839c25d6666833702df6325fd8569096) quincy (dev), process ceph-mon, pid 1 2021-01-28T03:49:51.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.435+0000 7f484f693700 0 pidfile_write: ignore empty --pid-file 2021-01-28T03:49:51.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 0 load: jerasure load: lrc load: isa 2021-01-28T03:49:51.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: RocksDB version: 6.8.1 2021-01-28T03:49:51.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-01-28T03:49:51.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Compile date Jan 27 2021 2021-01-28T03:49:51.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: DB SUMMARY 2021-01-28T03:49:51.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: CURRENT file: CURRENT 2021-01-28T03:49:51.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: IDENTITY file: IDENTITY 2021-01-28T03:49:51.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 131 Bytes 2021-01-28T03:49:51.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000004.sst 2021-01-28T03:49:51.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000006.log size: 72304 ; 2021-01-28T03:49:51.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.error_if_exists: 0 2021-01-28T03:49:51.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.create_if_missing: 0 2021-01-28T03:49:51.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.paranoid_checks: 1 2021-01-28T03:49:51.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.env: 0x55fbef2911c0 2021-01-28T03:49:51.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.fs: Posix File System 2021-01-28T03:49:51.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.info_log: 0x55fbf1527e80 2021-01-28T03:49:51.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.max_file_opening_threads: 16 2021-01-28T03:49:51.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.statistics: (nil) 2021-01-28T03:49:51.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.use_fsync: 0 2021-01-28T03:49:51.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.max_log_file_size: 0 2021-01-28T03:49:51.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-01-28T03:49:51.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-01-28T03:49:51.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.keep_log_file_num: 1000 2021-01-28T03:49:51.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.recycle_log_file_num: 0 2021-01-28T03:49:51.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.allow_fallocate: 1 2021-01-28T03:49:51.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.allow_mmap_reads: 0 2021-01-28T03:49:51.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.allow_mmap_writes: 0 2021-01-28T03:49:51.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.use_direct_reads: 0 2021-01-28T03:49:51.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-01-28T03:49:51.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.create_missing_column_families: 0 2021-01-28T03:49:51.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.db_log_dir: 2021-01-28T03:49:51.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2021-01-28T03:49:51.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-01-28T03:49:51.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.max_subcompactions: 1 2021-01-28T03:49:51.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.max_background_flushes: -1 2021-01-28T03:49:51.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-01-28T03:49:51.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-01-28T03:49:51.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-01-28T03:49:51.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-01-28T03:49:51.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-01-28T03:49:51.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.advise_random_on_open: 1 2021-01-28T03:49:51.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.db_write_buffer_size: 0 2021-01-28T03:49:51.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.write_buffer_manager: 0x55fbf1581bf0 2021-01-28T03:49:51.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-01-28T03:49:51.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-01-28T03:49:51.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-01-28T03:49:51.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-01-28T03:49:51.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.rate_limiter: (nil) 2021-01-28T03:49:51.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-01-28T03:49:51.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.wal_recovery_mode: 2 2021-01-28T03:49:51.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.enable_thread_tracking: 0 2021-01-28T03:49:51.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.enable_pipelined_write: 0 2021-01-28T03:49:51.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.unordered_write: 0 2021-01-28T03:49:51.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-01-28T03:49:51.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-01-28T03:49:51.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-01-28T03:49:51.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-01-28T03:49:51.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.row_cache: None 2021-01-28T03:49:51.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.wal_filter: None 2021-01-28T03:49:51.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-01-28T03:49:51.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.allow_ingest_behind: 0 2021-01-28T03:49:51.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.preserve_deletes: 0 2021-01-28T03:49:51.584 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.two_write_queues: 0 2021-01-28T03:49:51.584 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.manual_wal_flush: 0 2021-01-28T03:49:51.584 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.atomic_flush: 0 2021-01-28T03:49:51.584 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-01-28T03:49:51.584 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-01-28T03:49:51.585 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-01-28T03:49:51.585 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.log_readahead_size: 0 2021-01-28T03:49:51.585 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-01-28T03:49:51.585 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.max_background_jobs: 2 2021-01-28T03:49:51.585 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.max_background_compactions: -1 2021-01-28T03:49:51.586 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-01-28T03:49:51.586 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-01-28T03:49:51.586 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-01-28T03:49:51.586 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.max_total_wal_size: 0 2021-01-28T03:49:51.587 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-01-28T03:49:51.587 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-01-28T03:49:51.587 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-01-28T03:49:51.587 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-01-28T03:49:51.587 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.max_open_files: -1 2021-01-28T03:49:51.588 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.bytes_per_sync: 0 2021-01-28T03:49:51.588 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-01-28T03:49:51.588 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-01-28T03:49:51.588 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.compaction_readahead_size: 0 2021-01-28T03:49:51.588 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Compression algorithms supported: 2021-01-28T03:49:51.589 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-01-28T03:49:51.589 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: kZSTD supported: 0 2021-01-28T03:49:51.589 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: kXpressCompression supported: 0 2021-01-28T03:49:51.589 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: kLZ4HCCompression supported: 1 2021-01-28T03:49:51.589 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: kLZ4Compression supported: 1 2021-01-28T03:49:51.590 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: kBZip2Compression supported: 0 2021-01-28T03:49:51.590 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: kZlibCompression supported: 1 2021-01-28T03:49:51.590 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: kSnappyCompression supported: 1 2021-01-28T03:49:51.590 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-01-28T03:49:51.590 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2021-01-28T03:49:51.591 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-01-28T03:49:51.591 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-01-28T03:49:51.591 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.merge_operator: 2021-01-28T03:49:51.591 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.compaction_filter: None 2021-01-28T03:49:51.591 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.compaction_filter_factory: None 2021-01-28T03:49:51.592 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-01-28T03:49:51.592 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-01-28T03:49:51.592 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55fbf14d01e0) 2021-01-28T03:49:51.592 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: cache_index_and_filter_blocks: 1 2021-01-28T03:49:51.592 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: cache_index_and_filter_blocks_with_high_priority: 0 2021-01-28T03:49:51.593 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-01-28T03:49:51.593 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: pin_top_level_index_and_filter: 1 2021-01-28T03:49:51.593 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: index_type: 0 2021-01-28T03:49:51.593 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: data_block_index_type: 0 2021-01-28T03:49:51.597 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: index_shortening: 1 2021-01-28T03:49:51.598 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: data_block_hash_table_util_ratio: 0.750000 2021-01-28T03:49:51.598 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: hash_index_allow_collision: 1 2021-01-28T03:49:51.598 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: checksum: 1 2021-01-28T03:49:51.598 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: no_block_cache: 0 2021-01-28T03:49:51.598 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: block_cache: 0x55fbf1508510 2021-01-28T03:49:51.599 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: block_cache_name: BinnedLRUCache 2021-01-28T03:49:51.599 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: block_cache_options: 2021-01-28T03:49:51.599 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: capacity : 536870912 2021-01-28T03:49:51.599 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: num_shard_bits : 4 2021-01-28T03:49:51.600 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: strict_capacity_limit : 0 2021-01-28T03:49:51.600 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: high_pri_pool_ratio: 0.000 2021-01-28T03:49:51.600 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: block_cache_compressed: (nil) 2021-01-28T03:49:51.600 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: persistent_cache: (nil) 2021-01-28T03:49:51.600 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: block_size: 4096 2021-01-28T03:49:51.601 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: block_size_deviation: 10 2021-01-28T03:49:51.601 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: block_restart_interval: 16 2021-01-28T03:49:51.601 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: index_block_restart_interval: 1 2021-01-28T03:49:51.601 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: metadata_block_size: 4096 2021-01-28T03:49:51.601 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: partition_filters: 0 2021-01-28T03:49:51.602 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: use_delta_encoding: 1 2021-01-28T03:49:51.602 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: filter_policy: rocksdb.BuiltinBloomFilter 2021-01-28T03:49:51.602 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: whole_key_filtering: 1 2021-01-28T03:49:51.602 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: verify_compression: 0 2021-01-28T03:49:51.602 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: read_amp_bytes_per_bit: 0 2021-01-28T03:49:51.603 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: format_version: 2 2021-01-28T03:49:51.603 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: enable_index_compression: 1 2021-01-28T03:49:51.603 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: block_align: 0 2021-01-28T03:49:51.603 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.write_buffer_size: 33554432 2021-01-28T03:49:51.603 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.max_write_buffer_number: 2 2021-01-28T03:49:51.604 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.compression: NoCompression 2021-01-28T03:49:51.604 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.bottommost_compression: Disabled 2021-01-28T03:49:51.604 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.prefix_extractor: nullptr 2021-01-28T03:49:51.604 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-01-28T03:49:51.604 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.num_levels: 7 2021-01-28T03:49:51.605 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-01-28T03:49:51.605 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-01-28T03:49:51.605 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-01-28T03:49:51.605 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-01-28T03:49:51.605 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-01-28T03:49:51.606 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-01-28T03:49:51.606 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-01-28T03:49:51.606 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-01-28T03:49:51.606 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-01-28T03:49:51.606 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-01-28T03:49:51.607 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.compression_opts.level: 32767 2021-01-28T03:49:51.607 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.compression_opts.strategy: 0 2021-01-28T03:49:51.607 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-01-28T03:49:51.607 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-01-28T03:49:51.607 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.compression_opts.enabled: false 2021-01-28T03:49:51.608 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-01-28T03:49:51.608 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-01-28T03:49:51.608 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-01-28T03:49:51.608 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.target_file_size_base: 67108864 2021-01-28T03:49:51.608 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-01-28T03:49:51.609 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-01-28T03:49:51.609 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-01-28T03:49:51.609 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-01-28T03:49:51.609 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-01-28T03:49:51.609 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-01-28T03:49:51.610 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-01-28T03:49:51.610 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-01-28T03:49:51.610 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-01-28T03:49:51.610 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-01-28T03:49:51.610 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-01-28T03:49:51.611 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-01-28T03:49:51.611 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-01-28T03:49:51.611 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.arena_block_size: 4194304 2021-01-28T03:49:51.611 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-01-28T03:49:51.612 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-01-28T03:49:51.612 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-01-28T03:49:51.612 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.disable_auto_compactions: 0 2021-01-28T03:49:51.612 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-01-28T03:49:51.612 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-01-28T03:49:51.613 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-01-28T03:49:51.613 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-01-28T03:49:51.613 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-01-28T03:49:51.613 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-01-28T03:49:51.613 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-01-28T03:49:51.614 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-01-28T03:49:51.614 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-01-28T03:49:51.614 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-01-28T03:49:51.614 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.table_properties_collectors: 2021-01-28T03:49:51.614 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.inplace_update_support: 0 2021-01-28T03:49:51.615 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-01-28T03:49:51.615 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-01-28T03:49:51.615 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-01-28T03:49:51.615 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-01-28T03:49:51.615 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.bloom_locality: 0 2021-01-28T03:49:51.616 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.max_successive_merges: 0 2021-01-28T03:49:51.616 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-01-28T03:49:51.616 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.paranoid_file_checks: 0 2021-01-28T03:49:51.616 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.force_consistency_checks: 0 2021-01-28T03:49:51.616 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.report_bg_io_stats: 0 2021-01-28T03:49:51.617 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.ttl: 2592000 2021-01-28T03:49:51.617 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-01-28T03:49:51.617 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-01-28T03:49:51.617 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.439+0000 7f484f693700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 4 2021-01-28T03:49:51.618 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.443+0000 7f484f693700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611805791447352, "job": 1, "event": "recovery_started", "log_files": [6]} 2021-01-28T03:49:51.618 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.443+0000 7f484f693700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #6 mode 2 2021-01-28T03:49:51.618 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.443+0000 7f484f693700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-01-28T03:49:51.618 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.443+0000 7f484f693700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611805791450094, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 68745, "table_properties": {"data_size": 67038, "index_size": 312, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 581, "raw_key_size": 9364, "raw_average_key_size": 46, "raw_value_size": 61717, "raw_average_value_size": 308, "num_data_blocks": 10, "num_entries": 200, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1611805791, "oldest_key_time": 3, "file_creation_time": 0}} 2021-01-28T03:49:51.618 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.443+0000 7f484f693700 4 rocksdb: [version_set.cc:3826] Creating manifest 8 2021-01-28T03:49:51.619 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.443+0000 7f484f693700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611805791451144, "job": 1, "event": "recovery_finished"} 2021-01-28T03:49:51.619 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.447+0000 7f484f693700 4 rocksdb: DB pointer 0x55fbf15c7800 2021-01-28T03:49:51.619 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.447+0000 7f48364b4700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-01-28T03:49:51.619 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.447+0000 7f48364b4700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-01-28T03:49:51.619 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: ** DB Stats ** 2021-01-28T03:49:51.620 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-28T03:49:51.620 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-01-28T03:49:51.620 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-01-28T03:49:51.620 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-28T03:49:51.620 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-01-28T03:49:51.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-01-28T03:49:51.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-28T03:49:51.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: ** Compaction Stats [default] ** 2021-01-28T03:49:51.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-28T03:49:51.621 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-28T03:49:51.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: L0 2/0 68.79 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 38.0 0.00 0.00 1 0.002 0 0 2021-01-28T03:49:51.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: Sum 2/0 68.79 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 38.0 0.00 0.00 1 0.002 0 0 2021-01-28T03:49:51.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 38.0 0.00 0.00 1 0.002 0 0 2021-01-28T03:49:51.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: ** Compaction Stats [default] ** 2021-01-28T03:49:51.622 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-28T03:49:51.623 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-28T03:49:51.623 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 38.0 0.00 0.00 1 0.002 0 0 2021-01-28T03:49:51.623 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-28T03:49:51.623 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: Flush(GB): cumulative 0.000, interval 0.000 2021-01-28T03:49:51.623 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-28T03:49:51.624 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: AddFile(Total Files): cumulative 0, interval 0 2021-01-28T03:49:51.624 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: AddFile(L0 Files): cumulative 0, interval 0 2021-01-28T03:49:51.624 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: AddFile(Keys): cumulative 0, interval 0 2021-01-28T03:49:51.624 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: Cumulative compaction: 0.00 GB write, 9.24 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-28T03:49:51.624 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: Interval compaction: 0.00 GB write, 9.24 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-28T03:49:51.625 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-28T03:49:51.625 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: ** File Read Latency Histogram By Level [default] ** 2021-01-28T03:49:51.625 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: ** Compaction Stats [default] ** 2021-01-28T03:49:51.625 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-28T03:49:51.626 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-28T03:49:51.626 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: L0 2/0 68.79 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 38.0 0.00 0.00 1 0.002 0 0 2021-01-28T03:49:51.626 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: Sum 2/0 68.79 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 38.0 0.00 0.00 1 0.002 0 0 2021-01-28T03:49:51.626 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-01-28T03:49:51.626 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: ** Compaction Stats [default] ** 2021-01-28T03:49:51.627 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-28T03:49:51.627 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-28T03:49:51.627 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 38.0 0.00 0.00 1 0.002 0 0 2021-01-28T03:49:51.627 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-28T03:49:51.627 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: Flush(GB): cumulative 0.000, interval 0.000 2021-01-28T03:49:51.628 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-28T03:49:51.628 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: AddFile(Total Files): cumulative 0, interval 0 2021-01-28T03:49:51.628 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: AddFile(L0 Files): cumulative 0, interval 0 2021-01-28T03:49:51.628 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: AddFile(Keys): cumulative 0, interval 0 2021-01-28T03:49:51.628 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: Cumulative compaction: 0.00 GB write, 9.19 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-28T03:49:51.629 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-28T03:49:51.629 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-28T03:49:51.629 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: ** File Read Latency Histogram By Level [default] ** 2021-01-28T03:49:51.629 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.447+0000 7f484f693700 0 starting mon.a rank 0 at public addrs [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] at bind addrs [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid c217df96-611b-11eb-8f9e-001a4aab830c 2021-01-28T03:49:51.629 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.451+0000 7f484f693700 1 mon.a@-1(???) e1 preinit fsid c217df96-611b-11eb-8f9e-001a4aab830c 2021-01-28T03:49:51.630 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.451+0000 7f484f693700 0 mon.a@-1(???).mds e1 new map 2021-01-28T03:49:51.630 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.451+0000 7f484f693700 0 mon.a@-1(???).mds e1 print_map 2021-01-28T03:49:51.630 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: e1 2021-01-28T03:49:51.630 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: enable_multiple, ever_enabled_multiple: 1,1 2021-01-28T03:49:51.630 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-01-28T03:49:51.631 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: legacy client fscid: -1 2021-01-28T03:49:51.631 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: 2021-01-28T03:49:51.631 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: No filesystems configured 2021-01-28T03:49:51.631 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.451+0000 7f484f693700 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2021-01-28T03:49:51.631 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.451+0000 7f484f693700 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-01-28T03:49:51.632 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.451+0000 7f484f693700 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-01-28T03:49:51.632 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.451+0000 7f484f693700 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-01-28T03:49:51.632 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: audit 2021-01-28T03:49:48.266952+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.100:0/4044053355' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:49:51.632 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.451+0000 7f484f693700 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2021-01-28T03:49:51.632 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.451+0000 7f484f693700 20 expand_channel_meta expand map: {default=false} 2021-01-28T03:49:51.633 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.451+0000 7f484f693700 20 expand_channel_meta from 'false' to 'false' 2021-01-28T03:49:51.633 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.451+0000 7f484f693700 20 expand_channel_meta expanded map: {default=false} 2021-01-28T03:49:51.633 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.451+0000 7f484f693700 20 expand_channel_meta expand map: {default=info} 2021-01-28T03:49:51.633 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.451+0000 7f484f693700 20 expand_channel_meta from 'info' to 'info' 2021-01-28T03:49:51.633 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.451+0000 7f484f693700 20 expand_channel_meta expanded map: {default=info} 2021-01-28T03:49:51.634 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.451+0000 7f484f693700 20 expand_channel_meta expand map: {default=daemon} 2021-01-28T03:49:51.634 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.451+0000 7f484f693700 20 expand_channel_meta from 'daemon' to 'daemon' 2021-01-28T03:49:51.634 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.451+0000 7f484f693700 20 expand_channel_meta expanded map: {default=daemon} 2021-01-28T03:49:51.634 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.451+0000 7f484f693700 20 expand_channel_meta expand map: {default=debug} 2021-01-28T03:49:51.634 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.451+0000 7f484f693700 20 expand_channel_meta from 'debug' to 'debug' 2021-01-28T03:49:51.635 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: debug 2021-01-28T03:49:51.451+0000 7f484f693700 20 expand_channel_meta expanded map: {default=debug} 2021-01-28T03:49:51.635 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: cluster 2021-01-28T03:49:51.462196+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2021-01-28T03:49:51.635 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: cluster 2021-01-28T03:49:51.462284+0000 mon.a (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0]} 2021-01-28T03:49:51.635 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: cluster 2021-01-28T03:49:51.462330+0000 mon.a (mon.0) 3 : cluster [DBG] fsmap 2021-01-28T03:49:51.635 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: cluster 2021-01-28T03:49:51.462365+0000 mon.a (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2021-01-28T03:49:51.636 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:51 smithi100 bash[9834]: cluster 2021-01-28T03:49:51.462779+0000 mon.a (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2021-01-28T03:49:51.636 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.571+0000 7f0149ca9700 1 Processor -- start 2021-01-28T03:49:51.636 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.571+0000 7f0149ca9700 1 -- start start 2021-01-28T03:49:51.636 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.571+0000 7f0149ca9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f014406d400 0x7f01440fbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T03:49:51.637 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.571+0000 7f0149ca9700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01440fc380 con 0x7f014406d400 2021-01-28T03:49:51.637 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.571+0000 7f0148ca7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f014406d400 0x7f01440fbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:49:51.637 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.571+0000 7f0148ca7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f014406d400 0x7f01440fbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58806/0 (socket says 172.21.15.100:58806) 2021-01-28T03:49:51.637 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.571+0000 7f0148ca7700 1 -- 172.21.15.100:0/3149542729 learned_addr learned my addr 172.21.15.100:0/3149542729 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:49:51.638 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.575+0000 7f0148ca7700 1 -- 172.21.15.100:0/3149542729 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01440fc4c0 con 0x7f014406d400 2021-01-28T03:49:51.638 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.575+0000 7f0148ca7700 1 --2- 172.21.15.100:0/3149542729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f014406d400 0x7f01440fbe90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f013800b950 tx=0x7f0138006ee0).ready entity=mon.0 client_cookie=496653e494837f70 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:49:51.638 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.575+0000 7f01437fe700 1 -- 172.21.15.100:0/3149542729 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01380098d0 con 0x7f014406d400 2021-01-28T03:49:51.638 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.575+0000 7f01437fe700 1 -- 172.21.15.100:0/3149542729 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f0138009e90 con 0x7f014406d400 2021-01-28T03:49:51.638 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.575+0000 7f01437fe700 1 -- 172.21.15.100:0/3149542729 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0138011d10 con 0x7f014406d400 2021-01-28T03:49:51.639 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.575+0000 7f0149ca9700 1 -- 172.21.15.100:0/3149542729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f014406d400 msgr2=0x7f01440fbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:49:51.639 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.575+0000 7f0149ca9700 1 --2- 172.21.15.100:0/3149542729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f014406d400 0x7f01440fbe90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f013800b950 tx=0x7f0138006ee0).stop 2021-01-28T03:49:51.639 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.575+0000 7f0149ca9700 1 -- 172.21.15.100:0/3149542729 shutdown_connections 2021-01-28T03:49:51.639 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.575+0000 7f0149ca9700 1 --2- 172.21.15.100:0/3149542729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f014406d400 0x7f01440fbe90 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:49:51.639 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.575+0000 7f0149ca9700 1 -- 172.21.15.100:0/3149542729 >> 172.21.15.100:0/3149542729 conn(0x7f01440f3930 msgr2=0x7f01440f5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:49:51.640 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.575+0000 7f0149ca9700 1 -- 172.21.15.100:0/3149542729 shutdown_connections 2021-01-28T03:49:51.640 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.575+0000 7f0149ca9700 1 -- 172.21.15.100:0/3149542729 wait complete. 2021-01-28T03:49:51.640 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.575+0000 7f0149ca9700 1 Processor -- start 2021-01-28T03:49:51.640 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.575+0000 7f0149ca9700 1 -- start start 2021-01-28T03:49:51.640 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.575+0000 7f0149ca9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f014406d400 0x7f01440f9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:49:51.641 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.575+0000 7f0149ca9700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01440f7d90 con 0x7f014406d400 2021-01-28T03:49:51.641 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.575+0000 7f0148ca7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f014406d400 0x7f01440f9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:49:51.641 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.575+0000 7f0148ca7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f014406d400 0x7f01440f9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58808/0 (socket says 172.21.15.100:58808) 2021-01-28T03:49:51.641 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.575+0000 7f0148ca7700 1 -- 172.21.15.100:0/2628159142 learned_addr learned my addr 172.21.15.100:0/2628159142 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:49:51.641 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.579+0000 7f0148ca7700 1 -- 172.21.15.100:0/2628159142 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01440f7ed0 con 0x7f014406d400 2021-01-28T03:49:51.642 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.579+0000 7f0148ca7700 1 --2- 172.21.15.100:0/2628159142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f014406d400 0x7f01440f9910 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f0138009420 tx=0x7f0138006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:49:51.642 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.579+0000 7f01417fa700 1 -- 172.21.15.100:0/2628159142 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0138011b50 con 0x7f014406d400 2021-01-28T03:49:51.642 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.579+0000 7f01417fa700 1 -- 172.21.15.100:0/2628159142 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f0138011770 con 0x7f014406d400 2021-01-28T03:49:51.642 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.579+0000 7f0149ca9700 1 -- 172.21.15.100:0/2628159142 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01440f80c0 con 0x7f014406d400 2021-01-28T03:49:51.642 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.579+0000 7f01417fa700 1 -- 172.21.15.100:0/2628159142 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f013801bb00 con 0x7f014406d400 2021-01-28T03:49:51.643 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.579+0000 7f0149ca9700 1 -- 172.21.15.100:0/2628159142 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01440f8550 con 0x7f014406d400 2021-01-28T03:49:51.643 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.579+0000 7f01417fa700 1 -- 172.21.15.100:0/2628159142 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) v1 ==== 623+0+0 (secure 0 0 0) 0x7f013802b070 con 0x7f014406d400 2021-01-28T03:49:51.643 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.579+0000 7f01417fa700 1 -- 172.21.15.100:0/2628159142 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f01380233b0 con 0x7f014406d400 2021-01-28T03:49:51.643 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.579+0000 7f012effd700 1 -- 172.21.15.100:0/2628159142 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f011c004da0 con 0x7f014406d400 2021-01-28T03:49:51.643 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.583+0000 7f01417fa700 1 -- 172.21.15.100:0/2628159142 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72015 (secure 0 0 0) 0x7f013801f020 con 0x7f014406d400 2021-01-28T03:49:51.704 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.703+0000 7f012effd700 1 -- 172.21.15.100:0/2628159142 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f011c0059f0 con 0x7f014406d400 2021-01-28T03:49:51.711 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.711+0000 7f01417fa700 1 -- 172.21.15.100:0/2628159142 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f0138016070 con 0x7f014406d400 2021-01-28T03:49:51.712 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.711+0000 7f012effd700 1 -- 172.21.15.100:0/2628159142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f014406d400 msgr2=0x7f01440f9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:49:51.712 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.711+0000 7f012effd700 1 --2- 172.21.15.100:0/2628159142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f014406d400 0x7f01440f9910 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f0138009420 tx=0x7f0138006ee0).stop 2021-01-28T03:49:51.713 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.711+0000 7f012effd700 1 -- 172.21.15.100:0/2628159142 shutdown_connections 2021-01-28T03:49:51.713 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.711+0000 7f012effd700 1 --2- 172.21.15.100:0/2628159142 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f014406d400 0x7f01440f9910 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:49:51.713 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.711+0000 7f012effd700 1 -- 172.21.15.100:0/2628159142 >> 172.21.15.100:0/2628159142 conn(0x7f01440f3930 msgr2=0x7f01440f4730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:49:51.714 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.715+0000 7f012effd700 1 -- 172.21.15.100:0/2628159142 shutdown_connections 2021-01-28T03:49:51.714 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:51.715+0000 7f012effd700 1 -- 172.21.15.100:0/2628159142 wait complete. 2021-01-28T03:49:52.490 INFO:teuthology.orchestra.run.smithi100.stderr:Wrote config to /etc/ceph/ceph.conf 2021-01-28T03:49:52.491 INFO:teuthology.orchestra.run.smithi100.stderr:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2021-01-28T03:49:52.491 INFO:teuthology.orchestra.run.smithi100.stderr:Creating mgr... 2021-01-28T03:49:52.491 INFO:teuthology.orchestra.run.smithi100.stderr:Verifying port 9283 ... 2021-01-28T03:49:52.493 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: systemctl daemon-reload 2021-01-28T03:49:52.707 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: systemctl stop ceph-c217df96-611b-11eb-8f9e-001a4aab830c@mgr.y 2021-01-28T03:49:52.719 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: systemctl reset-failed ceph-c217df96-611b-11eb-8f9e-001a4aab830c@mgr.y 2021-01-28T03:49:52.724 INFO:teuthology.orchestra.run.smithi100.stderr:systemctl: Failed to reset failed state of unit ceph-c217df96-611b-11eb-8f9e-001a4aab830c@mgr.y.service: Unit ceph-c217df96-611b-11eb-8f9e-001a4aab830c@mgr.y.service not loaded. 2021-01-28T03:49:52.725 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: systemctl enable ceph-c217df96-611b-11eb-8f9e-001a4aab830c@mgr.y 2021-01-28T03:49:52.731 INFO:teuthology.orchestra.run.smithi100.stderr:systemctl: Created symlink /etc/systemd/system/ceph-c217df96-611b-11eb-8f9e-001a4aab830c.target.wants/ceph-c217df96-611b-11eb-8f9e-001a4aab830c@mgr.y.service -> /etc/systemd/system/ceph-c217df96-611b-11eb-8f9e-001a4aab830c@.service. 2021-01-28T03:49:52.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:52 smithi100 bash[9834]: audit 2021-01-28T03:49:51.717900+0000 mon.a (mon.0) 6 : audit [INF] from='client.? 172.21.15.100:0/2628159142' entity='client.admin' 2021-01-28T03:49:52.930 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: systemctl start ceph-c217df96-611b-11eb-8f9e-001a4aab830c@mgr.y 2021-01-28T03:49:52.942 INFO:teuthology.orchestra.run.smithi100.stderr:firewalld does not appear to be present 2021-01-28T03:49:52.942 INFO:teuthology.orchestra.run.smithi100.stderr:Not possible to enable service . firewalld.service is not available 2021-01-28T03:49:52.943 INFO:teuthology.orchestra.run.smithi100.stderr:Not possible to open ports <[]>. firewalld.service is not available 2021-01-28T03:49:52.943 INFO:teuthology.orchestra.run.smithi100.stderr:firewalld does not appear to be present 2021-01-28T03:49:52.944 INFO:teuthology.orchestra.run.smithi100.stderr:Not possible to open ports <[9283]>. firewalld.service is not available 2021-01-28T03:49:52.944 INFO:teuthology.orchestra.run.smithi100.stderr:Waiting for mgr to start... 2021-01-28T03:49:52.944 INFO:teuthology.orchestra.run.smithi100.stderr:Waiting for mgr... 2021-01-28T03:49:52.944 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi100 -v /var/log/ceph/c217df96-611b-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp3pxhmbk:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpih1yxits:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 status -f json-pretty 2021-01-28T03:49:54.454 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.455+0000 7fbfdaa4c700 1 Processor -- start 2021-01-28T03:49:54.455 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.455+0000 7fbfdaa4c700 1 -- start start 2021-01-28T03:49:54.455 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.455+0000 7fbfdaa4c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfd40f76b0 0x7fbfd40f7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T03:49:54.455 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.455+0000 7fbfdaa4c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd40f8050 con 0x7fbfd40f76b0 2021-01-28T03:49:54.458 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.455+0000 7fbfd3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfd40f76b0 0x7fbfd40f7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:49:54.459 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.455+0000 7fbfd3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfd40f76b0 0x7fbfd40f7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58814/0 (socket says 172.21.15.100:58814) 2021-01-28T03:49:54.459 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.455+0000 7fbfd3fff700 1 -- 172.21.15.100:0/572976913 learned_addr learned my addr 172.21.15.100:0/572976913 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:49:54.460 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.455+0000 7fbfd3fff700 1 -- 172.21.15.100:0/572976913 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd40f8190 con 0x7fbfd40f76b0 2021-01-28T03:49:54.460 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.455+0000 7fbfd3fff700 1 --2- 172.21.15.100:0/572976913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfd40f76b0 0x7fbfd40f7ad0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fbfc800b950 tx=0x7fbfc8006ee0).ready entity=mon.0 client_cookie=7b8b3450f2045962 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:49:54.461 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.455+0000 7fbfd2ffd700 1 -- 172.21.15.100:0/572976913 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfc8009840 con 0x7fbfd40f76b0 2021-01-28T03:49:54.461 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.455+0000 7fbfd2ffd700 1 -- 172.21.15.100:0/572976913 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fbfc8009e00 con 0x7fbfd40f76b0 2021-01-28T03:49:54.461 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.455+0000 7fbfd2ffd700 1 -- 172.21.15.100:0/572976913 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfc8011c80 con 0x7fbfd40f76b0 2021-01-28T03:49:54.462 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.459+0000 7fbfdaa4c700 1 -- 172.21.15.100:0/572976913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfd40f76b0 msgr2=0x7fbfd40f7ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:49:54.462 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.459+0000 7fbfdaa4c700 1 --2- 172.21.15.100:0/572976913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfd40f76b0 0x7fbfd40f7ad0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fbfc800b950 tx=0x7fbfc8006ee0).stop 2021-01-28T03:49:54.463 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.459+0000 7fbfdaa4c700 1 -- 172.21.15.100:0/572976913 shutdown_connections 2021-01-28T03:49:54.463 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.459+0000 7fbfdaa4c700 1 --2- 172.21.15.100:0/572976913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfd40f76b0 0x7fbfd40f7ad0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:49:54.463 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.459+0000 7fbfdaa4c700 1 -- 172.21.15.100:0/572976913 >> 172.21.15.100:0/572976913 conn(0x7fbfd40f31a0 msgr2=0x7fbfd40f55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:49:54.464 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.459+0000 7fbfdaa4c700 1 -- 172.21.15.100:0/572976913 shutdown_connections 2021-01-28T03:49:54.464 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.459+0000 7fbfdaa4c700 1 -- 172.21.15.100:0/572976913 wait complete. 2021-01-28T03:49:54.468 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.459+0000 7fbfdaa4c700 1 Processor -- start 2021-01-28T03:49:54.468 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.459+0000 7fbfdaa4c700 1 -- start start 2021-01-28T03:49:54.469 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.459+0000 7fbfdaa4c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfd40f76b0 0x7fbfd4107aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:49:54.469 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.459+0000 7fbfdaa4c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd4107f90 con 0x7fbfd40f76b0 2021-01-28T03:49:54.469 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.463+0000 7fbfd3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfd40f76b0 0x7fbfd4107aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:49:54.470 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.463+0000 7fbfd3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfd40f76b0 0x7fbfd4107aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58816/0 (socket says 172.21.15.100:58816) 2021-01-28T03:49:54.470 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.463+0000 7fbfd3fff700 1 -- 172.21.15.100:0/3486655942 learned_addr learned my addr 172.21.15.100:0/3486655942 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:49:54.471 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.463+0000 7fbfd3fff700 1 -- 172.21.15.100:0/3486655942 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd41080d0 con 0x7fbfd40f76b0 2021-01-28T03:49:54.471 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.463+0000 7fbfd3fff700 1 --2- 172.21.15.100:0/3486655942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfd40f76b0 0x7fbfd4107aa0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fbfc8009420 tx=0x7fbfc8006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:49:54.471 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.463+0000 7fbfd0ff9700 1 -- 172.21.15.100:0/3486655942 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfc8011ae0 con 0x7fbfd40f76b0 2021-01-28T03:49:54.472 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.463+0000 7fbfd0ff9700 1 -- 172.21.15.100:0/3486655942 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fbfc8010ec0 con 0x7fbfd40f76b0 2021-01-28T03:49:54.472 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.463+0000 7fbfdaa4c700 1 -- 172.21.15.100:0/3486655942 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd4108320 con 0x7fbfd40f76b0 2021-01-28T03:49:54.473 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.463+0000 7fbfd0ff9700 1 -- 172.21.15.100:0/3486655942 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbfc801bae0 con 0x7fbfd40f76b0 2021-01-28T03:49:54.473 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.463+0000 7fbfdaa4c700 1 -- 172.21.15.100:0/3486655942 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd4108e80 con 0x7fbfd40f76b0 2021-01-28T03:49:54.473 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.463+0000 7fbfd0ff9700 1 -- 172.21.15.100:0/3486655942 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) v1 ==== 623+0+0 (secure 0 0 0) 0x7fbfc802b070 con 0x7fbfd40f76b0 2021-01-28T03:49:54.474 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.463+0000 7fbfd0ff9700 1 -- 172.21.15.100:0/3486655942 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7fbfc8023720 con 0x7fbfd40f76b0 2021-01-28T03:49:54.474 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.463+0000 7fbfdaa4c700 1 -- 172.21.15.100:0/3486655942 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfb4004da0 con 0x7fbfd40f76b0 2021-01-28T03:49:54.475 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.467+0000 7fbfd0ff9700 1 -- 172.21.15.100:0/3486655942 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72015 (secure 0 0 0) 0x7fbfc801f020 con 0x7fbfd40f76b0 2021-01-28T03:49:54.597 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.599+0000 7fbfdaa4c700 1 -- 172.21.15.100:0/3486655942 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fbfb4005470 con 0x7fbfd40f76b0 2021-01-28T03:49:54.608 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.599+0000 7fbfd0ff9700 1 -- 172.21.15.100:0/3486655942 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1221 (secure 0 0 0) 0x7fbfc8016070 con 0x7fbfd40f76b0 2021-01-28T03:49:54.608 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.609 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: { 2021-01-28T03:49:54.609 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "fsid": "c217df96-611b-11eb-8f9e-001a4aab830c", 2021-01-28T03:49:54.609 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "health": { 2021-01-28T03:49:54.610 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2021-01-28T03:49:54.610 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "checks": {}, 2021-01-28T03:49:54.610 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "mutes": [] 2021-01-28T03:49:54.611 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: }, 2021-01-28T03:49:54.611 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "election_epoch": 5, 2021-01-28T03:49:54.611 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "quorum": [ 2021-01-28T03:49:54.612 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 0 2021-01-28T03:49:54.612 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: ], 2021-01-28T03:49:54.613 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "quorum_names": [ 2021-01-28T03:49:54.613 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "a" 2021-01-28T03:49:54.613 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: ], 2021-01-28T03:49:54.614 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "quorum_age": 3, 2021-01-28T03:49:54.614 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "monmap": { 2021-01-28T03:49:54.615 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-28T03:49:54.615 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2021-01-28T03:49:54.615 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "num_mons": 1 2021-01-28T03:49:54.616 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: }, 2021-01-28T03:49:54.616 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "osdmap": { 2021-01-28T03:49:54.617 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-28T03:49:54.617 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "num_osds": 0, 2021-01-28T03:49:54.618 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "num_up_osds": 0, 2021-01-28T03:49:54.618 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "osd_up_since": 0, 2021-01-28T03:49:54.618 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "num_in_osds": 0, 2021-01-28T03:49:54.619 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "osd_in_since": 0, 2021-01-28T03:49:54.619 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2021-01-28T03:49:54.620 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: }, 2021-01-28T03:49:54.620 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "pgmap": { 2021-01-28T03:49:54.620 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "pgs_by_state": [], 2021-01-28T03:49:54.621 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "num_pgs": 0, 2021-01-28T03:49:54.621 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "num_pools": 0, 2021-01-28T03:49:54.622 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "num_objects": 0, 2021-01-28T03:49:54.622 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "data_bytes": 0, 2021-01-28T03:49:54.622 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "bytes_used": 0, 2021-01-28T03:49:54.623 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "bytes_avail": 0, 2021-01-28T03:49:54.623 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "bytes_total": 0 2021-01-28T03:49:54.623 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: }, 2021-01-28T03:49:54.624 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "fsmap": { 2021-01-28T03:49:54.624 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-28T03:49:54.625 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "by_rank": [], 2021-01-28T03:49:54.625 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "up:standby": 0 2021-01-28T03:49:54.625 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: }, 2021-01-28T03:49:54.626 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "mgrmap": { 2021-01-28T03:49:54.626 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "available": false, 2021-01-28T03:49:54.627 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "num_standbys": 0, 2021-01-28T03:49:54.627 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "modules": [ 2021-01-28T03:49:54.627 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "iostat", 2021-01-28T03:49:54.628 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "restful" 2021-01-28T03:49:54.628 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: ], 2021-01-28T03:49:54.629 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "services": {} 2021-01-28T03:49:54.629 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: }, 2021-01-28T03:49:54.629 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "servicemap": { 2021-01-28T03:49:54.630 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-28T03:49:54.630 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "modified": "2021-01-28T03:49:43.979220+0000", 2021-01-28T03:49:54.631 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "services": {} 2021-01-28T03:49:54.631 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: }, 2021-01-28T03:49:54.632 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "progress_events": {} 2021-01-28T03:49:54.632 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: } 2021-01-28T03:49:54.632 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.599+0000 7fbfdaa4c700 1 -- 172.21.15.100:0/3486655942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfd40f76b0 msgr2=0x7fbfd4107aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:49:54.632 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.599+0000 7fbfdaa4c700 1 --2- 172.21.15.100:0/3486655942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfd40f76b0 0x7fbfd4107aa0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fbfc8009420 tx=0x7fbfc8006ee0).stop 2021-01-28T03:49:54.633 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.599+0000 7fbfdaa4c700 1 -- 172.21.15.100:0/3486655942 shutdown_connections 2021-01-28T03:49:54.633 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.599+0000 7fbfdaa4c700 1 --2- 172.21.15.100:0/3486655942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfd40f76b0 0x7fbfd4107aa0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:49:54.633 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.599+0000 7fbfdaa4c700 1 -- 172.21.15.100:0/3486655942 >> 172.21.15.100:0/3486655942 conn(0x7fbfd40f31a0 msgr2=0x7fbfd40f3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:49:54.633 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.599+0000 7fbfdaa4c700 1 -- 172.21.15.100:0/3486655942 shutdown_connections 2021-01-28T03:49:54.634 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:54.599+0000 7fbfdaa4c700 1 -- 172.21.15.100:0/3486655942 wait complete. 2021-01-28T03:49:55.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:54 smithi100 bash[9834]: audit 2021-01-28T03:49:54.604313+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.15.100:0/3486655942' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-01-28T03:49:55.274 INFO:teuthology.orchestra.run.smithi100.stderr:mgr not available, waiting (1/15)... 2021-01-28T03:49:57.276 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi100 -v /var/log/ceph/c217df96-611b-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp3pxhmbk:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpih1yxits:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 status -f json-pretty 2021-01-28T03:49:58.433 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.435+0000 7fbca9659700 1 Processor -- start 2021-01-28T03:49:58.434 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.435+0000 7fbca9659700 1 -- start start 2021-01-28T03:49:58.435 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.435+0000 7fbca9659700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbca40f8110 0x7fbca40f8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T03:49:58.435 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.435+0000 7fbca9659700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca40f8a20 con 0x7fbca40f8110 2021-01-28T03:49:58.436 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.435+0000 7fbca3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbca40f8110 0x7fbca40f8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:49:58.436 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.435+0000 7fbca3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbca40f8110 0x7fbca40f8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58818/0 (socket says 172.21.15.100:58818) 2021-01-28T03:49:58.436 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.435+0000 7fbca3fff700 1 -- 172.21.15.100:0/1527499672 learned_addr learned my addr 172.21.15.100:0/1527499672 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:49:58.436 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.435+0000 7fbca3fff700 1 -- 172.21.15.100:0/1527499672 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca40f8b60 con 0x7fbca40f8110 2021-01-28T03:49:58.436 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.435+0000 7fbca3fff700 1 --2- 172.21.15.100:0/1527499672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbca40f8110 0x7fbca40f8530 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fbc9400bbd0 tx=0x7fbc94006f70).ready entity=mon.0 client_cookie=69d4590640f140f server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:49:58.437 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.435+0000 7fbca2ffd700 1 -- 172.21.15.100:0/1527499672 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbc9400dbf0 con 0x7fbca40f8110 2021-01-28T03:49:58.437 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.435+0000 7fbca2ffd700 1 -- 172.21.15.100:0/1527499672 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fbc9400dd50 con 0x7fbca40f8110 2021-01-28T03:49:58.437 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.435+0000 7fbca2ffd700 1 -- 172.21.15.100:0/1527499672 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbc9400f4f0 con 0x7fbca40f8110 2021-01-28T03:49:58.438 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.439+0000 7fbca9659700 1 -- 172.21.15.100:0/1527499672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbca40f8110 msgr2=0x7fbca40f8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:49:58.438 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.439+0000 7fbca9659700 1 --2- 172.21.15.100:0/1527499672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbca40f8110 0x7fbca40f8530 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fbc9400bbd0 tx=0x7fbc94006f70).stop 2021-01-28T03:49:58.438 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.439+0000 7fbca9659700 1 -- 172.21.15.100:0/1527499672 shutdown_connections 2021-01-28T03:49:58.439 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.439+0000 7fbca9659700 1 --2- 172.21.15.100:0/1527499672 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbca40f8110 0x7fbca40f8530 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:49:58.439 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.439+0000 7fbca9659700 1 -- 172.21.15.100:0/1527499672 >> 172.21.15.100:0/1527499672 conn(0x7fbca40f3930 msgr2=0x7fbca40f5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:49:58.439 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.439+0000 7fbca9659700 1 -- 172.21.15.100:0/1527499672 shutdown_connections 2021-01-28T03:49:58.439 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.439+0000 7fbca9659700 1 -- 172.21.15.100:0/1527499672 wait complete. 2021-01-28T03:49:58.441 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.439+0000 7fbca9659700 1 Processor -- start 2021-01-28T03:49:58.441 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.439+0000 7fbca9659700 1 -- start start 2021-01-28T03:49:58.441 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.439+0000 7fbca9659700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbca40f8110 0x7fbca4109b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:49:58.442 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.439+0000 7fbca9659700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca410a020 con 0x7fbca40f8110 2021-01-28T03:49:58.442 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.439+0000 7fbca3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbca40f8110 0x7fbca4109b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:49:58.442 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.439+0000 7fbca3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbca40f8110 0x7fbca4109b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58820/0 (socket says 172.21.15.100:58820) 2021-01-28T03:49:58.442 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.439+0000 7fbca3fff700 1 -- 172.21.15.100:0/1031410078 learned_addr learned my addr 172.21.15.100:0/1031410078 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:49:58.442 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.439+0000 7fbca3fff700 1 -- 172.21.15.100:0/1031410078 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca410a160 con 0x7fbca40f8110 2021-01-28T03:49:58.443 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.439+0000 7fbca3fff700 1 --2- 172.21.15.100:0/1031410078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbca40f8110 0x7fbca4109b30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fbc9400d700 tx=0x7fbc94006f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:49:58.443 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.443+0000 7fbca0ff9700 1 -- 172.21.15.100:0/1031410078 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbc9400ff00 con 0x7fbca40f8110 2021-01-28T03:49:58.443 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.443+0000 7fbca0ff9700 1 -- 172.21.15.100:0/1031410078 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fbc940108d0 con 0x7fbca40f8110 2021-01-28T03:49:58.443 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.443+0000 7fbca0ff9700 1 -- 172.21.15.100:0/1031410078 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbc940213d0 con 0x7fbca40f8110 2021-01-28T03:49:58.443 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.443+0000 7fbca9659700 1 -- 172.21.15.100:0/1031410078 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbca410a3b0 con 0x7fbca40f8110 2021-01-28T03:49:58.444 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.443+0000 7fbca9659700 1 -- 172.21.15.100:0/1031410078 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbca410af10 con 0x7fbca40f8110 2021-01-28T03:49:58.444 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.443+0000 7fbca0ff9700 1 -- 172.21.15.100:0/1031410078 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) v1 ==== 623+0+0 (secure 0 0 0) 0x7fbc94029070 con 0x7fbca40f8110 2021-01-28T03:49:58.444 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.443+0000 7fbca0ff9700 1 -- 172.21.15.100:0/1031410078 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7fbc94022b30 con 0x7fbca40f8110 2021-01-28T03:49:58.445 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.443+0000 7fbca9659700 1 -- 172.21.15.100:0/1031410078 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbca40581f0 con 0x7fbca40f8110 2021-01-28T03:49:58.445 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.447+0000 7fbca0ff9700 1 -- 172.21.15.100:0/1031410078 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72015 (secure 0 0 0) 0x7fbc94027060 con 0x7fbca40f8110 2021-01-28T03:49:58.576 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.575+0000 7fbca9659700 1 -- 172.21.15.100:0/1031410078 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fbca40f9ec0 con 0x7fbca40f8110 2021-01-28T03:49:58.577 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.579+0000 7fbca0ff9700 1 -- 172.21.15.100:0/1031410078 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1221 (secure 0 0 0) 0x7fbc94014070 con 0x7fbca40f8110 2021-01-28T03:49:58.582 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.582 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: { 2021-01-28T03:49:58.582 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "fsid": "c217df96-611b-11eb-8f9e-001a4aab830c", 2021-01-28T03:49:58.583 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "health": { 2021-01-28T03:49:58.583 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2021-01-28T03:49:58.583 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "checks": {}, 2021-01-28T03:49:58.583 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "mutes": [] 2021-01-28T03:49:58.584 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: }, 2021-01-28T03:49:58.584 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "election_epoch": 5, 2021-01-28T03:49:58.584 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "quorum": [ 2021-01-28T03:49:58.584 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 0 2021-01-28T03:49:58.585 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: ], 2021-01-28T03:49:58.585 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "quorum_names": [ 2021-01-28T03:49:58.585 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "a" 2021-01-28T03:49:58.585 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: ], 2021-01-28T03:49:58.585 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "quorum_age": 7, 2021-01-28T03:49:58.586 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "monmap": { 2021-01-28T03:49:58.586 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-28T03:49:58.586 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2021-01-28T03:49:58.586 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "num_mons": 1 2021-01-28T03:49:58.587 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: }, 2021-01-28T03:49:58.587 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "osdmap": { 2021-01-28T03:49:58.587 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-28T03:49:58.587 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "num_osds": 0, 2021-01-28T03:49:58.587 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "num_up_osds": 0, 2021-01-28T03:49:58.588 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "osd_up_since": 0, 2021-01-28T03:49:58.588 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "num_in_osds": 0, 2021-01-28T03:49:58.588 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "osd_in_since": 0, 2021-01-28T03:49:58.588 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2021-01-28T03:49:58.588 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: }, 2021-01-28T03:49:58.589 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "pgmap": { 2021-01-28T03:49:58.589 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "pgs_by_state": [], 2021-01-28T03:49:58.589 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "num_pgs": 0, 2021-01-28T03:49:58.589 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "num_pools": 0, 2021-01-28T03:49:58.589 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "num_objects": 0, 2021-01-28T03:49:58.590 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "data_bytes": 0, 2021-01-28T03:49:58.590 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "bytes_used": 0, 2021-01-28T03:49:58.590 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "bytes_avail": 0, 2021-01-28T03:49:58.590 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "bytes_total": 0 2021-01-28T03:49:58.590 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: }, 2021-01-28T03:49:58.591 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "fsmap": { 2021-01-28T03:49:58.591 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-28T03:49:58.591 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "by_rank": [], 2021-01-28T03:49:58.591 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "up:standby": 0 2021-01-28T03:49:58.591 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: }, 2021-01-28T03:49:58.592 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "mgrmap": { 2021-01-28T03:49:58.592 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "available": false, 2021-01-28T03:49:58.592 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "num_standbys": 0, 2021-01-28T03:49:58.592 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "modules": [ 2021-01-28T03:49:58.592 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "iostat", 2021-01-28T03:49:58.593 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "restful" 2021-01-28T03:49:58.593 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: ], 2021-01-28T03:49:58.593 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "services": {} 2021-01-28T03:49:58.593 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: }, 2021-01-28T03:49:58.593 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "servicemap": { 2021-01-28T03:49:58.594 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-28T03:49:58.594 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "modified": "2021-01-28T03:49:43.979220+0000", 2021-01-28T03:49:58.594 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "services": {} 2021-01-28T03:49:58.594 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: }, 2021-01-28T03:49:58.595 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "progress_events": {} 2021-01-28T03:49:58.595 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: } 2021-01-28T03:49:58.595 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.579+0000 7fbca9659700 1 -- 172.21.15.100:0/1031410078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbca40f8110 msgr2=0x7fbca4109b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:49:58.595 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.579+0000 7fbca9659700 1 --2- 172.21.15.100:0/1031410078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbca40f8110 0x7fbca4109b30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fbc9400d700 tx=0x7fbc94006f70).stop 2021-01-28T03:49:58.595 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.579+0000 7fbca9659700 1 -- 172.21.15.100:0/1031410078 shutdown_connections 2021-01-28T03:49:58.596 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.579+0000 7fbca9659700 1 --2- 172.21.15.100:0/1031410078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbca40f8110 0x7fbca4109b30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:49:58.596 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.579+0000 7fbca9659700 1 -- 172.21.15.100:0/1031410078 >> 172.21.15.100:0/1031410078 conn(0x7fbca40f3930 msgr2=0x7fbca40f5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:49:58.596 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.579+0000 7fbca9659700 1 -- 172.21.15.100:0/1031410078 shutdown_connections 2021-01-28T03:49:58.596 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:49:58.579+0000 7fbca9659700 1 -- 172.21.15.100:0/1031410078 wait complete. 2021-01-28T03:49:59.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:49:58 smithi100 bash[9834]: audit 2021-01-28T03:49:58.583593+0000 mon.a (mon.0) 8 : audit [DBG] from='client.? 172.21.15.100:0/1031410078' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-01-28T03:49:59.216 INFO:teuthology.orchestra.run.smithi100.stderr:mgr not available, waiting (2/15)... 2021-01-28T03:50:00.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:00 smithi100 bash[9834]: cluster 2021-01-28T03:50:00.252993+0000 mon.a (mon.0) 9 : cluster [INF] Activating manager daemon y 2021-01-28T03:50:00.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:00 smithi100 bash[9834]: cluster 2021-01-28T03:50:00.257004+0000 mon.a (mon.0) 10 : cluster [DBG] mgrmap e2: y(active, starting, since 0.00420103s) 2021-01-28T03:50:00.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:00 smithi100 bash[9834]: audit 2021-01-28T03:50:00.258684+0000 mon.a (mon.0) 11 : audit [DBG] from='mgr.14100 172.21.15.100:0/386546108' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-01-28T03:50:00.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:00 smithi100 bash[9834]: audit 2021-01-28T03:50:00.259125+0000 mon.a (mon.0) 12 : audit [DBG] from='mgr.14100 172.21.15.100:0/386546108' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-01-28T03:50:00.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:00 smithi100 bash[9834]: audit 2021-01-28T03:50:00.259577+0000 mon.a (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.15.100:0/386546108' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-01-28T03:50:00.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:00 smithi100 bash[9834]: audit 2021-01-28T03:50:00.260061+0000 mon.a (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.15.100:0/386546108' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-01-28T03:50:00.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:00 smithi100 bash[9834]: audit 2021-01-28T03:50:00.260549+0000 mon.a (mon.0) 15 : audit [DBG] from='mgr.14100 172.21.15.100:0/386546108' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-01-28T03:50:00.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:00 smithi100 bash[9834]: cluster 2021-01-28T03:50:00.264654+0000 mon.a (mon.0) 16 : cluster [INF] Manager daemon y is now available 2021-01-28T03:50:00.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:00 smithi100 bash[9834]: audit 2021-01-28T03:50:00.285934+0000 mon.a (mon.0) 17 : audit [INF] from='mgr.14100 172.21.15.100:0/386546108' entity='mgr.y' 2021-01-28T03:50:00.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:00 smithi100 bash[9834]: audit 2021-01-28T03:50:00.286277+0000 mon.a (mon.0) 18 : audit [INF] from='mgr.14100 172.21.15.100:0/386546108' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T03:50:00.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:00 smithi100 bash[9834]: audit 2021-01-28T03:50:00.289213+0000 mon.a (mon.0) 19 : audit [INF] from='mgr.14100 172.21.15.100:0/386546108' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T03:50:00.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:00 smithi100 bash[9834]: audit 2021-01-28T03:50:00.300402+0000 mon.a (mon.0) 20 : audit [INF] from='mgr.14100 172.21.15.100:0/386546108' entity='mgr.y' 2021-01-28T03:50:01.218 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi100 -v /var/log/ceph/c217df96-611b-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp3pxhmbk:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpih1yxits:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 status -f json-pretty 2021-01-28T03:50:01.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:01 smithi100 bash[9834]: audit 2021-01-28T03:50:00.306065+0000 mon.a (mon.0) 21 : audit [INF] from='mgr.14100 172.21.15.100:0/386546108' entity='mgr.y' 2021-01-28T03:50:01.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:01 smithi100 bash[9834]: cluster 2021-01-28T03:50:01.264992+0000 mon.a (mon.0) 22 : cluster [DBG] mgrmap e3: y(active, since 1.01218s) 2021-01-28T03:50:02.438 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.439+0000 7fed3f0c0700 1 Processor -- start 2021-01-28T03:50:02.438 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.439+0000 7fed3f0c0700 1 -- start start 2021-01-28T03:50:02.440 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.439+0000 7fed3f0c0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed380fb5b0 0x7fed380fb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:02.440 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.439+0000 7fed3f0c0700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed380fbec0 con 0x7fed380fb5b0 2021-01-28T03:50:02.440 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.439+0000 7fed3ce5c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed380fb5b0 0x7fed380fb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:02.441 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.439+0000 7fed3ce5c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed380fb5b0 0x7fed380fb9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58840/0 (socket says 172.21.15.100:58840) 2021-01-28T03:50:02.441 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.439+0000 7fed3ce5c700 1 -- 172.21.15.100:0/3269910012 learned_addr learned my addr 172.21.15.100:0/3269910012 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:50:02.441 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.439+0000 7fed3ce5c700 1 -- 172.21.15.100:0/3269910012 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed380fc000 con 0x7fed380fb5b0 2021-01-28T03:50:02.441 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.439+0000 7fed3ce5c700 1 --2- 172.21.15.100:0/3269910012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed380fb5b0 0x7fed380fb9d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fed2000b950 tx=0x7fed20006ee0).ready entity=mon.0 client_cookie=dc0b01f93d3575d server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:02.445 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.439+0000 7fed377fe700 1 -- 172.21.15.100:0/3269910012 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fed20009840 con 0x7fed380fb5b0 2021-01-28T03:50:02.445 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.439+0000 7fed377fe700 1 -- 172.21.15.100:0/3269910012 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fed20009e00 con 0x7fed380fb5b0 2021-01-28T03:50:02.445 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.439+0000 7fed377fe700 1 -- 172.21.15.100:0/3269910012 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fed20011c80 con 0x7fed380fb5b0 2021-01-28T03:50:02.446 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.443+0000 7fed3f0c0700 1 -- 172.21.15.100:0/3269910012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed380fb5b0 msgr2=0x7fed380fb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:02.446 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.443+0000 7fed3f0c0700 1 --2- 172.21.15.100:0/3269910012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed380fb5b0 0x7fed380fb9d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fed2000b950 tx=0x7fed20006ee0).stop 2021-01-28T03:50:02.446 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.443+0000 7fed3f0c0700 1 -- 172.21.15.100:0/3269910012 shutdown_connections 2021-01-28T03:50:02.446 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.443+0000 7fed3f0c0700 1 --2- 172.21.15.100:0/3269910012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed380fb5b0 0x7fed380fb9d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:02.447 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.443+0000 7fed3f0c0700 1 -- 172.21.15.100:0/3269910012 >> 172.21.15.100:0/3269910012 conn(0x7fed3806ed10 msgr2=0x7fed3806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:50:02.447 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.443+0000 7fed3f0c0700 1 -- 172.21.15.100:0/3269910012 shutdown_connections 2021-01-28T03:50:02.447 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.443+0000 7fed3f0c0700 1 -- 172.21.15.100:0/3269910012 wait complete. 2021-01-28T03:50:02.447 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.443+0000 7fed3f0c0700 1 Processor -- start 2021-01-28T03:50:02.448 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.443+0000 7fed3f0c0700 1 -- start start 2021-01-28T03:50:02.448 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.443+0000 7fed3f0c0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed380fb5b0 0x7fed38109c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:02.448 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.443+0000 7fed3f0c0700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3810a120 con 0x7fed380fb5b0 2021-01-28T03:50:02.449 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.443+0000 7fed3ce5c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed380fb5b0 0x7fed38109c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:02.449 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.443+0000 7fed3ce5c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed380fb5b0 0x7fed38109c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58842/0 (socket says 172.21.15.100:58842) 2021-01-28T03:50:02.449 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.443+0000 7fed3ce5c700 1 -- 172.21.15.100:0/1786588576 learned_addr learned my addr 172.21.15.100:0/1786588576 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:50:02.449 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.443+0000 7fed3ce5c700 1 -- 172.21.15.100:0/1786588576 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3810a260 con 0x7fed380fb5b0 2021-01-28T03:50:02.450 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.443+0000 7fed3ce5c700 1 --2- 172.21.15.100:0/1786588576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed380fb5b0 0x7fed38109c30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fed20009fd0 tx=0x7fed20006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:02.450 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.443+0000 7fed357fa700 1 -- 172.21.15.100:0/1786588576 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fed20009ca0 con 0x7fed380fb5b0 2021-01-28T03:50:02.450 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.443+0000 7fed357fa700 1 -- 172.21.15.100:0/1786588576 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fed20011400 con 0x7fed380fb5b0 2021-01-28T03:50:02.450 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.443+0000 7fed357fa700 1 -- 172.21.15.100:0/1786588576 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fed2001bc00 con 0x7fed380fb5b0 2021-01-28T03:50:02.451 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.443+0000 7fed3f0c0700 1 -- 172.21.15.100:0/1786588576 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed3810a4b0 con 0x7fed380fb5b0 2021-01-28T03:50:02.451 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.443+0000 7fed3f0c0700 1 -- 172.21.15.100:0/1786588576 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed3810afa0 con 0x7fed380fb5b0 2021-01-28T03:50:02.451 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.447+0000 7fed3f0c0700 1 -- 172.21.15.100:0/1786588576 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed380581f0 con 0x7fed380fb5b0 2021-01-28T03:50:02.452 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.447+0000 7fed357fa700 1 -- 172.21.15.100:0/1786588576 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 3) v1 ==== 35680+0+0 (secure 0 0 0) 0x7fed2002b070 con 0x7fed380fb5b0 2021-01-28T03:50:02.452 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.447+0000 7fed357fa700 1 --2- 172.21.15.100:0/1786588576 >> v2:172.21.15.100:6800/728127347 conn(0x7fed1802fa80 0x7fed18031f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:02.453 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.447+0000 7fed357fa700 1 -- 172.21.15.100:0/1786588576 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7fed200416d0 con 0x7fed380fb5b0 2021-01-28T03:50:02.453 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.447+0000 7fed37fff700 1 --2- 172.21.15.100:0/1786588576 >> v2:172.21.15.100:6800/728127347 conn(0x7fed1802fa80 0x7fed18031f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:02.453 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.447+0000 7fed37fff700 1 --2- 172.21.15.100:0/1786588576 >> v2:172.21.15.100:6800/728127347 conn(0x7fed1802fa80 0x7fed18031f40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fed300089e0 tx=0x7fed30006ec0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:02.454 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.455+0000 7fed357fa700 1 -- 172.21.15.100:0/1786588576 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fed20011700 con 0x7fed380fb5b0 2021-01-28T03:50:02.461 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.463+0000 7fed357fa700 1 -- 172.21.15.100:0/1786588576 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 4) v1 ==== 35760+0+0 (secure 0 0 0) 0x7fed2000f070 con 0x7fed380fb5b0 2021-01-28T03:50:02.853 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.855+0000 7fed3f0c0700 1 -- 172.21.15.100:0/1786588576 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fed38044bc0 con 0x7fed380fb5b0 2021-01-28T03:50:02.854 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.855+0000 7fed357fa700 1 -- 172.21.15.100:0/1786588576 <== mon.0 v2:172.21.15.100:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1221 (secure 0 0 0) 0x7fed20016020 con 0x7fed380fb5b0 2021-01-28T03:50:02.855 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.855 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: { 2021-01-28T03:50:02.855 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "fsid": "c217df96-611b-11eb-8f9e-001a4aab830c", 2021-01-28T03:50:02.855 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "health": { 2021-01-28T03:50:02.856 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2021-01-28T03:50:02.856 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "checks": {}, 2021-01-28T03:50:02.856 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "mutes": [] 2021-01-28T03:50:02.856 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: }, 2021-01-28T03:50:02.858 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "election_epoch": 5, 2021-01-28T03:50:02.858 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "quorum": [ 2021-01-28T03:50:02.858 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 0 2021-01-28T03:50:02.858 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: ], 2021-01-28T03:50:02.859 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "quorum_names": [ 2021-01-28T03:50:02.860 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "a" 2021-01-28T03:50:02.860 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: ], 2021-01-28T03:50:02.860 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "quorum_age": 11, 2021-01-28T03:50:02.860 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "monmap": { 2021-01-28T03:50:02.861 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-28T03:50:02.861 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2021-01-28T03:50:02.861 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "num_mons": 1 2021-01-28T03:50:02.861 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: }, 2021-01-28T03:50:02.862 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "osdmap": { 2021-01-28T03:50:02.862 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-28T03:50:02.862 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "num_osds": 0, 2021-01-28T03:50:02.867 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "num_up_osds": 0, 2021-01-28T03:50:02.868 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "osd_up_since": 0, 2021-01-28T03:50:02.868 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "num_in_osds": 0, 2021-01-28T03:50:02.869 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "osd_in_since": 0, 2021-01-28T03:50:02.869 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2021-01-28T03:50:02.870 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: }, 2021-01-28T03:50:02.870 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "pgmap": { 2021-01-28T03:50:02.871 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "pgs_by_state": [], 2021-01-28T03:50:02.871 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "num_pgs": 0, 2021-01-28T03:50:02.871 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "num_pools": 0, 2021-01-28T03:50:02.872 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "num_objects": 0, 2021-01-28T03:50:02.872 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "data_bytes": 0, 2021-01-28T03:50:02.873 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "bytes_used": 0, 2021-01-28T03:50:02.873 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "bytes_avail": 0, 2021-01-28T03:50:02.873 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "bytes_total": 0 2021-01-28T03:50:02.874 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: }, 2021-01-28T03:50:02.874 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "fsmap": { 2021-01-28T03:50:02.875 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-28T03:50:02.875 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "by_rank": [], 2021-01-28T03:50:02.875 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "up:standby": 0 2021-01-28T03:50:02.876 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: }, 2021-01-28T03:50:02.876 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "mgrmap": { 2021-01-28T03:50:02.877 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "available": true, 2021-01-28T03:50:02.877 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "num_standbys": 0, 2021-01-28T03:50:02.877 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "modules": [ 2021-01-28T03:50:02.878 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "iostat", 2021-01-28T03:50:02.878 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "restful" 2021-01-28T03:50:02.879 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: ], 2021-01-28T03:50:02.879 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "services": {} 2021-01-28T03:50:02.880 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: }, 2021-01-28T03:50:02.880 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "servicemap": { 2021-01-28T03:50:02.880 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-28T03:50:02.881 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "modified": "2021-01-28T03:49:43.979220+0000", 2021-01-28T03:50:02.881 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "services": {} 2021-01-28T03:50:02.882 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: }, 2021-01-28T03:50:02.882 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "progress_events": {} 2021-01-28T03:50:02.882 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: } 2021-01-28T03:50:02.883 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.855+0000 7fed3f0c0700 1 -- 172.21.15.100:0/1786588576 >> v2:172.21.15.100:6800/728127347 conn(0x7fed1802fa80 msgr2=0x7fed18031f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:02.883 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.855+0000 7fed3f0c0700 1 --2- 172.21.15.100:0/1786588576 >> v2:172.21.15.100:6800/728127347 conn(0x7fed1802fa80 0x7fed18031f40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fed300089e0 tx=0x7fed30006ec0).stop 2021-01-28T03:50:02.884 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.855+0000 7fed3f0c0700 1 -- 172.21.15.100:0/1786588576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed380fb5b0 msgr2=0x7fed38109c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:02.884 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.855+0000 7fed3f0c0700 1 --2- 172.21.15.100:0/1786588576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed380fb5b0 0x7fed38109c30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fed20009fd0 tx=0x7fed20006ee0).stop 2021-01-28T03:50:02.884 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.859+0000 7fed3f0c0700 1 -- 172.21.15.100:0/1786588576 shutdown_connections 2021-01-28T03:50:02.885 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.859+0000 7fed3f0c0700 1 --2- 172.21.15.100:0/1786588576 >> v2:172.21.15.100:6800/728127347 conn(0x7fed1802fa80 0x7fed18031f40 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:02.885 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.859+0000 7fed3f0c0700 1 --2- 172.21.15.100:0/1786588576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed380fb5b0 0x7fed38109c30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:02.886 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.859+0000 7fed3f0c0700 1 -- 172.21.15.100:0/1786588576 >> 172.21.15.100:0/1786588576 conn(0x7fed3806ed10 msgr2=0x7fed380f9000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:50:02.886 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.859+0000 7fed3f0c0700 1 -- 172.21.15.100:0/1786588576 shutdown_connections 2021-01-28T03:50:02.887 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:02.859+0000 7fed3f0c0700 1 -- 172.21.15.100:0/1786588576 wait complete. 2021-01-28T03:50:03.441 INFO:teuthology.orchestra.run.smithi100.stderr:mgr is available 2021-01-28T03:50:03.442 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi100 -v /var/log/ceph/c217df96-611b-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp3pxhmbk:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpih1yxits:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 config-key set mgr/cephadm/ssh_user root 2021-01-28T03:50:03.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:03 smithi100 bash[9834]: cluster 2021-01-28T03:50:02.470591+0000 mon.a (mon.0) 23 : cluster [DBG] mgrmap e4: y(active, since 2s) 2021-01-28T03:50:03.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:03 smithi100 bash[9834]: audit 2021-01-28T03:50:02.860605+0000 mon.a (mon.0) 24 : audit [DBG] from='client.? 172.21.15.100:0/1786588576' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-01-28T03:50:04.602 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.603+0000 7f2452559700 1 Processor -- start 2021-01-28T03:50:04.602 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.603+0000 7f2452559700 1 -- start start 2021-01-28T03:50:04.603 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.603+0000 7f2452559700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f244c0fb5b0 0x7f244c0fb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:04.603 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.603+0000 7f2452559700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244c0fbec0 con 0x7f244c0fb5b0 2021-01-28T03:50:04.604 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.603+0000 7f244bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f244c0fb5b0 0x7f244c0fb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:04.604 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.603+0000 7f244bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f244c0fb5b0 0x7f244c0fb9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58846/0 (socket says 172.21.15.100:58846) 2021-01-28T03:50:04.605 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.603+0000 7f244bfff700 1 -- 172.21.15.100:0/1843714017 learned_addr learned my addr 172.21.15.100:0/1843714017 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:50:04.605 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.607+0000 7f244bfff700 1 -- 172.21.15.100:0/1843714017 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f244c0fc000 con 0x7f244c0fb5b0 2021-01-28T03:50:04.606 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.607+0000 7f244bfff700 1 --2- 172.21.15.100:0/1843714017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f244c0fb5b0 0x7f244c0fb9d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f244000b950 tx=0x7f2440006ee0).ready entity=mon.0 client_cookie=7bb7f410e5130710 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:04.607 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.607+0000 7f244affd700 1 -- 172.21.15.100:0/1843714017 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2440009840 con 0x7f244c0fb5b0 2021-01-28T03:50:04.607 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.607+0000 7f244affd700 1 -- 172.21.15.100:0/1843714017 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f2440009e00 con 0x7f244c0fb5b0 2021-01-28T03:50:04.608 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.607+0000 7f244affd700 1 -- 172.21.15.100:0/1843714017 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2440011c80 con 0x7f244c0fb5b0 2021-01-28T03:50:04.614 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.607+0000 7f2452559700 1 -- 172.21.15.100:0/1843714017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f244c0fb5b0 msgr2=0x7f244c0fb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:04.614 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.607+0000 7f2452559700 1 --2- 172.21.15.100:0/1843714017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f244c0fb5b0 0x7f244c0fb9d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f244000b950 tx=0x7f2440006ee0).stop 2021-01-28T03:50:04.615 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.607+0000 7f2452559700 1 -- 172.21.15.100:0/1843714017 shutdown_connections 2021-01-28T03:50:04.615 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.607+0000 7f2452559700 1 --2- 172.21.15.100:0/1843714017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f244c0fb5b0 0x7f244c0fb9d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:04.615 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.607+0000 7f2452559700 1 -- 172.21.15.100:0/1843714017 >> 172.21.15.100:0/1843714017 conn(0x7f244c06ed10 msgr2=0x7f244c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:50:04.616 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.607+0000 7f2452559700 1 -- 172.21.15.100:0/1843714017 shutdown_connections 2021-01-28T03:50:04.616 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.607+0000 7f2452559700 1 -- 172.21.15.100:0/1843714017 wait complete. 2021-01-28T03:50:04.617 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.607+0000 7f2452559700 1 Processor -- start 2021-01-28T03:50:04.617 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.607+0000 7f2452559700 1 -- start start 2021-01-28T03:50:04.618 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.611+0000 7f2452559700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f244c0fb5b0 0x7f244c109cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:04.618 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.611+0000 7f2452559700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244c10a1b0 con 0x7f244c0fb5b0 2021-01-28T03:50:04.618 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.611+0000 7f244bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f244c0fb5b0 0x7f244c109cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:04.619 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.611+0000 7f244bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f244c0fb5b0 0x7f244c109cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58848/0 (socket says 172.21.15.100:58848) 2021-01-28T03:50:04.619 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.611+0000 7f244bfff700 1 -- 172.21.15.100:0/681078816 learned_addr learned my addr 172.21.15.100:0/681078816 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:50:04.620 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.611+0000 7f244bfff700 1 -- 172.21.15.100:0/681078816 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f244c10a2f0 con 0x7f244c0fb5b0 2021-01-28T03:50:04.620 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.611+0000 7f244bfff700 1 --2- 172.21.15.100:0/681078816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f244c0fb5b0 0x7f244c109cc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f2440009fd0 tx=0x7f2440006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:04.621 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.611+0000 7f2448ff9700 1 -- 172.21.15.100:0/681078816 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2440009ca0 con 0x7f244c0fb5b0 2021-01-28T03:50:04.621 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.611+0000 7f2448ff9700 1 -- 172.21.15.100:0/681078816 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f2440011400 con 0x7f244c0fb5b0 2021-01-28T03:50:04.621 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.611+0000 7f2452559700 1 -- 172.21.15.100:0/681078816 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f244c10a540 con 0x7f244c0fb5b0 2021-01-28T03:50:04.622 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.611+0000 7f2448ff9700 1 -- 172.21.15.100:0/681078816 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f244001bc00 con 0x7f244c0fb5b0 2021-01-28T03:50:04.622 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.611+0000 7f2452559700 1 -- 172.21.15.100:0/681078816 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f244c10af60 con 0x7f244c0fb5b0 2021-01-28T03:50:04.623 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.611+0000 7f2452559700 1 -- 172.21.15.100:0/681078816 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f244c044bc0 con 0x7f244c0fb5b0 2021-01-28T03:50:04.623 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.611+0000 7f2448ff9700 1 -- 172.21.15.100:0/681078816 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 35760+0+0 (secure 0 0 0) 0x7f244002b070 con 0x7f244c0fb5b0 2021-01-28T03:50:04.623 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.615+0000 7f2448ff9700 1 --2- 172.21.15.100:0/681078816 >> v2:172.21.15.100:6800/728127347 conn(0x7f243802fae0 0x7f2438031fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:04.624 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.615+0000 7f2448ff9700 1 -- 172.21.15.100:0/681078816 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f2440041800 con 0x7f244c0fb5b0 2021-01-28T03:50:04.624 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.615+0000 7f244b7fe700 1 --2- 172.21.15.100:0/681078816 >> v2:172.21.15.100:6800/728127347 conn(0x7f243802fae0 0x7f2438031fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:04.625 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.615+0000 7f244b7fe700 1 --2- 172.21.15.100:0/681078816 >> v2:172.21.15.100:6800/728127347 conn(0x7f243802fae0 0x7f2438031fa0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f243c0089e0 tx=0x7f243c006ec0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:04.625 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:04.619+0000 7f2448ff9700 1 -- 172.21.15.100:0/681078816 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f244001b620 con 0x7f244c0fb5b0 2021-01-28T03:50:05.064 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:05.067+0000 7f2452559700 1 -- 172.21.15.100:0/681078816 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config-key set, key=mgr/cephadm/ssh_user}] v 0) v1 -- 0x7f244c0fd310 con 0x7f244c0fb5b0 2021-01-28T03:50:05.067 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:05.071+0000 7f2448ff9700 1 -- 172.21.15.100:0/681078816 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/cephadm/ssh_user}]=0 set mgr/cephadm/ssh_user v0)=0 set mgr/cephadm/ssh_user v0) v1 ==== 132+0+0 (secure 0 0 0) 0x7f2440016020 con 0x7f244c0fb5b0 2021-01-28T03:50:05.071 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:05.075+0000 7f2452559700 1 -- 172.21.15.100:0/681078816 >> v2:172.21.15.100:6800/728127347 conn(0x7f243802fae0 msgr2=0x7f2438031fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:05.071 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:05.075+0000 7f2452559700 1 --2- 172.21.15.100:0/681078816 >> v2:172.21.15.100:6800/728127347 conn(0x7f243802fae0 0x7f2438031fa0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f243c0089e0 tx=0x7f243c006ec0).stop 2021-01-28T03:50:05.072 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:05.075+0000 7f2452559700 1 -- 172.21.15.100:0/681078816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f244c0fb5b0 msgr2=0x7f244c109cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:05.073 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:05.075+0000 7f2452559700 1 --2- 172.21.15.100:0/681078816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f244c0fb5b0 0x7f244c109cc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f2440009fd0 tx=0x7f2440006ee0).stop 2021-01-28T03:50:05.073 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:05.075+0000 7f2452559700 1 -- 172.21.15.100:0/681078816 shutdown_connections 2021-01-28T03:50:05.073 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:05.075+0000 7f2452559700 1 --2- 172.21.15.100:0/681078816 >> v2:172.21.15.100:6800/728127347 conn(0x7f243802fae0 0x7f2438031fa0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:05.073 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:05.075+0000 7f2452559700 1 --2- 172.21.15.100:0/681078816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f244c0fb5b0 0x7f244c109cc0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:05.075+0000 7f2452559700 1 -- 172.21.15.100:0/681078816 >> 172.21.15.100:0/681078816 conn(0x7f244c06ed10 msgr2=0x7f244c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:50:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:05.075+0000 7f2452559700 1 -- 172.21.15.100:0/681078816 shutdown_connections 2021-01-28T03:50:05.074 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:05.075+0000 7f2452559700 1 -- 172.21.15.100:0/681078816 wait complete. 2021-01-28T03:50:05.075 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: set mgr/cephadm/ssh_user 2021-01-28T03:50:05.695 INFO:teuthology.orchestra.run.smithi100.stderr:Enabling cephadm module... 2021-01-28T03:50:05.695 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi100 -v /var/log/ceph/c217df96-611b-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp3pxhmbk:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpih1yxits:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 mgr module enable cephadm 2021-01-28T03:50:06.320 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:06 smithi100 bash[9834]: audit 2021-01-28T03:50:05.074357+0000 mon.a (mon.0) 25 : audit [INF] from='client.? 172.21.15.100:0/681078816' entity='client.admin' 2021-01-28T03:50:06.786 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.790+0000 7ff3c0d6c700 1 Processor -- start 2021-01-28T03:50:06.786 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.790+0000 7ff3c0d6c700 1 -- start start 2021-01-28T03:50:06.786 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.790+0000 7ff3c0d6c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3bc0f91f0 0x7ff3bc0f9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:06.788 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.790+0000 7ff3c0d6c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc0f9b00 con 0x7ff3bc0f91f0 2021-01-28T03:50:06.788 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.790+0000 7ff3bb7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3bc0f91f0 0x7ff3bc0f9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:06.789 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.790+0000 7ff3bb7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3bc0f91f0 0x7ff3bc0f9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58852/0 (socket says 172.21.15.100:58852) 2021-01-28T03:50:06.789 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.790+0000 7ff3bb7fe700 1 -- 172.21.15.100:0/3753868080 learned_addr learned my addr 172.21.15.100:0/3753868080 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:50:06.789 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.790+0000 7ff3bb7fe700 1 -- 172.21.15.100:0/3753868080 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3bc0f9c40 con 0x7ff3bc0f91f0 2021-01-28T03:50:06.789 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.790+0000 7ff3bb7fe700 1 --2- 172.21.15.100:0/3753868080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3bc0f91f0 0x7ff3bc0f9610 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7ff3ac009cc0 tx=0x7ff3ac0092d0).ready entity=mon.0 client_cookie=ddae3ab9bc6d9ba5 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:06.790 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.790+0000 7ff3ba7fc700 1 -- 172.21.15.100:0/3753868080 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3ac00bbf0 con 0x7ff3bc0f91f0 2021-01-28T03:50:06.790 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.790+0000 7ff3ba7fc700 1 -- 172.21.15.100:0/3753868080 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7ff3ac00bd50 con 0x7ff3bc0f91f0 2021-01-28T03:50:06.790 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.790+0000 7ff3ba7fc700 1 -- 172.21.15.100:0/3753868080 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3ac010560 con 0x7ff3bc0f91f0 2021-01-28T03:50:06.790 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.790+0000 7ff3c0d6c700 1 -- 172.21.15.100:0/3753868080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3bc0f91f0 msgr2=0x7ff3bc0f9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:06.790 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.790+0000 7ff3c0d6c700 1 --2- 172.21.15.100:0/3753868080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3bc0f91f0 0x7ff3bc0f9610 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7ff3ac009cc0 tx=0x7ff3ac0092d0).stop 2021-01-28T03:50:06.791 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.790+0000 7ff3c0d6c700 1 -- 172.21.15.100:0/3753868080 shutdown_connections 2021-01-28T03:50:06.791 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.790+0000 7ff3c0d6c700 1 --2- 172.21.15.100:0/3753868080 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3bc0f91f0 0x7ff3bc0f9610 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:06.791 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.790+0000 7ff3c0d6c700 1 -- 172.21.15.100:0/3753868080 >> 172.21.15.100:0/3753868080 conn(0x7ff3bc0f4a30 msgr2=0x7ff3bc0f6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:50:06.791 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.790+0000 7ff3c0d6c700 1 -- 172.21.15.100:0/3753868080 shutdown_connections 2021-01-28T03:50:06.791 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.790+0000 7ff3c0d6c700 1 -- 172.21.15.100:0/3753868080 wait complete. 2021-01-28T03:50:06.793 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.794+0000 7ff3c0d6c700 1 Processor -- start 2021-01-28T03:50:06.794 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.794+0000 7ff3c0d6c700 1 -- start start 2021-01-28T03:50:06.794 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.794+0000 7ff3c0d6c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3bc0f91f0 0x7ff3bc107890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:06.794 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.794+0000 7ff3c0d6c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc107d80 con 0x7ff3bc0f91f0 2021-01-28T03:50:06.795 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.794+0000 7ff3bb7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3bc0f91f0 0x7ff3bc107890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:06.795 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.794+0000 7ff3bb7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3bc0f91f0 0x7ff3bc107890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58854/0 (socket says 172.21.15.100:58854) 2021-01-28T03:50:06.795 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.794+0000 7ff3bb7fe700 1 -- 172.21.15.100:0/1129124079 learned_addr learned my addr 172.21.15.100:0/1129124079 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:50:06.795 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.794+0000 7ff3bb7fe700 1 -- 172.21.15.100:0/1129124079 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3bc107ec0 con 0x7ff3bc0f91f0 2021-01-28T03:50:06.796 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.794+0000 7ff3bb7fe700 1 --2- 172.21.15.100:0/1129124079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3bc0f91f0 0x7ff3bc107890 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7ff3ac006b80 tx=0x7ff3ac0092d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:06.796 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.794+0000 7ff3b3fff700 1 -- 172.21.15.100:0/1129124079 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3ac00bbf0 con 0x7ff3bc0f91f0 2021-01-28T03:50:06.796 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.794+0000 7ff3b3fff700 1 -- 172.21.15.100:0/1129124079 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7ff3ac00bec0 con 0x7ff3bc0f91f0 2021-01-28T03:50:06.796 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.794+0000 7ff3c0d6c700 1 -- 172.21.15.100:0/1129124079 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3bc108110 con 0x7ff3bc0f91f0 2021-01-28T03:50:06.797 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.794+0000 7ff3b3fff700 1 -- 172.21.15.100:0/1129124079 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3ac0235d0 con 0x7ff3bc0f91f0 2021-01-28T03:50:06.797 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.794+0000 7ff3c0d6c700 1 -- 172.21.15.100:0/1129124079 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3bc108c70 con 0x7ff3bc0f91f0 2021-01-28T03:50:06.797 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.794+0000 7ff3b3fff700 1 -- 172.21.15.100:0/1129124079 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 35760+0+0 (secure 0 0 0) 0x7ff3ac00f070 con 0x7ff3bc0f91f0 2021-01-28T03:50:06.797 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.798+0000 7ff3b3fff700 1 --2- 172.21.15.100:0/1129124079 >> v2:172.21.15.100:6800/728127347 conn(0x7ff39c02fb30 0x7ff39c031ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:06.797 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.798+0000 7ff3b3fff700 1 -- 172.21.15.100:0/1129124079 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7ff3ac041f60 con 0x7ff3bc0f91f0 2021-01-28T03:50:06.798 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.798+0000 7ff3baffd700 1 --2- 172.21.15.100:0/1129124079 >> v2:172.21.15.100:6800/728127347 conn(0x7ff39c02fb30 0x7ff39c031ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:06.798 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.798+0000 7ff3baffd700 1 --2- 172.21.15.100:0/1129124079 >> v2:172.21.15.100:6800/728127347 conn(0x7ff39c02fb30 0x7ff39c031ff0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7ff3a40096a0 tx=0x7ff3a4006b40).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:06.799 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.798+0000 7ff3c0d6c700 1 -- 172.21.15.100:0/1129124079 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3bc0581f0 con 0x7ff3bc0f91f0 2021-01-28T03:50:06.800 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:06.802+0000 7ff3b3fff700 1 -- 172.21.15.100:0/1129124079 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7ff3ac01e070 con 0x7ff3bc0f91f0 2021-01-28T03:50:07.160 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:07.161+0000 7ff3c0d6c700 1 -- 172.21.15.100:0/1129124079 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7ff3bc0fb090 con 0x7ff3bc0f91f0 2021-01-28T03:50:07.467 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:07.469+0000 7ff3b3fff700 1 -- 172.21.15.100:0/1129124079 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 5) v1 ==== 35771+0+0 (secure 0 0 0) 0x7ff3ac021dd0 con 0x7ff3bc0f91f0 2021-01-28T03:50:07.470 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:07.473+0000 7ff3b3fff700 1 -- 172.21.15.100:0/1129124079 <== mon.0 v2:172.21.15.100:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7ff3ac022b20 con 0x7ff3bc0f91f0 2021-01-28T03:50:07.474 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:07.477+0000 7ff3c0d6c700 1 -- 172.21.15.100:0/1129124079 >> v2:172.21.15.100:6800/728127347 conn(0x7ff39c02fb30 msgr2=0x7ff39c031ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:07.474 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:07.477+0000 7ff3c0d6c700 1 --2- 172.21.15.100:0/1129124079 >> v2:172.21.15.100:6800/728127347 conn(0x7ff39c02fb30 0x7ff39c031ff0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7ff3a40096a0 tx=0x7ff3a4006b40).stop 2021-01-28T03:50:07.475 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:07.477+0000 7ff3c0d6c700 1 -- 172.21.15.100:0/1129124079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3bc0f91f0 msgr2=0x7ff3bc107890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:07.475 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:07.477+0000 7ff3c0d6c700 1 --2- 172.21.15.100:0/1129124079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3bc0f91f0 0x7ff3bc107890 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7ff3ac006b80 tx=0x7ff3ac0092d0).stop 2021-01-28T03:50:07.476 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:07.477+0000 7ff3c0d6c700 1 -- 172.21.15.100:0/1129124079 shutdown_connections 2021-01-28T03:50:07.476 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:07.477+0000 7ff3c0d6c700 1 --2- 172.21.15.100:0/1129124079 >> v2:172.21.15.100:6800/728127347 conn(0x7ff39c02fb30 0x7ff39c031ff0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:07.477 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:07.477+0000 7ff3c0d6c700 1 --2- 172.21.15.100:0/1129124079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff3bc0f91f0 0x7ff3bc107890 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:07.477 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:07.477+0000 7ff3c0d6c700 1 -- 172.21.15.100:0/1129124079 >> 172.21.15.100:0/1129124079 conn(0x7ff3bc0f4a30 msgr2=0x7ff3bc0f5850 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:50:07.477 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:07.477+0000 7ff3c0d6c700 1 -- 172.21.15.100:0/1129124079 shutdown_connections 2021-01-28T03:50:07.478 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:07.477+0000 7ff3c0d6c700 1 -- 172.21.15.100:0/1129124079 wait complete. 2021-01-28T03:50:07.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:07 smithi100 bash[9834]: audit 2021-01-28T03:50:07.166537+0000 mon.a (mon.0) 26 : audit [INF] from='client.? 172.21.15.100:0/1129124079' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2021-01-28T03:50:07.821 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:50:07 smithi100 bash[10061]: ignoring --setgroup ceph since I am not root 2021-01-28T03:50:08.083 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi100 -v /var/log/ceph/c217df96-611b-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp3pxhmbk:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpih1yxits:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 mgr stat 2021-01-28T03:50:08.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:08 smithi100 bash[9834]: audit 2021-01-28T03:50:07.475389+0000 mon.a (mon.0) 27 : audit [INF] from='client.? 172.21.15.100:0/1129124079' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2021-01-28T03:50:08.906 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:08 smithi100 bash[9834]: cluster 2021-01-28T03:50:07.475512+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e5: y(active, since 7s) 2021-01-28T03:50:09.192 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.192+0000 7f570ffff700 1 Processor -- start 2021-01-28T03:50:09.192 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.192+0000 7f570ffff700 1 -- start start 2021-01-28T03:50:09.193 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.192+0000 7f570ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57100f9200 0x7f57100f9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:09.193 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.192+0000 7f570ffff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57100f9b10 con 0x7f57100f9200 2021-01-28T03:50:09.193 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.192+0000 7f570effd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57100f9200 0x7f57100f9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:09.194 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.192+0000 7f570effd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57100f9200 0x7f57100f9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58870/0 (socket says 172.21.15.100:58870) 2021-01-28T03:50:09.194 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.192+0000 7f570effd700 1 -- 172.21.15.100:0/763975102 learned_addr learned my addr 172.21.15.100:0/763975102 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:50:09.198 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.192+0000 7f570effd700 1 -- 172.21.15.100:0/763975102 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57100f9c50 con 0x7f57100f9200 2021-01-28T03:50:09.199 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.192+0000 7f570effd700 1 --2- 172.21.15.100:0/763975102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57100f9200 0x7f57100f9620 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f570000b950 tx=0x7f5700006ee0).ready entity=mon.0 client_cookie=c8c8f748e0a63b3 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:09.199 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.192+0000 7f570dffb700 1 -- 172.21.15.100:0/763975102 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5700009840 con 0x7f57100f9200 2021-01-28T03:50:09.199 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.192+0000 7f570dffb700 1 -- 172.21.15.100:0/763975102 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f5700009e00 con 0x7f57100f9200 2021-01-28T03:50:09.200 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.192+0000 7f570dffb700 1 -- 172.21.15.100:0/763975102 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5700011c80 con 0x7f57100f9200 2021-01-28T03:50:09.200 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.192+0000 7f570ffff700 1 -- 172.21.15.100:0/763975102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57100f9200 msgr2=0x7f57100f9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:09.200 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.192+0000 7f570ffff700 1 --2- 172.21.15.100:0/763975102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57100f9200 0x7f57100f9620 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f570000b950 tx=0x7f5700006ee0).stop 2021-01-28T03:50:09.201 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.192+0000 7f570ffff700 1 -- 172.21.15.100:0/763975102 shutdown_connections 2021-01-28T03:50:09.201 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.192+0000 7f570ffff700 1 --2- 172.21.15.100:0/763975102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57100f9200 0x7f57100f9620 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:09.201 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.192+0000 7f570ffff700 1 -- 172.21.15.100:0/763975102 >> 172.21.15.100:0/763975102 conn(0x7f57100f4a40 msgr2=0x7f57100f6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:50:09.202 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.192+0000 7f570ffff700 1 -- 172.21.15.100:0/763975102 shutdown_connections 2021-01-28T03:50:09.202 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.192+0000 7f570ffff700 1 -- 172.21.15.100:0/763975102 wait complete. 2021-01-28T03:50:09.202 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.196+0000 7f570ffff700 1 Processor -- start 2021-01-28T03:50:09.202 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.196+0000 7f570ffff700 1 -- start start 2021-01-28T03:50:09.203 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.196+0000 7f570ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57100f9200 0x7f57101078d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:09.203 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.196+0000 7f570ffff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5710107dc0 con 0x7f57100f9200 2021-01-28T03:50:09.203 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.196+0000 7f570effd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57100f9200 0x7f57101078d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:09.204 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.196+0000 7f570effd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57100f9200 0x7f57101078d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58872/0 (socket says 172.21.15.100:58872) 2021-01-28T03:50:09.204 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.196+0000 7f570effd700 1 -- 172.21.15.100:0/634034838 learned_addr learned my addr 172.21.15.100:0/634034838 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:50:09.204 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.196+0000 7f570effd700 1 -- 172.21.15.100:0/634034838 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5710107f00 con 0x7f57100f9200 2021-01-28T03:50:09.204 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.196+0000 7f570effd700 1 --2- 172.21.15.100:0/634034838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57100f9200 0x7f57101078d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f5700009420 tx=0x7f5700006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:09.205 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.196+0000 7f56f77fe700 1 -- 172.21.15.100:0/634034838 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5700009ca0 con 0x7f57100f9200 2021-01-28T03:50:09.205 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.196+0000 7f56f77fe700 1 -- 172.21.15.100:0/634034838 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f5700011ae0 con 0x7f57100f9200 2021-01-28T03:50:09.205 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.196+0000 7f570ffff700 1 -- 172.21.15.100:0/634034838 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5710108150 con 0x7f57100f9200 2021-01-28T03:50:09.206 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.196+0000 7f56f77fe700 1 -- 172.21.15.100:0/634034838 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f570001bb60 con 0x7f57100f9200 2021-01-28T03:50:09.206 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.196+0000 7f570ffff700 1 -- 172.21.15.100:0/634034838 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5710108cb0 con 0x7f57100f9200 2021-01-28T03:50:09.206 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.196+0000 7f56f77fe700 1 -- 172.21.15.100:0/634034838 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 35771+0+0 (secure 0 0 0) 0x7f570002b070 con 0x7f57100f9200 2021-01-28T03:50:09.206 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.196+0000 7f56f77fe700 1 --2- 172.21.15.100:0/634034838 >> v2:172.21.15.100:6800/728127347 conn(0x7f56fc034020 0x7f56fc0364e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:09.207 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.196+0000 7f56f77fe700 1 -- 172.21.15.100:0/634034838 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f57000417b0 con 0x7f57100f9200 2021-01-28T03:50:09.207 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.196+0000 7f570e7fc700 1 -- 172.21.15.100:0/634034838 >> v2:172.21.15.100:6800/728127347 conn(0x7f56fc034020 msgr2=0x7f56fc0364e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/728127347 2021-01-28T03:50:09.207 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.200+0000 7f570e7fc700 1 --2- 172.21.15.100:0/634034838 >> v2:172.21.15.100:6800/728127347 conn(0x7f56fc034020 0x7f56fc0364e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2021-01-28T03:50:09.208 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.200+0000 7f570ffff700 1 -- 172.21.15.100:0/634034838 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57100581f0 con 0x7f57100f9200 2021-01-28T03:50:09.209 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.208+0000 7f56f77fe700 1 -- 172.21.15.100:0/634034838 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f5700016030 con 0x7f57100f9200 2021-01-28T03:50:09.403 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.404+0000 7f570e7fc700 1 -- 172.21.15.100:0/634034838 >> v2:172.21.15.100:6800/728127347 conn(0x7f56fc034020 msgr2=0x7f56fc0364e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/728127347 2021-01-28T03:50:09.404 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.404+0000 7f570e7fc700 1 --2- 172.21.15.100:0/634034838 >> v2:172.21.15.100:6800/728127347 conn(0x7f56fc034020 0x7f56fc0364e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2021-01-28T03:50:09.571 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.568+0000 7f570ffff700 1 -- 172.21.15.100:0/634034838 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f57100fb030 con 0x7f57100f9200 2021-01-28T03:50:09.571 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.568+0000 7f56f77fe700 1 -- 172.21.15.100:0/634034838 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7f5700024400 con 0x7f57100f9200 2021-01-28T03:50:09.572 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: { 2021-01-28T03:50:09.572 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "epoch": 5, 2021-01-28T03:50:09.572 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "available": true, 2021-01-28T03:50:09.573 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "active_name": "y", 2021-01-28T03:50:09.573 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "num_standby": 0 2021-01-28T03:50:09.574 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: } 2021-01-28T03:50:09.577 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.572+0000 7f570ffff700 1 -- 172.21.15.100:0/634034838 >> v2:172.21.15.100:6800/728127347 conn(0x7f56fc034020 msgr2=0x7f56fc0364e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-01-28T03:50:09.578 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.572+0000 7f570ffff700 1 --2- 172.21.15.100:0/634034838 >> v2:172.21.15.100:6800/728127347 conn(0x7f56fc034020 0x7f56fc0364e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-28T03:50:09.578 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.572+0000 7f570ffff700 1 -- 172.21.15.100:0/634034838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57100f9200 msgr2=0x7f57101078d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:09.578 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.572+0000 7f570ffff700 1 --2- 172.21.15.100:0/634034838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57100f9200 0x7f57101078d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f5700009420 tx=0x7f5700006ee0).stop 2021-01-28T03:50:09.578 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.572+0000 7f570ffff700 1 -- 172.21.15.100:0/634034838 shutdown_connections 2021-01-28T03:50:09.579 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.572+0000 7f570ffff700 1 --2- 172.21.15.100:0/634034838 >> v2:172.21.15.100:6800/728127347 conn(0x7f56fc034020 0x7f56fc0364e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-28T03:50:09.579 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.572+0000 7f570ffff700 1 --2- 172.21.15.100:0/634034838 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f57100f9200 0x7f57101078d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:09.580 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.572+0000 7f570ffff700 1 -- 172.21.15.100:0/634034838 >> 172.21.15.100:0/634034838 conn(0x7f57100f4a40 msgr2=0x7f57100f5840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:50:09.580 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.572+0000 7f570ffff700 1 -- 172.21.15.100:0/634034838 shutdown_connections 2021-01-28T03:50:09.580 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:09.572+0000 7f570ffff700 1 -- 172.21.15.100:0/634034838 wait complete. 2021-01-28T03:50:10.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:09 smithi100 bash[9834]: audit 2021-01-28T03:50:09.573648+0000 mon.a (mon.0) 29 : audit [DBG] from='client.? 172.21.15.100:0/634034838' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2021-01-28T03:50:10.223 INFO:teuthology.orchestra.run.smithi100.stderr:Waiting for the mgr to restart... 2021-01-28T03:50:10.224 INFO:teuthology.orchestra.run.smithi100.stderr:Waiting for mgr epoch 5... 2021-01-28T03:50:10.224 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi100 -v /var/log/ceph/c217df96-611b-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp3pxhmbk:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpih1yxits:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 tell mgr mgr_status 2021-01-28T03:50:11.280 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.275+0000 7f0d9359e700 1 Processor -- start 2021-01-28T03:50:11.281 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.275+0000 7f0d9359e700 1 -- start start 2021-01-28T03:50:11.281 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.275+0000 7f0d9359e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d940f9200 0x7f0d940f9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:11.281 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.275+0000 7f0d9359e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d940f9b10 con 0x7f0d940f9200 2021-01-28T03:50:11.281 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.275+0000 7f0d9259c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d940f9200 0x7f0d940f9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:11.282 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.275+0000 7f0d9259c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d940f9200 0x7f0d940f9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58880/0 (socket says 172.21.15.100:58880) 2021-01-28T03:50:11.282 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.275+0000 7f0d9259c700 1 -- 172.21.15.100:0/3837537949 learned_addr learned my addr 172.21.15.100:0/3837537949 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:50:11.282 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.279+0000 7f0d9259c700 1 -- 172.21.15.100:0/3837537949 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d940f9c50 con 0x7f0d940f9200 2021-01-28T03:50:11.282 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.279+0000 7f0d9259c700 1 --2- 172.21.15.100:0/3837537949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d940f9200 0x7f0d940f9620 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f0d8400b950 tx=0x7f0d84006ee0).ready entity=mon.0 client_cookie=e715d6e9f94d9cd0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:11.282 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.279+0000 7f0d9159a700 1 -- 172.21.15.100:0/3837537949 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d84009840 con 0x7f0d940f9200 2021-01-28T03:50:11.283 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.279+0000 7f0d9159a700 1 -- 172.21.15.100:0/3837537949 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f0d84009e00 con 0x7f0d940f9200 2021-01-28T03:50:11.283 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.279+0000 7f0d9159a700 1 -- 172.21.15.100:0/3837537949 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d84011c80 con 0x7f0d940f9200 2021-01-28T03:50:11.284 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.279+0000 7f0d9359e700 1 -- 172.21.15.100:0/3837537949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d940f9200 msgr2=0x7f0d940f9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:11.285 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.279+0000 7f0d9359e700 1 --2- 172.21.15.100:0/3837537949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d940f9200 0x7f0d940f9620 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f0d8400b950 tx=0x7f0d84006ee0).stop 2021-01-28T03:50:11.285 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.279+0000 7f0d9359e700 1 -- 172.21.15.100:0/3837537949 shutdown_connections 2021-01-28T03:50:11.285 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.279+0000 7f0d9359e700 1 --2- 172.21.15.100:0/3837537949 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d940f9200 0x7f0d940f9620 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:11.285 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.279+0000 7f0d9359e700 1 -- 172.21.15.100:0/3837537949 >> 172.21.15.100:0/3837537949 conn(0x7f0d940f4a40 msgr2=0x7f0d940f6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:50:11.286 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.279+0000 7f0d9359e700 1 -- 172.21.15.100:0/3837537949 shutdown_connections 2021-01-28T03:50:11.286 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.279+0000 7f0d9359e700 1 -- 172.21.15.100:0/3837537949 wait complete. 2021-01-28T03:50:11.286 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.279+0000 7f0d9359e700 1 Processor -- start 2021-01-28T03:50:11.287 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.283+0000 7f0d9359e700 1 -- start start 2021-01-28T03:50:11.287 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.283+0000 7f0d9359e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d940f9200 0x7f0d9406f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:11.287 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.283+0000 7f0d9359e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9406da00 con 0x7f0d940f9200 2021-01-28T03:50:11.287 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.283+0000 7f0d9259c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d940f9200 0x7f0d9406f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:11.287 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.283+0000 7f0d9259c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d940f9200 0x7f0d9406f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58882/0 (socket says 172.21.15.100:58882) 2021-01-28T03:50:11.288 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.283+0000 7f0d9259c700 1 -- 172.21.15.100:0/765553264 learned_addr learned my addr 172.21.15.100:0/765553264 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:50:11.289 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.283+0000 7f0d9259c700 1 -- 172.21.15.100:0/765553264 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d9406db40 con 0x7f0d940f9200 2021-01-28T03:50:11.289 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.283+0000 7f0d9259c700 1 --2- 172.21.15.100:0/765553264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d940f9200 0x7f0d9406f580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f0d84009420 tx=0x7f0d84006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:11.289 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.283+0000 7f0d82ffd700 1 -- 172.21.15.100:0/765553264 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d84009ca0 con 0x7f0d940f9200 2021-01-28T03:50:11.289 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.283+0000 7f0d82ffd700 1 -- 172.21.15.100:0/765553264 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f0d84011400 con 0x7f0d940f9200 2021-01-28T03:50:11.290 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.283+0000 7f0d82ffd700 1 -- 172.21.15.100:0/765553264 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d8401bc50 con 0x7f0d940f9200 2021-01-28T03:50:11.290 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.283+0000 7f0d9359e700 1 -- 172.21.15.100:0/765553264 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d9406dd30 con 0x7f0d940f9200 2021-01-28T03:50:11.290 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.283+0000 7f0d9359e700 1 -- 172.21.15.100:0/765553264 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d9406e1c0 con 0x7f0d940f9200 2021-01-28T03:50:11.290 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.283+0000 7f0d82ffd700 1 -- 172.21.15.100:0/765553264 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 35771+0+0 (secure 0 0 0) 0x7f0d8402b070 con 0x7f0d940f9200 2021-01-28T03:50:11.290 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.283+0000 7f0d82ffd700 1 --2- 172.21.15.100:0/765553264 >> v2:172.21.15.100:6800/728127347 conn(0x7f0d7802fb70 0x7f0d78032030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:11.291 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.283+0000 7f0d82ffd700 1 -- 172.21.15.100:0/765553264 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7f0d84041820 con 0x7f0d940f9200 2021-01-28T03:50:11.291 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.283+0000 7f0d91d9b700 1 -- 172.21.15.100:0/765553264 >> v2:172.21.15.100:6800/728127347 conn(0x7f0d7802fb70 msgr2=0x7f0d78032030 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/728127347 2021-01-28T03:50:11.291 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.283+0000 7f0d91d9b700 1 --2- 172.21.15.100:0/765553264 >> v2:172.21.15.100:6800/728127347 conn(0x7f0d7802fb70 0x7f0d78032030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2021-01-28T03:50:11.291 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.283+0000 7f0d9359e700 1 -- 172.21.15.100:0/765553264 --> v2:172.21.15.100:6800/728127347 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0d940581f0 con 0x7f0d7802fb70 2021-01-28T03:50:11.488 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.487+0000 7f0d91d9b700 1 -- 172.21.15.100:0/765553264 >> v2:172.21.15.100:6800/728127347 conn(0x7f0d7802fb70 msgr2=0x7f0d78032030 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/728127347 2021-01-28T03:50:11.488 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.487+0000 7f0d91d9b700 1 --2- 172.21.15.100:0/765553264 >> v2:172.21.15.100:6800/728127347 conn(0x7f0d7802fb70 0x7f0d78032030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2021-01-28T03:50:11.892 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.891+0000 7f0d91d9b700 1 -- 172.21.15.100:0/765553264 >> v2:172.21.15.100:6800/728127347 conn(0x7f0d7802fb70 msgr2=0x7f0d78032030 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/728127347 2021-01-28T03:50:11.892 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:11.891+0000 7f0d91d9b700 1 --2- 172.21.15.100:0/765553264 >> v2:172.21.15.100:6800/728127347 conn(0x7f0d7802fb70 0x7f0d78032030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2021-01-28T03:50:12.693 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:12.695+0000 7f0d91d9b700 1 -- 172.21.15.100:0/765553264 >> v2:172.21.15.100:6800/728127347 conn(0x7f0d7802fb70 msgr2=0x7f0d78032030 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/728127347 2021-01-28T03:50:12.694 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:12.695+0000 7f0d91d9b700 1 --2- 172.21.15.100:0/765553264 >> v2:172.21.15.100:6800/728127347 conn(0x7f0d7802fb70 0x7f0d78032030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2021-01-28T03:50:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:13.394+0000 7f0d82ffd700 1 -- 172.21.15.100:0/765553264 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mgrmap(e 6) v1 ==== 35656+0+0 (secure 0 0 0) 0x7f0d8400f070 con 0x7f0d940f9200 2021-01-28T03:50:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:13.394+0000 7f0d82ffd700 1 -- 172.21.15.100:0/765553264 >> v2:172.21.15.100:6800/728127347 conn(0x7f0d7802fb70 msgr2=0x7f0d78032030 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-01-28T03:50:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:13.394+0000 7f0d82ffd700 1 --2- 172.21.15.100:0/765553264 >> v2:172.21.15.100:6800/728127347 conn(0x7f0d7802fb70 0x7f0d78032030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-28T03:50:14.396 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:14.394+0000 7f0d82ffd700 1 -- 172.21.15.100:0/765553264 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 7) v1 ==== 35691+0+0 (secure 0 0 0) 0x7f0d84024400 con 0x7f0d940f9200 2021-01-28T03:50:14.398 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:14.394+0000 7f0d82ffd700 1 --2- 172.21.15.100:0/765553264 >> v2:172.21.15.100:6800/2057733473 conn(0x7f0d78033450 0x7f0d78035840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:14.398 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:14.394+0000 7f0d82ffd700 1 -- 172.21.15.100:0/765553264 --> v2:172.21.15.100:6800/2057733473 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0d940581f0 con 0x7f0d78033450 2021-01-28T03:50:14.399 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:14.398+0000 7f0d91d9b700 1 --2- 172.21.15.100:0/765553264 >> v2:172.21.15.100:6800/2057733473 conn(0x7f0d78033450 0x7f0d78035840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:14.399 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:14.398+0000 7f0d91d9b700 1 --2- 172.21.15.100:0/765553264 >> v2:172.21.15.100:6800/2057733473 conn(0x7f0d78033450 0x7f0d78035840 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f0d88003720 tx=0x7f0d88006d10).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:14.401 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:14.402+0000 7f0d82ffd700 1 -- 172.21.15.100:0/765553264 <== mgr.14116 v2:172.21.15.100:6800/2057733473 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6438 (secure 0 0 0) 0x7f0d940581f0 con 0x7f0d78033450 2021-01-28T03:50:14.417 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:14.418+0000 7f0d9359e700 1 -- 172.21.15.100:0/765553264 --> v2:172.21.15.100:6800/2057733473 -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f0d94044bc0 con 0x7f0d78033450 2021-01-28T03:50:14.419 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:14.418+0000 7f0d82ffd700 1 -- 172.21.15.100:0/765553264 <== mgr.14116 v2:172.21.15.100:6800/2057733473 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f0d94044bc0 con 0x7f0d78033450 2021-01-28T03:50:14.420 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: { 2021-01-28T03:50:14.420 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "mgrmap_epoch": 7, 2021-01-28T03:50:14.420 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "initialized": true 2021-01-28T03:50:14.420 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: } 2021-01-28T03:50:14.421 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:14.418+0000 7f0d9359e700 1 -- 172.21.15.100:0/765553264 >> v2:172.21.15.100:6800/2057733473 conn(0x7f0d78033450 msgr2=0x7f0d78035840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:14.421 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:14.418+0000 7f0d9359e700 1 --2- 172.21.15.100:0/765553264 >> v2:172.21.15.100:6800/2057733473 conn(0x7f0d78033450 0x7f0d78035840 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f0d88003720 tx=0x7f0d88006d10).stop 2021-01-28T03:50:14.421 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:14.418+0000 7f0d9359e700 1 -- 172.21.15.100:0/765553264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d940f9200 msgr2=0x7f0d9406f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:14.421 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:14.418+0000 7f0d9359e700 1 --2- 172.21.15.100:0/765553264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d940f9200 0x7f0d9406f580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f0d84009420 tx=0x7f0d84006ee0).stop 2021-01-28T03:50:14.422 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:14.418+0000 7f0d9359e700 1 -- 172.21.15.100:0/765553264 shutdown_connections 2021-01-28T03:50:14.422 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:14.418+0000 7f0d9359e700 1 --2- 172.21.15.100:0/765553264 >> v2:172.21.15.100:6800/2057733473 conn(0x7f0d78033450 0x7f0d78035840 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:14.422 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:14.418+0000 7f0d9359e700 1 --2- 172.21.15.100:0/765553264 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d940f9200 0x7f0d9406f580 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:14.423 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:14.418+0000 7f0d9359e700 1 --2- 172.21.15.100:0/765553264 >> v2:172.21.15.100:6800/728127347 conn(0x7f0d7802fb70 0x7f0d78032030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-28T03:50:14.423 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:14.418+0000 7f0d9359e700 1 -- 172.21.15.100:0/765553264 >> 172.21.15.100:0/765553264 conn(0x7f0d940f4a40 msgr2=0x7f0d940f5840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:50:14.424 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:14.418+0000 7f0d9359e700 1 -- 172.21.15.100:0/765553264 shutdown_connections 2021-01-28T03:50:14.424 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:14.418+0000 7f0d9359e700 1 -- 172.21.15.100:0/765553264 wait complete. 2021-01-28T03:50:14.603 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:14 smithi100 bash[9834]: cluster 2021-01-28T03:50:13.341296+0000 mon.a (mon.0) 30 : cluster [INF] Active manager daemon y restarted 2021-01-28T03:50:14.603 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:14 smithi100 bash[9834]: cluster 2021-01-28T03:50:13.342122+0000 mon.a (mon.0) 31 : cluster [INF] Activating manager daemon y 2021-01-28T03:50:14.603 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:14 smithi100 bash[9834]: cluster 2021-01-28T03:50:13.344619+0000 mon.a (mon.0) 32 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2021-01-28T03:50:14.604 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:14 smithi100 bash[9834]: cluster 2021-01-28T03:50:13.398663+0000 mon.a (mon.0) 33 : cluster [DBG] mgrmap e6: y(active, starting, since 0.0567059s) 2021-01-28T03:50:14.604 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:14 smithi100 bash[9834]: audit 2021-01-28T03:50:13.402266+0000 mon.a (mon.0) 34 : audit [DBG] from='mgr.14116 172.21.15.100:0/3481312515' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-01-28T03:50:14.604 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:14 smithi100 bash[9834]: audit 2021-01-28T03:50:13.403607+0000 mon.a (mon.0) 35 : audit [DBG] from='mgr.14116 172.21.15.100:0/3481312515' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-01-28T03:50:14.604 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:14 smithi100 bash[9834]: audit 2021-01-28T03:50:13.403967+0000 mon.a (mon.0) 36 : audit [DBG] from='mgr.14116 172.21.15.100:0/3481312515' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-01-28T03:50:14.605 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:14 smithi100 bash[9834]: audit 2021-01-28T03:50:13.404279+0000 mon.a (mon.0) 37 : audit [DBG] from='mgr.14116 172.21.15.100:0/3481312515' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-01-28T03:50:14.605 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:14 smithi100 bash[9834]: audit 2021-01-28T03:50:13.405109+0000 mon.a (mon.0) 38 : audit [DBG] from='mgr.14116 172.21.15.100:0/3481312515' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-01-28T03:50:14.605 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:14 smithi100 bash[9834]: audit 2021-01-28T03:50:13.406625+0000 mon.a (mon.0) 39 : audit [DBG] from='mgr.14116 172.21.15.100:0/3481312515' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_user"}]: dispatch 2021-01-28T03:50:14.605 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:14 smithi100 bash[9834]: audit 2021-01-28T03:50:13.407182+0000 mon.a (mon.0) 40 : audit [DBG] from='mgr.14116 172.21.15.100:0/3481312515' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-01-28T03:50:14.605 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:14 smithi100 bash[9834]: audit 2021-01-28T03:50:13.407733+0000 mon.a (mon.0) 41 : audit [DBG] from='mgr.14116 172.21.15.100:0/3481312515' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-01-28T03:50:14.606 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:14 smithi100 bash[9834]: audit 2021-01-28T03:50:13.408195+0000 mon.a (mon.0) 42 : audit [DBG] from='mgr.14116 172.21.15.100:0/3481312515' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-01-28T03:50:14.606 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:14 smithi100 bash[9834]: cluster 2021-01-28T03:50:13.412348+0000 mon.a (mon.0) 43 : cluster [INF] Manager daemon y is now available 2021-01-28T03:50:14.606 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:14 smithi100 bash[9834]: audit 2021-01-28T03:50:13.432791+0000 mon.a (mon.0) 44 : audit [INF] from='mgr.14116 172.21.15.100:0/3481312515' entity='mgr.y' 2021-01-28T03:50:14.606 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:14 smithi100 bash[9834]: audit 2021-01-28T03:50:13.438603+0000 mon.a (mon.0) 45 : audit [INF] from='mgr.14116 172.21.15.100:0/3481312515' entity='mgr.y' 2021-01-28T03:50:14.607 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:14 smithi100 bash[9834]: audit 2021-01-28T03:50:13.442397+0000 mon.a (mon.0) 46 : audit [INF] from='mgr.14116 172.21.15.100:0/3481312515' entity='mgr.y' 2021-01-28T03:50:14.607 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:14 smithi100 bash[9834]: audit 2021-01-28T03:50:13.579036+0000 mon.a (mon.0) 47 : audit [INF] from='mgr.14116 172.21.15.100:0/3481312515' entity='mgr.y' 2021-01-28T03:50:14.607 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:14 smithi100 bash[9834]: audit 2021-01-28T03:50:13.588431+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.14116 172.21.15.100:0/3481312515' entity='mgr.y' 2021-01-28T03:50:14.607 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:14 smithi100 bash[9834]: audit 2021-01-28T03:50:13.594282+0000 mon.a (mon.0) 49 : audit [INF] from='mgr.14116 172.21.15.100:0/3481312515' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T03:50:14.607 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:14 smithi100 bash[9834]: audit 2021-01-28T03:50:13.596695+0000 mon.a (mon.0) 50 : audit [INF] from='mgr.14116 172.21.15.100:0/3481312515' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T03:50:15.080 INFO:teuthology.orchestra.run.smithi100.stderr:mgr epoch 5 is available 2021-01-28T03:50:15.080 INFO:teuthology.orchestra.run.smithi100.stderr:Setting orchestrator backend to cephadm... 2021-01-28T03:50:15.080 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi100 -v /var/log/ceph/c217df96-611b-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp3pxhmbk:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpih1yxits:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 orch set backend cephadm 2021-01-28T03:50:15.824 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:15 smithi100 bash[9834]: cluster 2021-01-28T03:50:14.401703+0000 mon.a (mon.0) 51 : cluster [DBG] mgrmap e7: y(active, since 1.05975s) 2021-01-28T03:50:15.824 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:15 smithi100 bash[9834]: audit 2021-01-28T03:50:14.402645+0000 mgr.y (mgr.14116) 1 : audit [DBG] from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2021-01-28T03:50:15.824 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:15 smithi100 bash[9834]: audit 2021-01-28T03:50:14.420579+0000 mgr.y (mgr.14116) 2 : audit [DBG] from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2021-01-28T03:50:16.123 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.122+0000 7f7cf9d23700 1 Processor -- start 2021-01-28T03:50:16.123 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.122+0000 7f7cf9d23700 1 -- start start 2021-01-28T03:50:16.123 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.122+0000 7f7cf9d23700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cf40fcac0 0x7f7cf40fcee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:16.124 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.122+0000 7f7cf9d23700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf40fd3d0 con 0x7f7cf40fcac0 2021-01-28T03:50:16.124 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.122+0000 7f7cf8d21700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cf40fcac0 0x7f7cf40fcee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:16.124 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.122+0000 7f7cf8d21700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cf40fcac0 0x7f7cf40fcee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58914/0 (socket says 172.21.15.100:58914) 2021-01-28T03:50:16.124 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.122+0000 7f7cf8d21700 1 -- 172.21.15.100:0/1284565389 learned_addr learned my addr 172.21.15.100:0/1284565389 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:50:16.124 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.122+0000 7f7cf8d21700 1 -- 172.21.15.100:0/1284565389 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf40fd510 con 0x7f7cf40fcac0 2021-01-28T03:50:16.125 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.122+0000 7f7cf8d21700 1 --2- 172.21.15.100:0/1284565389 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cf40fcac0 0x7f7cf40fcee0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f7cdc00b950 tx=0x7f7cdc006ee0).ready entity=mon.0 client_cookie=1fa9b6d1ff9cb0d5 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:16.126 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.122+0000 7f7cf37fe700 1 -- 172.21.15.100:0/1284565389 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cdc009840 con 0x7f7cf40fcac0 2021-01-28T03:50:16.126 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.122+0000 7f7cf37fe700 1 -- 172.21.15.100:0/1284565389 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f7cdc009e00 con 0x7f7cf40fcac0 2021-01-28T03:50:16.126 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.122+0000 7f7cf37fe700 1 -- 172.21.15.100:0/1284565389 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cdc011c80 con 0x7f7cf40fcac0 2021-01-28T03:50:16.127 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.126+0000 7f7cf9d23700 1 -- 172.21.15.100:0/1284565389 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cf40fcac0 msgr2=0x7f7cf40fcee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:16.127 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.126+0000 7f7cf9d23700 1 --2- 172.21.15.100:0/1284565389 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cf40fcac0 0x7f7cf40fcee0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f7cdc00b950 tx=0x7f7cdc006ee0).stop 2021-01-28T03:50:16.127 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.126+0000 7f7cf9d23700 1 -- 172.21.15.100:0/1284565389 shutdown_connections 2021-01-28T03:50:16.127 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.126+0000 7f7cf9d23700 1 --2- 172.21.15.100:0/1284565389 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cf40fcac0 0x7f7cf40fcee0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:16.127 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.126+0000 7f7cf9d23700 1 -- 172.21.15.100:0/1284565389 >> 172.21.15.100:0/1284565389 conn(0x7f7cf406ea50 msgr2=0x7f7cf406ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:50:16.128 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.126+0000 7f7cf9d23700 1 -- 172.21.15.100:0/1284565389 shutdown_connections 2021-01-28T03:50:16.128 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.126+0000 7f7cf9d23700 1 -- 172.21.15.100:0/1284565389 wait complete. 2021-01-28T03:50:16.128 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.126+0000 7f7cf9d23700 1 Processor -- start 2021-01-28T03:50:16.130 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.126+0000 7f7cf9d23700 1 -- start start 2021-01-28T03:50:16.131 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.126+0000 7f7cf9d23700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cf40fcac0 0x7f7cf4109b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:16.131 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.126+0000 7f7cf9d23700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf410a020 con 0x7f7cf40fcac0 2021-01-28T03:50:16.131 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.126+0000 7f7cf8d21700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cf40fcac0 0x7f7cf4109b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:16.131 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.126+0000 7f7cf8d21700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cf40fcac0 0x7f7cf4109b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58916/0 (socket says 172.21.15.100:58916) 2021-01-28T03:50:16.132 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.126+0000 7f7cf8d21700 1 -- 172.21.15.100:0/2415323288 learned_addr learned my addr 172.21.15.100:0/2415323288 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:50:16.132 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.126+0000 7f7cf8d21700 1 -- 172.21.15.100:0/2415323288 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf410a160 con 0x7f7cf40fcac0 2021-01-28T03:50:16.132 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.126+0000 7f7cf8d21700 1 --2- 172.21.15.100:0/2415323288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cf40fcac0 0x7f7cf4109b30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f7cdc009fd0 tx=0x7f7cdc006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:16.132 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.126+0000 7f7cf17fa700 1 -- 172.21.15.100:0/2415323288 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cdc009ca0 con 0x7f7cf40fcac0 2021-01-28T03:50:16.132 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.126+0000 7f7cf9d23700 1 -- 172.21.15.100:0/2415323288 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf410a3b0 con 0x7f7cf40fcac0 2021-01-28T03:50:16.133 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.126+0000 7f7cf17fa700 1 -- 172.21.15.100:0/2415323288 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f7cdc011400 con 0x7f7cf40fcac0 2021-01-28T03:50:16.133 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.126+0000 7f7cf17fa700 1 -- 172.21.15.100:0/2415323288 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7cdc01bc00 con 0x7f7cf40fcac0 2021-01-28T03:50:16.133 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.126+0000 7f7cf9d23700 1 -- 172.21.15.100:0/2415323288 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf410af10 con 0x7f7cf40fcac0 2021-01-28T03:50:16.133 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.130+0000 7f7cf17fa700 1 -- 172.21.15.100:0/2415323288 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) v1 ==== 35771+0+0 (secure 0 0 0) 0x7f7cdc02b070 con 0x7f7cf40fcac0 2021-01-28T03:50:16.133 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.130+0000 7f7cf17fa700 1 --2- 172.21.15.100:0/2415323288 >> v2:172.21.15.100:6800/2057733473 conn(0x7f7cd402fb70 0x7f7cd4032030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:16.134 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.130+0000 7f7cf17fa700 1 -- 172.21.15.100:0/2415323288 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 883+0+0 (secure 0 0 0) 0x7f7cdc041900 con 0x7f7cf40fcac0 2021-01-28T03:50:16.134 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.130+0000 7f7cf3fff700 1 --2- 172.21.15.100:0/2415323288 >> v2:172.21.15.100:6800/2057733473 conn(0x7f7cd402fb70 0x7f7cd4032030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:16.134 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.130+0000 7f7cf3fff700 1 --2- 172.21.15.100:0/2415323288 >> v2:172.21.15.100:6800/2057733473 conn(0x7f7cd402fb70 0x7f7cd4032030 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f7cec0089e0 tx=0x7f7cec006ec0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:16.135 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.130+0000 7f7cf9d23700 1 -- 172.21.15.100:0/2415323288 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf40581f0 con 0x7f7cf40fcac0 2021-01-28T03:50:16.138 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.138+0000 7f7cf17fa700 1 -- 172.21.15.100:0/2415323288 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f7cdc016080 con 0x7f7cf40fcac0 2021-01-28T03:50:16.490 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.490+0000 7f7cf9d23700 1 -- 172.21.15.100:0/2415323288 --> v2:172.21.15.100:6800/2057733473 -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f7cf40fbdc0 con 0x7f7cd402fb70 2021-01-28T03:50:16.501 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.502+0000 7f7cf17fa700 1 -- 172.21.15.100:0/2415323288 <== mgr.14116 v2:172.21.15.100:6800/2057733473 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f7cf40fbdc0 con 0x7f7cd402fb70 2021-01-28T03:50:16.503 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.502+0000 7f7cf9d23700 1 -- 172.21.15.100:0/2415323288 >> v2:172.21.15.100:6800/2057733473 conn(0x7f7cd402fb70 msgr2=0x7f7cd4032030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:16.504 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.502+0000 7f7cf9d23700 1 --2- 172.21.15.100:0/2415323288 >> v2:172.21.15.100:6800/2057733473 conn(0x7f7cd402fb70 0x7f7cd4032030 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f7cec0089e0 tx=0x7f7cec006ec0).stop 2021-01-28T03:50:16.504 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.502+0000 7f7cf9d23700 1 -- 172.21.15.100:0/2415323288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cf40fcac0 msgr2=0x7f7cf4109b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:16.504 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.502+0000 7f7cf9d23700 1 --2- 172.21.15.100:0/2415323288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cf40fcac0 0x7f7cf4109b30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f7cdc009fd0 tx=0x7f7cdc006ee0).stop 2021-01-28T03:50:16.505 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.502+0000 7f7cf9d23700 1 -- 172.21.15.100:0/2415323288 shutdown_connections 2021-01-28T03:50:16.505 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.502+0000 7f7cf9d23700 1 --2- 172.21.15.100:0/2415323288 >> v2:172.21.15.100:6800/2057733473 conn(0x7f7cd402fb70 0x7f7cd4032030 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:16.506 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.502+0000 7f7cf9d23700 1 --2- 172.21.15.100:0/2415323288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cf40fcac0 0x7f7cf4109b30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:16.506 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.502+0000 7f7cf9d23700 1 -- 172.21.15.100:0/2415323288 >> 172.21.15.100:0/2415323288 conn(0x7f7cf406ea50 msgr2=0x7f7cf40f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:50:16.506 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.502+0000 7f7cf9d23700 1 -- 172.21.15.100:0/2415323288 shutdown_connections 2021-01-28T03:50:16.506 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:16.502+0000 7f7cf9d23700 1 -- 172.21.15.100:0/2415323288 wait complete. 2021-01-28T03:50:16.698 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:16 smithi100 bash[9834]: cluster 2021-01-28T03:50:15.407072+0000 mon.a (mon.0) 52 : cluster [DBG] mgrmap e8: y(active, since 2s) 2021-01-28T03:50:17.169 INFO:teuthology.orchestra.run.smithi100.stderr:Generating ssh key... 2021-01-28T03:50:17.169 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi100 -v /var/log/ceph/c217df96-611b-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp3pxhmbk:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpih1yxits:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 cephadm generate-key 2021-01-28T03:50:17.824 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:17 smithi100 bash[9834]: audit 2021-01-28T03:50:16.494084+0000 mgr.y (mgr.14116) 3 : audit [DBG] from='client.14126 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:50:17.824 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:17 smithi100 bash[9834]: audit 2021-01-28T03:50:16.502985+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.14116 172.21.15.100:0/3481312515' entity='mgr.y' 2021-01-28T03:50:17.824 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:17 smithi100 bash[9834]: audit 2021-01-28T03:50:16.512335+0000 mon.a (mon.0) 54 : audit [INF] from='mgr.14116 172.21.15.100:0/3481312515' entity='mgr.y' 2021-01-28T03:50:18.178 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.178+0000 7f3124caf700 1 Processor -- start 2021-01-28T03:50:18.178 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.178+0000 7f3124caf700 1 -- start start 2021-01-28T03:50:18.180 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.178+0000 7f3124caf700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31200f93d0 0x7f31200f97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:18.180 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.178+0000 7f3124caf700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31200f9ce0 con 0x7f31200f93d0 2021-01-28T03:50:18.180 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.178+0000 7f311e59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31200f93d0 0x7f31200f97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:18.180 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.178+0000 7f311e59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31200f93d0 0x7f31200f97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58920/0 (socket says 172.21.15.100:58920) 2021-01-28T03:50:18.181 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.178+0000 7f311e59c700 1 -- 172.21.15.100:0/410857877 learned_addr learned my addr 172.21.15.100:0/410857877 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:50:18.181 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.178+0000 7f311e59c700 1 -- 172.21.15.100:0/410857877 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31200f9e20 con 0x7f31200f93d0 2021-01-28T03:50:18.181 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.178+0000 7f311e59c700 1 --2- 172.21.15.100:0/410857877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31200f93d0 0x7f31200f97f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f311000b950 tx=0x7f3110006ee0).ready entity=mon.0 client_cookie=273501c9753d4c43 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:18.181 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.178+0000 7f311d59a700 1 -- 172.21.15.100:0/410857877 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3110009840 con 0x7f31200f93d0 2021-01-28T03:50:18.182 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.178+0000 7f311d59a700 1 -- 172.21.15.100:0/410857877 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f3110009e00 con 0x7f31200f93d0 2021-01-28T03:50:18.184 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.178+0000 7f311d59a700 1 -- 172.21.15.100:0/410857877 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3110011c80 con 0x7f31200f93d0 2021-01-28T03:50:18.184 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.182+0000 7f3124caf700 1 -- 172.21.15.100:0/410857877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31200f93d0 msgr2=0x7f31200f97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:18.184 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.182+0000 7f3124caf700 1 --2- 172.21.15.100:0/410857877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31200f93d0 0x7f31200f97f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f311000b950 tx=0x7f3110006ee0).stop 2021-01-28T03:50:18.185 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.182+0000 7f3124caf700 1 -- 172.21.15.100:0/410857877 shutdown_connections 2021-01-28T03:50:18.185 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.182+0000 7f3124caf700 1 --2- 172.21.15.100:0/410857877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31200f93d0 0x7f31200f97f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:18.185 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.182+0000 7f3124caf700 1 -- 172.21.15.100:0/410857877 >> 172.21.15.100:0/410857877 conn(0x7f31200f4bf0 msgr2=0x7f31200f7010 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:50:18.186 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.182+0000 7f3124caf700 1 -- 172.21.15.100:0/410857877 shutdown_connections 2021-01-28T03:50:18.186 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.182+0000 7f3124caf700 1 -- 172.21.15.100:0/410857877 wait complete. 2021-01-28T03:50:18.186 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.182+0000 7f3124caf700 1 Processor -- start 2021-01-28T03:50:18.187 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.182+0000 7f3124caf700 1 -- start start 2021-01-28T03:50:18.187 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.182+0000 7f3124caf700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31200f93d0 0x7f3120109e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:18.187 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.182+0000 7f3124caf700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312010a360 con 0x7f31200f93d0 2021-01-28T03:50:18.187 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.182+0000 7f311e59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31200f93d0 0x7f3120109e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:18.188 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.182+0000 7f311e59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31200f93d0 0x7f3120109e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58922/0 (socket says 172.21.15.100:58922) 2021-01-28T03:50:18.188 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.182+0000 7f311e59c700 1 -- 172.21.15.100:0/1656455091 learned_addr learned my addr 172.21.15.100:0/1656455091 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:50:18.188 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.182+0000 7f311e59c700 1 -- 172.21.15.100:0/1656455091 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f312010a4a0 con 0x7f31200f93d0 2021-01-28T03:50:18.189 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.182+0000 7f311e59c700 1 --2- 172.21.15.100:0/1656455091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31200f93d0 0x7f3120109e70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f3110009420 tx=0x7f3110006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:18.190 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.182+0000 7f310effd700 1 -- 172.21.15.100:0/1656455091 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3110009ca0 con 0x7f31200f93d0 2021-01-28T03:50:18.190 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.186+0000 7f310effd700 1 -- 172.21.15.100:0/1656455091 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f3110011400 con 0x7f31200f93d0 2021-01-28T03:50:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.186+0000 7f3124caf700 1 -- 172.21.15.100:0/1656455091 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31201057f0 con 0x7f31200f93d0 2021-01-28T03:50:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.186+0000 7f3124caf700 1 -- 172.21.15.100:0/1656455091 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3120105c80 con 0x7f31200f93d0 2021-01-28T03:50:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.186+0000 7f310effd700 1 -- 172.21.15.100:0/1656455091 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f311001bc50 con 0x7f31200f93d0 2021-01-28T03:50:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.186+0000 7f310effd700 1 -- 172.21.15.100:0/1656455091 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) v1 ==== 35771+0+0 (secure 0 0 0) 0x7f311002b070 con 0x7f31200f93d0 2021-01-28T03:50:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.186+0000 7f310effd700 1 --2- 172.21.15.100:0/1656455091 >> v2:172.21.15.100:6800/2057733473 conn(0x7f310402fb70 0x7f3104032030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:18.192 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.186+0000 7f310effd700 1 -- 172.21.15.100:0/1656455091 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 883+0+0 (secure 0 0 0) 0x7f3110041830 con 0x7f31200f93d0 2021-01-28T03:50:18.192 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.186+0000 7f3124caf700 1 -- 172.21.15.100:0/1656455091 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3120044bc0 con 0x7f31200f93d0 2021-01-28T03:50:18.192 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.186+0000 7f311dd9b700 1 --2- 172.21.15.100:0/1656455091 >> v2:172.21.15.100:6800/2057733473 conn(0x7f310402fb70 0x7f3104032030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:18.192 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.186+0000 7f311dd9b700 1 --2- 172.21.15.100:0/1656455091 >> v2:172.21.15.100:6800/2057733473 conn(0x7f310402fb70 0x7f3104032030 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f31140096a0 tx=0x7f3114006b40).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:18.193 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.194+0000 7f310effd700 1 -- 172.21.15.100:0/1656455091 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f3110016020 con 0x7f31200f93d0 2021-01-28T03:50:18.485 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.486+0000 7f3124caf700 1 -- 172.21.15.100:0/1656455091 --> v2:172.21.15.100:6800/2057733473 -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f31200fb130 con 0x7f310402fb70 2021-01-28T03:50:18.788 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.786+0000 7f310effd700 1 -- 172.21.15.100:0/1656455091 <== mgr.14116 v2:172.21.15.100:6800/2057733473 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f31200fb130 con 0x7f310402fb70 2021-01-28T03:50:18.792 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.790+0000 7f3124caf700 1 -- 172.21.15.100:0/1656455091 >> v2:172.21.15.100:6800/2057733473 conn(0x7f310402fb70 msgr2=0x7f3104032030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:18.792 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.790+0000 7f3124caf700 1 --2- 172.21.15.100:0/1656455091 >> v2:172.21.15.100:6800/2057733473 conn(0x7f310402fb70 0x7f3104032030 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f31140096a0 tx=0x7f3114006b40).stop 2021-01-28T03:50:18.792 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.790+0000 7f3124caf700 1 -- 172.21.15.100:0/1656455091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31200f93d0 msgr2=0x7f3120109e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:18.793 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.790+0000 7f3124caf700 1 --2- 172.21.15.100:0/1656455091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31200f93d0 0x7f3120109e70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f3110009420 tx=0x7f3110006ee0).stop 2021-01-28T03:50:18.794 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.790+0000 7f3124caf700 1 -- 172.21.15.100:0/1656455091 shutdown_connections 2021-01-28T03:50:18.794 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.790+0000 7f3124caf700 1 --2- 172.21.15.100:0/1656455091 >> v2:172.21.15.100:6800/2057733473 conn(0x7f310402fb70 0x7f3104032030 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:18.794 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.790+0000 7f3124caf700 1 --2- 172.21.15.100:0/1656455091 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31200f93d0 0x7f3120109e70 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:18.794 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.790+0000 7f3124caf700 1 -- 172.21.15.100:0/1656455091 >> 172.21.15.100:0/1656455091 conn(0x7f31200f4bf0 msgr2=0x7f31200f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:50:18.794 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.790+0000 7f3124caf700 1 -- 172.21.15.100:0/1656455091 shutdown_connections 2021-01-28T03:50:18.795 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:18.790+0000 7f3124caf700 1 -- 172.21.15.100:0/1656455091 wait complete. 2021-01-28T03:50:18.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:18 smithi100 bash[9834]: audit 2021-01-28T03:50:18.488138+0000 mgr.y (mgr.14116) 4 : audit [DBG] from='client.14128 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:50:18.824 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:18 smithi100 bash[9834]: cephadm 2021-01-28T03:50:18.488384+0000 mgr.y (mgr.14116) 5 : cephadm [INF] Generating ssh key... 2021-01-28T03:50:18.824 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:50:18 smithi100 bash[10061]: Generating public/private rsa key pair. 2021-01-28T03:50:18.824 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:50:18 smithi100 bash[10061]: Your identification has been saved in /tmp/tmppa46n95k/key. 2021-01-28T03:50:18.824 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:50:18 smithi100 bash[10061]: Your public key has been saved in /tmp/tmppa46n95k/key.pub. 2021-01-28T03:50:18.825 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:50:18 smithi100 bash[10061]: The key fingerprint is: 2021-01-28T03:50:18.825 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:50:18 smithi100 bash[10061]: SHA256:p0QLmyzswMRAqljJYMmg8ymNDRJ8ZGQVGOCv3iMrm28 ceph-c217df96-611b-11eb-8f9e-001a4aab830c 2021-01-28T03:50:18.825 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:50:18 smithi100 bash[10061]: The key's randomart image is: 2021-01-28T03:50:18.825 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:50:18 smithi100 bash[10061]: +---[RSA 3072]----+ 2021-01-28T03:50:18.825 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:50:18 smithi100 bash[10061]: |X+=*+o. | 2021-01-28T03:50:18.826 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:50:18 smithi100 bash[10061]: |=Xo+ | 2021-01-28T03:50:18.826 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:50:18 smithi100 bash[10061]: |*.B . . | 2021-01-28T03:50:18.826 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:50:18 smithi100 bash[10061]: |+@.o . = . | 2021-01-28T03:50:18.826 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:50:18 smithi100 bash[10061]: |= B.o + S . | 2021-01-28T03:50:18.826 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:50:18 smithi100 bash[10061]: | ..o . . o | 2021-01-28T03:50:18.827 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:50:18 smithi100 bash[10061]: | . . . | 2021-01-28T03:50:18.827 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:50:18 smithi100 bash[10061]: |ooE. | 2021-01-28T03:50:18.827 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:50:18 smithi100 bash[10061]: |+*+.. | 2021-01-28T03:50:18.827 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:50:18 smithi100 bash[10061]: +----[SHA256]-----+ 2021-01-28T03:50:19.567 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi100 -v /var/log/ceph/c217df96-611b-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp3pxhmbk:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpih1yxits:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 cephadm get-pub-key 2021-01-28T03:50:20.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:19 smithi100 bash[9834]: audit 2021-01-28T03:50:18.784072+0000 mon.a (mon.0) 55 : audit [INF] from='mgr.14116 172.21.15.100:0/3481312515' entity='mgr.y' 2021-01-28T03:50:20.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:19 smithi100 bash[9834]: audit 2021-01-28T03:50:18.788233+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.14116 172.21.15.100:0/3481312515' entity='mgr.y' 2021-01-28T03:50:20.693 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.686+0000 7fb466a62700 1 Processor -- start 2021-01-28T03:50:20.699 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.686+0000 7fb466a62700 1 -- start start 2021-01-28T03:50:20.700 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.686+0000 7fb466a62700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb460073ab0 0x7fb460102550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:20.701 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.686+0000 7fb466a62700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb460102a40 con 0x7fb460073ab0 2021-01-28T03:50:20.701 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.686+0000 7fb465a60700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb460073ab0 0x7fb460102550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:20.703 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.686+0000 7fb465a60700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb460073ab0 0x7fb460102550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58926/0 (socket says 172.21.15.100:58926) 2021-01-28T03:50:20.705 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.686+0000 7fb465a60700 1 -- 172.21.15.100:0/3654140109 learned_addr learned my addr 172.21.15.100:0/3654140109 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:50:20.706 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.686+0000 7fb465a60700 1 -- 172.21.15.100:0/3654140109 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb460102b80 con 0x7fb460073ab0 2021-01-28T03:50:20.707 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.686+0000 7fb465a60700 1 --2- 172.21.15.100:0/3654140109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb460073ab0 0x7fb460102550 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fb45000b950 tx=0x7fb450006ee0).ready entity=mon.0 client_cookie=a8af34386a60bc0d server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:20.708 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.686+0000 7fb464a5e700 1 -- 172.21.15.100:0/3654140109 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb450009840 con 0x7fb460073ab0 2021-01-28T03:50:20.709 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.686+0000 7fb464a5e700 1 -- 172.21.15.100:0/3654140109 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fb450009e00 con 0x7fb460073ab0 2021-01-28T03:50:20.709 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.686+0000 7fb464a5e700 1 -- 172.21.15.100:0/3654140109 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb450011c80 con 0x7fb460073ab0 2021-01-28T03:50:20.711 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.686+0000 7fb466a62700 1 -- 172.21.15.100:0/3654140109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb460073ab0 msgr2=0x7fb460102550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:20.713 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.686+0000 7fb466a62700 1 --2- 172.21.15.100:0/3654140109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb460073ab0 0x7fb460102550 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fb45000b950 tx=0x7fb450006ee0).stop 2021-01-28T03:50:20.713 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.690+0000 7fb466a62700 1 -- 172.21.15.100:0/3654140109 shutdown_connections 2021-01-28T03:50:20.713 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.690+0000 7fb466a62700 1 --2- 172.21.15.100:0/3654140109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb460073ab0 0x7fb460102550 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:20.714 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.690+0000 7fb466a62700 1 -- 172.21.15.100:0/3654140109 >> 172.21.15.100:0/3654140109 conn(0x7fb46006ea50 msgr2=0x7fb460070e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:50:20.714 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.690+0000 7fb466a62700 1 -- 172.21.15.100:0/3654140109 shutdown_connections 2021-01-28T03:50:20.714 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.690+0000 7fb466a62700 1 -- 172.21.15.100:0/3654140109 wait complete. 2021-01-28T03:50:20.716 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.690+0000 7fb466a62700 1 Processor -- start 2021-01-28T03:50:20.716 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.690+0000 7fb466a62700 1 -- start start 2021-01-28T03:50:20.716 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.690+0000 7fb466a62700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb460073ab0 0x7fb46010df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:20.717 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.690+0000 7fb466a62700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46010e480 con 0x7fb460073ab0 2021-01-28T03:50:20.717 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.690+0000 7fb465a60700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb460073ab0 0x7fb46010df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:20.717 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.690+0000 7fb465a60700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb460073ab0 0x7fb46010df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58928/0 (socket says 172.21.15.100:58928) 2021-01-28T03:50:20.717 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.690+0000 7fb465a60700 1 -- 172.21.15.100:0/2303517678 learned_addr learned my addr 172.21.15.100:0/2303517678 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:50:20.717 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.690+0000 7fb465a60700 1 -- 172.21.15.100:0/2303517678 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb46010e5c0 con 0x7fb460073ab0 2021-01-28T03:50:20.718 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.690+0000 7fb465a60700 1 --2- 172.21.15.100:0/2303517678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb460073ab0 0x7fb46010df90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fb450009420 tx=0x7fb450006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:20.718 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.690+0000 7fb45e7fc700 1 -- 172.21.15.100:0/2303517678 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb450009ca0 con 0x7fb460073ab0 2021-01-28T03:50:20.718 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.690+0000 7fb45e7fc700 1 -- 172.21.15.100:0/2303517678 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fb450011400 con 0x7fb460073ab0 2021-01-28T03:50:20.718 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.690+0000 7fb466a62700 1 -- 172.21.15.100:0/2303517678 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb46010e810 con 0x7fb460073ab0 2021-01-28T03:50:20.718 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.690+0000 7fb45e7fc700 1 -- 172.21.15.100:0/2303517678 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb45001bbf0 con 0x7fb460073ab0 2021-01-28T03:50:20.719 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.690+0000 7fb466a62700 1 -- 172.21.15.100:0/2303517678 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb46010f370 con 0x7fb460073ab0 2021-01-28T03:50:20.719 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.694+0000 7fb45e7fc700 1 -- 172.21.15.100:0/2303517678 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) v1 ==== 35771+0+0 (secure 0 0 0) 0x7fb45002b070 con 0x7fb460073ab0 2021-01-28T03:50:20.719 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.694+0000 7fb45e7fc700 1 --2- 172.21.15.100:0/2303517678 >> v2:172.21.15.100:6800/2057733473 conn(0x7fb44002fb70 0x7fb440032030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:20.719 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.694+0000 7fb45e7fc700 1 -- 172.21.15.100:0/2303517678 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 883+0+0 (secure 0 0 0) 0x7fb450041820 con 0x7fb460073ab0 2021-01-28T03:50:20.720 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.694+0000 7fb46525f700 1 --2- 172.21.15.100:0/2303517678 >> v2:172.21.15.100:6800/2057733473 conn(0x7fb44002fb70 0x7fb440032030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:20.720 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.694+0000 7fb466a62700 1 -- 172.21.15.100:0/2303517678 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4600581f0 con 0x7fb460073ab0 2021-01-28T03:50:20.720 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.694+0000 7fb46525f700 1 --2- 172.21.15.100:0/2303517678 >> v2:172.21.15.100:6800/2057733473 conn(0x7fb44002fb70 0x7fb440032030 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fb4480089e0 tx=0x7fb448006ec0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:20.720 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.698+0000 7fb45e7fc700 1 -- 172.21.15.100:0/2303517678 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fb45001be60 con 0x7fb460073ab0 2021-01-28T03:50:20.989 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.990+0000 7fb466a62700 1 -- 172.21.15.100:0/2303517678 --> v2:172.21.15.100:6800/2057733473 -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fb4601039c0 con 0x7fb44002fb70 2021-01-28T03:50:20.990 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.990+0000 7fb45e7fc700 1 -- 172.21.15.100:0/2303517678 <== mgr.14116 v2:172.21.15.100:6800/2057733473 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fb4601039c0 con 0x7fb44002fb70 2021-01-28T03:50:20.990 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTsm15urqXtErlQcaHcpGB/xtCwSQ/8jOTXIlx/57mHbM6OSn+K+jjdmQ4MttUMIyDkC+C6Xane+Koz5IKbQJzqDiMnGX/u/2fRB1BL30iDxpWCynRuNl2CNLBm7VkP26zSOPEW0aGk+ZuwQKQ5AUq8g/hcFjEtkmcULWNvh5oJTRMdkFxTLorcP0x0hw/kWV57zrq5j5m4BQdTQsgieShf+p4QKzSiBaI2SZYGhvyQSKviY0dCkRSwb6rlJtd9USAmhCPbhSbZtub7SjP1KYG71WNVlbyhzFeaIvB3x8wpDkMjIxcdiNf9QTERfioE4i3ZjAVk/Rp7DqrM1AJlUS6ZNEEXbvw8WrZ0pgjFE3503/Mxjd7OswYpqCLnfJToy2kr/Aan2d/cTGUoSDYbQxzNApIENTJngBFMky4g/+JYF/nrg2I/9ckM3WX/WKedjHm2IuXwvYexB043qg68kGtJdpZknrsJLJ+0J/tTHE+XXD96gsaGKUXVCX0VNftSUc= ceph-c217df96-611b-11eb-8f9e-001a4aab830c 2021-01-28T03:50:20.992 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.990+0000 7fb466a62700 1 -- 172.21.15.100:0/2303517678 >> v2:172.21.15.100:6800/2057733473 conn(0x7fb44002fb70 msgr2=0x7fb440032030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:20.992 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.990+0000 7fb466a62700 1 --2- 172.21.15.100:0/2303517678 >> v2:172.21.15.100:6800/2057733473 conn(0x7fb44002fb70 0x7fb440032030 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fb4480089e0 tx=0x7fb448006ec0).stop 2021-01-28T03:50:20.993 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.990+0000 7fb466a62700 1 -- 172.21.15.100:0/2303517678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb460073ab0 msgr2=0x7fb46010df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:20.993 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.990+0000 7fb466a62700 1 --2- 172.21.15.100:0/2303517678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb460073ab0 0x7fb46010df90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fb450009420 tx=0x7fb450006ee0).stop 2021-01-28T03:50:20.994 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.990+0000 7fb466a62700 1 -- 172.21.15.100:0/2303517678 shutdown_connections 2021-01-28T03:50:20.994 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.990+0000 7fb466a62700 1 --2- 172.21.15.100:0/2303517678 >> v2:172.21.15.100:6800/2057733473 conn(0x7fb44002fb70 0x7fb440032030 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:20.994 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.990+0000 7fb466a62700 1 --2- 172.21.15.100:0/2303517678 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb460073ab0 0x7fb46010df90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:20.994 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.990+0000 7fb466a62700 1 -- 172.21.15.100:0/2303517678 >> 172.21.15.100:0/2303517678 conn(0x7fb46006ea50 msgr2=0x7fb46006f890 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:50:20.995 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.994+0000 7fb466a62700 1 -- 172.21.15.100:0/2303517678 shutdown_connections 2021-01-28T03:50:20.995 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:20.994+0000 7fb466a62700 1 -- 172.21.15.100:0/2303517678 wait complete. 2021-01-28T03:50:21.590 INFO:teuthology.orchestra.run.smithi100.stderr:Wrote public SSH key to to /home/ubuntu/cephtest/ceph.pub 2021-01-28T03:50:21.591 INFO:teuthology.orchestra.run.smithi100.stderr:Adding key to root@localhost's authorized_keys... 2021-01-28T03:50:21.591 INFO:teuthology.orchestra.run.smithi100.stderr:Adding host smithi100... 2021-01-28T03:50:21.592 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi100 -v /var/log/ceph/c217df96-611b-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp3pxhmbk:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpih1yxits:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 orch host add smithi100 2021-01-28T03:50:22.761 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.758+0000 7f5f3ffff700 1 Processor -- start 2021-01-28T03:50:22.761 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.762+0000 7f5f3ffff700 1 -- start start 2021-01-28T03:50:22.761 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.762+0000 7f5f3ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f4006f510 0x7f5f4006dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:22.762 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.762+0000 7f5f3ffff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4006f930 con 0x7f5f4006f510 2021-01-28T03:50:22.762 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.762+0000 7f5f3effd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f4006f510 0x7f5f4006dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:22.764 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.762+0000 7f5f3effd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f4006f510 0x7f5f4006dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58932/0 (socket says 172.21.15.100:58932) 2021-01-28T03:50:22.764 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.762+0000 7f5f3effd700 1 -- 172.21.15.100:0/2997231611 learned_addr learned my addr 172.21.15.100:0/2997231611 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:50:22.764 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.762+0000 7f5f3effd700 1 -- 172.21.15.100:0/2997231611 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f4006dfa0 con 0x7f5f4006f510 2021-01-28T03:50:22.764 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.762+0000 7f5f3effd700 1 --2- 172.21.15.100:0/2997231611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f4006f510 0x7f5f4006dab0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f5f2800b950 tx=0x7f5f28006ee0).ready entity=mon.0 client_cookie=414dc2662af5ad11 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:22.765 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.762+0000 7f5f3dffb700 1 -- 172.21.15.100:0/2997231611 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f28009840 con 0x7f5f4006f510 2021-01-28T03:50:22.765 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.762+0000 7f5f3dffb700 1 -- 172.21.15.100:0/2997231611 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f5f28009e00 con 0x7f5f4006f510 2021-01-28T03:50:22.766 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.762+0000 7f5f3dffb700 1 -- 172.21.15.100:0/2997231611 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f28011c80 con 0x7f5f4006f510 2021-01-28T03:50:22.766 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.762+0000 7f5f3ffff700 1 -- 172.21.15.100:0/2997231611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f4006f510 msgr2=0x7f5f4006dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:22.766 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.762+0000 7f5f3ffff700 1 --2- 172.21.15.100:0/2997231611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f4006f510 0x7f5f4006dab0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f5f2800b950 tx=0x7f5f28006ee0).stop 2021-01-28T03:50:22.766 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.762+0000 7f5f3ffff700 1 -- 172.21.15.100:0/2997231611 shutdown_connections 2021-01-28T03:50:22.767 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.762+0000 7f5f3ffff700 1 --2- 172.21.15.100:0/2997231611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f4006f510 0x7f5f4006dab0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:22.767 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.762+0000 7f5f3ffff700 1 -- 172.21.15.100:0/2997231611 >> 172.21.15.100:0/2997231611 conn(0x7f5f400f4a30 msgr2=0x7f5f400f6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:50:22.767 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.762+0000 7f5f3ffff700 1 -- 172.21.15.100:0/2997231611 shutdown_connections 2021-01-28T03:50:22.767 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.762+0000 7f5f3ffff700 1 -- 172.21.15.100:0/2997231611 wait complete. 2021-01-28T03:50:22.768 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.762+0000 7f5f3ffff700 1 Processor -- start 2021-01-28T03:50:22.771 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.762+0000 7f5f3ffff700 1 -- start start 2021-01-28T03:50:22.771 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.766+0000 7f5f3ffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f4006f510 0x7f5f40109b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:22.771 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.766+0000 7f5f3ffff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f40109ff0 con 0x7f5f4006f510 2021-01-28T03:50:22.772 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.766+0000 7f5f3effd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f4006f510 0x7f5f40109b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:22.772 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.766+0000 7f5f3effd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f4006f510 0x7f5f40109b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58934/0 (socket says 172.21.15.100:58934) 2021-01-28T03:50:22.773 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.766+0000 7f5f3effd700 1 -- 172.21.15.100:0/3841233344 learned_addr learned my addr 172.21.15.100:0/3841233344 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:50:22.773 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.766+0000 7f5f3effd700 1 -- 172.21.15.100:0/3841233344 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f4010a130 con 0x7f5f4006f510 2021-01-28T03:50:22.774 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.766+0000 7f5f3effd700 1 --2- 172.21.15.100:0/3841233344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f4006f510 0x7f5f40109b00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f5f28009fd0 tx=0x7f5f28006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:22.774 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.766+0000 7f5f377fe700 1 -- 172.21.15.100:0/3841233344 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f28009ca0 con 0x7f5f4006f510 2021-01-28T03:50:22.774 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.766+0000 7f5f377fe700 1 -- 172.21.15.100:0/3841233344 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f5f28011700 con 0x7f5f4006f510 2021-01-28T03:50:22.775 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.766+0000 7f5f3ffff700 1 -- 172.21.15.100:0/3841233344 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f4010a380 con 0x7f5f4006f510 2021-01-28T03:50:22.775 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.766+0000 7f5f377fe700 1 -- 172.21.15.100:0/3841233344 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f2801b9f0 con 0x7f5f4006f510 2021-01-28T03:50:22.776 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.766+0000 7f5f3ffff700 1 -- 172.21.15.100:0/3841233344 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f4010aee0 con 0x7f5f4006f510 2021-01-28T03:50:22.776 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.766+0000 7f5f377fe700 1 -- 172.21.15.100:0/3841233344 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) v1 ==== 35771+0+0 (secure 0 0 0) 0x7f5f2800f070 con 0x7f5f4006f510 2021-01-28T03:50:22.776 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.766+0000 7f5f377fe700 1 --2- 172.21.15.100:0/3841233344 >> v2:172.21.15.100:6800/2057733473 conn(0x7f5f2002fb70 0x7f5f20032030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:22.777 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.766+0000 7f5f377fe700 1 -- 172.21.15.100:0/3841233344 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 883+0+0 (secure 0 0 0) 0x7f5f28040fa0 con 0x7f5f4006f510 2021-01-28T03:50:22.777 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.766+0000 7f5f3e7fc700 1 --2- 172.21.15.100:0/3841233344 >> v2:172.21.15.100:6800/2057733473 conn(0x7f5f2002fb70 0x7f5f20032030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:22.778 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.766+0000 7f5f3ffff700 1 -- 172.21.15.100:0/3841233344 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f400581f0 con 0x7f5f4006f510 2021-01-28T03:50:22.778 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.770+0000 7f5f3e7fc700 1 --2- 172.21.15.100:0/3841233344 >> v2:172.21.15.100:6800/2057733473 conn(0x7f5f2002fb70 0x7f5f20032030 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f5f300089e0 tx=0x7f5f30006ec0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:22.779 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:22.774+0000 7f5f377fe700 1 -- 172.21.15.100:0/3841233344 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f5f28016030 con 0x7f5f4006f510 2021-01-28T03:50:22.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:22 smithi100 bash[9834]: audit 2021-01-28T03:50:20.992600+0000 mgr.y (mgr.14116) 6 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:50:23.103 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:23.102+0000 7f5f3ffff700 1 -- 172.21.15.100:0/3841233344 --> v2:172.21.15.100:6800/2057733473 -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi100", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f400ff4c0 con 0x7f5f2002fb70 2021-01-28T03:50:23.572 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:50:23 smithi100 bash[10061]: Warning: Permanently added 'smithi100,172.21.15.100' (ECDSA) to the list of known hosts. 2021-01-28T03:50:23.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:23 smithi100 bash[9834]: audit 2021-01-28T03:50:23.107464+0000 mgr.y (mgr.14116) 7 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi100", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:50:23.889 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:23.890+0000 7f5f377fe700 1 -- 172.21.15.100:0/3841233344 <== mgr.14116 v2:172.21.15.100:6800/2057733473 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+23 (secure 0 0 0) 0x7f5f400ff4c0 con 0x7f5f2002fb70 2021-01-28T03:50:23.889 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: Added host 'smithi100' 2021-01-28T03:50:23.893 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:23.894+0000 7f5f3ffff700 1 -- 172.21.15.100:0/3841233344 >> v2:172.21.15.100:6800/2057733473 conn(0x7f5f2002fb70 msgr2=0x7f5f20032030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:23.893 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:23.894+0000 7f5f3ffff700 1 --2- 172.21.15.100:0/3841233344 >> v2:172.21.15.100:6800/2057733473 conn(0x7f5f2002fb70 0x7f5f20032030 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f5f300089e0 tx=0x7f5f30006ec0).stop 2021-01-28T03:50:23.894 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:23.894+0000 7f5f3ffff700 1 -- 172.21.15.100:0/3841233344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f4006f510 msgr2=0x7f5f40109b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:23.894 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:23.894+0000 7f5f3ffff700 1 --2- 172.21.15.100:0/3841233344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f4006f510 0x7f5f40109b00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f5f28009fd0 tx=0x7f5f28006ee0).stop 2021-01-28T03:50:23.894 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:23.894+0000 7f5f3ffff700 1 -- 172.21.15.100:0/3841233344 shutdown_connections 2021-01-28T03:50:23.894 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:23.894+0000 7f5f3ffff700 1 --2- 172.21.15.100:0/3841233344 >> v2:172.21.15.100:6800/2057733473 conn(0x7f5f2002fb70 0x7f5f20032030 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:23.895 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:23.894+0000 7f5f3ffff700 1 --2- 172.21.15.100:0/3841233344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f4006f510 0x7f5f40109b00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:23.895 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:23.894+0000 7f5f3ffff700 1 -- 172.21.15.100:0/3841233344 >> 172.21.15.100:0/3841233344 conn(0x7f5f400f4a30 msgr2=0x7f5f400f5820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:50:23.896 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:23.894+0000 7f5f3ffff700 1 -- 172.21.15.100:0/3841233344 shutdown_connections 2021-01-28T03:50:23.896 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:23.894+0000 7f5f3ffff700 1 -- 172.21.15.100:0/3841233344 wait complete. 2021-01-28T03:50:24.642 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi100 -v /var/log/ceph/c217df96-611b-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp3pxhmbk:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpih1yxits:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 config set mgr mgr/dashboard/ssl_server_port 8443 2021-01-28T03:50:25.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:24 smithi100 bash[9834]: audit 2021-01-28T03:50:23.888763+0000 mon.a (mon.0) 57 : audit [INF] from='mgr.14116 172.21.15.100:0/3481312515' entity='mgr.y' 2021-01-28T03:50:25.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:24 smithi100 bash[9834]: cephadm 2021-01-28T03:50:23.889389+0000 mgr.y (mgr.14116) 8 : cephadm [INF] Added host smithi100 2021-01-28T03:50:25.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:24 smithi100 bash[9834]: audit 2021-01-28T03:50:24.309579+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.14116 172.21.15.100:0/3481312515' entity='mgr.y' 2021-01-28T03:50:25.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:24 smithi100 bash[9834]: audit 2021-01-28T03:50:24.311152+0000 mon.a (mon.0) 59 : audit [DBG] from='mgr.14116 172.21.15.100:0/3481312515' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:50:26.291 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.290+0000 7f13e0e44700 1 Processor -- start 2021-01-28T03:50:26.291 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.290+0000 7f13e0e44700 1 -- start start 2021-01-28T03:50:26.292 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.290+0000 7f13e0e44700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13dc0fcac0 0x7f13dc0fcee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:26.292 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.290+0000 7f13e0e44700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc0fd3d0 con 0x7f13dc0fcac0 2021-01-28T03:50:26.293 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.290+0000 7f13db7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13dc0fcac0 0x7f13dc0fcee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:26.293 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.290+0000 7f13db7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13dc0fcac0 0x7f13dc0fcee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58940/0 (socket says 172.21.15.100:58940) 2021-01-28T03:50:26.294 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.290+0000 7f13db7fe700 1 -- 172.21.15.100:0/1714296660 learned_addr learned my addr 172.21.15.100:0/1714296660 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:50:26.294 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.290+0000 7f13db7fe700 1 -- 172.21.15.100:0/1714296660 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13dc0fd510 con 0x7f13dc0fcac0 2021-01-28T03:50:26.294 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.294+0000 7f13db7fe700 1 --2- 172.21.15.100:0/1714296660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13dc0fcac0 0x7f13dc0fcee0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f13cc00b950 tx=0x7f13cc006ee0).ready entity=mon.0 client_cookie=4590d11d36e01ab server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:26.294 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.294+0000 7f13da7fc700 1 -- 172.21.15.100:0/1714296660 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13cc009840 con 0x7f13dc0fcac0 2021-01-28T03:50:26.295 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.294+0000 7f13da7fc700 1 -- 172.21.15.100:0/1714296660 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f13cc009e00 con 0x7f13dc0fcac0 2021-01-28T03:50:26.295 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.294+0000 7f13da7fc700 1 -- 172.21.15.100:0/1714296660 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13cc011c80 con 0x7f13dc0fcac0 2021-01-28T03:50:26.295 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.294+0000 7f13e0e44700 1 -- 172.21.15.100:0/1714296660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13dc0fcac0 msgr2=0x7f13dc0fcee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:26.295 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.294+0000 7f13e0e44700 1 --2- 172.21.15.100:0/1714296660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13dc0fcac0 0x7f13dc0fcee0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f13cc00b950 tx=0x7f13cc006ee0).stop 2021-01-28T03:50:26.295 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.294+0000 7f13e0e44700 1 -- 172.21.15.100:0/1714296660 shutdown_connections 2021-01-28T03:50:26.296 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.294+0000 7f13e0e44700 1 --2- 172.21.15.100:0/1714296660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13dc0fcac0 0x7f13dc0fcee0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:26.297 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.294+0000 7f13e0e44700 1 -- 172.21.15.100:0/1714296660 >> 172.21.15.100:0/1714296660 conn(0x7f13dc06ea50 msgr2=0x7f13dc06ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:50:26.298 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.294+0000 7f13e0e44700 1 -- 172.21.15.100:0/1714296660 shutdown_connections 2021-01-28T03:50:26.298 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.294+0000 7f13e0e44700 1 -- 172.21.15.100:0/1714296660 wait complete. 2021-01-28T03:50:26.298 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.294+0000 7f13e0e44700 1 Processor -- start 2021-01-28T03:50:26.299 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.294+0000 7f13e0e44700 1 -- start start 2021-01-28T03:50:26.299 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.294+0000 7f13e0e44700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13dc0fcac0 0x7f13dc109b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:26.299 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.294+0000 7f13e0e44700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc10a080 con 0x7f13dc0fcac0 2021-01-28T03:50:26.299 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.294+0000 7f13db7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13dc0fcac0 0x7f13dc109b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:26.300 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.298+0000 7f13db7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13dc0fcac0 0x7f13dc109b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58942/0 (socket says 172.21.15.100:58942) 2021-01-28T03:50:26.300 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.298+0000 7f13db7fe700 1 -- 172.21.15.100:0/1777970605 learned_addr learned my addr 172.21.15.100:0/1777970605 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:50:26.300 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.298+0000 7f13db7fe700 1 -- 172.21.15.100:0/1777970605 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13dc10a1c0 con 0x7f13dc0fcac0 2021-01-28T03:50:26.300 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.298+0000 7f13db7fe700 1 --2- 172.21.15.100:0/1777970605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13dc0fcac0 0x7f13dc109b90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f13cc009420 tx=0x7f13cc006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:26.300 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.298+0000 7f13d3fff700 1 -- 172.21.15.100:0/1777970605 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13cc009ca0 con 0x7f13dc0fcac0 2021-01-28T03:50:26.301 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.298+0000 7f13d3fff700 1 -- 172.21.15.100:0/1777970605 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f13cc011ae0 con 0x7f13dc0fcac0 2021-01-28T03:50:26.301 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.298+0000 7f13d3fff700 1 -- 172.21.15.100:0/1777970605 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13cc01bb60 con 0x7f13dc0fcac0 2021-01-28T03:50:26.301 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.298+0000 7f13e0e44700 1 -- 172.21.15.100:0/1777970605 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13dc10a410 con 0x7f13dc0fcac0 2021-01-28T03:50:26.301 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.298+0000 7f13e0e44700 1 -- 172.21.15.100:0/1777970605 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13dc10af70 con 0x7f13dc0fcac0 2021-01-28T03:50:26.302 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.298+0000 7f13d3fff700 1 -- 172.21.15.100:0/1777970605 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) v1 ==== 35771+0+0 (secure 0 0 0) 0x7f13cc02b070 con 0x7f13dc0fcac0 2021-01-28T03:50:26.303 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.298+0000 7f13d3fff700 1 --2- 172.21.15.100:0/1777970605 >> v2:172.21.15.100:6800/2057733473 conn(0x7f13bc02fb80 0x7f13bc032040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:26.303 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.298+0000 7f13d3fff700 1 -- 172.21.15.100:0/1777970605 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 883+0+0 (secure 0 0 0) 0x7f13cc041880 con 0x7f13dc0fcac0 2021-01-28T03:50:26.303 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.298+0000 7f13daffd700 1 --2- 172.21.15.100:0/1777970605 >> v2:172.21.15.100:6800/2057733473 conn(0x7f13bc02fb80 0x7f13bc032040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:26.303 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.298+0000 7f13e0e44700 1 -- 172.21.15.100:0/1777970605 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13dc0581f0 con 0x7f13dc0fcac0 2021-01-28T03:50:26.305 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.298+0000 7f13daffd700 1 --2- 172.21.15.100:0/1777970605 >> v2:172.21.15.100:6800/2057733473 conn(0x7f13bc02fb80 0x7f13bc032040 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f13c40096a0 tx=0x7f13c4006b40).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:26.307 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.306+0000 7f13d3fff700 1 -- 172.21.15.100:0/1777970605 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f13cc016020 con 0x7f13dc0fcac0 2021-01-28T03:50:26.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:26 smithi100 bash[9834]: audit 2021-01-28T03:50:25.089560+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.14116 172.21.15.100:0/3481312515' entity='mgr.y' 2021-01-28T03:50:26.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:26 smithi100 bash[9834]: audit 2021-01-28T03:50:25.090707+0000 mon.a (mon.0) 61 : audit [DBG] from='mgr.14116 172.21.15.100:0/3481312515' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:50:26.600 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.598+0000 7f13e0e44700 1 -- 172.21.15.100:0/1777970605 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f13dc0fbcc0 con 0x7f13dc0fcac0 2021-01-28T03:50:26.604 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.602+0000 7f13d3fff700 1 -- 172.21.15.100:0/1777970605 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f13cc0330c0 con 0x7f13dc0fcac0 2021-01-28T03:50:26.607 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.606+0000 7f13e0e44700 1 -- 172.21.15.100:0/1777970605 >> v2:172.21.15.100:6800/2057733473 conn(0x7f13bc02fb80 msgr2=0x7f13bc032040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:26.607 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.606+0000 7f13e0e44700 1 --2- 172.21.15.100:0/1777970605 >> v2:172.21.15.100:6800/2057733473 conn(0x7f13bc02fb80 0x7f13bc032040 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f13c40096a0 tx=0x7f13c4006b40).stop 2021-01-28T03:50:26.607 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.606+0000 7f13e0e44700 1 -- 172.21.15.100:0/1777970605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13dc0fcac0 msgr2=0x7f13dc109b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:26.607 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.606+0000 7f13e0e44700 1 --2- 172.21.15.100:0/1777970605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13dc0fcac0 0x7f13dc109b90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f13cc009420 tx=0x7f13cc006ee0).stop 2021-01-28T03:50:26.608 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.606+0000 7f13e0e44700 1 -- 172.21.15.100:0/1777970605 shutdown_connections 2021-01-28T03:50:26.608 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.606+0000 7f13e0e44700 1 --2- 172.21.15.100:0/1777970605 >> v2:172.21.15.100:6800/2057733473 conn(0x7f13bc02fb80 0x7f13bc032040 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:26.609 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.606+0000 7f13e0e44700 1 --2- 172.21.15.100:0/1777970605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13dc0fcac0 0x7f13dc109b90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:26.609 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.606+0000 7f13e0e44700 1 -- 172.21.15.100:0/1777970605 >> 172.21.15.100:0/1777970605 conn(0x7f13dc06ea50 msgr2=0x7f13dc0f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:50:26.609 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.606+0000 7f13e0e44700 1 -- 172.21.15.100:0/1777970605 shutdown_connections 2021-01-28T03:50:26.609 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:26.606+0000 7f13e0e44700 1 -- 172.21.15.100:0/1777970605 wait complete. 2021-01-28T03:50:27.584 INFO:teuthology.orchestra.run.smithi100.stderr:Enabling the dashboard module... 2021-01-28T03:50:27.585 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi100 -v /var/log/ceph/c217df96-611b-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp3pxhmbk:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpih1yxits:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 mgr module enable dashboard 2021-01-28T03:50:27.636 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:27 smithi100 bash[9834]: audit 2021-01-28T03:50:26.606734+0000 mon.a (mon.0) 62 : audit [INF] from='client.? 172.21.15.100:0/1777970605' entity='client.admin' 2021-01-28T03:50:28.921 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.914+0000 7f859358b700 1 Processor -- start 2021-01-28T03:50:28.922 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.914+0000 7f859358b700 1 -- start start 2021-01-28T03:50:28.922 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.914+0000 7f859358b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f858c06f570 0x7f858c06db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:28.922 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.918+0000 7f859358b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858c06f990 con 0x7f858c06f570 2021-01-28T03:50:28.922 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.918+0000 7f8592589700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f858c06f570 0x7f858c06db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:28.923 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.918+0000 7f8592589700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f858c06f570 0x7f858c06db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58946/0 (socket says 172.21.15.100:58946) 2021-01-28T03:50:28.923 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.918+0000 7f8592589700 1 -- 172.21.15.100:0/912208924 learned_addr learned my addr 172.21.15.100:0/912208924 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:50:28.923 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.918+0000 7f8592589700 1 -- 172.21.15.100:0/912208924 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f858c06e000 con 0x7f858c06f570 2021-01-28T03:50:28.923 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.918+0000 7f8592589700 1 --2- 172.21.15.100:0/912208924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f858c06f570 0x7f858c06db10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f8584009cc0 tx=0x7f85840092d0).ready entity=mon.0 client_cookie=e4cf755bcd097bc9 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:28.924 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.918+0000 7f8591587700 1 -- 172.21.15.100:0/912208924 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f858400bbf0 con 0x7f858c06f570 2021-01-28T03:50:28.924 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.918+0000 7f8591587700 1 -- 172.21.15.100:0/912208924 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f858400bd50 con 0x7f858c06f570 2021-01-28T03:50:28.924 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.918+0000 7f8591587700 1 -- 172.21.15.100:0/912208924 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8584010560 con 0x7f858c06f570 2021-01-28T03:50:28.924 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.918+0000 7f859358b700 1 -- 172.21.15.100:0/912208924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f858c06f570 msgr2=0x7f858c06db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:28.924 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.918+0000 7f859358b700 1 --2- 172.21.15.100:0/912208924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f858c06f570 0x7f858c06db10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f8584009cc0 tx=0x7f85840092d0).stop 2021-01-28T03:50:28.925 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.918+0000 7f859358b700 1 -- 172.21.15.100:0/912208924 shutdown_connections 2021-01-28T03:50:28.926 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.918+0000 7f859358b700 1 --2- 172.21.15.100:0/912208924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f858c06f570 0x7f858c06db10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:28.926 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.918+0000 7f859358b700 1 -- 172.21.15.100:0/912208924 >> 172.21.15.100:0/912208924 conn(0x7f858c0f4a30 msgr2=0x7f858c0f6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:50:28.926 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.918+0000 7f859358b700 1 -- 172.21.15.100:0/912208924 shutdown_connections 2021-01-28T03:50:28.928 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.922+0000 7f859358b700 1 -- 172.21.15.100:0/912208924 wait complete. 2021-01-28T03:50:28.929 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.922+0000 7f859358b700 1 Processor -- start 2021-01-28T03:50:28.930 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.922+0000 7f859358b700 1 -- start start 2021-01-28T03:50:28.930 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.922+0000 7f859358b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f858c06f570 0x7f858c0f9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:28.931 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.922+0000 7f859358b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858c0f9630 con 0x7f858c06f570 2021-01-28T03:50:28.931 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.922+0000 7f8592589700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f858c06f570 0x7f858c0f9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:28.931 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.922+0000 7f8592589700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f858c06f570 0x7f858c0f9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58948/0 (socket says 172.21.15.100:58948) 2021-01-28T03:50:28.931 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.922+0000 7f8592589700 1 -- 172.21.15.100:0/895487667 learned_addr learned my addr 172.21.15.100:0/895487667 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:50:28.932 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.926+0000 7f8592589700 1 -- 172.21.15.100:0/895487667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f858c0f9770 con 0x7f858c06f570 2021-01-28T03:50:28.932 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.926+0000 7f8592589700 1 --2- 172.21.15.100:0/895487667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f858c06f570 0x7f858c0f9140 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f8584009c90 tx=0x7f85840092d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:28.932 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.926+0000 7f858affd700 1 -- 172.21.15.100:0/895487667 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f85840103a0 con 0x7f858c06f570 2021-01-28T03:50:28.933 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.926+0000 7f858affd700 1 -- 172.21.15.100:0/895487667 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f8584011af0 con 0x7f858c06f570 2021-01-28T03:50:28.933 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.926+0000 7f858affd700 1 -- 172.21.15.100:0/895487667 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f85840223b0 con 0x7f858c06f570 2021-01-28T03:50:28.933 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.926+0000 7f859358b700 1 -- 172.21.15.100:0/895487667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f858c0f99c0 con 0x7f858c06f570 2021-01-28T03:50:28.933 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.926+0000 7f859358b700 1 -- 172.21.15.100:0/895487667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f858c0fa570 con 0x7f858c06f570 2021-01-28T03:50:28.933 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.926+0000 7f858affd700 1 -- 172.21.15.100:0/895487667 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 8) v1 ==== 35771+0+0 (secure 0 0 0) 0x7f858402a070 con 0x7f858c06f570 2021-01-28T03:50:28.934 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.926+0000 7f859358b700 1 -- 172.21.15.100:0/895487667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f858c0581f0 con 0x7f858c06f570 2021-01-28T03:50:28.934 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.926+0000 7f858affd700 1 --2- 172.21.15.100:0/895487667 >> v2:172.21.15.100:6800/2057733473 conn(0x7f857802fb70 0x7f8578032030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:28.934 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.926+0000 7f858affd700 1 -- 172.21.15.100:0/895487667 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 883+0+0 (secure 0 0 0) 0x7f8584042900 con 0x7f858c06f570 2021-01-28T03:50:28.934 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.926+0000 7f8591d88700 1 --2- 172.21.15.100:0/895487667 >> v2:172.21.15.100:6800/2057733473 conn(0x7f857802fb70 0x7f8578032030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:28.934 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.926+0000 7f8591d88700 1 --2- 172.21.15.100:0/895487667 >> v2:172.21.15.100:6800/2057733473 conn(0x7f857802fb70 0x7f8578032030 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f85800096a0 tx=0x7f8580006b40).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:28.935 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:28.930+0000 7f858affd700 1 -- 172.21.15.100:0/895487667 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f8584018b10 con 0x7f858c06f570 2021-01-28T03:50:29.288 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:29.286+0000 7f859358b700 1 -- 172.21.15.100:0/895487667 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f858c044bc0 con 0x7f858c06f570 2021-01-28T03:50:29.342 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:29.342+0000 7f858affd700 1 -- 172.21.15.100:0/895487667 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 9) v1 ==== 35784+0+0 (secure 0 0 0) 0x7f8584020030 con 0x7f858c06f570 2021-01-28T03:50:29.344 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:29.342+0000 7f858affd700 1 -- 172.21.15.100:0/895487667 <== mon.0 v2:172.21.15.100:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f8584006630 con 0x7f858c06f570 2021-01-28T03:50:29.349 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:29.346+0000 7f859358b700 1 -- 172.21.15.100:0/895487667 >> v2:172.21.15.100:6800/2057733473 conn(0x7f857802fb70 msgr2=0x7f8578032030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:29.349 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:29.346+0000 7f859358b700 1 --2- 172.21.15.100:0/895487667 >> v2:172.21.15.100:6800/2057733473 conn(0x7f857802fb70 0x7f8578032030 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f85800096a0 tx=0x7f8580006b40).stop 2021-01-28T03:50:29.349 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:29.346+0000 7f859358b700 1 -- 172.21.15.100:0/895487667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f858c06f570 msgr2=0x7f858c0f9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:29.350 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:29.346+0000 7f859358b700 1 --2- 172.21.15.100:0/895487667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f858c06f570 0x7f858c0f9140 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f8584009c90 tx=0x7f85840092d0).stop 2021-01-28T03:50:29.351 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:29.350+0000 7f859358b700 1 -- 172.21.15.100:0/895487667 shutdown_connections 2021-01-28T03:50:29.351 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:29.350+0000 7f859358b700 1 --2- 172.21.15.100:0/895487667 >> v2:172.21.15.100:6800/2057733473 conn(0x7f857802fb70 0x7f8578032030 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:29.351 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:29.350+0000 7f859358b700 1 --2- 172.21.15.100:0/895487667 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f858c06f570 0x7f858c0f9140 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:29.351 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:29.350+0000 7f859358b700 1 -- 172.21.15.100:0/895487667 >> 172.21.15.100:0/895487667 conn(0x7f858c0f4a30 msgr2=0x7f858c0f5870 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:50:29.352 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:29.350+0000 7f859358b700 1 -- 172.21.15.100:0/895487667 shutdown_connections 2021-01-28T03:50:29.352 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:29.350+0000 7f859358b700 1 -- 172.21.15.100:0/895487667 wait complete. 2021-01-28T03:50:29.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:29 smithi100 bash[9834]: audit 2021-01-28T03:50:29.291693+0000 mon.a (mon.0) 63 : audit [INF] from='client.? 172.21.15.100:0/895487667' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2021-01-28T03:50:29.824 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:50:29 smithi100 bash[10061]: ignoring --setuser ceph since I am not root 2021-01-28T03:50:29.824 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:50:29 smithi100 bash[10061]: ignoring --setgroup ceph since I am not root 2021-01-28T03:50:29.975 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi100 -v /var/log/ceph/c217df96-611b-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp3pxhmbk:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpih1yxits:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 mgr stat 2021-01-28T03:50:30.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:30 smithi100 bash[9834]: audit 2021-01-28T03:50:29.346767+0000 mon.a (mon.0) 64 : audit [INF] from='client.? 172.21.15.100:0/895487667' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2021-01-28T03:50:30.824 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:30 smithi100 bash[9834]: cluster 2021-01-28T03:50:29.346893+0000 mon.a (mon.0) 65 : cluster [DBG] mgrmap e9: y(active, since 16s) 2021-01-28T03:50:31.088 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.086+0000 7ff6b9728700 1 Processor -- start 2021-01-28T03:50:31.088 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.086+0000 7ff6b9728700 1 -- start start 2021-01-28T03:50:31.088 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.086+0000 7ff6b9728700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6b406f4e0 0x7ff6b406da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:31.089 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.086+0000 7ff6b9728700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b406f900 con 0x7ff6b406f4e0 2021-01-28T03:50:31.089 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.086+0000 7ff6b3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6b406f4e0 0x7ff6b406da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:31.089 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.086+0000 7ff6b3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6b406f4e0 0x7ff6b406da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58964/0 (socket says 172.21.15.100:58964) 2021-01-28T03:50:31.090 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.086+0000 7ff6b3fff700 1 -- 172.21.15.100:0/2003140993 learned_addr learned my addr 172.21.15.100:0/2003140993 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:50:31.090 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.090+0000 7ff6b3fff700 1 -- 172.21.15.100:0/2003140993 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b406df70 con 0x7ff6b406f4e0 2021-01-28T03:50:31.090 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.090+0000 7ff6b3fff700 1 --2- 172.21.15.100:0/2003140993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6b406f4e0 0x7ff6b406da80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7ff6a400b950 tx=0x7ff6a4006ee0).ready entity=mon.0 client_cookie=b50c6062aae90adf server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:31.090 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.090+0000 7ff6b2ffd700 1 -- 172.21.15.100:0/2003140993 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6a4009840 con 0x7ff6b406f4e0 2021-01-28T03:50:31.091 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.090+0000 7ff6b2ffd700 1 -- 172.21.15.100:0/2003140993 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7ff6a4009e00 con 0x7ff6b406f4e0 2021-01-28T03:50:31.091 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.090+0000 7ff6b2ffd700 1 -- 172.21.15.100:0/2003140993 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6a4011c80 con 0x7ff6b406f4e0 2021-01-28T03:50:31.092 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.090+0000 7ff6b9728700 1 -- 172.21.15.100:0/2003140993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6b406f4e0 msgr2=0x7ff6b406da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:31.093 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.090+0000 7ff6b9728700 1 --2- 172.21.15.100:0/2003140993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6b406f4e0 0x7ff6b406da80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7ff6a400b950 tx=0x7ff6a4006ee0).stop 2021-01-28T03:50:31.093 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.090+0000 7ff6b9728700 1 -- 172.21.15.100:0/2003140993 shutdown_connections 2021-01-28T03:50:31.093 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.090+0000 7ff6b9728700 1 --2- 172.21.15.100:0/2003140993 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6b406f4e0 0x7ff6b406da80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:31.093 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.090+0000 7ff6b9728700 1 -- 172.21.15.100:0/2003140993 >> 172.21.15.100:0/2003140993 conn(0x7ff6b40f4a40 msgr2=0x7ff6b40f6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:50:31.093 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.090+0000 7ff6b9728700 1 -- 172.21.15.100:0/2003140993 shutdown_connections 2021-01-28T03:50:31.094 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.090+0000 7ff6b9728700 1 -- 172.21.15.100:0/2003140993 wait complete. 2021-01-28T03:50:31.094 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.090+0000 7ff6b9728700 1 Processor -- start 2021-01-28T03:50:31.094 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.090+0000 7ff6b9728700 1 -- start start 2021-01-28T03:50:31.094 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.090+0000 7ff6b9728700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6b406f4e0 0x7ff6b4109b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:31.095 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.090+0000 7ff6b9728700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b410a000 con 0x7ff6b406f4e0 2021-01-28T03:50:31.095 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.094+0000 7ff6b3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6b406f4e0 0x7ff6b4109b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:31.095 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.094+0000 7ff6b3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6b406f4e0 0x7ff6b4109b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58966/0 (socket says 172.21.15.100:58966) 2021-01-28T03:50:31.095 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.094+0000 7ff6b3fff700 1 -- 172.21.15.100:0/2983665873 learned_addr learned my addr 172.21.15.100:0/2983665873 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:50:31.095 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.094+0000 7ff6b3fff700 1 -- 172.21.15.100:0/2983665873 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b410a140 con 0x7ff6b406f4e0 2021-01-28T03:50:31.096 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.094+0000 7ff6b3fff700 1 --2- 172.21.15.100:0/2983665873 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6b406f4e0 0x7ff6b4109b10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7ff6a4009420 tx=0x7ff6a4006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:31.097 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.094+0000 7ff6b0ff9700 1 -- 172.21.15.100:0/2983665873 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6a4009ca0 con 0x7ff6b406f4e0 2021-01-28T03:50:31.097 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.094+0000 7ff6b0ff9700 1 -- 172.21.15.100:0/2983665873 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7ff6a4011ae0 con 0x7ff6b406f4e0 2021-01-28T03:50:31.097 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.094+0000 7ff6b0ff9700 1 -- 172.21.15.100:0/2983665873 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6a401ba50 con 0x7ff6b406f4e0 2021-01-28T03:50:31.097 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.094+0000 7ff6b9728700 1 -- 172.21.15.100:0/2983665873 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b410a390 con 0x7ff6b406f4e0 2021-01-28T03:50:31.098 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.094+0000 7ff6b9728700 1 -- 172.21.15.100:0/2983665873 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b410aef0 con 0x7ff6b406f4e0 2021-01-28T03:50:31.098 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.094+0000 7ff6b0ff9700 1 -- 172.21.15.100:0/2983665873 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 9) v1 ==== 35784+0+0 (secure 0 0 0) 0x7ff6a402b070 con 0x7ff6b406f4e0 2021-01-28T03:50:31.098 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.094+0000 7ff6b9728700 1 -- 172.21.15.100:0/2983665873 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b40581f0 con 0x7ff6b406f4e0 2021-01-28T03:50:31.098 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.094+0000 7ff6b0ff9700 1 --2- 172.21.15.100:0/2983665873 >> v2:172.21.15.100:6800/2057733473 conn(0x7ff6a002fbb0 0x7ff6a0032070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:31.098 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.094+0000 7ff6b0ff9700 1 -- 172.21.15.100:0/2983665873 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 883+0+0 (secure 0 0 0) 0x7ff6a40417e0 con 0x7ff6b406f4e0 2021-01-28T03:50:31.099 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.094+0000 7ff6b37fe700 1 -- 172.21.15.100:0/2983665873 >> v2:172.21.15.100:6800/2057733473 conn(0x7ff6a002fbb0 msgr2=0x7ff6a0032070 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/2057733473 2021-01-28T03:50:31.099 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.094+0000 7ff6b37fe700 1 --2- 172.21.15.100:0/2983665873 >> v2:172.21.15.100:6800/2057733473 conn(0x7ff6a002fbb0 0x7ff6a0032070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2021-01-28T03:50:31.102 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.102+0000 7ff6b0ff9700 1 -- 172.21.15.100:0/2983665873 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7ff6a4022900 con 0x7ff6b406f4e0 2021-01-28T03:50:31.296 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.298+0000 7ff6b37fe700 1 -- 172.21.15.100:0/2983665873 >> v2:172.21.15.100:6800/2057733473 conn(0x7ff6a002fbb0 msgr2=0x7ff6a0032070 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/2057733473 2021-01-28T03:50:31.297 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.298+0000 7ff6b37fe700 1 --2- 172.21.15.100:0/2983665873 >> v2:172.21.15.100:6800/2057733473 conn(0x7ff6a002fbb0 0x7ff6a0032070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2021-01-28T03:50:31.438 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.438+0000 7ff6b9728700 1 -- 172.21.15.100:0/2983665873 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7ff6b4044bc0 con 0x7ff6b406f4e0 2021-01-28T03:50:31.439 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.438+0000 7ff6b0ff9700 1 -- 172.21.15.100:0/2983665873 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7ff6a4016070 con 0x7ff6b406f4e0 2021-01-28T03:50:31.440 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: { 2021-01-28T03:50:31.440 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "epoch": 9, 2021-01-28T03:50:31.440 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "available": true, 2021-01-28T03:50:31.440 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "active_name": "y", 2021-01-28T03:50:31.441 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "num_standby": 0 2021-01-28T03:50:31.441 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: } 2021-01-28T03:50:31.442 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.442+0000 7ff6b9728700 1 -- 172.21.15.100:0/2983665873 >> v2:172.21.15.100:6800/2057733473 conn(0x7ff6a002fbb0 msgr2=0x7ff6a0032070 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-01-28T03:50:31.442 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.442+0000 7ff6b9728700 1 --2- 172.21.15.100:0/2983665873 >> v2:172.21.15.100:6800/2057733473 conn(0x7ff6a002fbb0 0x7ff6a0032070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-28T03:50:31.442 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.442+0000 7ff6b9728700 1 -- 172.21.15.100:0/2983665873 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6b406f4e0 msgr2=0x7ff6b4109b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:31.443 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.442+0000 7ff6b9728700 1 --2- 172.21.15.100:0/2983665873 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6b406f4e0 0x7ff6b4109b10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7ff6a4009420 tx=0x7ff6a4006ee0).stop 2021-01-28T03:50:31.443 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.442+0000 7ff6b9728700 1 -- 172.21.15.100:0/2983665873 shutdown_connections 2021-01-28T03:50:31.443 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.442+0000 7ff6b9728700 1 --2- 172.21.15.100:0/2983665873 >> v2:172.21.15.100:6800/2057733473 conn(0x7ff6a002fbb0 0x7ff6a0032070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-28T03:50:31.443 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.442+0000 7ff6b9728700 1 --2- 172.21.15.100:0/2983665873 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6b406f4e0 0x7ff6b4109b10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:31.444 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.442+0000 7ff6b9728700 1 -- 172.21.15.100:0/2983665873 >> 172.21.15.100:0/2983665873 conn(0x7ff6b40f4a40 msgr2=0x7ff6b40f6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:50:31.444 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.442+0000 7ff6b9728700 1 -- 172.21.15.100:0/2983665873 shutdown_connections 2021-01-28T03:50:31.444 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:31.442+0000 7ff6b9728700 1 -- 172.21.15.100:0/2983665873 wait complete. 2021-01-28T03:50:31.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:31 smithi100 bash[9834]: audit 2021-01-28T03:50:31.441869+0000 mon.a (mon.0) 66 : audit [DBG] from='client.? 172.21.15.100:0/2983665873' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2021-01-28T03:50:32.098 INFO:teuthology.orchestra.run.smithi100.stderr:Waiting for the mgr to restart... 2021-01-28T03:50:32.098 INFO:teuthology.orchestra.run.smithi100.stderr:Waiting for mgr epoch 9... 2021-01-28T03:50:32.099 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi100 -v /var/log/ceph/c217df96-611b-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp3pxhmbk:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpih1yxits:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 tell mgr mgr_status 2021-01-28T03:50:33.212 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.210+0000 7fbaa95d7700 1 Processor -- start 2021-01-28T03:50:33.212 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.210+0000 7fbaa95d7700 1 -- start start 2021-01-28T03:50:33.212 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.210+0000 7fbaa95d7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaa40f9720 0x7fbaa40f9b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:33.213 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.210+0000 7fbaa95d7700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa40fa0c0 con 0x7fbaa40f9720 2021-01-28T03:50:33.213 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.210+0000 7fbaa3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaa40f9720 0x7fbaa40f9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:33.213 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.210+0000 7fbaa3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaa40f9720 0x7fbaa40f9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58974/0 (socket says 172.21.15.100:58974) 2021-01-28T03:50:33.214 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.210+0000 7fbaa3fff700 1 -- 172.21.15.100:0/978402145 learned_addr learned my addr 172.21.15.100:0/978402145 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:50:33.214 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.210+0000 7fbaa3fff700 1 -- 172.21.15.100:0/978402145 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa40fa200 con 0x7fbaa40f9720 2021-01-28T03:50:33.214 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.210+0000 7fbaa3fff700 1 --2- 172.21.15.100:0/978402145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaa40f9720 0x7fbaa40f9b40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fba94009370 tx=0x7fba94006ee0).ready entity=mon.0 client_cookie=25f447a3794609fe server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:33.214 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.210+0000 7fbaa2ffd700 1 -- 172.21.15.100:0/978402145 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba940128e0 con 0x7fbaa40f9720 2021-01-28T03:50:33.215 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.210+0000 7fbaa2ffd700 1 -- 172.21.15.100:0/978402145 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fba94013030 con 0x7fbaa40f9720 2021-01-28T03:50:33.215 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.210+0000 7fbaa2ffd700 1 -- 172.21.15.100:0/978402145 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba9401c440 con 0x7fbaa40f9720 2021-01-28T03:50:33.215 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.210+0000 7fbaa95d7700 1 -- 172.21.15.100:0/978402145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaa40f9720 msgr2=0x7fbaa40f9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:33.215 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.214+0000 7fbaa95d7700 1 --2- 172.21.15.100:0/978402145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaa40f9720 0x7fbaa40f9b40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fba94009370 tx=0x7fba94006ee0).stop 2021-01-28T03:50:33.218 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.214+0000 7fbaa95d7700 1 -- 172.21.15.100:0/978402145 shutdown_connections 2021-01-28T03:50:33.219 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.214+0000 7fbaa95d7700 1 --2- 172.21.15.100:0/978402145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaa40f9720 0x7fbaa40f9b40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:33.219 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.214+0000 7fbaa95d7700 1 -- 172.21.15.100:0/978402145 >> 172.21.15.100:0/978402145 conn(0x7fbaa40f2fd0 msgr2=0x7fbaa40f53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:50:33.219 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.214+0000 7fbaa95d7700 1 -- 172.21.15.100:0/978402145 shutdown_connections 2021-01-28T03:50:33.219 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.214+0000 7fbaa95d7700 1 -- 172.21.15.100:0/978402145 wait complete. 2021-01-28T03:50:33.220 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.214+0000 7fbaa95d7700 1 Processor -- start 2021-01-28T03:50:33.220 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.214+0000 7fbaa95d7700 1 -- start start 2021-01-28T03:50:33.220 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.214+0000 7fbaa95d7700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaa40f9720 0x7fbaa4105690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:33.220 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.214+0000 7fbaa95d7700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa4105b80 con 0x7fbaa40f9720 2021-01-28T03:50:33.221 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.214+0000 7fbaa3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaa40f9720 0x7fbaa4105690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:33.221 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.214+0000 7fbaa3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaa40f9720 0x7fbaa4105690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58976/0 (socket says 172.21.15.100:58976) 2021-01-28T03:50:33.221 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.214+0000 7fbaa3fff700 1 -- 172.21.15.100:0/1069073148 learned_addr learned my addr 172.21.15.100:0/1069073148 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:50:33.221 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.214+0000 7fbaa3fff700 1 -- 172.21.15.100:0/1069073148 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa4105cc0 con 0x7fbaa40f9720 2021-01-28T03:50:33.222 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.214+0000 7fbaa3fff700 1 --2- 172.21.15.100:0/1069073148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaa40f9720 0x7fbaa4105690 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fba9401c8a0 tx=0x7fba94015040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:33.222 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.214+0000 7fbaa0ff9700 1 -- 172.21.15.100:0/1069073148 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba94020070 con 0x7fbaa40f9720 2021-01-28T03:50:33.222 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.214+0000 7fbaa0ff9700 1 -- 172.21.15.100:0/1069073148 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fba9401ce70 con 0x7fbaa40f9720 2021-01-28T03:50:33.223 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.214+0000 7fbaa0ff9700 1 -- 172.21.15.100:0/1069073148 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba940243c0 con 0x7fbaa40f9720 2021-01-28T03:50:33.223 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.214+0000 7fbaa95d7700 1 -- 172.21.15.100:0/1069073148 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa4105f10 con 0x7fbaa40f9720 2021-01-28T03:50:33.223 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.214+0000 7fbaa95d7700 1 -- 172.21.15.100:0/1069073148 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa4106a70 con 0x7fbaa40f9720 2021-01-28T03:50:33.223 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.218+0000 7fbaa0ff9700 1 -- 172.21.15.100:0/1069073148 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 9) v1 ==== 35784+0+0 (secure 0 0 0) 0x7fba9402b020 con 0x7fbaa40f9720 2021-01-28T03:50:33.224 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.218+0000 7fbaa0ff9700 1 --2- 172.21.15.100:0/1069073148 >> v2:172.21.15.100:6800/2057733473 conn(0x7fba9002fbc0 0x7fba90032080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:33.224 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.218+0000 7fbaa95d7700 1 -- 172.21.15.100:0/1069073148 --> v2:172.21.15.100:6800/2057733473 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbaa40581f0 con 0x7fba9002fbc0 2021-01-28T03:50:33.224 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.218+0000 7fbaa0ff9700 1 -- 172.21.15.100:0/1069073148 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 883+0+0 (secure 0 0 0) 0x7fba94024720 con 0x7fbaa40f9720 2021-01-28T03:50:33.224 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.218+0000 7fbaa37fe700 1 -- 172.21.15.100:0/1069073148 >> v2:172.21.15.100:6800/2057733473 conn(0x7fba9002fbc0 msgr2=0x7fba90032080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/2057733473 2021-01-28T03:50:33.225 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.218+0000 7fbaa37fe700 1 --2- 172.21.15.100:0/1069073148 >> v2:172.21.15.100:6800/2057733473 conn(0x7fba9002fbc0 0x7fba90032080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2021-01-28T03:50:33.420 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.422+0000 7fbaa37fe700 1 -- 172.21.15.100:0/1069073148 >> v2:172.21.15.100:6800/2057733473 conn(0x7fba9002fbc0 msgr2=0x7fba90032080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/2057733473 2021-01-28T03:50:33.421 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.422+0000 7fbaa37fe700 1 --2- 172.21.15.100:0/1069073148 >> v2:172.21.15.100:6800/2057733473 conn(0x7fba9002fbc0 0x7fba90032080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2021-01-28T03:50:33.824 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.826+0000 7fbaa37fe700 1 -- 172.21.15.100:0/1069073148 >> v2:172.21.15.100:6800/2057733473 conn(0x7fba9002fbc0 msgr2=0x7fba90032080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/2057733473 2021-01-28T03:50:33.825 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:33.826+0000 7fbaa37fe700 1 --2- 172.21.15.100:0/1069073148 >> v2:172.21.15.100:6800/2057733473 conn(0x7fba9002fbc0 0x7fba90032080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2021-01-28T03:50:34.628 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:34.630+0000 7fbaa37fe700 1 -- 172.21.15.100:0/1069073148 >> v2:172.21.15.100:6800/2057733473 conn(0x7fba9002fbc0 msgr2=0x7fba90032080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.100:6800/2057733473 2021-01-28T03:50:34.629 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:34.630+0000 7fbaa37fe700 1 --2- 172.21.15.100:0/1069073148 >> v2:172.21.15.100:6800/2057733473 conn(0x7fba9002fbc0 0x7fba90032080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2021-01-28T03:50:35.261 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:35.262+0000 7fbaa0ff9700 1 -- 172.21.15.100:0/1069073148 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mgrmap(e 10) v1 ==== 35669+0+0 (secure 0 0 0) 0x7fba94019d70 con 0x7fbaa40f9720 2021-01-28T03:50:35.262 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:35.262+0000 7fbaa0ff9700 1 -- 172.21.15.100:0/1069073148 >> v2:172.21.15.100:6800/2057733473 conn(0x7fba9002fbc0 msgr2=0x7fba90032080 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-01-28T03:50:35.262 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:35.262+0000 7fbaa0ff9700 1 --2- 172.21.15.100:0/1069073148 >> v2:172.21.15.100:6800/2057733473 conn(0x7fba9002fbc0 0x7fba90032080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-28T03:50:35.530 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:50:35 smithi100 bash[10061]: Warning: Permanently added 'smithi100,172.21.15.100' (ECDSA) to the list of known hosts. 2021-01-28T03:50:35.530 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:35 smithi100 bash[9834]: cluster 2021-01-28T03:50:35.208923+0000 mon.a (mon.0) 67 : cluster [INF] Active manager daemon y restarted 2021-01-28T03:50:35.531 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:35 smithi100 bash[9834]: cluster 2021-01-28T03:50:35.209815+0000 mon.a (mon.0) 68 : cluster [INF] Activating manager daemon y 2021-01-28T03:50:35.531 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:35 smithi100 bash[9834]: cluster 2021-01-28T03:50:35.213879+0000 mon.a (mon.0) 69 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2021-01-28T03:50:36.268 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:36.266+0000 7fbaa0ff9700 1 -- 172.21.15.100:0/1069073148 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 11) v1 ==== 35704+0+0 (secure 0 0 0) 0x7fba94045f30 con 0x7fbaa40f9720 2021-01-28T03:50:36.269 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:36.266+0000 7fbaa0ff9700 1 --2- 172.21.15.100:0/1069073148 >> v2:172.21.15.100:6800/928846103 conn(0x7fba90033590 0x7fba90035980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:36.269 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:36.270+0000 7fbaa0ff9700 1 -- 172.21.15.100:0/1069073148 --> v2:172.21.15.100:6800/928846103 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbaa40581f0 con 0x7fba90033590 2021-01-28T03:50:36.270 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:36.270+0000 7fbaa37fe700 1 --2- 172.21.15.100:0/1069073148 >> v2:172.21.15.100:6800/928846103 conn(0x7fba90033590 0x7fba90035980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:36.271 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:36.270+0000 7fbaa37fe700 1 --2- 172.21.15.100:0/1069073148 >> v2:172.21.15.100:6800/928846103 conn(0x7fba90033590 0x7fba90035980 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7fba980036d0 tx=0x7fba98006d60).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:36.276 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:36.274+0000 7fbaa0ff9700 1 -- 172.21.15.100:0/1069073148 <== mgr.14138 v2:172.21.15.100:6800/928846103 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6438 (secure 0 0 0) 0x7fbaa40581f0 con 0x7fba90033590 2021-01-28T03:50:36.285 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:36.286+0000 7fbaa95d7700 1 -- 172.21.15.100:0/1069073148 --> v2:172.21.15.100:6800/928846103 -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fbaa4044bc0 con 0x7fba90033590 2021-01-28T03:50:36.286 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:36.286+0000 7fbaa0ff9700 1 -- 172.21.15.100:0/1069073148 <== mgr.14138 v2:172.21.15.100:6800/928846103 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7fbaa4044bc0 con 0x7fba90033590 2021-01-28T03:50:36.287 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: { 2021-01-28T03:50:36.287 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "mgrmap_epoch": 11, 2021-01-28T03:50:36.288 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: "initialized": true 2021-01-28T03:50:36.288 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: } 2021-01-28T03:50:36.289 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:36.286+0000 7fbaa95d7700 1 -- 172.21.15.100:0/1069073148 >> v2:172.21.15.100:6800/928846103 conn(0x7fba90033590 msgr2=0x7fba90035980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:36.289 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:36.286+0000 7fbaa95d7700 1 --2- 172.21.15.100:0/1069073148 >> v2:172.21.15.100:6800/928846103 conn(0x7fba90033590 0x7fba90035980 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7fba980036d0 tx=0x7fba98006d60).stop 2021-01-28T03:50:36.289 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:36.286+0000 7fbaa95d7700 1 -- 172.21.15.100:0/1069073148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaa40f9720 msgr2=0x7fbaa4105690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:36.290 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:36.286+0000 7fbaa95d7700 1 --2- 172.21.15.100:0/1069073148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaa40f9720 0x7fbaa4105690 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fba9401c8a0 tx=0x7fba94015040).stop 2021-01-28T03:50:36.290 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:36.286+0000 7fbaa95d7700 1 -- 172.21.15.100:0/1069073148 shutdown_connections 2021-01-28T03:50:36.290 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:36.286+0000 7fbaa95d7700 1 --2- 172.21.15.100:0/1069073148 >> v2:172.21.15.100:6800/928846103 conn(0x7fba90033590 0x7fba90035980 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:36.290 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:36.286+0000 7fbaa95d7700 1 --2- 172.21.15.100:0/1069073148 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbaa40f9720 0x7fbaa4105690 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:36.290 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:36.286+0000 7fbaa95d7700 1 --2- 172.21.15.100:0/1069073148 >> v2:172.21.15.100:6800/2057733473 conn(0x7fba9002fbc0 0x7fba90032080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-28T03:50:36.291 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:36.286+0000 7fbaa95d7700 1 -- 172.21.15.100:0/1069073148 >> 172.21.15.100:0/1069073148 conn(0x7fbaa40f2fd0 msgr2=0x7fbaa40f4670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:50:36.291 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:36.286+0000 7fbaa95d7700 1 -- 172.21.15.100:0/1069073148 shutdown_connections 2021-01-28T03:50:36.291 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:36.286+0000 7fbaa95d7700 1 -- 172.21.15.100:0/1069073148 wait complete. 2021-01-28T03:50:36.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:36 smithi100 bash[9834]: cluster 2021-01-28T03:50:35.265833+0000 mon.a (mon.0) 70 : cluster [DBG] mgrmap e10: y(active, starting, since 0.0561188s) 2021-01-28T03:50:36.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:36 smithi100 bash[9834]: audit 2021-01-28T03:50:35.273756+0000 mon.a (mon.0) 71 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-01-28T03:50:36.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:36 smithi100 bash[9834]: audit 2021-01-28T03:50:35.274411+0000 mon.a (mon.0) 72 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-01-28T03:50:36.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:36 smithi100 bash[9834]: audit 2021-01-28T03:50:35.274788+0000 mon.a (mon.0) 73 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-01-28T03:50:36.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:36 smithi100 bash[9834]: audit 2021-01-28T03:50:35.275137+0000 mon.a (mon.0) 74 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-01-28T03:50:36.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:36 smithi100 bash[9834]: audit 2021-01-28T03:50:35.275754+0000 mon.a (mon.0) 75 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-01-28T03:50:36.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:36 smithi100 bash[9834]: audit 2021-01-28T03:50:35.277020+0000 mon.a (mon.0) 76 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi100"}]: dispatch 2021-01-28T03:50:36.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:36 smithi100 bash[9834]: audit 2021-01-28T03:50:35.277577+0000 mon.a (mon.0) 77 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-01-28T03:50:36.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:36 smithi100 bash[9834]: audit 2021-01-28T03:50:35.278121+0000 mon.a (mon.0) 78 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2021-01-28T03:50:36.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:36 smithi100 bash[9834]: audit 2021-01-28T03:50:35.278657+0000 mon.a (mon.0) 79 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-01-28T03:50:36.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:36 smithi100 bash[9834]: audit 2021-01-28T03:50:35.279225+0000 mon.a (mon.0) 80 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-01-28T03:50:36.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:36 smithi100 bash[9834]: audit 2021-01-28T03:50:35.279799+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_user"}]: dispatch 2021-01-28T03:50:36.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:36 smithi100 bash[9834]: audit 2021-01-28T03:50:35.280347+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-01-28T03:50:36.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:36 smithi100 bash[9834]: audit 2021-01-28T03:50:35.280866+0000 mon.a (mon.0) 83 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-01-28T03:50:36.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:36 smithi100 bash[9834]: audit 2021-01-28T03:50:35.281407+0000 mon.a (mon.0) 84 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-01-28T03:50:36.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:36 smithi100 bash[9834]: cluster 2021-01-28T03:50:35.284326+0000 mon.a (mon.0) 85 : cluster [INF] Manager daemon y is now available 2021-01-28T03:50:36.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:36 smithi100 bash[9834]: audit 2021-01-28T03:50:35.465450+0000 mon.a (mon.0) 86 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T03:50:36.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:36 smithi100 bash[9834]: audit 2021-01-28T03:50:35.470046+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T03:50:36.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:36 smithi100 bash[9834]: audit 2021-01-28T03:50:35.685413+0000 mon.a (mon.0) 88 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:50:37.197 INFO:teuthology.orchestra.run.smithi100.stderr:mgr epoch 9 is available 2021-01-28T03:50:37.198 INFO:teuthology.orchestra.run.smithi100.stderr:Generating a dashboard self-signed certificate... 2021-01-28T03:50:37.199 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi100 -v /var/log/ceph/c217df96-611b-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp3pxhmbk:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpih1yxits:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 dashboard create-self-signed-cert 2021-01-28T03:50:37.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:37 smithi100 bash[9834]: cluster 2021-01-28T03:50:36.271093+0000 mon.a (mon.0) 89 : cluster [DBG] mgrmap e11: y(active, since 1.06138s) 2021-01-28T03:50:37.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:37 smithi100 bash[9834]: audit 2021-01-28T03:50:36.274700+0000 mgr.y (mgr.14138) 1 : audit [DBG] from='client.14142 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2021-01-28T03:50:37.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:37 smithi100 bash[9834]: audit 2021-01-28T03:50:36.287976+0000 mgr.y (mgr.14138) 2 : audit [DBG] from='client.14142 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2021-01-28T03:50:37.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:37 smithi100 bash[9834]: audit 2021-01-28T03:50:36.374925+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:50:37.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:37 smithi100 bash[9834]: audit 2021-01-28T03:50:36.376028+0000 mon.a (mon.0) 91 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:50:38.649 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:38 smithi100 bash[9834]: cluster 2021-01-28T03:50:37.476761+0000 mon.a (mon.0) 92 : cluster [DBG] mgrmap e12: y(active, since 2s) 2021-01-28T03:50:38.816 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.806+0000 7faf15e1a700 1 Processor -- start 2021-01-28T03:50:38.816 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.806+0000 7faf15e1a700 1 -- start start 2021-01-28T03:50:38.817 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.806+0000 7faf15e1a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf100fcac0 0x7faf100fcee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:38.817 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.806+0000 7faf15e1a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf100fd3d0 con 0x7faf100fcac0 2021-01-28T03:50:38.818 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.806+0000 7faf14e18700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf100fcac0 0x7faf100fcee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:38.818 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.806+0000 7faf14e18700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf100fcac0 0x7faf100fcee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59010/0 (socket says 172.21.15.100:59010) 2021-01-28T03:50:38.820 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.806+0000 7faf14e18700 1 -- 172.21.15.100:0/264147065 learned_addr learned my addr 172.21.15.100:0/264147065 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:50:38.820 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.806+0000 7faf14e18700 1 -- 172.21.15.100:0/264147065 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf100fd510 con 0x7faf100fcac0 2021-01-28T03:50:38.820 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.806+0000 7faf14e18700 1 --2- 172.21.15.100:0/264147065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf100fcac0 0x7faf100fcee0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7faf08009cc0 tx=0x7faf080092d0).ready entity=mon.0 client_cookie=103950bb04e15959 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:38.821 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.810+0000 7faf0f7fe700 1 -- 172.21.15.100:0/264147065 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf0800bbf0 con 0x7faf100fcac0 2021-01-28T03:50:38.821 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.810+0000 7faf0f7fe700 1 -- 172.21.15.100:0/264147065 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7faf0800bd50 con 0x7faf100fcac0 2021-01-28T03:50:38.821 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.810+0000 7faf0f7fe700 1 -- 172.21.15.100:0/264147065 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf08010560 con 0x7faf100fcac0 2021-01-28T03:50:38.821 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.810+0000 7faf15e1a700 1 -- 172.21.15.100:0/264147065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf100fcac0 msgr2=0x7faf100fcee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:38.821 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.810+0000 7faf15e1a700 1 --2- 172.21.15.100:0/264147065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf100fcac0 0x7faf100fcee0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7faf08009cc0 tx=0x7faf080092d0).stop 2021-01-28T03:50:38.822 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.810+0000 7faf15e1a700 1 -- 172.21.15.100:0/264147065 shutdown_connections 2021-01-28T03:50:38.822 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.810+0000 7faf15e1a700 1 --2- 172.21.15.100:0/264147065 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf100fcac0 0x7faf100fcee0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:38.822 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.810+0000 7faf15e1a700 1 -- 172.21.15.100:0/264147065 >> 172.21.15.100:0/264147065 conn(0x7faf1006ea50 msgr2=0x7faf1006ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:50:38.822 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.810+0000 7faf15e1a700 1 -- 172.21.15.100:0/264147065 shutdown_connections 2021-01-28T03:50:38.823 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.810+0000 7faf15e1a700 1 -- 172.21.15.100:0/264147065 wait complete. 2021-01-28T03:50:38.823 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.810+0000 7faf15e1a700 1 Processor -- start 2021-01-28T03:50:38.823 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.810+0000 7faf15e1a700 1 -- start start 2021-01-28T03:50:38.823 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.810+0000 7faf15e1a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf100fcac0 0x7faf1006ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:38.823 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.810+0000 7faf15e1a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf10070400 con 0x7faf100fcac0 2021-01-28T03:50:38.824 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.810+0000 7faf14e18700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf100fcac0 0x7faf1006ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:38.824 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.810+0000 7faf14e18700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf100fcac0 0x7faf1006ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59012/0 (socket says 172.21.15.100:59012) 2021-01-28T03:50:38.824 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.810+0000 7faf14e18700 1 -- 172.21.15.100:0/1336949137 learned_addr learned my addr 172.21.15.100:0/1336949137 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:50:38.824 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.810+0000 7faf14e18700 1 -- 172.21.15.100:0/1336949137 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf10070540 con 0x7faf100fcac0 2021-01-28T03:50:38.824 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.810+0000 7faf14e18700 1 --2- 172.21.15.100:0/1336949137 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf100fcac0 0x7faf1006ff10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7faf08006b80 tx=0x7faf080092d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:38.825 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.810+0000 7faf0d7fa700 1 -- 172.21.15.100:0/1336949137 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf0800bbf0 con 0x7faf100fcac0 2021-01-28T03:50:38.825 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.810+0000 7faf0d7fa700 1 -- 172.21.15.100:0/1336949137 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7faf0800bec0 con 0x7faf100fcac0 2021-01-28T03:50:38.825 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.810+0000 7faf0d7fa700 1 -- 172.21.15.100:0/1336949137 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faf080235d0 con 0x7faf100fcac0 2021-01-28T03:50:38.826 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.810+0000 7faf15e1a700 1 -- 172.21.15.100:0/1336949137 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf10070790 con 0x7faf100fcac0 2021-01-28T03:50:38.826 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.814+0000 7faf15e1a700 1 -- 172.21.15.100:0/1336949137 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf10071340 con 0x7faf100fcac0 2021-01-28T03:50:38.826 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.814+0000 7faf0d7fa700 1 -- 172.21.15.100:0/1336949137 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 12) v1 ==== 35784+0+0 (secure 0 0 0) 0x7faf0802a070 con 0x7faf100fcac0 2021-01-28T03:50:38.826 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.814+0000 7faf0d7fa700 1 --2- 172.21.15.100:0/1336949137 >> v2:172.21.15.100:6800/928846103 conn(0x7faef002fb70 0x7faef0032030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:38.826 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.814+0000 7faf0d7fa700 1 -- 172.21.15.100:0/1336949137 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1012+0+0 (secure 0 0 0) 0x7faf08042200 con 0x7faf100fcac0 2021-01-28T03:50:38.827 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.814+0000 7faf06ffd700 1 -- 172.21.15.100:0/1336949137 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf100581f0 con 0x7faf100fcac0 2021-01-28T03:50:38.827 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.814+0000 7faf0ffff700 1 --2- 172.21.15.100:0/1336949137 >> v2:172.21.15.100:6800/928846103 conn(0x7faef002fb70 0x7faef0032030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:38.827 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.814+0000 7faf0ffff700 1 --2- 172.21.15.100:0/1336949137 >> v2:172.21.15.100:6800/928846103 conn(0x7faef002fb70 0x7faef0032030 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7faef80096a0 tx=0x7faef8006b40).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:38.828 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:38.818+0000 7faf0d7fa700 1 -- 172.21.15.100:0/1336949137 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7faf0801e070 con 0x7faf100fcac0 2021-01-28T03:50:39.115 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:39.114+0000 7faf06ffd700 1 -- 172.21.15.100:0/1336949137 --> v2:172.21.15.100:6800/928846103 -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7faf10044bc0 con 0x7faef002fb70 2021-01-28T03:50:39.242 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:39.242+0000 7faf0d7fa700 1 -- 172.21.15.100:0/1336949137 <== mgr.14138 v2:172.21.15.100:6800/928846103 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7faf10044bc0 con 0x7faef002fb70 2021-01-28T03:50:39.242 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: Self-signed certificate created 2021-01-28T03:50:39.244 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:39.246+0000 7faf06ffd700 1 -- 172.21.15.100:0/1336949137 >> v2:172.21.15.100:6800/928846103 conn(0x7faef002fb70 msgr2=0x7faef0032030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:39.245 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:39.246+0000 7faf06ffd700 1 --2- 172.21.15.100:0/1336949137 >> v2:172.21.15.100:6800/928846103 conn(0x7faef002fb70 0x7faef0032030 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7faef80096a0 tx=0x7faef8006b40).stop 2021-01-28T03:50:39.245 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:39.246+0000 7faf06ffd700 1 -- 172.21.15.100:0/1336949137 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf100fcac0 msgr2=0x7faf1006ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:39.245 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:39.246+0000 7faf06ffd700 1 --2- 172.21.15.100:0/1336949137 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf100fcac0 0x7faf1006ff10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7faf08006b80 tx=0x7faf080092d0).stop 2021-01-28T03:50:39.246 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:39.246+0000 7faf06ffd700 1 -- 172.21.15.100:0/1336949137 shutdown_connections 2021-01-28T03:50:39.246 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:39.246+0000 7faf06ffd700 1 --2- 172.21.15.100:0/1336949137 >> v2:172.21.15.100:6800/928846103 conn(0x7faef002fb70 0x7faef0032030 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:39.246 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:39.246+0000 7faf06ffd700 1 --2- 172.21.15.100:0/1336949137 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf100fcac0 0x7faf1006ff10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:39.247 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:39.246+0000 7faf06ffd700 1 -- 172.21.15.100:0/1336949137 >> 172.21.15.100:0/1336949137 conn(0x7faf1006ea50 msgr2=0x7faf100f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:50:39.247 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:39.246+0000 7faf06ffd700 1 -- 172.21.15.100:0/1336949137 shutdown_connections 2021-01-28T03:50:39.247 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:39.246+0000 7faf06ffd700 1 -- 172.21.15.100:0/1336949137 wait complete. 2021-01-28T03:50:39.893 INFO:teuthology.orchestra.run.smithi100.stderr:Creating initial admin user... 2021-01-28T03:50:39.894 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi100 -v /var/log/ceph/c217df96-611b-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp3pxhmbk:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpih1yxits:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmp9l4hhjw8:/tmp/dashboard.pw:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 dashboard ac-user-create admin -i /tmp/dashboard.pw administrator --force-password --pwd-update-required 2021-01-28T03:50:40.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:40 smithi100 bash[9834]: audit 2021-01-28T03:50:39.118703+0000 mgr.y (mgr.14138) 3 : audit [DBG] from='client.14148 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:50:40.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:40 smithi100 bash[9834]: audit 2021-01-28T03:50:39.237596+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:50:40.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:40 smithi100 bash[9834]: audit 2021-01-28T03:50:39.244492+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:50:41.112 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.110+0000 7f35d71de700 1 Processor -- start 2021-01-28T03:50:41.112 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.110+0000 7f35d71de700 1 -- start start 2021-01-28T03:50:41.113 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.110+0000 7f35d71de700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35d006d540 0x7f35d00fbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:41.114 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.110+0000 7f35d71de700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d00fc390 con 0x7f35d006d540 2021-01-28T03:50:41.114 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.114+0000 7f35d61dc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35d006d540 0x7f35d00fbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:41.114 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.114+0000 7f35d61dc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35d006d540 0x7f35d00fbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59020/0 (socket says 172.21.15.100:59020) 2021-01-28T03:50:41.114 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.114+0000 7f35d61dc700 1 -- 172.21.15.100:0/277752027 learned_addr learned my addr 172.21.15.100:0/277752027 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:50:41.114 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.114+0000 7f35d61dc700 1 -- 172.21.15.100:0/277752027 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d00fc4d0 con 0x7f35d006d540 2021-01-28T03:50:41.115 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.114+0000 7f35d61dc700 1 --2- 172.21.15.100:0/277752027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35d006d540 0x7f35d00fbea0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f35c800b950 tx=0x7f35c8006ee0).ready entity=mon.0 client_cookie=441ab178d88942c9 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:41.115 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.114+0000 7f35d51da700 1 -- 172.21.15.100:0/277752027 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35c8009840 con 0x7f35d006d540 2021-01-28T03:50:41.115 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.114+0000 7f35d51da700 1 -- 172.21.15.100:0/277752027 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f35c8009e00 con 0x7f35d006d540 2021-01-28T03:50:41.115 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.114+0000 7f35d51da700 1 -- 172.21.15.100:0/277752027 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35c8011c80 con 0x7f35d006d540 2021-01-28T03:50:41.117 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.114+0000 7f35d71de700 1 -- 172.21.15.100:0/277752027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35d006d540 msgr2=0x7f35d00fbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:41.117 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.114+0000 7f35d71de700 1 --2- 172.21.15.100:0/277752027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35d006d540 0x7f35d00fbea0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f35c800b950 tx=0x7f35c8006ee0).stop 2021-01-28T03:50:41.118 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.114+0000 7f35d71de700 1 -- 172.21.15.100:0/277752027 shutdown_connections 2021-01-28T03:50:41.118 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.114+0000 7f35d71de700 1 --2- 172.21.15.100:0/277752027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35d006d540 0x7f35d00fbea0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:41.118 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.114+0000 7f35d71de700 1 -- 172.21.15.100:0/277752027 >> 172.21.15.100:0/277752027 conn(0x7f35d00f3940 msgr2=0x7f35d00f5d60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:50:41.118 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.114+0000 7f35d71de700 1 -- 172.21.15.100:0/277752027 shutdown_connections 2021-01-28T03:50:41.119 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.114+0000 7f35d71de700 1 -- 172.21.15.100:0/277752027 wait complete. 2021-01-28T03:50:41.119 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.114+0000 7f35d71de700 1 Processor -- start 2021-01-28T03:50:41.119 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.114+0000 7f35d71de700 1 -- start start 2021-01-28T03:50:41.119 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.114+0000 7f35d71de700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35d006d540 0x7f35d0109be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:41.119 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.114+0000 7f35d71de700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d010a0d0 con 0x7f35d006d540 2021-01-28T03:50:41.120 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.114+0000 7f35d61dc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35d006d540 0x7f35d0109be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:41.120 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.114+0000 7f35d61dc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35d006d540 0x7f35d0109be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59022/0 (socket says 172.21.15.100:59022) 2021-01-28T03:50:41.120 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.118+0000 7f35d61dc700 1 -- 172.21.15.100:0/206272789 learned_addr learned my addr 172.21.15.100:0/206272789 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:50:41.120 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.118+0000 7f35d61dc700 1 -- 172.21.15.100:0/206272789 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d010a210 con 0x7f35d006d540 2021-01-28T03:50:41.121 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.118+0000 7f35d61dc700 1 --2- 172.21.15.100:0/206272789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35d006d540 0x7f35d0109be0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f35c8010860 tx=0x7f35c8006ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:41.121 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.118+0000 7f35ceffd700 1 -- 172.21.15.100:0/206272789 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35c8009ca0 con 0x7f35d006d540 2021-01-28T03:50:41.121 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.118+0000 7f35d71de700 1 -- 172.21.15.100:0/206272789 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d010a460 con 0x7f35d006d540 2021-01-28T03:50:41.121 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.118+0000 7f35d71de700 1 -- 172.21.15.100:0/206272789 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d010afc0 con 0x7f35d006d540 2021-01-28T03:50:41.122 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.118+0000 7f35ceffd700 1 -- 172.21.15.100:0/206272789 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f35c8011ae0 con 0x7f35d006d540 2021-01-28T03:50:41.123 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.118+0000 7f35ceffd700 1 -- 172.21.15.100:0/206272789 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f35c801bc10 con 0x7f35d006d540 2021-01-28T03:50:41.123 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.118+0000 7f35ceffd700 1 -- 172.21.15.100:0/206272789 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 12) v1 ==== 35784+0+0 (secure 0 0 0) 0x7f35c800f070 con 0x7f35d006d540 2021-01-28T03:50:41.123 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.118+0000 7f35ceffd700 1 --2- 172.21.15.100:0/206272789 >> v2:172.21.15.100:6800/928846103 conn(0x7f35bc02fc60 0x7f35bc032120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:41.123 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.118+0000 7f35ceffd700 1 -- 172.21.15.100:0/206272789 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1012+0+0 (secure 0 0 0) 0x7f35c8042020 con 0x7f35d006d540 2021-01-28T03:50:41.123 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.118+0000 7f35d71de700 1 -- 172.21.15.100:0/206272789 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d00581f0 con 0x7f35d006d540 2021-01-28T03:50:41.124 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.118+0000 7f35d59db700 1 --2- 172.21.15.100:0/206272789 >> v2:172.21.15.100:6800/928846103 conn(0x7f35bc02fc60 0x7f35bc032120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:41.124 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.122+0000 7f35d59db700 1 --2- 172.21.15.100:0/206272789 >> v2:172.21.15.100:6800/928846103 conn(0x7f35bc02fc60 0x7f35bc032120 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f35c40096a0 tx=0x7f35c4006b40).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:41.127 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.126+0000 7f35ceffd700 1 -- 172.21.15.100:0/206272789 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f35c8016080 con 0x7f35d006d540 2021-01-28T03:50:41.238 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.238+0000 7f35ceffd700 1 -- 172.21.15.100:0/206272789 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 13) v1 ==== 35845+0+0 (secure 0 0 0) 0x7f35c80238d0 con 0x7f35d006d540 2021-01-28T03:50:41.445 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.446+0000 7f35d71de700 1 -- 172.21.15.100:0/206272789 --> v2:172.21.15.100:6800/928846103 -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f35d0058010 con 0x7f35bc02fc60 2021-01-28T03:50:41.686 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.686+0000 7f35ceffd700 1 -- 172.21.15.100:0/206272789 <== mgr.14138 v2:172.21.15.100:6800/928846103 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f35d0058010 con 0x7f35bc02fc60 2021-01-28T03:50:41.687 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: {"username": "admin", "password": "$2b$12$Katawwmw4u1dF1sWOXuFeO2NUVj6m6pQnkf/6YxLyHllFsc2eMHAu", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1611805841, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2021-01-28T03:50:41.690 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.690+0000 7f35d71de700 1 -- 172.21.15.100:0/206272789 >> v2:172.21.15.100:6800/928846103 conn(0x7f35bc02fc60 msgr2=0x7f35bc032120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:41.690 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.690+0000 7f35d71de700 1 --2- 172.21.15.100:0/206272789 >> v2:172.21.15.100:6800/928846103 conn(0x7f35bc02fc60 0x7f35bc032120 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f35c40096a0 tx=0x7f35c4006b40).stop 2021-01-28T03:50:41.691 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.690+0000 7f35d71de700 1 -- 172.21.15.100:0/206272789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35d006d540 msgr2=0x7f35d0109be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:41.691 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.690+0000 7f35d71de700 1 --2- 172.21.15.100:0/206272789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35d006d540 0x7f35d0109be0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f35c8010860 tx=0x7f35c8006ee0).stop 2021-01-28T03:50:41.692 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.690+0000 7f35d71de700 1 -- 172.21.15.100:0/206272789 shutdown_connections 2021-01-28T03:50:41.692 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.690+0000 7f35d71de700 1 --2- 172.21.15.100:0/206272789 >> v2:172.21.15.100:6800/928846103 conn(0x7f35bc02fc60 0x7f35bc032120 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:41.692 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.690+0000 7f35d71de700 1 --2- 172.21.15.100:0/206272789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35d006d540 0x7f35d0109be0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:41.692 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.690+0000 7f35d71de700 1 -- 172.21.15.100:0/206272789 >> 172.21.15.100:0/206272789 conn(0x7f35d00f3940 msgr2=0x7f35d00f4730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:50:41.692 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.690+0000 7f35d71de700 1 -- 172.21.15.100:0/206272789 shutdown_connections 2021-01-28T03:50:41.693 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:41.690+0000 7f35d71de700 1 -- 172.21.15.100:0/206272789 wait complete. 2021-01-28T03:50:42.367 INFO:teuthology.orchestra.run.smithi100.stderr:Fetching dashboard port number... 2021-01-28T03:50:42.368 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi100 -v /var/log/ceph/c217df96-611b-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpp3pxhmbk:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpih1yxits:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 config get mgr mgr/dashboard/ssl_server_port 2021-01-28T03:50:42.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:42 smithi100 bash[9834]: cluster 2021-01-28T03:50:41.243532+0000 mon.a (mon.0) 95 : cluster [DBG] mgrmap e13: y(active, since 6s) 2021-01-28T03:50:42.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:42 smithi100 bash[9834]: audit 2021-01-28T03:50:41.689063+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:50:43.539 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.538+0000 7f18d9245700 1 Processor -- start 2021-01-28T03:50:43.539 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.538+0000 7f18d9245700 1 -- start start 2021-01-28T03:50:43.540 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.538+0000 7f18d9245700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18d406f4e0 0x7f18d406da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:43.540 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.538+0000 7f18d9245700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d406f900 con 0x7f18d406f4e0 2021-01-28T03:50:43.541 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.538+0000 7f18d3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18d406f4e0 0x7f18d406da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:43.541 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.538+0000 7f18d3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18d406f4e0 0x7f18d406da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59026/0 (socket says 172.21.15.100:59026) 2021-01-28T03:50:43.542 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.538+0000 7f18d3fff700 1 -- 172.21.15.100:0/2002888015 learned_addr learned my addr 172.21.15.100:0/2002888015 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:50:43.542 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.538+0000 7f18d3fff700 1 -- 172.21.15.100:0/2002888015 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d406df70 con 0x7f18d406f4e0 2021-01-28T03:50:43.542 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.538+0000 7f18d3fff700 1 --2- 172.21.15.100:0/2002888015 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18d406f4e0 0x7f18d406da80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f18cc009cc0 tx=0x7f18cc0092d0).ready entity=mon.0 client_cookie=70563b2e9937a26a server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:43.543 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.538+0000 7f18d2ffd700 1 -- 172.21.15.100:0/2002888015 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18cc00bbf0 con 0x7f18d406f4e0 2021-01-28T03:50:43.550 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.538+0000 7f18d2ffd700 1 -- 172.21.15.100:0/2002888015 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f18cc00bd50 con 0x7f18d406f4e0 2021-01-28T03:50:43.551 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.538+0000 7f18d2ffd700 1 -- 172.21.15.100:0/2002888015 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18cc010560 con 0x7f18d406f4e0 2021-01-28T03:50:43.551 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.538+0000 7f18d9245700 1 -- 172.21.15.100:0/2002888015 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18d406f4e0 msgr2=0x7f18d406da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:43.552 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.538+0000 7f18d9245700 1 --2- 172.21.15.100:0/2002888015 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18d406f4e0 0x7f18d406da80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f18cc009cc0 tx=0x7f18cc0092d0).stop 2021-01-28T03:50:43.552 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.538+0000 7f18d9245700 1 -- 172.21.15.100:0/2002888015 shutdown_connections 2021-01-28T03:50:43.552 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.538+0000 7f18d9245700 1 --2- 172.21.15.100:0/2002888015 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18d406f4e0 0x7f18d406da80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:43.553 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.538+0000 7f18d9245700 1 -- 172.21.15.100:0/2002888015 >> 172.21.15.100:0/2002888015 conn(0x7f18d40f49f0 msgr2=0x7f18d40f6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:50:43.553 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.538+0000 7f18d9245700 1 -- 172.21.15.100:0/2002888015 shutdown_connections 2021-01-28T03:50:43.554 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.542+0000 7f18d9245700 1 -- 172.21.15.100:0/2002888015 wait complete. 2021-01-28T03:50:43.554 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.542+0000 7f18d9245700 1 Processor -- start 2021-01-28T03:50:43.555 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.542+0000 7f18d9245700 1 -- start start 2021-01-28T03:50:43.556 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.542+0000 7f18d9245700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18d406f4e0 0x7f18d4109ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:43.556 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.542+0000 7f18d9245700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d4109fa0 con 0x7f18d406f4e0 2021-01-28T03:50:43.556 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.542+0000 7f18d3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18d406f4e0 0x7f18d4109ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:43.557 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.542+0000 7f18d3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18d406f4e0 0x7f18d4109ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59028/0 (socket says 172.21.15.100:59028) 2021-01-28T03:50:43.557 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.542+0000 7f18d3fff700 1 -- 172.21.15.100:0/3399438709 learned_addr learned my addr 172.21.15.100:0/3399438709 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:50:43.558 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.542+0000 7f18d3fff700 1 -- 172.21.15.100:0/3399438709 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d410a0e0 con 0x7f18d406f4e0 2021-01-28T03:50:43.558 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.542+0000 7f18d3fff700 1 --2- 172.21.15.100:0/3399438709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18d406f4e0 0x7f18d4109ab0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f18cc010cb0 tx=0x7f18cc0092d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:43.559 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.542+0000 7f18d0ff9700 1 -- 172.21.15.100:0/3399438709 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18cc00bbf0 con 0x7f18d406f4e0 2021-01-28T03:50:43.559 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.542+0000 7f18d0ff9700 1 -- 172.21.15.100:0/3399438709 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f18cc00bec0 con 0x7f18d406f4e0 2021-01-28T03:50:43.560 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.542+0000 7f18d9245700 1 -- 172.21.15.100:0/3399438709 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18d410a330 con 0x7f18d406f4e0 2021-01-28T03:50:43.560 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.542+0000 7f18d0ff9700 1 -- 172.21.15.100:0/3399438709 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f18cc0235d0 con 0x7f18d406f4e0 2021-01-28T03:50:43.561 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.542+0000 7f18d9245700 1 -- 172.21.15.100:0/3399438709 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d410ae90 con 0x7f18d406f4e0 2021-01-28T03:50:43.561 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.546+0000 7f18d9245700 1 -- 172.21.15.100:0/3399438709 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18d40581f0 con 0x7f18d406f4e0 2021-01-28T03:50:43.561 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.546+0000 7f18d0ff9700 1 -- 172.21.15.100:0/3399438709 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) v1 ==== 35845+0+0 (secure 0 0 0) 0x7f18cc00f070 con 0x7f18d406f4e0 2021-01-28T03:50:43.562 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.546+0000 7f18d0ff9700 1 --2- 172.21.15.100:0/3399438709 >> v2:172.21.15.100:6800/928846103 conn(0x7f18b802fc20 0x7f18b80320e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:43.562 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.546+0000 7f18d0ff9700 1 -- 172.21.15.100:0/3399438709 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1012+0+0 (secure 0 0 0) 0x7f18cc042130 con 0x7f18d406f4e0 2021-01-28T03:50:43.563 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.546+0000 7f18d37fe700 1 --2- 172.21.15.100:0/3399438709 >> v2:172.21.15.100:6800/928846103 conn(0x7f18b802fc20 0x7f18b80320e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:43.563 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.546+0000 7f18d37fe700 1 --2- 172.21.15.100:0/3399438709 >> v2:172.21.15.100:6800/928846103 conn(0x7f18b802fc20 0x7f18b80320e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f18bc0096a0 tx=0x7f18bc006b40).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:43.564 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.554+0000 7f18d0ff9700 1 -- 172.21.15.100:0/3399438709 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f18cc021910 con 0x7f18d406f4e0 2021-01-28T03:50:43.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:43 smithi100 bash[9834]: audit 2021-01-28T03:50:41.449230+0000 mgr.y (mgr.14138) 4 : audit [DBG] from='client.14150 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:50:43.844 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.842+0000 7f18d9245700 1 -- 172.21.15.100:0/3399438709 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f18d4044bc0 con 0x7f18d406f4e0 2021-01-28T03:50:43.844 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.846+0000 7f18d0ff9700 1 -- 172.21.15.100:0/3399438709 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f18cc01e030 con 0x7f18d406f4e0 2021-01-28T03:50:43.845 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 8443 2021-01-28T03:50:43.847 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.846+0000 7f18d9245700 1 -- 172.21.15.100:0/3399438709 >> v2:172.21.15.100:6800/928846103 conn(0x7f18b802fc20 msgr2=0x7f18b80320e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:43.847 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.846+0000 7f18d9245700 1 --2- 172.21.15.100:0/3399438709 >> v2:172.21.15.100:6800/928846103 conn(0x7f18b802fc20 0x7f18b80320e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f18bc0096a0 tx=0x7f18bc006b40).stop 2021-01-28T03:50:43.849 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.846+0000 7f18d9245700 1 -- 172.21.15.100:0/3399438709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18d406f4e0 msgr2=0x7f18d4109ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:43.849 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.846+0000 7f18d9245700 1 --2- 172.21.15.100:0/3399438709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18d406f4e0 0x7f18d4109ab0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f18cc010cb0 tx=0x7f18cc0092d0).stop 2021-01-28T03:50:43.849 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.846+0000 7f18d9245700 1 -- 172.21.15.100:0/3399438709 shutdown_connections 2021-01-28T03:50:43.850 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.846+0000 7f18d9245700 1 --2- 172.21.15.100:0/3399438709 >> v2:172.21.15.100:6800/928846103 conn(0x7f18b802fc20 0x7f18b80320e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:43.851 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.846+0000 7f18d9245700 1 --2- 172.21.15.100:0/3399438709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f18d406f4e0 0x7f18d4109ab0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:43.852 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.846+0000 7f18d9245700 1 -- 172.21.15.100:0/3399438709 >> 172.21.15.100:0/3399438709 conn(0x7f18d40f49f0 msgr2=0x7f18d40f5840 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:50:43.852 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.846+0000 7f18d9245700 1 -- 172.21.15.100:0/3399438709 shutdown_connections 2021-01-28T03:50:43.852 INFO:teuthology.orchestra.run.smithi100.stderr:/usr/bin/ceph: 2021-01-28T03:50:43.846+0000 7f18d9245700 1 -- 172.21.15.100:0/3399438709 wait complete. 2021-01-28T03:50:44.490 INFO:teuthology.orchestra.run.smithi100.stderr:firewalld does not appear to be present 2021-01-28T03:50:44.491 INFO:teuthology.orchestra.run.smithi100.stderr:Not possible to open ports <[8443]>. firewalld.service is not available 2021-01-28T03:50:44.494 INFO:teuthology.orchestra.run.smithi100.stderr:Ceph Dashboard is now available at: 2021-01-28T03:50:44.494 INFO:teuthology.orchestra.run.smithi100.stderr: 2021-01-28T03:50:44.495 INFO:teuthology.orchestra.run.smithi100.stderr: URL: https://smithi100.front.sepia.ceph.com:8443/ 2021-01-28T03:50:44.495 INFO:teuthology.orchestra.run.smithi100.stderr: User: admin 2021-01-28T03:50:44.495 INFO:teuthology.orchestra.run.smithi100.stderr: Password: xjl4coxom1 2021-01-28T03:50:44.495 INFO:teuthology.orchestra.run.smithi100.stderr: 2021-01-28T03:50:44.496 INFO:teuthology.orchestra.run.smithi100.stderr:You can access the Ceph CLI with: 2021-01-28T03:50:44.497 INFO:teuthology.orchestra.run.smithi100.stderr: 2021-01-28T03:50:44.497 INFO:teuthology.orchestra.run.smithi100.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid c217df96-611b-11eb-8f9e-001a4aab830c -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2021-01-28T03:50:44.497 INFO:teuthology.orchestra.run.smithi100.stderr: 2021-01-28T03:50:44.497 INFO:teuthology.orchestra.run.smithi100.stderr:Please consider enabling telemetry to help improve Ceph: 2021-01-28T03:50:44.498 INFO:teuthology.orchestra.run.smithi100.stderr: 2021-01-28T03:50:44.498 INFO:teuthology.orchestra.run.smithi100.stderr: ceph telemetry on 2021-01-28T03:50:44.498 INFO:teuthology.orchestra.run.smithi100.stderr: 2021-01-28T03:50:44.498 INFO:teuthology.orchestra.run.smithi100.stderr:For more information see: 2021-01-28T03:50:44.499 INFO:teuthology.orchestra.run.smithi100.stderr: 2021-01-28T03:50:44.499 INFO:teuthology.orchestra.run.smithi100.stderr: https://docs.ceph.com/docs/master/mgr/telemetry/ 2021-01-28T03:50:44.499 INFO:teuthology.orchestra.run.smithi100.stderr: 2021-01-28T03:50:44.499 INFO:teuthology.orchestra.run.smithi100.stderr:Bootstrap complete. 2021-01-28T03:50:44.500 INFO:teuthology.orchestra.run.smithi100.stderr:Releasing lock 139858668714064 on /run/cephadm/c217df96-611b-11eb-8f9e-001a4aab830c.lock 2021-01-28T03:50:44.500 INFO:teuthology.orchestra.run.smithi100.stderr:Lock 139858668714064 released on /run/cephadm/c217df96-611b-11eb-8f9e-001a4aab830c.lock 2021-01-28T03:50:44.517 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:44 smithi100 bash[9834]: audit 2021-01-28T03:50:43.847497+0000 mon.a (mon.0) 97 : audit [DBG] from='client.? 172.21.15.100:0/3399438709' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2021-01-28T03:50:44.529 INFO:tasks.cephadm:Fetching config... 2021-01-28T03:50:44.538 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2021-01-28T03:50:44.538 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2021-01-28T03:50:44.553 INFO:tasks.cephadm:Fetching client.admin keyring... 2021-01-28T03:50:44.553 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2021-01-28T03:50:44.554 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2021-01-28T03:50:44.609 INFO:tasks.cephadm:Fetching mon keyring... 2021-01-28T03:50:44.611 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2021-01-28T03:50:44.611 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/c217df96-611b-11eb-8f9e-001a4aab830c/mon.a/keyring of=/dev/stdout 2021-01-28T03:50:44.636 INFO:tasks.cephadm:Fetching pub ssh key... 2021-01-28T03:50:44.637 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2021-01-28T03:50:44.637 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2021-01-28T03:50:44.698 INFO:tasks.cephadm:Installing pub ssh key for root users... 2021-01-28T03:50:44.698 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m 0700 /root/.ssh &&echo ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTsm15urqXtErlQcaHcpGB/xtCwSQ/8jOTXIlx/57mHbM6OSn+K+jjdmQ4MttUMIyDkC+C6Xane+Koz5IKbQJzqDiMnGX/u/2fRB1BL30iDxpWCynRuNl2CNLBm7VkP26zSOPEW0aGk+ZuwQKQ5AUq8g/hcFjEtkmcULWNvh5oJTRMdkFxTLorcP0x0hw/kWV57zrq5j5m4BQdTQsgieShf+p4QKzSiBaI2SZYGhvyQSKviY0dCkRSwb6rlJtd9USAmhCPbhSbZtub7SjP1KYG71WNVlbyhzFeaIvB3x8wpDkMjIxcdiNf9QTERfioE4i3ZjAVk/Rp7DqrM1AJlUS6ZNEEXbvw8WrZ0pgjFE3503/Mxjd7OswYpqCLnfJToy2kr/Aan2d/cTGUoSDYbQxzNApIENTJngBFMky4g/+JYF/nrg2I/9ckM3WX/WKedjHm2IuXwvYexB043qg68kGtJdpZknrsJLJ+0J/tTHE+XXD96gsaGKUXVCX0VNftSUc= ceph-c217df96-611b-11eb-8f9e-001a4aab830c |sudo tee -a /root/.ssh/authorized_keys &&sudo chmod 0600 /root/.ssh/authorized_keys 2021-01-28T03:50:44.732 INFO:teuthology.orchestra.run.smithi100.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTsm15urqXtErlQcaHcpGB/xtCwSQ/8jOTXIlx/57mHbM6OSn+K+jjdmQ4MttUMIyDkC+C6Xane+Koz5IKbQJzqDiMnGX/u/2fRB1BL30iDxpWCynRuNl2CNLBm7VkP26zSOPEW0aGk+ZuwQKQ5AUq8g/hcFjEtkmcULWNvh5oJTRMdkFxTLorcP0x0hw/kWV57zrq5j5m4BQdTQsgieShf+p4QKzSiBaI2SZYGhvyQSKviY0dCkRSwb6rlJtd9USAmhCPbhSbZtub7SjP1KYG71WNVlbyhzFeaIvB3x8wpDkMjIxcdiNf9QTERfioE4i3ZjAVk/Rp7DqrM1AJlUS6ZNEEXbvw8WrZ0pgjFE3503/Mxjd7OswYpqCLnfJToy2kr/Aan2d/cTGUoSDYbQxzNApIENTJngBFMky4g/+JYF/nrg2I/9ckM3WX/WKedjHm2IuXwvYexB043qg68kGtJdpZknrsJLJ+0J/tTHE+XXD96gsaGKUXVCX0VNftSUc= ceph-c217df96-611b-11eb-8f9e-001a4aab830c 2021-01-28T03:50:44.744 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m 0700 /root/.ssh &&echo ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTsm15urqXtErlQcaHcpGB/xtCwSQ/8jOTXIlx/57mHbM6OSn+K+jjdmQ4MttUMIyDkC+C6Xane+Koz5IKbQJzqDiMnGX/u/2fRB1BL30iDxpWCynRuNl2CNLBm7VkP26zSOPEW0aGk+ZuwQKQ5AUq8g/hcFjEtkmcULWNvh5oJTRMdkFxTLorcP0x0hw/kWV57zrq5j5m4BQdTQsgieShf+p4QKzSiBaI2SZYGhvyQSKviY0dCkRSwb6rlJtd9USAmhCPbhSbZtub7SjP1KYG71WNVlbyhzFeaIvB3x8wpDkMjIxcdiNf9QTERfioE4i3ZjAVk/Rp7DqrM1AJlUS6ZNEEXbvw8WrZ0pgjFE3503/Mxjd7OswYpqCLnfJToy2kr/Aan2d/cTGUoSDYbQxzNApIENTJngBFMky4g/+JYF/nrg2I/9ckM3WX/WKedjHm2IuXwvYexB043qg68kGtJdpZknrsJLJ+0J/tTHE+XXD96gsaGKUXVCX0VNftSUc= ceph-c217df96-611b-11eb-8f9e-001a4aab830c |sudo tee -a /root/.ssh/authorized_keys &&sudo chmod 0600 /root/.ssh/authorized_keys 2021-01-28T03:50:44.774 INFO:teuthology.orchestra.run.smithi162.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTsm15urqXtErlQcaHcpGB/xtCwSQ/8jOTXIlx/57mHbM6OSn+K+jjdmQ4MttUMIyDkC+C6Xane+Koz5IKbQJzqDiMnGX/u/2fRB1BL30iDxpWCynRuNl2CNLBm7VkP26zSOPEW0aGk+ZuwQKQ5AUq8g/hcFjEtkmcULWNvh5oJTRMdkFxTLorcP0x0hw/kWV57zrq5j5m4BQdTQsgieShf+p4QKzSiBaI2SZYGhvyQSKviY0dCkRSwb6rlJtd9USAmhCPbhSbZtub7SjP1KYG71WNVlbyhzFeaIvB3x8wpDkMjIxcdiNf9QTERfioE4i3ZjAVk/Rp7DqrM1AJlUS6ZNEEXbvw8WrZ0pgjFE3503/Mxjd7OswYpqCLnfJToy2kr/Aan2d/cTGUoSDYbQxzNApIENTJngBFMky4g/+JYF/nrg2I/9ckM3WX/WKedjHm2IuXwvYexB043qg68kGtJdpZknrsJLJ+0J/tTHE+XXD96gsaGKUXVCX0VNftSUc= ceph-c217df96-611b-11eb-8f9e-001a4aab830c 2021-01-28T03:50:44.786 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph config set mgr mgr/cephadm/allow_ptrace true 2021-01-28T03:50:48.883 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:48.882+0000 7f2ad69e0700 1 -- 172.21.15.100:0/3639550895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ad00f4290 msgr2=0x7f2ad00f46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:48.883 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:48.882+0000 7f2ad69e0700 1 --2- 172.21.15.100:0/3639550895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ad00f4290 0x7f2ad00f46b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f2acc004d00 tx=0x7f2acc009b30).stop 2021-01-28T03:50:48.884 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:48.882+0000 7f2ad69e0700 1 -- 172.21.15.100:0/3639550895 shutdown_connections 2021-01-28T03:50:48.884 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:48.882+0000 7f2ad69e0700 1 --2- 172.21.15.100:0/3639550895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ad00f4290 0x7f2ad00f46b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:48.884 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:48.882+0000 7f2ad69e0700 1 -- 172.21.15.100:0/3639550895 >> 172.21.15.100:0/3639550895 conn(0x7f2ad00efa90 msgr2=0x7f2ad00f1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:50:48.884 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:48.882+0000 7f2ad69e0700 1 -- 172.21.15.100:0/3639550895 shutdown_connections 2021-01-28T03:50:48.885 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:48.882+0000 7f2ad69e0700 1 -- 172.21.15.100:0/3639550895 wait complete. 2021-01-28T03:50:48.887 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:48.882+0000 7f2ad69e0700 1 Processor -- start 2021-01-28T03:50:48.887 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:48.886+0000 7f2ad69e0700 1 -- start start 2021-01-28T03:50:48.888 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:48.886+0000 7f2ad69e0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ad00f4290 0x7f2ad01097d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:48.888 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:48.886+0000 7f2ad69e0700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad01051c0 con 0x7f2ad00f4290 2021-01-28T03:50:48.888 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:48.886+0000 7f2ad59de700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ad00f4290 0x7f2ad01097d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:48.888 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:48.886+0000 7f2ad59de700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ad00f4290 0x7f2ad01097d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59034/0 (socket says 172.21.15.100:59034) 2021-01-28T03:50:48.889 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:48.886+0000 7f2ad59de700 1 -- 172.21.15.100:0/2326201610 learned_addr learned my addr 172.21.15.100:0/2326201610 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:50:48.889 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:48.886+0000 7f2ad59de700 1 -- 172.21.15.100:0/2326201610 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad005f310 con 0x7f2ad00f4290 2021-01-28T03:50:48.889 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:48.886+0000 7f2ad59de700 1 --2- 172.21.15.100:0/2326201610 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ad00f4290 0x7f2ad01097d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f2acc0096a0 tx=0x7f2acc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:48.889 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:48.886+0000 7f2ac67fc700 1 -- 172.21.15.100:0/2326201610 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2acc00e030 con 0x7f2ad00f4290 2021-01-28T03:50:48.890 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:48.886+0000 7f2ac67fc700 1 -- 172.21.15.100:0/2326201610 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f2acc0077b0 con 0x7f2ad00f4290 2021-01-28T03:50:48.890 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:48.886+0000 7f2ac67fc700 1 -- 172.21.15.100:0/2326201610 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2acc018070 con 0x7f2ad00f4290 2021-01-28T03:50:48.891 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:48.886+0000 7f2ad69e0700 1 -- 172.21.15.100:0/2326201610 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad005f560 con 0x7f2ad00f4290 2021-01-28T03:50:48.891 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:48.886+0000 7f2ad69e0700 1 -- 172.21.15.100:0/2326201610 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad0109e80 con 0x7f2ad00f4290 2021-01-28T03:50:48.891 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:48.886+0000 7f2ac67fc700 1 -- 172.21.15.100:0/2326201610 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) v1 ==== 35845+0+0 (secure 0 0 0) 0x7f2acc01d860 con 0x7f2ad00f4290 2021-01-28T03:50:48.891 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:48.886+0000 7f2ac67fc700 1 --2- 172.21.15.100:0/2326201610 >> v2:172.21.15.100:6800/928846103 conn(0x7f2abc02fc70 0x7f2abc032130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:50:48.891 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:48.886+0000 7f2ac67fc700 1 -- 172.21.15.100:0/2326201610 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1012+0+0 (secure 0 0 0) 0x7f2acc041500 con 0x7f2ad00f4290 2021-01-28T03:50:48.892 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:48.886+0000 7f2ad51dd700 1 --2- 172.21.15.100:0/2326201610 >> v2:172.21.15.100:6800/928846103 conn(0x7f2abc02fc70 0x7f2abc032130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:50:48.892 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:48.886+0000 7f2ad69e0700 1 -- 172.21.15.100:0/2326201610 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad00581f0 con 0x7f2ad00f4290 2021-01-28T03:50:48.892 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:48.886+0000 7f2ad51dd700 1 --2- 172.21.15.100:0/2326201610 >> v2:172.21.15.100:6800/928846103 conn(0x7f2abc02fc70 0x7f2abc032130 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f2ac00096a0 tx=0x7f2ac0006b40).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:50:48.896 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:48.898+0000 7f2ac67fc700 1 -- 172.21.15.100:0/2326201610 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f2acc01b370 con 0x7f2ad00f4290 2021-01-28T03:50:49.061 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:49.062+0000 7f2ad69e0700 1 -- 172.21.15.100:0/2326201610 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f2ad00271a0 con 0x7f2ad00f4290 2021-01-28T03:50:49.067 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:49.066+0000 7f2ac67fc700 1 -- 172.21.15.100:0/2326201610 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f2acc025b80 con 0x7f2ad00f4290 2021-01-28T03:50:49.069 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:49.070+0000 7f2ad69e0700 1 -- 172.21.15.100:0/2326201610 >> v2:172.21.15.100:6800/928846103 conn(0x7f2abc02fc70 msgr2=0x7f2abc032130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:49.070 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:49.070+0000 7f2ad69e0700 1 --2- 172.21.15.100:0/2326201610 >> v2:172.21.15.100:6800/928846103 conn(0x7f2abc02fc70 0x7f2abc032130 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f2ac00096a0 tx=0x7f2ac0006b40).stop 2021-01-28T03:50:49.070 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:49.070+0000 7f2ad69e0700 1 -- 172.21.15.100:0/2326201610 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ad00f4290 msgr2=0x7f2ad01097d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:50:49.071 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:49.070+0000 7f2ad69e0700 1 --2- 172.21.15.100:0/2326201610 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ad00f4290 0x7f2ad01097d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f2acc0096a0 tx=0x7f2acc009b30).stop 2021-01-28T03:50:49.071 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:49.070+0000 7f2ad69e0700 1 -- 172.21.15.100:0/2326201610 shutdown_connections 2021-01-28T03:50:49.071 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:49.070+0000 7f2ad69e0700 1 --2- 172.21.15.100:0/2326201610 >> v2:172.21.15.100:6800/928846103 conn(0x7f2abc02fc70 0x7f2abc032130 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:49.074 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:49.070+0000 7f2ad69e0700 1 --2- 172.21.15.100:0/2326201610 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ad00f4290 0x7f2ad01097d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:50:49.074 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:49.070+0000 7f2ad69e0700 1 -- 172.21.15.100:0/2326201610 >> 172.21.15.100:0/2326201610 conn(0x7f2ad00efa90 msgr2=0x7f2ad00f1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:50:49.075 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:49.070+0000 7f2ad69e0700 1 -- 172.21.15.100:0/2326201610 shutdown_connections 2021-01-28T03:50:49.075 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:50:49.070+0000 7f2ad69e0700 1 -- 172.21.15.100:0/2326201610 wait complete. 2021-01-28T03:50:49.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:48 smithi100 bash[9834]: audit 2021-01-28T03:50:48.674391+0000 mon.a (mon.0) 98 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:50:50.128 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi162 2021-01-28T03:50:50.129 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2021-01-28T03:50:50.130 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/etc/ceph/ceph.conf 2021-01-28T03:50:50.137 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2021-01-28T03:50:50.137 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/etc/ceph/ceph.client.admin.keyring 2021-01-28T03:50:50.144 INFO:tasks.cephadm:Adding host smithi162 to orchestrator... 2021-01-28T03:50:50.145 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph orch host add smithi162 2021-01-28T03:50:50.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:50 smithi100 bash[9834]: audit 2021-01-28T03:50:49.029972+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:50:50.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:50 smithi100 bash[9834]: cephadm 2021-01-28T03:50:49.030685+0000 mgr.y (mgr.14138) 5 : cephadm [INF] refreshing smithi100 facts 2021-01-28T03:50:50.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:50 smithi100 bash[9834]: audit 2021-01-28T03:50:49.070122+0000 mon.a (mon.0) 100 : audit [INF] from='client.? 172.21.15.100:0/2326201610' entity='client.admin' 2021-01-28T03:50:50.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:50 smithi100 bash[9834]: audit 2021-01-28T03:50:49.503189+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:50:50.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:50 smithi100 bash[9834]: audit 2021-01-28T03:50:49.504130+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-28T03:50:50.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:50 smithi100 bash[9834]: audit 2021-01-28T03:50:49.505263+0000 mon.a (mon.0) 103 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:50:50.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:50 smithi100 bash[9834]: audit 2021-01-28T03:50:49.507165+0000 mon.a (mon.0) 104 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2021-01-28T03:50:51.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:51 smithi100 bash[9834]: cephadm 2021-01-28T03:50:49.503681+0000 mgr.y (mgr.14138) 6 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2021-01-28T03:50:51.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:51 smithi100 bash[9834]: cephadm 2021-01-28T03:50:49.506261+0000 mgr.y (mgr.14138) 7 : cephadm [INF] Reconfiguring daemon mon.a on smithi100 2021-01-28T03:50:55.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:55 smithi100 bash[9834]: audit 2021-01-28T03:50:54.295375+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:50:55.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:55 smithi100 bash[9834]: cephadm 2021-01-28T03:50:54.296357+0000 mgr.y (mgr.14138) 8 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2021-01-28T03:50:55.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:55 smithi100 bash[9834]: audit 2021-01-28T03:50:54.296933+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2021-01-28T03:50:55.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:55 smithi100 bash[9834]: audit 2021-01-28T03:50:54.298446+0000 mon.a (mon.0) 107 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:50:55.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:55 smithi100 bash[9834]: cephadm 2021-01-28T03:50:54.299474+0000 mgr.y (mgr.14138) 9 : cephadm [INF] Reconfiguring daemon mgr.y on smithi100 2021-01-28T03:50:55.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:55 smithi100 bash[9834]: audit 2021-01-28T03:50:54.300088+0000 mon.a (mon.0) 108 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2021-01-28T03:50:56.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:56 smithi100 bash[9834]: cluster 2021-01-28T03:50:55.276065+0000 mgr.y (mgr.14138) 10 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:50:57.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:57 smithi100 bash[9834]: audit 2021-01-28T03:50:56.385310+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:50:57.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:57 smithi100 bash[9834]: audit 2021-01-28T03:50:56.388204+0000 mon.a (mon.0) 110 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:50:57.824 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:57 smithi100 bash[9834]: audit 2021-01-28T03:50:57.140747+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:50:57.824 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:57 smithi100 bash[9834]: audit 2021-01-28T03:50:57.144038+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:50:58.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:50:58 smithi100 bash[9834]: cluster 2021-01-28T03:50:57.276495+0000 mgr.y (mgr.14138) 11 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:00.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:00 smithi100 bash[9834]: cluster 2021-01-28T03:50:59.276923+0000 mgr.y (mgr.14138) 12 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:02.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:02 smithi100 bash[9834]: cluster 2021-01-28T03:51:01.277474+0000 mgr.y (mgr.14138) 13 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:04.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:04 smithi100 bash[9834]: cluster 2021-01-28T03:51:03.277913+0000 mgr.y (mgr.14138) 14 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:06.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:06 smithi100 bash[9834]: cluster 2021-01-28T03:51:05.278355+0000 mgr.y (mgr.14138) 15 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:07.835 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:07 smithi100 bash[9834]: cluster 2021-01-28T03:51:07.278766+0000 mgr.y (mgr.14138) 16 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:10.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:10 smithi100 bash[9834]: cluster 2021-01-28T03:51:09.279169+0000 mgr.y (mgr.14138) 17 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:12.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:12 smithi100 bash[9834]: cluster 2021-01-28T03:51:11.279580+0000 mgr.y (mgr.14138) 18 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:14.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:14 smithi100 bash[9834]: cluster 2021-01-28T03:51:13.279967+0000 mgr.y (mgr.14138) 19 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:16.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:16 smithi100 bash[9834]: cluster 2021-01-28T03:51:15.280386+0000 mgr.y (mgr.14138) 20 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:17.016 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:17.015+0000 7fb8e7fff700 1 -- 172.21.15.162:0/536438314 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8e805f2d0 msgr2=0x7fb8e80f8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:51:17.016 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:17.015+0000 7fb8e7fff700 1 --2- 172.21.15.162:0/536438314 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8e805f2d0 0x7fb8e80f8010 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fb8d8009cc0 tx=0x7fb8d8004d10).stop 2021-01-28T03:51:17.017 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:17.015+0000 7fb8e7fff700 1 -- 172.21.15.162:0/536438314 shutdown_connections 2021-01-28T03:51:17.017 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:17.015+0000 7fb8e7fff700 1 --2- 172.21.15.162:0/536438314 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8e805f2d0 0x7fb8e80f8010 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:51:17.018 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:17.015+0000 7fb8e7fff700 1 -- 172.21.15.162:0/536438314 >> 172.21.15.162:0/536438314 conn(0x7fb8e80efa90 msgr2=0x7fb8e80f1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:51:17.018 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:17.015+0000 7fb8e7fff700 1 -- 172.21.15.162:0/536438314 shutdown_connections 2021-01-28T03:51:17.018 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:17.015+0000 7fb8e7fff700 1 -- 172.21.15.162:0/536438314 wait complete. 2021-01-28T03:51:17.018 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:17.015+0000 7fb8e7fff700 1 Processor -- start 2021-01-28T03:51:17.019 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:17.015+0000 7fb8e7fff700 1 -- start start 2021-01-28T03:51:17.019 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:17.015+0000 7fb8e7fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8e805f2d0 0x7fb8e80f5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:51:17.019 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:17.015+0000 7fb8e7fff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e80f3f10 con 0x7fb8e805f2d0 2021-01-28T03:51:17.021 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:17.015+0000 7fb8e6ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8e805f2d0 0x7fb8e80f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:51:17.021 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:17.015+0000 7fb8e6ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8e805f2d0 0x7fb8e80f5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.162:50046/0 (socket says 172.21.15.162:50046) 2021-01-28T03:51:17.021 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:17.015+0000 7fb8e6ffd700 1 -- 172.21.15.162:0/3385550409 learned_addr learned my addr 172.21.15.162:0/3385550409 (peer_addr_for_me v2:172.21.15.162:0/0) 2021-01-28T03:51:17.021 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:17.015+0000 7fb8e6ffd700 1 -- 172.21.15.162:0/3385550409 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e80f4050 con 0x7fb8e805f2d0 2021-01-28T03:51:17.022 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:17.019+0000 7fb8e6ffd700 1 --2- 172.21.15.162:0/3385550409 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8e805f2d0 0x7fb8e80f5a90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fb8d8004a10 tx=0x7fb8d8004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:51:17.022 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:17.019+0000 7fb8df7fe700 1 -- 172.21.15.162:0/3385550409 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb8d800e030 con 0x7fb8e805f2d0 2021-01-28T03:51:17.022 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:17.019+0000 7fb8df7fe700 1 -- 172.21.15.162:0/3385550409 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fb8d8013a90 con 0x7fb8e805f2d0 2021-01-28T03:51:17.023 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:17.019+0000 7fb8e7fff700 1 -- 172.21.15.162:0/3385550409 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e80f4240 con 0x7fb8e805f2d0 2021-01-28T03:51:17.023 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:17.019+0000 7fb8df7fe700 1 -- 172.21.15.162:0/3385550409 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb8d8018070 con 0x7fb8e805f2d0 2021-01-28T03:51:17.023 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:17.019+0000 7fb8e7fff700 1 -- 172.21.15.162:0/3385550409 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8e80f46d0 con 0x7fb8e805f2d0 2021-01-28T03:51:17.023 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:17.019+0000 7fb8e7fff700 1 -- 172.21.15.162:0/3385550409 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8e80581f0 con 0x7fb8e805f2d0 2021-01-28T03:51:17.023 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:17.019+0000 7fb8df7fe700 1 -- 172.21.15.162:0/3385550409 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) v1 ==== 35845+0+0 (secure 0 0 0) 0x7fb8d8013630 con 0x7fb8e805f2d0 2021-01-28T03:51:17.024 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:17.019+0000 7fb8df7fe700 1 --2- 172.21.15.162:0/3385550409 >> v2:172.21.15.100:6800/928846103 conn(0x7fb8d402fc20 0x7fb8d40320e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:51:17.024 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:17.019+0000 7fb8df7fe700 1 -- 172.21.15.162:0/3385550409 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1012+0+0 (secure 0 0 0) 0x7fb8d8041710 con 0x7fb8e805f2d0 2021-01-28T03:51:17.024 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:17.019+0000 7fb8e67fc700 1 --2- 172.21.15.162:0/3385550409 >> v2:172.21.15.100:6800/928846103 conn(0x7fb8d402fc20 0x7fb8d40320e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:51:17.024 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:17.019+0000 7fb8e67fc700 1 --2- 172.21.15.162:0/3385550409 >> v2:172.21.15.100:6800/928846103 conn(0x7fb8d402fc20 0x7fb8d40320e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fb8d00096a0 tx=0x7fb8d0006b40).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:51:17.031 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:17.031+0000 7fb8df7fe700 1 -- 172.21.15.162:0/3385550409 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fb8d8013d70 con 0x7fb8e805f2d0 2021-01-28T03:51:17.220 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:17.219+0000 7fb8e7fff700 1 -- 172.21.15.162:0/3385550409 --> v2:172.21.15.100:6800/928846103 -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi162", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8e80fa4b0 con 0x7fb8d402fc20 2021-01-28T03:51:17.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:17 smithi100 bash[9834]: audit 2021-01-28T03:51:17.226564+0000 mgr.y (mgr.14138) 21 : audit [DBG] from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi162", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:51:17.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:17 smithi100 bash[9834]: cluster 2021-01-28T03:51:17.280885+0000 mgr.y (mgr.14138) 22 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:17.573 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:51:17 smithi100 bash[10061]: Warning: Permanently added 'smithi162,172.21.15.162' (ECDSA) to the list of known hosts. 2021-01-28T03:51:18.002 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:18.003+0000 7fb8df7fe700 1 -- 172.21.15.162:0/3385550409 <== mgr.14138 v2:172.21.15.100:6800/928846103 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+23 (secure 0 0 0) 0x7fb8e80fa4b0 con 0x7fb8d402fc20 2021-01-28T03:51:18.002 INFO:teuthology.orchestra.run.smithi162.stdout:Added host 'smithi162' 2021-01-28T03:51:18.005 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:18.007+0000 7fb8e7fff700 1 -- 172.21.15.162:0/3385550409 >> v2:172.21.15.100:6800/928846103 conn(0x7fb8d402fc20 msgr2=0x7fb8d40320e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:51:18.006 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:18.007+0000 7fb8e7fff700 1 --2- 172.21.15.162:0/3385550409 >> v2:172.21.15.100:6800/928846103 conn(0x7fb8d402fc20 0x7fb8d40320e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fb8d00096a0 tx=0x7fb8d0006b40).stop 2021-01-28T03:51:18.006 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:18.007+0000 7fb8e7fff700 1 -- 172.21.15.162:0/3385550409 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8e805f2d0 msgr2=0x7fb8e80f5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:51:18.007 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:18.007+0000 7fb8e7fff700 1 --2- 172.21.15.162:0/3385550409 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8e805f2d0 0x7fb8e80f5a90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fb8d8004a10 tx=0x7fb8d8004d10).stop 2021-01-28T03:51:18.007 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:18.007+0000 7fb8e7fff700 1 -- 172.21.15.162:0/3385550409 shutdown_connections 2021-01-28T03:51:18.007 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:18.007+0000 7fb8e7fff700 1 --2- 172.21.15.162:0/3385550409 >> v2:172.21.15.100:6800/928846103 conn(0x7fb8d402fc20 0x7fb8d40320e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:51:18.007 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:18.007+0000 7fb8e7fff700 1 --2- 172.21.15.162:0/3385550409 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb8e805f2d0 0x7fb8e80f5a90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:51:18.007 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:18.007+0000 7fb8e7fff700 1 -- 172.21.15.162:0/3385550409 >> 172.21.15.162:0/3385550409 conn(0x7fb8e80efa90 msgr2=0x7fb8e80f1e50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:51:18.008 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:18.007+0000 7fb8e7fff700 1 -- 172.21.15.162:0/3385550409 shutdown_connections 2021-01-28T03:51:18.008 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:18.007+0000 7fb8e7fff700 1 -- 172.21.15.162:0/3385550409 wait complete. 2021-01-28T03:51:18.674 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph orch host ls --format=json 2021-01-28T03:51:19.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:19 smithi100 bash[9834]: audit 2021-01-28T03:51:18.002320+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:51:19.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:19 smithi100 bash[9834]: cephadm 2021-01-28T03:51:18.003234+0000 mgr.y (mgr.14138) 23 : cephadm [INF] Added host smithi162 2021-01-28T03:51:19.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:19 smithi100 bash[9834]: audit 2021-01-28T03:51:18.007555+0000 mon.a (mon.0) 114 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:51:19.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:19 smithi100 bash[9834]: audit 2021-01-28T03:51:18.439876+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:51:19.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:19 smithi100 bash[9834]: audit 2021-01-28T03:51:18.441286+0000 mon.a (mon.0) 116 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:51:19.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:19 smithi100 bash[9834]: audit 2021-01-28T03:51:18.711202+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:51:19.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:19 smithi100 bash[9834]: audit 2021-01-28T03:51:18.799223+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:51:19.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:19 smithi100 bash[9834]: audit 2021-01-28T03:51:18.800799+0000 mon.a (mon.0) 119 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:51:20.322 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:20 smithi100 bash[9834]: cluster 2021-01-28T03:51:19.281296+0000 mgr.y (mgr.14138) 24 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:22.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:22 smithi100 bash[9834]: cluster 2021-01-28T03:51:21.281698+0000 mgr.y (mgr.14138) 25 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:22.935 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:22.935+0000 7f00edc56700 1 -- 172.21.15.162:0/545889435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00e80f3c70 msgr2=0x7f00e80f4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:51:22.936 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:22.935+0000 7f00edc56700 1 --2- 172.21.15.162:0/545889435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00e80f3c70 0x7f00e80f4090 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f00d8004d00 tx=0x7f00d8009b30).stop 2021-01-28T03:51:22.936 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:22.935+0000 7f00edc56700 1 -- 172.21.15.162:0/545889435 shutdown_connections 2021-01-28T03:51:22.936 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:22.935+0000 7f00edc56700 1 --2- 172.21.15.162:0/545889435 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00e80f3c70 0x7f00e80f4090 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:51:22.936 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:22.935+0000 7f00edc56700 1 -- 172.21.15.162:0/545889435 >> 172.21.15.162:0/545889435 conn(0x7f00e80ef3d0 msgr2=0x7f00e80f17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:51:22.937 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:22.935+0000 7f00edc56700 1 -- 172.21.15.162:0/545889435 shutdown_connections 2021-01-28T03:51:22.937 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:22.935+0000 7f00edc56700 1 -- 172.21.15.162:0/545889435 wait complete. 2021-01-28T03:51:22.938 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:22.935+0000 7f00edc56700 1 Processor -- start 2021-01-28T03:51:22.939 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:22.935+0000 7f00edc56700 1 -- start start 2021-01-28T03:51:22.939 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:22.935+0000 7f00edc56700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00e80f3c70 0x7f00e8106ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:51:22.939 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:22.935+0000 7f00edc56700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e8106fb0 con 0x7f00e80f3c70 2021-01-28T03:51:22.939 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:22.939+0000 7f00e77fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00e80f3c70 0x7f00e8106ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:51:22.939 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:22.939+0000 7f00e77fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00e80f3c70 0x7f00e8106ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.162:50052/0 (socket says 172.21.15.162:50052) 2021-01-28T03:51:22.940 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:22.939+0000 7f00e77fe700 1 -- 172.21.15.162:0/3421307512 learned_addr learned my addr 172.21.15.162:0/3421307512 (peer_addr_for_me v2:172.21.15.162:0/0) 2021-01-28T03:51:22.940 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:22.939+0000 7f00e77fe700 1 -- 172.21.15.162:0/3421307512 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e81070f0 con 0x7f00e80f3c70 2021-01-28T03:51:22.940 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:22.939+0000 7f00e77fe700 1 --2- 172.21.15.162:0/3421307512 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00e80f3c70 0x7f00e8106ac0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f00d8000c00 tx=0x7f00d8009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:51:22.941 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:22.939+0000 7f00cffff700 1 -- 172.21.15.162:0/3421307512 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00d800e030 con 0x7f00e80f3c70 2021-01-28T03:51:22.941 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:22.939+0000 7f00edc56700 1 -- 172.21.15.162:0/3421307512 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e8107340 con 0x7f00e80f3c70 2021-01-28T03:51:22.941 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:22.939+0000 7f00cffff700 1 -- 172.21.15.162:0/3421307512 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f00d80077b0 con 0x7f00e80f3c70 2021-01-28T03:51:22.941 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:22.939+0000 7f00cffff700 1 -- 172.21.15.162:0/3421307512 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00d8018070 con 0x7f00e80f3c70 2021-01-28T03:51:22.942 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:22.939+0000 7f00edc56700 1 -- 172.21.15.162:0/3421307512 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e8107ea0 con 0x7f00e80f3c70 2021-01-28T03:51:22.942 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:22.939+0000 7f00cffff700 1 -- 172.21.15.162:0/3421307512 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) v1 ==== 35845+0+0 (secure 0 0 0) 0x7f00d8013620 con 0x7f00e80f3c70 2021-01-28T03:51:22.943 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:22.939+0000 7f00cffff700 1 --2- 172.21.15.162:0/3421307512 >> v2:172.21.15.100:6800/928846103 conn(0x7f00d002fcc0 0x7f00d0032180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:51:22.943 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:22.939+0000 7f00cffff700 1 -- 172.21.15.162:0/3421307512 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1012+0+0 (secure 0 0 0) 0x7f00d8041460 con 0x7f00e80f3c70 2021-01-28T03:51:22.943 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:22.939+0000 7f00edc56700 1 -- 172.21.15.162:0/3421307512 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e80581f0 con 0x7f00e80f3c70 2021-01-28T03:51:22.943 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:22.943+0000 7f00e6ffd700 1 --2- 172.21.15.162:0/3421307512 >> v2:172.21.15.100:6800/928846103 conn(0x7f00d002fcc0 0x7f00d0032180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:51:22.944 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:22.943+0000 7f00e6ffd700 1 --2- 172.21.15.162:0/3421307512 >> v2:172.21.15.100:6800/928846103 conn(0x7f00d002fcc0 0x7f00d0032180 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f00dc0096a0 tx=0x7f00dc006b40).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:51:22.950 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:22.951+0000 7f00cffff700 1 -- 172.21.15.162:0/3421307512 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f00d801b370 con 0x7f00e80f3c70 2021-01-28T03:51:23.171 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:23.171+0000 7f00edc56700 1 -- 172.21.15.162:0/3421307512 --> v2:172.21.15.100:6800/928846103 -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f00e80f8e10 con 0x7f00d002fcc0 2021-01-28T03:51:23.175 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:23.175+0000 7f00cffff700 1 -- 172.21.15.162:0/3421307512 <== mgr.14138 v2:172.21.15.100:6800/928846103 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+153 (secure 0 0 0) 0x7f00e80f8e10 con 0x7f00d002fcc0 2021-01-28T03:51:23.175 INFO:teuthology.orchestra.run.smithi162.stdout: 2021-01-28T03:51:23.175 INFO:teuthology.orchestra.run.smithi162.stdout:[{"addr": "smithi100", "hostname": "smithi100", "labels": [], "status": ""}, {"addr": "smithi162", "hostname": "smithi162", "labels": [], "status": ""}] 2021-01-28T03:51:23.178 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:23.179+0000 7f00edc56700 1 -- 172.21.15.162:0/3421307512 >> v2:172.21.15.100:6800/928846103 conn(0x7f00d002fcc0 msgr2=0x7f00d0032180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:51:23.178 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:23.179+0000 7f00edc56700 1 --2- 172.21.15.162:0/3421307512 >> v2:172.21.15.100:6800/928846103 conn(0x7f00d002fcc0 0x7f00d0032180 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f00dc0096a0 tx=0x7f00dc006b40).stop 2021-01-28T03:51:23.178 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:23.179+0000 7f00edc56700 1 -- 172.21.15.162:0/3421307512 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00e80f3c70 msgr2=0x7f00e8106ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:51:23.179 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:23.179+0000 7f00edc56700 1 --2- 172.21.15.162:0/3421307512 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00e80f3c70 0x7f00e8106ac0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f00d8000c00 tx=0x7f00d8009b30).stop 2021-01-28T03:51:23.179 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:23.179+0000 7f00edc56700 1 -- 172.21.15.162:0/3421307512 shutdown_connections 2021-01-28T03:51:23.179 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:23.179+0000 7f00edc56700 1 --2- 172.21.15.162:0/3421307512 >> v2:172.21.15.100:6800/928846103 conn(0x7f00d002fcc0 0x7f00d0032180 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:51:23.179 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:23.179+0000 7f00edc56700 1 --2- 172.21.15.162:0/3421307512 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00e80f3c70 0x7f00e8106ac0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:51:23.179 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:23.179+0000 7f00edc56700 1 -- 172.21.15.162:0/3421307512 >> 172.21.15.162:0/3421307512 conn(0x7f00e80ef3d0 msgr2=0x7f00e80f9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:51:23.180 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:23.179+0000 7f00edc56700 1 -- 172.21.15.162:0/3421307512 shutdown_connections 2021-01-28T03:51:23.180 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:23.179+0000 7f00edc56700 1 -- 172.21.15.162:0/3421307512 wait complete. 2021-01-28T03:51:23.885 INFO:tasks.cephadm:Setting crush tunables to default 2021-01-28T03:51:23.891 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph osd crush tunables default 2021-01-28T03:51:24.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:24 smithi100 bash[9834]: audit 2021-01-28T03:51:23.177509+0000 mgr.y (mgr.14138) 26 : audit [DBG] from='client.14158 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-01-28T03:51:24.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:24 smithi100 bash[9834]: cluster 2021-01-28T03:51:23.282111+0000 mgr.y (mgr.14138) 27 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:25.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:25 smithi100 bash[9834]: audit 2021-01-28T03:51:25.021543+0000 mon.a (mon.0) 120 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:51:26.714 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:26 smithi100 bash[9834]: cluster 2021-01-28T03:51:25.282462+0000 mgr.y (mgr.14138) 28 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:26.715 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:26 smithi100 bash[9834]: audit 2021-01-28T03:51:25.387965+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:51:26.715 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:26 smithi100 bash[9834]: cephadm 2021-01-28T03:51:25.388797+0000 mgr.y (mgr.14138) 29 : cephadm [INF] refreshing smithi162 facts 2021-01-28T03:51:26.715 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:26 smithi100 bash[9834]: audit 2021-01-28T03:51:25.853514+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:51:26.716 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:26 smithi100 bash[9834]: audit 2021-01-28T03:51:25.859731+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:51:26.916 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:26.918+0000 7f9caf59e700 1 -- 172.21.15.100:0/310043384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cb006aa10 msgr2=0x7f9cb0068fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:51:26.916 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:26.918+0000 7f9caf59e700 1 --2- 172.21.15.100:0/310043384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cb006aa10 0x7f9cb0068fb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f9ca4004d00 tx=0x7f9ca4009b30).stop 2021-01-28T03:51:26.917 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:26.918+0000 7f9caf59e700 1 -- 172.21.15.100:0/310043384 shutdown_connections 2021-01-28T03:51:26.917 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:26.918+0000 7f9caf59e700 1 --2- 172.21.15.100:0/310043384 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cb006aa10 0x7f9cb0068fb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:51:26.918 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:26.918+0000 7f9caf59e700 1 -- 172.21.15.100:0/310043384 >> 172.21.15.100:0/310043384 conn(0x7f9cb00f0bb0 msgr2=0x7f9cb00f2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:51:26.918 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:26.918+0000 7f9caf59e700 1 -- 172.21.15.100:0/310043384 shutdown_connections 2021-01-28T03:51:26.918 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:26.918+0000 7f9caf59e700 1 -- 172.21.15.100:0/310043384 wait complete. 2021-01-28T03:51:26.921 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:26.918+0000 7f9caf59e700 1 Processor -- start 2021-01-28T03:51:26.921 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:26.918+0000 7f9caf59e700 1 -- start start 2021-01-28T03:51:26.922 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:26.918+0000 7f9caf59e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cb006aa10 0x7f9cb010ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:51:26.922 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:26.918+0000 7f9caf59e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb010b240 con 0x7f9cb006aa10 2021-01-28T03:51:26.922 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:26.918+0000 7f9cae59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cb006aa10 0x7f9cb010ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:51:26.922 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:26.918+0000 7f9cae59c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cb006aa10 0x7f9cb010ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59042/0 (socket says 172.21.15.100:59042) 2021-01-28T03:51:26.923 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:26.918+0000 7f9cae59c700 1 -- 172.21.15.100:0/1037844277 learned_addr learned my addr 172.21.15.100:0/1037844277 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:51:26.923 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:26.918+0000 7f9cae59c700 1 -- 172.21.15.100:0/1037844277 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb010b380 con 0x7f9cb006aa10 2021-01-28T03:51:26.924 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:26.918+0000 7f9cae59c700 1 --2- 172.21.15.100:0/1037844277 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cb006aa10 0x7f9cb010ad50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f9ca4000c00 tx=0x7f9ca4009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:51:26.924 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:26.918+0000 7f9c9effd700 1 -- 172.21.15.100:0/1037844277 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ca400e030 con 0x7f9cb006aa10 2021-01-28T03:51:26.925 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:26.918+0000 7f9c9effd700 1 -- 172.21.15.100:0/1037844277 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f9ca40077b0 con 0x7f9cb006aa10 2021-01-28T03:51:26.925 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:26.918+0000 7f9caf59e700 1 -- 172.21.15.100:0/1037844277 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb010b5d0 con 0x7f9cb006aa10 2021-01-28T03:51:26.926 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:26.918+0000 7f9c9effd700 1 -- 172.21.15.100:0/1037844277 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ca4018070 con 0x7f9cb006aa10 2021-01-28T03:51:26.926 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:26.922+0000 7f9caf59e700 1 -- 172.21.15.100:0/1037844277 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb010c050 con 0x7f9cb006aa10 2021-01-28T03:51:26.926 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:26.922+0000 7f9caf59e700 1 -- 172.21.15.100:0/1037844277 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb00581f0 con 0x7f9cb006aa10 2021-01-28T03:51:26.926 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:26.922+0000 7f9c9effd700 1 -- 172.21.15.100:0/1037844277 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) v1 ==== 35845+0+0 (secure 0 0 0) 0x7f9ca401d820 con 0x7f9cb006aa10 2021-01-28T03:51:26.926 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:26.922+0000 7f9c9effd700 1 --2- 172.21.15.100:0/1037844277 >> v2:172.21.15.100:6800/928846103 conn(0x7f9c9802fd00 0x7f9c980321c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:51:26.927 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:26.922+0000 7f9c9effd700 1 -- 172.21.15.100:0/1037844277 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1012+0+0 (secure 0 0 0) 0x7f9ca4041400 con 0x7f9cb006aa10 2021-01-28T03:51:26.927 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:26.922+0000 7f9cadd9b700 1 --2- 172.21.15.100:0/1037844277 >> v2:172.21.15.100:6800/928846103 conn(0x7f9c9802fd00 0x7f9c980321c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:51:26.927 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:26.922+0000 7f9cadd9b700 1 --2- 172.21.15.100:0/1037844277 >> v2:172.21.15.100:6800/928846103 conn(0x7f9c9802fd00 0x7f9c980321c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f9ca00089e0 tx=0x7f9ca0006ec0).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:51:26.929 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:26.930+0000 7f9c9effd700 1 -- 172.21.15.100:0/1037844277 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f9ca401b370 con 0x7f9cb006aa10 2021-01-28T03:51:27.100 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:27.102+0000 7f9caf59e700 1 -- 172.21.15.100:0/1037844277 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f9cb00f8430 con 0x7f9cb006aa10 2021-01-28T03:51:27.486 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:27.486+0000 7f9c9effd700 1 -- 172.21.15.100:0/1037844277 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f9cb00f8430 con 0x7f9cb006aa10 2021-01-28T03:51:27.490 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:27.490+0000 7f9caf59e700 1 -- 172.21.15.100:0/1037844277 >> v2:172.21.15.100:6800/928846103 conn(0x7f9c9802fd00 msgr2=0x7f9c980321c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:51:27.491 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:27.490+0000 7f9caf59e700 1 --2- 172.21.15.100:0/1037844277 >> v2:172.21.15.100:6800/928846103 conn(0x7f9c9802fd00 0x7f9c980321c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f9ca00089e0 tx=0x7f9ca0006ec0).stop 2021-01-28T03:51:27.491 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:27.490+0000 7f9caf59e700 1 -- 172.21.15.100:0/1037844277 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cb006aa10 msgr2=0x7f9cb010ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:51:27.491 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:27.490+0000 7f9caf59e700 1 --2- 172.21.15.100:0/1037844277 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cb006aa10 0x7f9cb010ad50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f9ca4000c00 tx=0x7f9ca4009b30).stop 2021-01-28T03:51:27.491 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:27.494+0000 7f9caf59e700 1 -- 172.21.15.100:0/1037844277 shutdown_connections 2021-01-28T03:51:27.492 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:27.494+0000 7f9caf59e700 1 --2- 172.21.15.100:0/1037844277 >> v2:172.21.15.100:6800/928846103 conn(0x7f9c9802fd00 0x7f9c980321c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:51:27.492 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:27.494+0000 7f9caf59e700 1 --2- 172.21.15.100:0/1037844277 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cb006aa10 0x7f9cb010ad50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:51:27.492 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:27.494+0000 7f9caf59e700 1 -- 172.21.15.100:0/1037844277 >> 172.21.15.100:0/1037844277 conn(0x7f9cb00f0bb0 msgr2=0x7f9cb00f17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:51:27.492 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:27.494+0000 7f9caf59e700 1 -- 172.21.15.100:0/1037844277 shutdown_connections 2021-01-28T03:51:27.493 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:27.494+0000 7f9caf59e700 1 -- 172.21.15.100:0/1037844277 wait complete. 2021-01-28T03:51:27.493 INFO:teuthology.orchestra.run.smithi100.stderr:adjusted tunables profile to default 2021-01-28T03:51:27.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:27 smithi100 bash[9834]: audit 2021-01-28T03:51:27.104306+0000 mon.a (mon.0) 124 : audit [INF] from='client.? 172.21.15.100:0/1037844277' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2021-01-28T03:51:27.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:27 smithi100 bash[9834]: cluster 2021-01-28T03:51:27.282848+0000 mgr.y (mgr.14138) 30 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:28.195 INFO:tasks.cephadm:Adding mon.c on smithi100 2021-01-28T03:51:28.196 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph orch daemon add mon 'smithi100:[v2:172.21.15.100:3301,v1:172.21.15.100:6790]=c' 2021-01-28T03:51:28.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:28 smithi100 bash[9834]: audit 2021-01-28T03:51:27.490688+0000 mon.a (mon.0) 125 : audit [INF] from='client.? 172.21.15.100:0/1037844277' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2021-01-28T03:51:28.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:28 smithi100 bash[9834]: cluster 2021-01-28T03:51:27.490815+0000 mon.a (mon.0) 126 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2021-01-28T03:51:28.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:28 smithi100 bash[9834]: audit 2021-01-28T03:51:27.491536+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-01-28T03:51:29.682 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:29 smithi100 bash[9834]: audit 2021-01-28T03:51:28.496639+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2021-01-28T03:51:29.682 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:29 smithi100 bash[9834]: cluster 2021-01-28T03:51:28.496756+0000 mon.a (mon.0) 129 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2021-01-28T03:51:29.682 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:29 smithi100 bash[9834]: audit 2021-01-28T03:51:28.498202+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-01-28T03:51:29.682 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:29 smithi100 bash[9834]: cluster 2021-01-28T03:51:29.283401+0000 mgr.y (mgr.14138) 31 : cluster [DBG] pgmap v22: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:30.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:30 smithi100 bash[9834]: audit 2021-01-28T03:51:29.503452+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2021-01-28T03:51:30.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:30 smithi100 bash[9834]: cluster 2021-01-28T03:51:29.503591+0000 mon.a (mon.0) 132 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-01-28T03:51:31.292 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:31.294+0000 7f5736e53700 1 -- 172.21.15.100:0/4062883933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f573006aa10 msgr2=0x7f5730068fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:51:31.293 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:31.294+0000 7f5736e53700 1 --2- 172.21.15.100:0/4062883933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f573006aa10 0x7f5730068fb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f5720009cc0 tx=0x7f5720004d10).stop 2021-01-28T03:51:31.293 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:31.294+0000 7f5736e53700 1 -- 172.21.15.100:0/4062883933 shutdown_connections 2021-01-28T03:51:31.293 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:31.294+0000 7f5736e53700 1 --2- 172.21.15.100:0/4062883933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f573006aa10 0x7f5730068fb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:51:31.293 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:31.294+0000 7f5736e53700 1 -- 172.21.15.100:0/4062883933 >> 172.21.15.100:0/4062883933 conn(0x7f57300f0bb0 msgr2=0x7f57300f2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:51:31.294 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:31.294+0000 7f5736e53700 1 -- 172.21.15.100:0/4062883933 shutdown_connections 2021-01-28T03:51:31.294 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:31.294+0000 7f5736e53700 1 -- 172.21.15.100:0/4062883933 wait complete. 2021-01-28T03:51:31.294 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:31.294+0000 7f5736e53700 1 Processor -- start 2021-01-28T03:51:31.294 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:31.294+0000 7f5736e53700 1 -- start start 2021-01-28T03:51:31.295 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:31.294+0000 7f5736e53700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5730106970 0x7f5730106d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:51:31.296 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:31.294+0000 7f5736e53700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5730107280 con 0x7f5730106970 2021-01-28T03:51:31.296 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:31.294+0000 7f5735e51700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5730106970 0x7f5730106d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:51:31.296 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:31.294+0000 7f5735e51700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5730106970 0x7f5730106d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59048/0 (socket says 172.21.15.100:59048) 2021-01-28T03:51:31.296 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:31.294+0000 7f5735e51700 1 -- 172.21.15.100:0/313110935 learned_addr learned my addr 172.21.15.100:0/313110935 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:51:31.297 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:31.294+0000 7f5735e51700 1 -- 172.21.15.100:0/313110935 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57301073c0 con 0x7f5730106970 2021-01-28T03:51:31.297 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:31.294+0000 7f5735e51700 1 --2- 172.21.15.100:0/313110935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5730106970 0x7f5730106d90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f5720004a60 tx=0x7f5720004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:51:31.297 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:31.298+0000 7f572e7fc700 1 -- 172.21.15.100:0/313110935 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f572000e070 con 0x7f5730106970 2021-01-28T03:51:31.297 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:31.298+0000 7f5736e53700 1 -- 172.21.15.100:0/313110935 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5730107d90 con 0x7f5730106970 2021-01-28T03:51:31.298 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:31.298+0000 7f572e7fc700 1 -- 172.21.15.100:0/313110935 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f5720018040 con 0x7f5730106970 2021-01-28T03:51:31.298 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:31.298+0000 7f572e7fc700 1 -- 172.21.15.100:0/313110935 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5720017070 con 0x7f5730106970 2021-01-28T03:51:31.298 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:31.298+0000 7f5736e53700 1 -- 172.21.15.100:0/313110935 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57301081c0 con 0x7f5730106970 2021-01-28T03:51:31.299 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:31.298+0000 7f5717fff700 1 -- 172.21.15.100:0/313110935 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f570c004da0 con 0x7f5730106970 2021-01-28T03:51:31.299 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:31.298+0000 7f572e7fc700 1 -- 172.21.15.100:0/313110935 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) v1 ==== 35845+0+0 (secure 0 0 0) 0x7f5720013630 con 0x7f5730106970 2021-01-28T03:51:31.299 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:31.298+0000 7f572e7fc700 1 --2- 172.21.15.100:0/313110935 >> v2:172.21.15.100:6800/928846103 conn(0x7f571802fc20 0x7f57180320e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:51:31.300 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:31.298+0000 7f572e7fc700 1 -- 172.21.15.100:0/313110935 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1412+0+0 (secure 0 0 0) 0x7f5720041390 con 0x7f5730106970 2021-01-28T03:51:31.300 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:31.298+0000 7f5735650700 1 --2- 172.21.15.100:0/313110935 >> v2:172.21.15.100:6800/928846103 conn(0x7f571802fc20 0x7f57180320e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:51:31.300 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:31.298+0000 7f5735650700 1 --2- 172.21.15.100:0/313110935 >> v2:172.21.15.100:6800/928846103 conn(0x7f571802fc20 0x7f57180320e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f57240096a0 tx=0x7f5724006b40).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:51:31.302 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:31.302+0000 7f572e7fc700 1 -- 172.21.15.100:0/313110935 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f5720013cf0 con 0x7f5730106970 2021-01-28T03:51:31.494 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:31.494+0000 7f5717fff700 1 -- 172.21.15.100:0/313110935 --> v2:172.21.15.100:6800/928846103 -- mgr_command(tid 0: {"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi100:[v2:172.21.15.100:3301,v1:172.21.15.100:6790]=c", "target": ["mon-mgr", ""]}) v1 -- 0x7f570c000c70 con 0x7f571802fc20 2021-01-28T03:51:31.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:31 smithi100 bash[9834]: cluster 2021-01-28T03:51:31.283697+0000 mgr.y (mgr.14138) 32 : cluster [DBG] pgmap v24: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:32.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:32 smithi100 bash[9834]: audit 2021-01-28T03:51:31.500231+0000 mgr.y (mgr.14138) 33 : audit [DBG] from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi100:[v2:172.21.15.100:3301,v1:172.21.15.100:6790]=c", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:51:32.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:32 smithi100 bash[9834]: audit 2021-01-28T03:51:31.505663+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-28T03:51:32.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:32 smithi100 bash[9834]: audit 2021-01-28T03:51:31.508526+0000 mon.a (mon.0) 134 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:51:32.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:32 smithi100 bash[9834]: cephadm 2021-01-28T03:51:31.509855+0000 mgr.y (mgr.14138) 34 : cephadm [INF] Deploying daemon mon.c on smithi100 2021-01-28T03:51:32.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:32 smithi100 bash[9834]: audit 2021-01-28T03:51:31.510645+0000 mon.a (mon.0) 135 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2021-01-28T03:51:33.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:33 smithi100 bash[9834]: cluster 2021-01-28T03:51:33.284089+0000 mgr.y (mgr.14138) 35 : cluster [DBG] pgmap v25: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:36.040 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:36.042+0000 7f572e7fc700 1 -- 172.21.15.100:0/313110935 <== mgr.14138 v2:172.21.15.100:6800/928846103 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+35 (secure 0 0 0) 0x7f570c000c70 con 0x7f571802fc20 2021-01-28T03:51:36.041 INFO:teuthology.orchestra.run.smithi100.stdout:Deployed mon.c on host 'smithi100' 2021-01-28T03:51:36.042 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:36.042+0000 7f5717fff700 1 -- 172.21.15.100:0/313110935 >> v2:172.21.15.100:6800/928846103 conn(0x7f571802fc20 msgr2=0x7f57180320e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:51:36.042 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:36.042+0000 7f5717fff700 1 --2- 172.21.15.100:0/313110935 >> v2:172.21.15.100:6800/928846103 conn(0x7f571802fc20 0x7f57180320e0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f57240096a0 tx=0x7f5724006b40).stop 2021-01-28T03:51:36.043 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:36.042+0000 7f5717fff700 1 -- 172.21.15.100:0/313110935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5730106970 msgr2=0x7f5730106d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:51:36.043 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:36.042+0000 7f5717fff700 1 --2- 172.21.15.100:0/313110935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5730106970 0x7f5730106d90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f5720004a60 tx=0x7f5720004d10).stop 2021-01-28T03:51:36.043 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:36.042+0000 7f5717fff700 1 -- 172.21.15.100:0/313110935 shutdown_connections 2021-01-28T03:51:36.043 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:36.042+0000 7f5717fff700 1 --2- 172.21.15.100:0/313110935 >> v2:172.21.15.100:6800/928846103 conn(0x7f571802fc20 0x7f57180320e0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:51:36.043 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:36.042+0000 7f5717fff700 1 --2- 172.21.15.100:0/313110935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5730106970 0x7f5730106d90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:51:36.044 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:36.042+0000 7f5717fff700 1 -- 172.21.15.100:0/313110935 >> 172.21.15.100:0/313110935 conn(0x7f57300f0bb0 msgr2=0x7f57300f13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:51:36.044 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:36.042+0000 7f5717fff700 1 -- 172.21.15.100:0/313110935 shutdown_connections 2021-01-28T03:51:36.044 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:36.042+0000 7f5717fff700 1 -- 172.21.15.100:0/313110935 wait complete. 2021-01-28T03:51:36.567 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:36 smithi100 bash[9834]: cluster 2021-01-28T03:51:35.284689+0000 mgr.y (mgr.14138) 36 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:36.567 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:36 smithi100 bash[9834]: audit 2021-01-28T03:51:35.469428+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T03:51:36.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:36 smithi100 bash[9834]: audit 2021-01-28T03:51:35.481403+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T03:51:36.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:36 smithi100 bash[9834]: audit 2021-01-28T03:51:36.041664+0000 mon.a (mon.0) 138 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:51:36.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:36 smithi100 bash[9834]: audit 2021-01-28T03:51:36.043480+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:51:37.500 DEBUG:teuthology.orchestra.run.smithi100:mon.c> sudo journalctl -f -n 0 -u ceph-c217df96-611b-11eb-8f9e-001a4aab830c@mon.c.service 2021-01-28T03:51:37.504 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2021-01-28T03:51:37.504 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph mon dump -f json 2021-01-28T03:51:37.554 INFO:journalctl@ceph.mon.c.smithi100.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T03:51:37.750 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.710+0000 7f3c56289700 0 set uid:gid to 167:167 (ceph:ceph) 2021-01-28T03:51:37.751 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.710+0000 7f3c56289700 0 ceph version 17.0.0-184-g507028cb (507028cb839c25d6666833702df6325fd8569096) quincy (dev), process ceph-mon, pid 1 2021-01-28T03:51:37.751 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.710+0000 7f3c56289700 0 pidfile_write: ignore empty --pid-file 2021-01-28T03:51:37.751 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 0 load: jerasure load: lrc load: isa 2021-01-28T03:51:37.751 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: RocksDB version: 6.8.1 2021-01-28T03:51:37.751 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-01-28T03:51:37.752 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Compile date Jan 27 2021 2021-01-28T03:51:37.752 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: DB SUMMARY 2021-01-28T03:51:37.752 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: CURRENT file: CURRENT 2021-01-28T03:51:37.752 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: IDENTITY file: IDENTITY 2021-01-28T03:51:37.752 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2021-01-28T03:51:37.753 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2021-01-28T03:51:37.753 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000003.log size: 511 ; 2021-01-28T03:51:37.753 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.error_if_exists: 0 2021-01-28T03:51:37.753 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.create_if_missing: 0 2021-01-28T03:51:37.754 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.paranoid_checks: 1 2021-01-28T03:51:37.754 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.env: 0x55f470a7c1c0 2021-01-28T03:51:37.754 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.fs: Posix File System 2021-01-28T03:51:37.754 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.info_log: 0x55f4717f3e80 2021-01-28T03:51:37.754 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.max_file_opening_threads: 16 2021-01-28T03:51:37.755 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.statistics: (nil) 2021-01-28T03:51:37.755 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.use_fsync: 0 2021-01-28T03:51:37.755 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.max_log_file_size: 0 2021-01-28T03:51:37.755 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-01-28T03:51:37.755 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-01-28T03:51:37.756 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.keep_log_file_num: 1000 2021-01-28T03:51:37.756 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.recycle_log_file_num: 0 2021-01-28T03:51:37.758 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.allow_fallocate: 1 2021-01-28T03:51:37.758 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.allow_mmap_reads: 0 2021-01-28T03:51:37.758 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.allow_mmap_writes: 0 2021-01-28T03:51:37.758 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.use_direct_reads: 0 2021-01-28T03:51:37.759 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-01-28T03:51:37.759 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.create_missing_column_families: 0 2021-01-28T03:51:37.759 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.db_log_dir: 2021-01-28T03:51:37.759 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2021-01-28T03:51:37.759 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-01-28T03:51:37.760 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.max_subcompactions: 1 2021-01-28T03:51:37.760 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.max_background_flushes: -1 2021-01-28T03:51:37.760 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-01-28T03:51:37.760 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-01-28T03:51:37.760 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-01-28T03:51:37.761 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-01-28T03:51:37.761 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-01-28T03:51:37.761 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.advise_random_on_open: 1 2021-01-28T03:51:37.761 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.db_write_buffer_size: 0 2021-01-28T03:51:37.761 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.write_buffer_manager: 0x55f47184dc20 2021-01-28T03:51:37.762 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-01-28T03:51:37.762 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-01-28T03:51:37.762 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-01-28T03:51:37.762 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-01-28T03:51:37.762 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.rate_limiter: (nil) 2021-01-28T03:51:37.763 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-01-28T03:51:37.763 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.wal_recovery_mode: 2 2021-01-28T03:51:37.763 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.enable_thread_tracking: 0 2021-01-28T03:51:37.763 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.enable_pipelined_write: 0 2021-01-28T03:51:37.763 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.unordered_write: 0 2021-01-28T03:51:37.764 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-01-28T03:51:37.764 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-01-28T03:51:37.764 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-01-28T03:51:37.764 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-01-28T03:51:37.765 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.row_cache: None 2021-01-28T03:51:37.766 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.wal_filter: None 2021-01-28T03:51:37.766 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-01-28T03:51:37.766 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.allow_ingest_behind: 0 2021-01-28T03:51:37.766 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.preserve_deletes: 0 2021-01-28T03:51:37.766 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.two_write_queues: 0 2021-01-28T03:51:37.767 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.manual_wal_flush: 0 2021-01-28T03:51:37.767 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.atomic_flush: 0 2021-01-28T03:51:37.767 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-01-28T03:51:37.767 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-01-28T03:51:37.767 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-01-28T03:51:37.768 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.log_readahead_size: 0 2021-01-28T03:51:37.768 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-01-28T03:51:37.768 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.max_background_jobs: 2 2021-01-28T03:51:37.768 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.max_background_compactions: -1 2021-01-28T03:51:37.768 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-01-28T03:51:37.769 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-01-28T03:51:37.769 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-01-28T03:51:37.769 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.max_total_wal_size: 0 2021-01-28T03:51:37.769 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-01-28T03:51:37.769 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-01-28T03:51:37.770 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-01-28T03:51:37.770 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-01-28T03:51:37.770 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.max_open_files: -1 2021-01-28T03:51:37.770 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.bytes_per_sync: 0 2021-01-28T03:51:37.770 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-01-28T03:51:37.771 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-01-28T03:51:37.771 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.compaction_readahead_size: 0 2021-01-28T03:51:37.771 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Compression algorithms supported: 2021-01-28T03:51:37.771 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-01-28T03:51:37.771 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: kZSTD supported: 0 2021-01-28T03:51:37.772 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: kXpressCompression supported: 0 2021-01-28T03:51:37.772 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: kLZ4HCCompression supported: 1 2021-01-28T03:51:37.772 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: kLZ4Compression supported: 1 2021-01-28T03:51:37.772 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: kBZip2Compression supported: 0 2021-01-28T03:51:37.772 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: kZlibCompression supported: 1 2021-01-28T03:51:37.773 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: kSnappyCompression supported: 1 2021-01-28T03:51:37.773 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-01-28T03:51:37.773 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000001 2021-01-28T03:51:37.774 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-01-28T03:51:37.774 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-01-28T03:51:37.774 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.merge_operator: 2021-01-28T03:51:37.774 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.compaction_filter: None 2021-01-28T03:51:37.775 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.compaction_filter_factory: None 2021-01-28T03:51:37.775 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-01-28T03:51:37.776 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-01-28T03:51:37.776 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f47179c1e0) 2021-01-28T03:51:37.776 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: cache_index_and_filter_blocks: 1 2021-01-28T03:51:37.776 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: cache_index_and_filter_blocks_with_high_priority: 0 2021-01-28T03:51:37.776 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-01-28T03:51:37.777 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: pin_top_level_index_and_filter: 1 2021-01-28T03:51:37.777 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: index_type: 0 2021-01-28T03:51:37.777 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: data_block_index_type: 0 2021-01-28T03:51:37.777 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: index_shortening: 1 2021-01-28T03:51:37.777 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: data_block_hash_table_util_ratio: 0.750000 2021-01-28T03:51:37.778 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: hash_index_allow_collision: 1 2021-01-28T03:51:37.778 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: checksum: 1 2021-01-28T03:51:37.778 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: no_block_cache: 0 2021-01-28T03:51:37.778 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: block_cache: 0x55f4717d4510 2021-01-28T03:51:37.779 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: block_cache_name: BinnedLRUCache 2021-01-28T03:51:37.779 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: block_cache_options: 2021-01-28T03:51:37.779 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: capacity : 536870912 2021-01-28T03:51:37.779 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: num_shard_bits : 4 2021-01-28T03:51:37.779 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: strict_capacity_limit : 0 2021-01-28T03:51:37.780 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: high_pri_pool_ratio: 0.000 2021-01-28T03:51:37.780 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: block_cache_compressed: (nil) 2021-01-28T03:51:37.780 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: persistent_cache: (nil) 2021-01-28T03:51:37.780 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: block_size: 4096 2021-01-28T03:51:37.780 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: block_size_deviation: 10 2021-01-28T03:51:37.781 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: block_restart_interval: 16 2021-01-28T03:51:37.781 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: index_block_restart_interval: 1 2021-01-28T03:51:37.781 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: metadata_block_size: 4096 2021-01-28T03:51:37.781 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: partition_filters: 0 2021-01-28T03:51:37.781 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: use_delta_encoding: 1 2021-01-28T03:51:37.781 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: filter_policy: rocksdb.BuiltinBloomFilter 2021-01-28T03:51:37.782 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: whole_key_filtering: 1 2021-01-28T03:51:37.782 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: verify_compression: 0 2021-01-28T03:51:37.782 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: read_amp_bytes_per_bit: 0 2021-01-28T03:51:37.782 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: format_version: 2 2021-01-28T03:51:37.783 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: enable_index_compression: 1 2021-01-28T03:51:37.783 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: block_align: 0 2021-01-28T03:51:37.783 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.write_buffer_size: 33554432 2021-01-28T03:51:37.783 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.max_write_buffer_number: 2 2021-01-28T03:51:37.783 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.compression: NoCompression 2021-01-28T03:51:37.783 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.bottommost_compression: Disabled 2021-01-28T03:51:37.784 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.prefix_extractor: nullptr 2021-01-28T03:51:37.784 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-01-28T03:51:37.785 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.num_levels: 7 2021-01-28T03:51:37.785 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-01-28T03:51:37.785 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-01-28T03:51:37.785 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-01-28T03:51:37.785 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-01-28T03:51:37.786 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-01-28T03:51:37.786 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-01-28T03:51:37.787 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-01-28T03:51:37.787 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-01-28T03:51:37.787 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-01-28T03:51:37.787 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-01-28T03:51:37.788 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.compression_opts.level: 32767 2021-01-28T03:51:37.788 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.compression_opts.strategy: 0 2021-01-28T03:51:37.788 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-01-28T03:51:37.788 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-01-28T03:51:37.788 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.compression_opts.enabled: false 2021-01-28T03:51:37.789 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-01-28T03:51:37.789 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-01-28T03:51:37.789 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-01-28T03:51:37.789 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.target_file_size_base: 67108864 2021-01-28T03:51:37.789 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-01-28T03:51:37.790 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-01-28T03:51:37.790 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-01-28T03:51:37.790 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-01-28T03:51:37.790 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-01-28T03:51:37.790 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-01-28T03:51:37.791 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-01-28T03:51:37.791 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-01-28T03:51:37.791 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-01-28T03:51:37.791 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-01-28T03:51:37.791 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-01-28T03:51:37.792 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-01-28T03:51:37.792 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-01-28T03:51:37.792 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.arena_block_size: 4194304 2021-01-28T03:51:37.792 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-01-28T03:51:37.792 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-01-28T03:51:37.793 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-01-28T03:51:37.793 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.disable_auto_compactions: 0 2021-01-28T03:51:37.793 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-01-28T03:51:37.793 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-01-28T03:51:37.793 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-01-28T03:51:37.794 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-01-28T03:51:37.794 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-01-28T03:51:37.794 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-01-28T03:51:37.795 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-01-28T03:51:37.795 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-01-28T03:51:37.795 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-01-28T03:51:37.796 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-01-28T03:51:37.796 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.714+0000 7f3c56289700 4 rocksdb: Options.table_properties_collectors: 2021-01-28T03:51:37.797 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.718+0000 7f3c56289700 4 rocksdb: Options.inplace_update_support: 0 2021-01-28T03:51:37.797 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.718+0000 7f3c56289700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-01-28T03:51:37.797 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.718+0000 7f3c56289700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-01-28T03:51:37.797 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.718+0000 7f3c56289700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-01-28T03:51:37.797 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.718+0000 7f3c56289700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-01-28T03:51:37.798 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.718+0000 7f3c56289700 4 rocksdb: Options.bloom_locality: 0 2021-01-28T03:51:37.798 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.718+0000 7f3c56289700 4 rocksdb: Options.max_successive_merges: 0 2021-01-28T03:51:37.798 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.718+0000 7f3c56289700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-01-28T03:51:37.798 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.718+0000 7f3c56289700 4 rocksdb: Options.paranoid_file_checks: 0 2021-01-28T03:51:37.798 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.718+0000 7f3c56289700 4 rocksdb: Options.force_consistency_checks: 0 2021-01-28T03:51:37.799 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.718+0000 7f3c56289700 4 rocksdb: Options.report_bg_io_stats: 0 2021-01-28T03:51:37.799 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.718+0000 7f3c56289700 4 rocksdb: Options.ttl: 2592000 2021-01-28T03:51:37.799 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.718+0000 7f3c56289700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-01-28T03:51:37.800 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.718+0000 7f3c56289700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-01-28T03:51:37.800 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.718+0000 7f3c56289700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2021-01-28T03:51:37.800 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.718+0000 7f3c56289700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611805897722695, "job": 1, "event": "recovery_started", "log_files": [3]} 2021-01-28T03:51:37.800 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.718+0000 7f3c56289700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #3 mode 2 2021-01-28T03:51:37.800 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.718+0000 7f3c56289700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-01-28T03:51:37.801 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.722+0000 7f3c56289700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611805897723390, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1437, "table_properties": {"data_size": 523, "index_size": 40, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1611805897, "oldest_key_time": 3, "file_creation_time": 0}} 2021-01-28T03:51:37.801 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.722+0000 7f3c56289700 4 rocksdb: [version_set.cc:3826] Creating manifest 5 2021-01-28T03:51:37.801 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.722+0000 7f3c56289700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611805897723964, "job": 1, "event": "recovery_finished"} 2021-01-28T03:51:37.801 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.722+0000 7f3c56289700 4 rocksdb: DB pointer 0x55f471893800 2021-01-28T03:51:37.802 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.722+0000 7f3c3d0aa700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-01-28T03:51:37.802 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.722+0000 7f3c3d0aa700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-01-28T03:51:37.802 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: ** DB Stats ** 2021-01-28T03:51:37.802 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-28T03:51:37.803 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-01-28T03:51:37.803 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-01-28T03:51:37.803 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-28T03:51:37.803 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-01-28T03:51:37.803 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-01-28T03:51:37.804 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-28T03:51:37.804 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: ** Compaction Stats [default] ** 2021-01-28T03:51:37.804 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-28T03:51:37.805 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-28T03:51:37.805 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.2 0.00 0.00 1 0.001 0 0 2021-01-28T03:51:37.806 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.2 0.00 0.00 1 0.001 0 0 2021-01-28T03:51:37.806 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.2 0.00 0.00 1 0.001 0 0 2021-01-28T03:51:37.806 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: ** Compaction Stats [default] ** 2021-01-28T03:51:37.806 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-28T03:51:37.807 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-28T03:51:37.807 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.2 0.00 0.00 1 0.001 0 0 2021-01-28T03:51:37.808 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-28T03:51:37.808 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: Flush(GB): cumulative 0.000, interval 0.000 2021-01-28T03:51:37.808 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-28T03:51:37.808 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: AddFile(Total Files): cumulative 0, interval 0 2021-01-28T03:51:37.808 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: AddFile(L0 Files): cumulative 0, interval 0 2021-01-28T03:51:37.809 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: AddFile(Keys): cumulative 0, interval 0 2021-01-28T03:51:37.809 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: Cumulative compaction: 0.00 GB write, 0.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-28T03:51:37.809 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: Interval compaction: 0.00 GB write, 0.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-28T03:51:37.809 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-28T03:51:37.809 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: ** File Read Latency Histogram By Level [default] ** 2021-01-28T03:51:37.810 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: ** Compaction Stats [default] ** 2021-01-28T03:51:37.810 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-28T03:51:37.810 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-28T03:51:37.810 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.2 0.00 0.00 1 0.001 0 0 2021-01-28T03:51:37.810 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.2 0.00 0.00 1 0.001 0 0 2021-01-28T03:51:37.811 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-01-28T03:51:37.811 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: ** Compaction Stats [default] ** 2021-01-28T03:51:37.811 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-28T03:51:37.811 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-28T03:51:37.811 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.2 0.00 0.00 1 0.001 0 0 2021-01-28T03:51:37.812 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-28T03:51:37.812 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: Flush(GB): cumulative 0.000, interval 0.000 2021-01-28T03:51:37.812 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-28T03:51:37.812 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: AddFile(Total Files): cumulative 0, interval 0 2021-01-28T03:51:37.812 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: AddFile(L0 Files): cumulative 0, interval 0 2021-01-28T03:51:37.813 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: AddFile(Keys): cumulative 0, interval 0 2021-01-28T03:51:37.813 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: Cumulative compaction: 0.00 GB write, 0.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-28T03:51:37.813 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-28T03:51:37.813 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-28T03:51:37.813 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: ** File Read Latency Histogram By Level [default] ** 2021-01-28T03:51:37.814 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.722+0000 7f3c56289700 0 mon.c does not exist in monmap, will attempt to join an existing cluster 2021-01-28T03:51:37.814 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.722+0000 7f3c56289700 0 using public_addrv [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] 2021-01-28T03:51:37.814 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.722+0000 7f3c56289700 0 starting mon.c rank -1 at public addrs [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] at bind addrs [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid c217df96-611b-11eb-8f9e-001a4aab830c 2021-01-28T03:51:37.814 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.726+0000 7f3c56289700 1 mon.c@-1(???) e0 preinit fsid c217df96-611b-11eb-8f9e-001a4aab830c 2021-01-28T03:51:37.814 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.746+0000 7f3c3f8af700 0 mon.c@-1(synchronizing).mds e1 new map 2021-01-28T03:51:37.815 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.746+0000 7f3c3f8af700 0 mon.c@-1(synchronizing).mds e1 print_map 2021-01-28T03:51:37.815 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: e1 2021-01-28T03:51:37.816 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: enable_multiple, ever_enabled_multiple: 1,1 2021-01-28T03:51:37.816 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-01-28T03:51:37.816 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: legacy client fscid: -1 2021-01-28T03:51:37.816 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: 2021-01-28T03:51:37.816 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: No filesystems configured 2021-01-28T03:51:37.817 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.746+0000 7f3c3f8af700 1 mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2021-01-28T03:51:37.817 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.746+0000 7f3c3f8af700 1 mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2021-01-28T03:51:37.817 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.746+0000 7f3c3f8af700 1 mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2021-01-28T03:51:37.817 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.746+0000 7f3c3f8af700 1 mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2021-01-28T03:51:37.817 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.746+0000 7f3c3f8af700 1 mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2021-01-28T03:51:37.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.746+0000 7f3c3f8af700 1 mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2021-01-28T03:51:37.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.746+0000 7f3c3f8af700 1 mon.c@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2021-01-28T03:51:37.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.746+0000 7f3c3f8af700 1 mon.c@-1(synchronizing).osd e6 e6: 0 total, 0 up, 0 in 2021-01-28T03:51:37.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.746+0000 7f3c3f8af700 0 mon.c@-1(synchronizing).osd e6 crush map has features 3314933000852226048, adjusting msgr requires 2021-01-28T03:51:37.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.746+0000 7f3c3f8af700 0 mon.c@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-01-28T03:51:37.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.746+0000 7f3c3f8af700 0 mon.c@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-01-28T03:51:37.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.746+0000 7f3c3f8af700 0 mon.c@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-01-28T03:51:37.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: cluster 2021-01-28T03:51:35.284689+0000 mgr.y (mgr.14138) 36 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:37.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: audit 2021-01-28T03:51:35.469428+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T03:51:37.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: audit 2021-01-28T03:51:35.481403+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T03:51:37.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: audit 2021-01-28T03:51:36.041664+0000 mon.a (mon.0) 138 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:51:37.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: audit 2021-01-28T03:51:36.043480+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:51:37.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.750+0000 7f3c3f8af700 1 mon.c@-1(synchronizing).paxosservice(auth 1..4) refresh upgraded, format 0 -> 3 2021-01-28T03:51:37.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.750+0000 7f3c3f8af700 20 expand_channel_meta expand map: {default=false} 2021-01-28T03:51:37.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.750+0000 7f3c3f8af700 20 expand_channel_meta from 'false' to 'false' 2021-01-28T03:51:37.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.750+0000 7f3c3f8af700 20 expand_channel_meta expanded map: {default=false} 2021-01-28T03:51:37.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.750+0000 7f3c3f8af700 20 expand_channel_meta expand map: {default=info} 2021-01-28T03:51:37.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.750+0000 7f3c3f8af700 20 expand_channel_meta from 'info' to 'info' 2021-01-28T03:51:37.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.750+0000 7f3c3f8af700 20 expand_channel_meta expanded map: {default=info} 2021-01-28T03:51:37.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.750+0000 7f3c3f8af700 20 expand_channel_meta expand map: {default=daemon} 2021-01-28T03:51:37.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.750+0000 7f3c3f8af700 20 expand_channel_meta from 'daemon' to 'daemon' 2021-01-28T03:51:37.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.750+0000 7f3c3f8af700 20 expand_channel_meta expanded map: {default=daemon} 2021-01-28T03:51:37.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.750+0000 7f3c3f8af700 20 expand_channel_meta expand map: {default=debug} 2021-01-28T03:51:37.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.750+0000 7f3c3f8af700 20 expand_channel_meta from 'debug' to 'debug' 2021-01-28T03:51:37.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.750+0000 7f3c3f8af700 20 expand_channel_meta expanded map: {default=debug} 2021-01-28T03:51:37.823 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:37 smithi100 bash[13549]: debug 2021-01-28T03:51:37.750+0000 7f3c3f8af700 10 mon.c@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2021-01-28T03:51:43.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:42 smithi100 bash[9834]: cluster 2021-01-28T03:51:37.761884+0000 mon.a (mon.0) 143 : cluster [INF] mon.a calling monitor election 2021-01-28T03:51:43.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:42 smithi100 bash[9834]: audit 2021-01-28T03:51:38.757322+0000 mon.a (mon.0) 144 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-28T03:51:43.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:42 smithi100 bash[9834]: cluster 2021-01-28T03:51:39.285763+0000 mgr.y (mgr.14138) 38 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:43.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:42 smithi100 bash[9834]: audit 2021-01-28T03:51:39.757631+0000 mon.a (mon.0) 145 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-28T03:51:43.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:42 smithi100 bash[9834]: cluster 2021-01-28T03:51:39.760233+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-01-28T03:51:43.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:42 smithi100 bash[9834]: audit 2021-01-28T03:51:40.759719+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-28T03:51:43.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:42 smithi100 bash[9834]: cluster 2021-01-28T03:51:41.286269+0000 mgr.y (mgr.14138) 39 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:43.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:42 smithi100 bash[9834]: audit 2021-01-28T03:51:41.757769+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-28T03:51:43.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:42 smithi100 bash[9834]: audit 2021-01-28T03:51:42.757860+0000 mon.a (mon.0) 148 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-28T03:51:43.326 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:42 smithi100 bash[9834]: cluster 2021-01-28T03:51:42.784957+0000 mon.a (mon.0) 149 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-01-28T03:51:43.326 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:42 smithi100 bash[9834]: cluster 2021-01-28T03:51:42.790572+0000 mon.a (mon.0) 150 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0],c=[v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0]} 2021-01-28T03:51:43.326 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:42 smithi100 bash[9834]: cluster 2021-01-28T03:51:42.790683+0000 mon.a (mon.0) 151 : cluster [DBG] fsmap 2021-01-28T03:51:43.326 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:42 smithi100 bash[9834]: cluster 2021-01-28T03:51:42.790741+0000 mon.a (mon.0) 152 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-01-28T03:51:43.327 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:42 smithi100 bash[9834]: cluster 2021-01-28T03:51:42.791311+0000 mon.a (mon.0) 153 : cluster [DBG] mgrmap e13: y(active, since 67s) 2021-01-28T03:51:43.327 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:42 smithi100 bash[9834]: cluster 2021-01-28T03:51:42.796717+0000 mon.a (mon.0) 154 : cluster [INF] overall HEALTH_OK 2021-01-28T03:51:43.327 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:42 smithi100 bash[13549]: cluster 2021-01-28T03:51:37.761884+0000 mon.a (mon.0) 143 : cluster [INF] mon.a calling monitor election 2021-01-28T03:51:43.327 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:42 smithi100 bash[13549]: audit 2021-01-28T03:51:38.757322+0000 mon.a (mon.0) 144 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-28T03:51:43.328 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:42 smithi100 bash[13549]: cluster 2021-01-28T03:51:39.285763+0000 mgr.y (mgr.14138) 38 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:43.328 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:42 smithi100 bash[13549]: audit 2021-01-28T03:51:39.757631+0000 mon.a (mon.0) 145 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-28T03:51:43.328 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:42 smithi100 bash[13549]: cluster 2021-01-28T03:51:39.760233+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-01-28T03:51:43.328 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:42 smithi100 bash[13549]: audit 2021-01-28T03:51:40.759719+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-28T03:51:43.328 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:42 smithi100 bash[13549]: cluster 2021-01-28T03:51:41.286269+0000 mgr.y (mgr.14138) 39 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:43.329 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:42 smithi100 bash[13549]: audit 2021-01-28T03:51:41.757769+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-28T03:51:43.329 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:42 smithi100 bash[13549]: audit 2021-01-28T03:51:42.757860+0000 mon.a (mon.0) 148 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-28T03:51:43.329 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:42 smithi100 bash[13549]: cluster 2021-01-28T03:51:42.784957+0000 mon.a (mon.0) 149 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-01-28T03:51:43.329 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:42 smithi100 bash[13549]: cluster 2021-01-28T03:51:42.790572+0000 mon.a (mon.0) 150 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0],c=[v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0]} 2021-01-28T03:51:43.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:42 smithi100 bash[13549]: cluster 2021-01-28T03:51:42.790683+0000 mon.a (mon.0) 151 : cluster [DBG] fsmap 2021-01-28T03:51:43.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:42 smithi100 bash[13549]: cluster 2021-01-28T03:51:42.790741+0000 mon.a (mon.0) 152 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-01-28T03:51:43.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:42 smithi100 bash[13549]: cluster 2021-01-28T03:51:42.791311+0000 mon.a (mon.0) 153 : cluster [DBG] mgrmap e13: y(active, since 67s) 2021-01-28T03:51:43.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:42 smithi100 bash[13549]: cluster 2021-01-28T03:51:42.796717+0000 mon.a (mon.0) 154 : cluster [INF] overall HEALTH_OK 2021-01-28T03:51:43.896 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.898+0000 7fceaad5a700 1 -- 172.21.15.100:0/656530061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce90003250 msgr2=0x7fce900056c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:51:43.897 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.898+0000 7fceaad5a700 1 --2- 172.21.15.100:0/656530061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce90003250 0x7fce900056c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fcea40f61e0 tx=0x7fce9400b040).stop 2021-01-28T03:51:43.897 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.898+0000 7fceaad5a700 1 -- 172.21.15.100:0/656530061 shutdown_connections 2021-01-28T03:51:43.897 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.898+0000 7fceaad5a700 1 --2- 172.21.15.100:0/656530061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce90003250 0x7fce900056c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:51:43.897 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.898+0000 7fceaad5a700 1 -- 172.21.15.100:0/656530061 >> 172.21.15.100:0/656530061 conn(0x7fcea40f0bb0 msgr2=0x7fcea40f2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:51:43.897 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.898+0000 7fceaad5a700 1 -- 172.21.15.100:0/656530061 shutdown_connections 2021-01-28T03:51:43.898 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.898+0000 7fceaad5a700 1 -- 172.21.15.100:0/656530061 wait complete. 2021-01-28T03:51:43.899 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.898+0000 7fceaad5a700 1 Processor -- start 2021-01-28T03:51:43.899 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.898+0000 7fceaad5a700 1 -- start start 2021-01-28T03:51:43.899 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.902+0000 7fceaad5a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce90003250 0x7fcea41047b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:51:43.899 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.902+0000 7fceaad5a700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcea4104ca0 0x7fcea4105b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:51:43.900 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.902+0000 7fceaad5a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea4105200 con 0x7fce90003250 2021-01-28T03:51:43.900 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.902+0000 7fceaad5a700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea4105340 con 0x7fcea4104ca0 2021-01-28T03:51:43.900 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.902+0000 7fcea9d58700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce90003250 0x7fcea41047b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:51:43.900 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.902+0000 7fcea9d58700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce90003250 0x7fcea41047b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59080/0 (socket says 172.21.15.100:59080) 2021-01-28T03:51:43.900 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.902+0000 7fcea9d58700 1 -- 172.21.15.100:0/965853600 learned_addr learned my addr 172.21.15.100:0/965853600 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:51:43.901 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.902+0000 7fcea9557700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcea4104ca0 0x7fcea4105b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:51:43.902 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.902+0000 7fcea9557700 1 -- 172.21.15.100:0/965853600 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcea4104ca0 msgr2=0x7fcea4105b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2021-01-28T03:51:43.902 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.902+0000 7fcea9557700 1 -- 172.21.15.100:0/965853600 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcea4104ca0 msgr2=0x7fcea4105b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-01-28T03:51:43.902 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.902+0000 7fcea9557700 1 --2- 172.21.15.100:0/965853600 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcea4104ca0 0x7fcea4105b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-01-28T03:51:43.903 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.902+0000 7fcea9557700 1 --2- 172.21.15.100:0/965853600 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcea4104ca0 0x7fcea4105b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-01-28T03:51:43.903 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.902+0000 7fcea9d58700 1 -- 172.21.15.100:0/965853600 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcea4104ca0 msgr2=0x7fcea4105b90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-01-28T03:51:43.903 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.902+0000 7fcea9d58700 1 --2- 172.21.15.100:0/965853600 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcea4104ca0 0x7fcea4105b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:51:43.903 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.902+0000 7fcea9d58700 1 -- 172.21.15.100:0/965853600 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea4106080 con 0x7fce90003250 2021-01-28T03:51:43.903 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.902+0000 7fcea9d58700 1 --2- 172.21.15.100:0/965853600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce90003250 0x7fcea41047b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fce940045a0 tx=0x7fce9400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:51:43.904 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.902+0000 7fce9a7fc700 1 -- 172.21.15.100:0/965853600 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fce940207d0 con 0x7fce90003250 2021-01-28T03:51:43.904 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.902+0000 7fce9a7fc700 1 -- 172.21.15.100:0/965853600 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fce94020d90 con 0x7fce90003250 2021-01-28T03:51:43.904 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.902+0000 7fceaad5a700 1 -- 172.21.15.100:0/965853600 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcea41062d0 con 0x7fce90003250 2021-01-28T03:51:43.904 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.902+0000 7fce9a7fc700 1 -- 172.21.15.100:0/965853600 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fce9401fae0 con 0x7fce90003250 2021-01-28T03:51:43.905 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.902+0000 7fceaad5a700 1 -- 172.21.15.100:0/965853600 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcea4106890 con 0x7fce90003250 2021-01-28T03:51:43.905 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.906+0000 7fce9a7fc700 1 -- 172.21.15.100:0/965853600 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) v1 ==== 35845+0+0 (secure 0 0 0) 0x7fce94029410 con 0x7fce90003250 2021-01-28T03:51:43.906 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.906+0000 7fce9a7fc700 1 --2- 172.21.15.100:0/965853600 >> v2:172.21.15.100:6800/928846103 conn(0x7fce8802fdc0 0x7fce88032280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:51:43.906 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.906+0000 7fceaad5a700 1 -- 172.21.15.100:0/965853600 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcea40581f0 con 0x7fce90003250 2021-01-28T03:51:43.906 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.906+0000 7fce9a7fc700 1 -- 172.21.15.100:0/965853600 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1412+0+0 (secure 0 0 0) 0x7fce94042250 con 0x7fce90003250 2021-01-28T03:51:43.906 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.906+0000 7fcea9557700 1 --2- 172.21.15.100:0/965853600 >> v2:172.21.15.100:6800/928846103 conn(0x7fce8802fdc0 0x7fce88032280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:51:43.907 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.906+0000 7fcea9557700 1 --2- 172.21.15.100:0/965853600 >> v2:172.21.15.100:6800/928846103 conn(0x7fce8802fdc0 0x7fce88032280 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fcea0006c30 tx=0x7fcea0008040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:51:43.911 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:43.914+0000 7fce9a7fc700 1 -- 172.21.15.100:0/965853600 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fce940302f0 con 0x7fce90003250 2021-01-28T03:51:44.138 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:44.138+0000 7fceaad5a700 1 -- 172.21.15.100:0/965853600 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fcea40f7f90 con 0x7fce90003250 2021-01-28T03:51:44.139 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:44.142+0000 7fce9a7fc700 1 -- 172.21.15.100:0/965853600 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+955 (secure 0 0 0) 0x7fce94024030 con 0x7fce90003250 2021-01-28T03:51:44.139 INFO:teuthology.orchestra.run.smithi100.stdout: 2021-01-28T03:51:44.139 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":2,"fsid":"c217df96-611b-11eb-8f9e-001a4aab830c","modified":"2021-01-28T03:51:37.758067Z","created":"2021-01-28T03:49:38.774756Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3301","nonce":0},{"type":"v1","addr":"172.21.15.100:6790","nonce":0}]},"addr":"172.21.15.100:6790/0","public_addr":"172.21.15.100:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2021-01-28T03:51:44.140 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:44.142+0000 7fceaad5a700 1 -- 172.21.15.100:0/965853600 >> v2:172.21.15.100:6800/928846103 conn(0x7fce8802fdc0 msgr2=0x7fce88032280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:51:44.141 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:44.142+0000 7fceaad5a700 1 --2- 172.21.15.100:0/965853600 >> v2:172.21.15.100:6800/928846103 conn(0x7fce8802fdc0 0x7fce88032280 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fcea0006c30 tx=0x7fcea0008040).stop 2021-01-28T03:51:44.141 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:44.142+0000 7fceaad5a700 1 -- 172.21.15.100:0/965853600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce90003250 msgr2=0x7fcea41047b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:51:44.141 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:44.142+0000 7fceaad5a700 1 --2- 172.21.15.100:0/965853600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce90003250 0x7fcea41047b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fce940045a0 tx=0x7fce9400b040).stop 2021-01-28T03:51:44.141 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:44.142+0000 7fceaad5a700 1 -- 172.21.15.100:0/965853600 shutdown_connections 2021-01-28T03:51:44.142 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:44.142+0000 7fceaad5a700 1 --2- 172.21.15.100:0/965853600 >> v2:172.21.15.100:6800/928846103 conn(0x7fce8802fdc0 0x7fce88032280 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:51:44.142 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:44.142+0000 7fceaad5a700 1 --2- 172.21.15.100:0/965853600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce90003250 0x7fcea41047b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:51:44.142 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:44.142+0000 7fceaad5a700 1 --2- 172.21.15.100:0/965853600 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcea4104ca0 0x7fcea4105b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:51:44.142 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:44.142+0000 7fceaad5a700 1 -- 172.21.15.100:0/965853600 >> 172.21.15.100:0/965853600 conn(0x7fcea40f0bb0 msgr2=0x7fcea40f9090 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:51:44.143 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:44.142+0000 7fceaad5a700 1 -- 172.21.15.100:0/965853600 shutdown_connections 2021-01-28T03:51:44.143 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:51:44.142+0000 7fceaad5a700 1 -- 172.21.15.100:0/965853600 wait complete. 2021-01-28T03:51:44.143 INFO:teuthology.orchestra.run.smithi100.stderr:dumped monmap epoch 2 2021-01-28T03:51:44.196 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:43 smithi100 bash[13549]: cluster 2021-01-28T03:51:43.286748+0000 mgr.y (mgr.14138) 40 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:44.196 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:43 smithi100 bash[13549]: audit 2021-01-28T03:51:43.758131+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-28T03:51:44.196 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:43 smithi100 bash[9834]: cluster 2021-01-28T03:51:43.286748+0000 mgr.y (mgr.14138) 40 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:44.197 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:43 smithi100 bash[9834]: audit 2021-01-28T03:51:43.758131+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-28T03:51:44.876 INFO:tasks.cephadm:Adding mon.b on smithi162 2021-01-28T03:51:44.878 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph orch daemon add mon smithi162:172.21.15.162=b 2021-01-28T03:51:45.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:44 smithi100 bash[9834]: audit 2021-01-28T03:51:44.143494+0000 mon.a (mon.0) 156 : audit [DBG] from='client.? 172.21.15.100:0/965853600' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-01-28T03:51:45.322 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:44 smithi100 bash[13549]: audit 2021-01-28T03:51:44.143494+0000 mon.a (mon.0) 156 : audit [DBG] from='client.? 172.21.15.100:0/965853600' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-01-28T03:51:46.321 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:45 smithi100 bash[9834]: cluster 2021-01-28T03:51:45.287182+0000 mgr.y (mgr.14138) 41 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:46.322 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:45 smithi100 bash[13549]: cluster 2021-01-28T03:51:45.287182+0000 mgr.y (mgr.14138) 41 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:47.701 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.703+0000 7f39054d2700 1 -- 172.21.15.162:0/2649594078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f390005f2d0 msgr2=0x7f39000f8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:51:47.701 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.703+0000 7f39054d2700 1 --2- 172.21.15.162:0/2649594078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f390005f2d0 0x7f39000f8010 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f38f8009cc0 tx=0x7f38f8004d10).stop 2021-01-28T03:51:47.701 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.703+0000 7f39054d2700 1 -- 172.21.15.162:0/2649594078 shutdown_connections 2021-01-28T03:51:47.702 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.703+0000 7f39054d2700 1 --2- 172.21.15.162:0/2649594078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f390005f2d0 0x7f39000f8010 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:51:47.702 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.703+0000 7f39054d2700 1 -- 172.21.15.162:0/2649594078 >> 172.21.15.162:0/2649594078 conn(0x7f39000efa90 msgr2=0x7f39000f1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:51:47.702 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.703+0000 7f39054d2700 1 -- 172.21.15.162:0/2649594078 shutdown_connections 2021-01-28T03:51:47.702 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.703+0000 7f39054d2700 1 -- 172.21.15.162:0/2649594078 wait complete. 2021-01-28T03:51:47.704 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.703+0000 7f39054d2700 1 Processor -- start 2021-01-28T03:51:47.704 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.703+0000 7f39054d2700 1 -- start start 2021-01-28T03:51:47.704 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.703+0000 7f39054d2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3900104a80 0x7f3900104ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:51:47.704 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.703+0000 7f39054d2700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3900105390 0x7f3900105ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:51:47.705 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.703+0000 7f39054d2700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3900106470 con 0x7f3900104a80 2021-01-28T03:51:47.705 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.703+0000 7f39054d2700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39001065b0 con 0x7f3900105390 2021-01-28T03:51:47.705 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.703+0000 7f38fffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3900104a80 0x7f3900104ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:51:47.705 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.703+0000 7f38fffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3900104a80 0x7f3900104ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.162:50058/0 (socket says 172.21.15.162:50058) 2021-01-28T03:51:47.705 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.703+0000 7f38fffff700 1 -- 172.21.15.162:0/3182638111 learned_addr learned my addr 172.21.15.162:0/3182638111 (peer_addr_for_me v2:172.21.15.162:0/0) 2021-01-28T03:51:47.706 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.703+0000 7f38ff7fe700 1 --2- 172.21.15.162:0/3182638111 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3900105390 0x7f3900105ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:51:47.706 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.703+0000 7f38ff7fe700 1 -- 172.21.15.162:0/3182638111 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3900105390 msgr2=0x7f3900105ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2021-01-28T03:51:47.706 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.703+0000 7f38ff7fe700 1 -- 172.21.15.162:0/3182638111 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3900105390 msgr2=0x7f3900105ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-01-28T03:51:47.706 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.703+0000 7f38ff7fe700 1 --2- 172.21.15.162:0/3182638111 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3900105390 0x7f3900105ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-01-28T03:51:47.706 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.703+0000 7f38ff7fe700 1 --2- 172.21.15.162:0/3182638111 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3900105390 0x7f3900105ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-01-28T03:51:47.707 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.703+0000 7f38fffff700 1 -- 172.21.15.162:0/3182638111 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3900105390 msgr2=0x7f3900105ea0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-01-28T03:51:47.707 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.703+0000 7f38fffff700 1 --2- 172.21.15.162:0/3182638111 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3900105390 0x7f3900105ea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:51:47.707 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.703+0000 7f38fffff700 1 -- 172.21.15.162:0/3182638111 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3900106770 con 0x7f3900104a80 2021-01-28T03:51:47.707 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.703+0000 7f38fffff700 1 --2- 172.21.15.162:0/3182638111 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3900104a80 0x7f3900104ea0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f38f8000f80 tx=0x7f38f8004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:51:47.707 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.703+0000 7f38fcff9700 1 -- 172.21.15.162:0/3182638111 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f38f8017070 con 0x7f3900104a80 2021-01-28T03:51:47.708 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.703+0000 7f39054d2700 1 -- 172.21.15.162:0/3182638111 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39001069c0 con 0x7f3900104a80 2021-01-28T03:51:47.708 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.703+0000 7f38fcff9700 1 -- 172.21.15.162:0/3182638111 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f38f8018040 con 0x7f3900104a80 2021-01-28T03:51:47.708 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.703+0000 7f38fcff9700 1 -- 172.21.15.162:0/3182638111 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f38f800e030 con 0x7f3900104a80 2021-01-28T03:51:47.708 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.703+0000 7f39054d2700 1 -- 172.21.15.162:0/3182638111 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f390010b160 con 0x7f3900104a80 2021-01-28T03:51:47.709 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.707+0000 7f38fcff9700 1 -- 172.21.15.162:0/3182638111 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) v1 ==== 35845+0+0 (secure 0 0 0) 0x7f38f8024030 con 0x7f3900104a80 2021-01-28T03:51:47.709 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.707+0000 7f39054d2700 1 -- 172.21.15.162:0/3182638111 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39000581f0 con 0x7f3900104a80 2021-01-28T03:51:47.710 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.707+0000 7f38fcff9700 1 --2- 172.21.15.162:0/3182638111 >> v2:172.21.15.100:6800/928846103 conn(0x7f38ec02fdc0 0x7f38ec032280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:51:47.710 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.707+0000 7f38fcff9700 1 -- 172.21.15.162:0/3182638111 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1412+0+0 (secure 0 0 0) 0x7f38f80423c0 con 0x7f3900104a80 2021-01-28T03:51:47.710 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.707+0000 7f38ff7fe700 1 --2- 172.21.15.162:0/3182638111 >> v2:172.21.15.100:6800/928846103 conn(0x7f38ec02fdc0 0x7f38ec032280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:51:47.710 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.707+0000 7f38ff7fe700 1 --2- 172.21.15.162:0/3182638111 >> v2:172.21.15.100:6800/928846103 conn(0x7f38ec02fdc0 0x7f38ec032280 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f3900105ae0 tx=0x7f38e8008040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:51:47.716 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.719+0000 7f38fcff9700 1 -- 172.21.15.162:0/3182638111 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f38f80116e0 con 0x7f3900104a80 2021-01-28T03:51:47.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:47 smithi100 bash[9834]: cluster 2021-01-28T03:51:47.287704+0000 mgr.y (mgr.14138) 42 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:47.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:47 smithi100 bash[13549]: cluster 2021-01-28T03:51:47.287704+0000 mgr.y (mgr.14138) 42 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:47.909 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:47.911+0000 7f39054d2700 1 -- 172.21.15.162:0/3182638111 --> v2:172.21.15.100:6800/928846103 -- mgr_command(tid 0: {"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi162:172.21.15.162=b", "target": ["mon-mgr", ""]}) v1 -- 0x7f39000f0a80 con 0x7f38ec02fdc0 2021-01-28T03:51:49.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:48 smithi100 bash[9834]: audit 2021-01-28T03:51:47.916157+0000 mgr.y (mgr.14138) 43 : audit [DBG] from='client.14170 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi162:172.21.15.162=b", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:51:49.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:48 smithi100 bash[9834]: audit 2021-01-28T03:51:47.919236+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-28T03:51:49.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:48 smithi100 bash[9834]: audit 2021-01-28T03:51:47.921272+0000 mon.a (mon.0) 158 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:51:49.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:48 smithi100 bash[9834]: cephadm 2021-01-28T03:51:47.922725+0000 mgr.y (mgr.14138) 44 : cephadm [INF] Deploying daemon mon.b on smithi162 2021-01-28T03:51:49.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:48 smithi100 bash[9834]: audit 2021-01-28T03:51:47.923639+0000 mon.a (mon.0) 159 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2021-01-28T03:51:49.073 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:48 smithi100 bash[13549]: audit 2021-01-28T03:51:47.916157+0000 mgr.y (mgr.14138) 43 : audit [DBG] from='client.14170 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi162:172.21.15.162=b", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:51:49.074 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:48 smithi100 bash[13549]: audit 2021-01-28T03:51:47.919236+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-28T03:51:49.074 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:48 smithi100 bash[13549]: audit 2021-01-28T03:51:47.921272+0000 mon.a (mon.0) 158 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:51:49.074 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:48 smithi100 bash[13549]: cephadm 2021-01-28T03:51:47.922725+0000 mgr.y (mgr.14138) 44 : cephadm [INF] Deploying daemon mon.b on smithi162 2021-01-28T03:51:49.074 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:48 smithi100 bash[13549]: audit 2021-01-28T03:51:47.923639+0000 mon.a (mon.0) 159 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2021-01-28T03:51:50.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:49 smithi100 bash[9834]: cluster 2021-01-28T03:51:49.288254+0000 mgr.y (mgr.14138) 45 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:50.072 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:49 smithi100 bash[13549]: cluster 2021-01-28T03:51:49.288254+0000 mgr.y (mgr.14138) 45 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:52.731 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:52.731+0000 7f38fcff9700 1 -- 172.21.15.162:0/3182638111 <== mgr.14138 v2:172.21.15.100:6800/928846103 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+35 (secure 0 0 0) 0x7f39000f0a80 con 0x7f38ec02fdc0 2021-01-28T03:51:52.732 INFO:teuthology.orchestra.run.smithi162.stdout:Deployed mon.b on host 'smithi162' 2021-01-28T03:51:52.735 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:52.735+0000 7f39054d2700 1 -- 172.21.15.162:0/3182638111 >> v2:172.21.15.100:6800/928846103 conn(0x7f38ec02fdc0 msgr2=0x7f38ec032280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:51:52.735 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:52.735+0000 7f39054d2700 1 --2- 172.21.15.162:0/3182638111 >> v2:172.21.15.100:6800/928846103 conn(0x7f38ec02fdc0 0x7f38ec032280 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f3900105ae0 tx=0x7f38e8008040).stop 2021-01-28T03:51:52.735 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:52.735+0000 7f39054d2700 1 -- 172.21.15.162:0/3182638111 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3900104a80 msgr2=0x7f3900104ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:51:52.736 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:52.735+0000 7f39054d2700 1 --2- 172.21.15.162:0/3182638111 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3900104a80 0x7f3900104ea0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f38f8000f80 tx=0x7f38f8004d10).stop 2021-01-28T03:51:52.736 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:52.735+0000 7f39054d2700 1 -- 172.21.15.162:0/3182638111 shutdown_connections 2021-01-28T03:51:52.736 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:52.735+0000 7f39054d2700 1 --2- 172.21.15.162:0/3182638111 >> v2:172.21.15.100:6800/928846103 conn(0x7f38ec02fdc0 0x7f38ec032280 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:51:52.736 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:52.735+0000 7f39054d2700 1 --2- 172.21.15.162:0/3182638111 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3900104a80 0x7f3900104ea0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:51:52.736 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:52.735+0000 7f39054d2700 1 --2- 172.21.15.162:0/3182638111 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3900105390 0x7f3900105ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:51:52.737 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:52.735+0000 7f39054d2700 1 -- 172.21.15.162:0/3182638111 >> 172.21.15.162:0/3182638111 conn(0x7f39000efa90 msgr2=0x7f39000f0370 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:51:52.737 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:52.735+0000 7f39054d2700 1 -- 172.21.15.162:0/3182638111 shutdown_connections 2021-01-28T03:51:52.737 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:52.735+0000 7f39054d2700 1 -- 172.21.15.162:0/3182638111 wait complete. 2021-01-28T03:51:52.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:52 smithi100 bash[9834]: cluster 2021-01-28T03:51:51.288831+0000 mgr.y (mgr.14138) 46 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:52.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:52 smithi100 bash[13549]: cluster 2021-01-28T03:51:51.288831+0000 mgr.y (mgr.14138) 46 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:53.711 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:53 smithi100 bash[9834]: audit 2021-01-28T03:51:52.726602+0000 mon.a (mon.0) 160 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:51:53.712 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:53 smithi100 bash[9834]: audit 2021-01-28T03:51:52.730790+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:51:53.712 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:53 smithi100 bash[9834]: audit 2021-01-28T03:51:53.335869+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:51:53.712 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:53 smithi100 bash[9834]: audit 2021-01-28T03:51:53.342076+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:51:53.713 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:53 smithi100 bash[9834]: audit 2021-01-28T03:51:53.343218+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-28T03:51:53.713 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:53 smithi100 bash[13549]: audit 2021-01-28T03:51:52.726602+0000 mon.a (mon.0) 160 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:51:53.713 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:53 smithi100 bash[13549]: audit 2021-01-28T03:51:52.730790+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:51:53.713 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:53 smithi100 bash[13549]: audit 2021-01-28T03:51:53.335869+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:51:53.714 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:53 smithi100 bash[13549]: audit 2021-01-28T03:51:53.342076+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:51:53.714 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:53 smithi100 bash[13549]: audit 2021-01-28T03:51:53.343218+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-28T03:51:53.903 DEBUG:teuthology.orchestra.run.smithi162:mon.b> sudo journalctl -f -n 0 -u ceph-c217df96-611b-11eb-8f9e-001a4aab830c@mon.b.service 2021-01-28T03:51:53.906 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2021-01-28T03:51:53.907 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph mon dump -f json 2021-01-28T03:51:53.938 INFO:journalctl@ceph.mon.b.smithi162.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T03:51:54.510 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.163+0000 7f43a6ed1700 0 set uid:gid to 167:167 (ceph:ceph) 2021-01-28T03:51:54.510 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.163+0000 7f43a6ed1700 0 ceph version 17.0.0-184-g507028cb (507028cb839c25d6666833702df6325fd8569096) quincy (dev), process ceph-mon, pid 1 2021-01-28T03:51:54.510 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.163+0000 7f43a6ed1700 0 pidfile_write: ignore empty --pid-file 2021-01-28T03:51:54.511 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 0 load: jerasure load: lrc load: isa 2021-01-28T03:51:54.511 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: RocksDB version: 6.8.1 2021-01-28T03:51:54.511 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-01-28T03:51:54.511 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Compile date Jan 27 2021 2021-01-28T03:51:54.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: DB SUMMARY 2021-01-28T03:51:54.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: CURRENT file: CURRENT 2021-01-28T03:51:54.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: IDENTITY file: IDENTITY 2021-01-28T03:51:54.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2021-01-28T03:51:54.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2021-01-28T03:51:54.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000003.log size: 636 ; 2021-01-28T03:51:54.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.error_if_exists: 0 2021-01-28T03:51:54.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.create_if_missing: 0 2021-01-28T03:51:54.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.paranoid_checks: 1 2021-01-28T03:51:54.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.env: 0x55c2be4221c0 2021-01-28T03:51:54.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.fs: Posix File System 2021-01-28T03:51:54.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.info_log: 0x55c2bfb2fe80 2021-01-28T03:51:54.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.max_file_opening_threads: 16 2021-01-28T03:51:54.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.statistics: (nil) 2021-01-28T03:51:54.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.use_fsync: 0 2021-01-28T03:51:54.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.max_log_file_size: 0 2021-01-28T03:51:54.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-01-28T03:51:54.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-01-28T03:51:54.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.keep_log_file_num: 1000 2021-01-28T03:51:54.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.recycle_log_file_num: 0 2021-01-28T03:51:54.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.allow_fallocate: 1 2021-01-28T03:51:54.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.allow_mmap_reads: 0 2021-01-28T03:51:54.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.allow_mmap_writes: 0 2021-01-28T03:51:54.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.use_direct_reads: 0 2021-01-28T03:51:54.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-01-28T03:51:54.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.create_missing_column_families: 0 2021-01-28T03:51:54.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.db_log_dir: 2021-01-28T03:51:54.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-b/store.db 2021-01-28T03:51:54.518 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-01-28T03:51:54.518 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.max_subcompactions: 1 2021-01-28T03:51:54.518 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.max_background_flushes: -1 2021-01-28T03:51:54.518 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-01-28T03:51:54.519 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-01-28T03:51:54.519 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-01-28T03:51:54.519 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-01-28T03:51:54.519 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-01-28T03:51:54.519 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.advise_random_on_open: 1 2021-01-28T03:51:54.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.db_write_buffer_size: 0 2021-01-28T03:51:54.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.write_buffer_manager: 0x55c2bfb89bf0 2021-01-28T03:51:54.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-01-28T03:51:54.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-01-28T03:51:54.521 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-01-28T03:51:54.521 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-01-28T03:51:54.521 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.rate_limiter: (nil) 2021-01-28T03:51:54.521 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-01-28T03:51:54.521 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.wal_recovery_mode: 2 2021-01-28T03:51:54.522 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.enable_thread_tracking: 0 2021-01-28T03:51:54.524 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.enable_pipelined_write: 0 2021-01-28T03:51:54.524 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.unordered_write: 0 2021-01-28T03:51:54.525 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-01-28T03:51:54.525 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-01-28T03:51:54.525 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-01-28T03:51:54.525 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-01-28T03:51:54.525 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.row_cache: None 2021-01-28T03:51:54.526 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.wal_filter: None 2021-01-28T03:51:54.526 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-01-28T03:51:54.526 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.allow_ingest_behind: 0 2021-01-28T03:51:54.526 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.preserve_deletes: 0 2021-01-28T03:51:54.526 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.two_write_queues: 0 2021-01-28T03:51:54.527 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.manual_wal_flush: 0 2021-01-28T03:51:54.527 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.atomic_flush: 0 2021-01-28T03:51:54.527 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-01-28T03:51:54.527 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-01-28T03:51:54.527 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-01-28T03:51:54.528 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.log_readahead_size: 0 2021-01-28T03:51:54.528 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-01-28T03:51:54.528 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.max_background_jobs: 2 2021-01-28T03:51:54.528 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.max_background_compactions: -1 2021-01-28T03:51:54.528 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-01-28T03:51:54.529 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-01-28T03:51:54.529 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-01-28T03:51:54.529 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.max_total_wal_size: 0 2021-01-28T03:51:54.529 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-01-28T03:51:54.529 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-01-28T03:51:54.530 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-01-28T03:51:54.530 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-01-28T03:51:54.530 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.max_open_files: -1 2021-01-28T03:51:54.531 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.bytes_per_sync: 0 2021-01-28T03:51:54.531 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-01-28T03:51:54.531 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-01-28T03:51:54.531 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.compaction_readahead_size: 0 2021-01-28T03:51:54.531 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Compression algorithms supported: 2021-01-28T03:51:54.532 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-01-28T03:51:54.532 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: kZSTD supported: 0 2021-01-28T03:51:54.532 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: kXpressCompression supported: 0 2021-01-28T03:51:54.532 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: kLZ4HCCompression supported: 1 2021-01-28T03:51:54.532 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: kLZ4Compression supported: 1 2021-01-28T03:51:54.533 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: kBZip2Compression supported: 0 2021-01-28T03:51:54.533 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: kZlibCompression supported: 1 2021-01-28T03:51:54.533 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: kSnappyCompression supported: 1 2021-01-28T03:51:54.533 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-01-28T03:51:54.533 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000001 2021-01-28T03:51:54.534 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-01-28T03:51:54.535 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-01-28T03:51:54.535 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.merge_operator: 2021-01-28T03:51:54.535 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.compaction_filter: None 2021-01-28T03:51:54.535 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.compaction_filter_factory: None 2021-01-28T03:51:54.535 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-01-28T03:51:54.536 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-01-28T03:51:54.536 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c2bfad81e0) 2021-01-28T03:51:54.536 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: cache_index_and_filter_blocks: 1 2021-01-28T03:51:54.537 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: cache_index_and_filter_blocks_with_high_priority: 0 2021-01-28T03:51:54.537 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-01-28T03:51:54.537 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: pin_top_level_index_and_filter: 1 2021-01-28T03:51:54.537 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: index_type: 0 2021-01-28T03:51:54.537 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: data_block_index_type: 0 2021-01-28T03:51:54.538 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: index_shortening: 1 2021-01-28T03:51:54.538 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: data_block_hash_table_util_ratio: 0.750000 2021-01-28T03:51:54.538 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: hash_index_allow_collision: 1 2021-01-28T03:51:54.538 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: checksum: 1 2021-01-28T03:51:54.539 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: no_block_cache: 0 2021-01-28T03:51:54.539 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: block_cache: 0x55c2bfb10510 2021-01-28T03:51:54.539 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: block_cache_name: BinnedLRUCache 2021-01-28T03:51:54.539 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: block_cache_options: 2021-01-28T03:51:54.539 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: capacity : 536870912 2021-01-28T03:51:54.540 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: num_shard_bits : 4 2021-01-28T03:51:54.540 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: strict_capacity_limit : 0 2021-01-28T03:51:54.540 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: high_pri_pool_ratio: 0.000 2021-01-28T03:51:54.540 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: block_cache_compressed: (nil) 2021-01-28T03:51:54.541 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: persistent_cache: (nil) 2021-01-28T03:51:54.541 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: block_size: 4096 2021-01-28T03:51:54.541 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: block_size_deviation: 10 2021-01-28T03:51:54.541 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: block_restart_interval: 16 2021-01-28T03:51:54.541 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: index_block_restart_interval: 1 2021-01-28T03:51:54.542 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: metadata_block_size: 4096 2021-01-28T03:51:54.542 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: partition_filters: 0 2021-01-28T03:51:54.542 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: use_delta_encoding: 1 2021-01-28T03:51:54.542 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: filter_policy: rocksdb.BuiltinBloomFilter 2021-01-28T03:51:54.542 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: whole_key_filtering: 1 2021-01-28T03:51:54.543 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: verify_compression: 0 2021-01-28T03:51:54.543 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: read_amp_bytes_per_bit: 0 2021-01-28T03:51:54.543 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: format_version: 2 2021-01-28T03:51:54.543 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: enable_index_compression: 1 2021-01-28T03:51:54.543 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: block_align: 0 2021-01-28T03:51:54.544 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.write_buffer_size: 33554432 2021-01-28T03:51:54.544 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.max_write_buffer_number: 2 2021-01-28T03:51:54.544 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.compression: NoCompression 2021-01-28T03:51:54.544 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.bottommost_compression: Disabled 2021-01-28T03:51:54.545 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.prefix_extractor: nullptr 2021-01-28T03:51:54.545 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-01-28T03:51:54.545 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.num_levels: 7 2021-01-28T03:51:54.546 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-01-28T03:51:54.546 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-01-28T03:51:54.546 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-01-28T03:51:54.546 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-01-28T03:51:54.546 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-01-28T03:51:54.547 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-01-28T03:51:54.547 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-01-28T03:51:54.547 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-01-28T03:51:54.547 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-01-28T03:51:54.548 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-01-28T03:51:54.548 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.compression_opts.level: 32767 2021-01-28T03:51:54.548 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.compression_opts.strategy: 0 2021-01-28T03:51:54.548 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-01-28T03:51:54.548 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-01-28T03:51:54.549 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.compression_opts.enabled: false 2021-01-28T03:51:54.549 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-01-28T03:51:54.549 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-01-28T03:51:54.550 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-01-28T03:51:54.550 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.target_file_size_base: 67108864 2021-01-28T03:51:54.550 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-01-28T03:51:54.550 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-01-28T03:51:54.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-01-28T03:51:54.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-01-28T03:51:54.551 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-01-28T03:51:54.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-01-28T03:51:54.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-01-28T03:51:54.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-01-28T03:51:54.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-01-28T03:51:54.552 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-01-28T03:51:54.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-01-28T03:51:54.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-01-28T03:51:54.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-01-28T03:51:54.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.arena_block_size: 4194304 2021-01-28T03:51:54.553 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-01-28T03:51:54.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-01-28T03:51:54.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-01-28T03:51:54.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.disable_auto_compactions: 0 2021-01-28T03:51:54.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-01-28T03:51:54.554 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-01-28T03:51:54.555 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-01-28T03:51:54.555 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-01-28T03:51:54.555 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-01-28T03:51:54.556 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-01-28T03:51:54.556 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-01-28T03:51:54.556 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-01-28T03:51:54.556 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-01-28T03:51:54.557 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-01-28T03:51:54.557 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.table_properties_collectors: 2021-01-28T03:51:54.557 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.inplace_update_support: 0 2021-01-28T03:51:54.557 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-01-28T03:51:54.557 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-01-28T03:51:54.558 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-01-28T03:51:54.558 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-01-28T03:51:54.558 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.bloom_locality: 0 2021-01-28T03:51:54.558 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.max_successive_merges: 0 2021-01-28T03:51:54.558 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-01-28T03:51:54.559 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.paranoid_file_checks: 0 2021-01-28T03:51:54.559 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.force_consistency_checks: 0 2021-01-28T03:51:54.559 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.report_bg_io_stats: 0 2021-01-28T03:51:54.559 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.ttl: 2592000 2021-01-28T03:51:54.559 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-01-28T03:51:54.560 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-01-28T03:51:54.560 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2021-01-28T03:51:54.561 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611805914170559, "job": 1, "event": "recovery_started", "log_files": [3]} 2021-01-28T03:51:54.561 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #3 mode 2 2021-01-28T03:51:54.561 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-01-28T03:51:54.561 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611805914171214, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1562, "table_properties": {"data_size": 648, "index_size": 40, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1611805914, "oldest_key_time": 3, "file_creation_time": 0}} 2021-01-28T03:51:54.562 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.167+0000 7f43a6ed1700 4 rocksdb: [version_set.cc:3826] Creating manifest 5 2021-01-28T03:51:54.562 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.171+0000 7f43a6ed1700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611805914171884, "job": 1, "event": "recovery_finished"} 2021-01-28T03:51:54.562 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.171+0000 7f43a6ed1700 4 rocksdb: DB pointer 0x55c2bfbcf800 2021-01-28T03:51:54.562 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.171+0000 7f438dcf2700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-01-28T03:51:54.563 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.171+0000 7f43a6ed1700 0 mon.b does not exist in monmap, will attempt to join an existing cluster 2021-01-28T03:51:54.563 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.171+0000 7f438dcf2700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-01-28T03:51:54.563 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: ** DB Stats ** 2021-01-28T03:51:54.563 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-28T03:51:54.563 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-01-28T03:51:54.564 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-01-28T03:51:54.564 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-28T03:51:54.564 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-01-28T03:51:54.564 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-01-28T03:51:54.564 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-28T03:51:54.565 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: ** Compaction Stats [default] ** 2021-01-28T03:51:54.565 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-28T03:51:54.565 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-28T03:51:54.566 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: L0 1/0 1.53 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.5 0.00 0.00 1 0.001 0 0 2021-01-28T03:51:54.566 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: Sum 1/0 1.53 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.5 0.00 0.00 1 0.001 0 0 2021-01-28T03:51:54.566 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.5 0.00 0.00 1 0.001 0 0 2021-01-28T03:51:54.566 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: ** Compaction Stats [default] ** 2021-01-28T03:51:54.567 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-28T03:51:54.567 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-28T03:51:54.567 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.5 0.00 0.00 1 0.001 0 0 2021-01-28T03:51:54.567 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-28T03:51:54.567 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: Flush(GB): cumulative 0.000, interval 0.000 2021-01-28T03:51:54.568 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-28T03:51:54.568 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: AddFile(Total Files): cumulative 0, interval 0 2021-01-28T03:51:54.568 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: AddFile(L0 Files): cumulative 0, interval 0 2021-01-28T03:51:54.568 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: AddFile(Keys): cumulative 0, interval 0 2021-01-28T03:51:54.569 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: Cumulative compaction: 0.00 GB write, 0.44 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-28T03:51:54.569 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: Interval compaction: 0.00 GB write, 0.44 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-28T03:51:54.569 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-28T03:51:54.570 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: ** File Read Latency Histogram By Level [default] ** 2021-01-28T03:51:54.570 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: ** Compaction Stats [default] ** 2021-01-28T03:51:54.570 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-28T03:51:54.570 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-28T03:51:54.570 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: L0 1/0 1.53 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.5 0.00 0.00 1 0.001 0 0 2021-01-28T03:51:54.571 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: Sum 1/0 1.53 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.5 0.00 0.00 1 0.001 0 0 2021-01-28T03:51:54.571 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-01-28T03:51:54.571 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: ** Compaction Stats [default] ** 2021-01-28T03:51:54.571 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-28T03:51:54.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-28T03:51:54.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.5 0.00 0.00 1 0.001 0 0 2021-01-28T03:51:54.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-28T03:51:54.572 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: Flush(GB): cumulative 0.000, interval 0.000 2021-01-28T03:51:54.573 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-28T03:51:54.573 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: AddFile(Total Files): cumulative 0, interval 0 2021-01-28T03:51:54.573 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: AddFile(L0 Files): cumulative 0, interval 0 2021-01-28T03:51:54.573 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: AddFile(Keys): cumulative 0, interval 0 2021-01-28T03:51:54.573 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: Cumulative compaction: 0.00 GB write, 0.42 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-28T03:51:54.574 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-28T03:51:54.574 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-28T03:51:54.574 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: ** File Read Latency Histogram By Level [default] ** 2021-01-28T03:51:54.574 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.171+0000 7f43a6ed1700 0 using public_addr v2:172.21.15.162:0/0 -> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2021-01-28T03:51:54.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.175+0000 7f43a6ed1700 0 starting mon.b rank -1 at public addrs [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] at bind addrs [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid c217df96-611b-11eb-8f9e-001a4aab830c 2021-01-28T03:51:54.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.175+0000 7f43a6ed1700 1 mon.b@-1(???) e0 preinit fsid c217df96-611b-11eb-8f9e-001a4aab830c 2021-01-28T03:51:54.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.207+0000 7f43904f7700 0 mon.b@-1(synchronizing).mds e1 new map 2021-01-28T03:51:54.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.207+0000 7f43904f7700 0 mon.b@-1(synchronizing).mds e1 print_map 2021-01-28T03:51:54.575 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: e1 2021-01-28T03:51:54.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: enable_multiple, ever_enabled_multiple: 1,1 2021-01-28T03:51:54.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-01-28T03:51:54.576 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: legacy client fscid: -1 2021-01-28T03:51:54.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: 2021-01-28T03:51:54.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: No filesystems configured 2021-01-28T03:51:54.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.207+0000 7f43904f7700 1 mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2021-01-28T03:51:54.577 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.207+0000 7f43904f7700 1 mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2021-01-28T03:51:54.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.207+0000 7f43904f7700 1 mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2021-01-28T03:51:54.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.207+0000 7f43904f7700 1 mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2021-01-28T03:51:54.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.207+0000 7f43904f7700 1 mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2021-01-28T03:51:54.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.207+0000 7f43904f7700 1 mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2021-01-28T03:51:54.579 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.211+0000 7f43904f7700 1 mon.b@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2021-01-28T03:51:54.579 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.211+0000 7f43904f7700 1 mon.b@-1(synchronizing).osd e6 e6: 0 total, 0 up, 0 in 2021-01-28T03:51:54.579 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.211+0000 7f43904f7700 0 mon.b@-1(synchronizing).osd e6 crush map has features 3314933000852226048, adjusting msgr requires 2021-01-28T03:51:54.579 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.211+0000 7f43904f7700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-01-28T03:51:54.580 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.211+0000 7f43904f7700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-01-28T03:51:54.580 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.211+0000 7f43904f7700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-01-28T03:51:54.580 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: audit 2021-01-28T03:51:52.726602+0000 mon.a (mon.0) 160 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:51:54.581 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: audit 2021-01-28T03:51:52.730790+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:51:54.581 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: audit 2021-01-28T03:51:53.335869+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:51:54.581 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: audit 2021-01-28T03:51:53.342076+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:51:54.581 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: audit 2021-01-28T03:51:53.343218+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-28T03:51:54.582 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.211+0000 7f43904f7700 1 mon.b@-1(synchronizing).paxosservice(auth 1..5) refresh upgraded, format 0 -> 3 2021-01-28T03:51:54.582 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.211+0000 7f43904f7700 20 expand_channel_meta expand map: {default=false} 2021-01-28T03:51:54.582 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.211+0000 7f43904f7700 20 expand_channel_meta from 'false' to 'false' 2021-01-28T03:51:54.582 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.211+0000 7f43904f7700 20 expand_channel_meta expanded map: {default=false} 2021-01-28T03:51:54.583 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.211+0000 7f43904f7700 20 expand_channel_meta expand map: {default=info} 2021-01-28T03:51:54.583 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.211+0000 7f43904f7700 20 expand_channel_meta from 'info' to 'info' 2021-01-28T03:51:54.583 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.211+0000 7f43904f7700 20 expand_channel_meta expanded map: {default=info} 2021-01-28T03:51:54.583 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.211+0000 7f43904f7700 20 expand_channel_meta expand map: {default=daemon} 2021-01-28T03:51:54.583 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.211+0000 7f43904f7700 20 expand_channel_meta from 'daemon' to 'daemon' 2021-01-28T03:51:54.584 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.211+0000 7f43904f7700 20 expand_channel_meta expanded map: {default=daemon} 2021-01-28T03:51:54.584 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.211+0000 7f43904f7700 20 expand_channel_meta expand map: {default=debug} 2021-01-28T03:51:54.584 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.211+0000 7f43904f7700 20 expand_channel_meta from 'debug' to 'debug' 2021-01-28T03:51:54.584 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.211+0000 7f43904f7700 20 expand_channel_meta expanded map: {default=debug} 2021-01-28T03:51:54.584 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:51:54 smithi162 bash[9856]: debug 2021-01-28T03:51:54.211+0000 7f43904f7700 10 mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2021-01-28T03:51:59.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[9834]: cluster 2021-01-28T03:51:54.228504+0000 mon.a (mon.0) 168 : cluster [INF] mon.a calling monitor election 2021-01-28T03:51:59.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[9834]: cluster 2021-01-28T03:51:54.228759+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2021-01-28T03:51:59.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[9834]: audit 2021-01-28T03:51:55.220707+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-28T03:51:59.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[9834]: cluster 2021-01-28T03:51:55.289821+0000 mgr.y (mgr.14138) 51 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:59.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[9834]: audit 2021-01-28T03:51:56.220847+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-28T03:51:59.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[9834]: audit 2021-01-28T03:51:57.220766+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-28T03:51:59.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[9834]: cluster 2021-01-28T03:51:57.290318+0000 mgr.y (mgr.14138) 52 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:59.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[9834]: audit 2021-01-28T03:51:58.220952+0000 mon.a (mon.0) 172 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-28T03:51:59.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[9834]: audit 2021-01-28T03:51:59.221056+0000 mon.a (mon.0) 173 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-28T03:51:59.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[9834]: cluster 2021-01-28T03:51:59.230853+0000 mon.a (mon.0) 174 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-01-28T03:51:59.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[9834]: cluster 2021-01-28T03:51:59.235875+0000 mon.a (mon.0) 175 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0],b=[v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0],c=[v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0]} 2021-01-28T03:51:59.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[9834]: cluster 2021-01-28T03:51:59.235981+0000 mon.a (mon.0) 176 : cluster [DBG] fsmap 2021-01-28T03:51:59.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[9834]: cluster 2021-01-28T03:51:59.236038+0000 mon.a (mon.0) 177 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-01-28T03:51:59.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[9834]: cluster 2021-01-28T03:51:59.236375+0000 mon.a (mon.0) 178 : cluster [DBG] mgrmap e13: y(active, since 84s) 2021-01-28T03:51:59.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[9834]: cluster 2021-01-28T03:51:59.236708+0000 mon.a (mon.0) 179 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2021-01-28T03:51:59.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[9834]: cluster 2021-01-28T03:51:59.243276+0000 mon.a (mon.0) 180 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2021-01-28T03:51:59.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[9834]: cluster 2021-01-28T03:51:59.243388+0000 mon.a (mon.0) 181 : cluster [WRN] [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2021-01-28T03:51:59.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[9834]: cluster 2021-01-28T03:51:59.243449+0000 mon.a (mon.0) 182 : cluster [WRN] mon.b (rank 2) addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] is down (out of quorum) 2021-01-28T03:51:59.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[9834]: audit 2021-01-28T03:51:59.247952+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:51:59.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[9834]: audit 2021-01-28T03:51:59.249257+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2021-01-28T03:51:59.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[9834]: audit 2021-01-28T03:51:59.250646+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:51:59.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[9834]: audit 2021-01-28T03:51:59.252091+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2021-01-28T03:51:59.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[13549]: cluster 2021-01-28T03:51:54.228504+0000 mon.a (mon.0) 168 : cluster [INF] mon.a calling monitor election 2021-01-28T03:51:59.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[13549]: cluster 2021-01-28T03:51:54.228759+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2021-01-28T03:51:59.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[13549]: audit 2021-01-28T03:51:55.220707+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-28T03:51:59.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[13549]: cluster 2021-01-28T03:51:55.289821+0000 mgr.y (mgr.14138) 51 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:59.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[13549]: audit 2021-01-28T03:51:56.220847+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-28T03:51:59.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[13549]: audit 2021-01-28T03:51:57.220766+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-28T03:51:59.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[13549]: cluster 2021-01-28T03:51:57.290318+0000 mgr.y (mgr.14138) 52 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:51:59.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[13549]: audit 2021-01-28T03:51:58.220952+0000 mon.a (mon.0) 172 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-28T03:51:59.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[13549]: audit 2021-01-28T03:51:59.221056+0000 mon.a (mon.0) 173 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-28T03:51:59.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[13549]: cluster 2021-01-28T03:51:59.230853+0000 mon.a (mon.0) 174 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-01-28T03:51:59.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[13549]: cluster 2021-01-28T03:51:59.235875+0000 mon.a (mon.0) 175 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0],b=[v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0],c=[v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0]} 2021-01-28T03:51:59.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[13549]: cluster 2021-01-28T03:51:59.235981+0000 mon.a (mon.0) 176 : cluster [DBG] fsmap 2021-01-28T03:51:59.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[13549]: cluster 2021-01-28T03:51:59.236038+0000 mon.a (mon.0) 177 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-01-28T03:51:59.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[13549]: cluster 2021-01-28T03:51:59.236375+0000 mon.a (mon.0) 178 : cluster [DBG] mgrmap e13: y(active, since 84s) 2021-01-28T03:51:59.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[13549]: cluster 2021-01-28T03:51:59.236708+0000 mon.a (mon.0) 179 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2021-01-28T03:51:59.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[13549]: cluster 2021-01-28T03:51:59.243276+0000 mon.a (mon.0) 180 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2021-01-28T03:51:59.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[13549]: cluster 2021-01-28T03:51:59.243388+0000 mon.a (mon.0) 181 : cluster [WRN] [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2021-01-28T03:51:59.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[13549]: cluster 2021-01-28T03:51:59.243449+0000 mon.a (mon.0) 182 : cluster [WRN] mon.b (rank 2) addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] is down (out of quorum) 2021-01-28T03:51:59.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[13549]: audit 2021-01-28T03:51:59.247952+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:51:59.585 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[13549]: audit 2021-01-28T03:51:59.249257+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2021-01-28T03:51:59.585 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[13549]: audit 2021-01-28T03:51:59.250646+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:51:59.586 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:51:59 smithi100 bash[13549]: audit 2021-01-28T03:51:59.252091+0000 mon.a (mon.0) 186 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2021-01-28T03:51:59.962 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.963+0000 7fe216d5f700 1 -- 172.21.15.162:0/1698473129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1f8003250 msgr2=0x7fe1f80056c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:51:59.963 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.963+0000 7fe216d5f700 1 --2- 172.21.15.162:0/1698473129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1f8003250 0x7fe1f80056c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fe21006f0f0 tx=0x7fe20400b040).stop 2021-01-28T03:51:59.963 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.963+0000 7fe216d5f700 1 -- 172.21.15.162:0/1698473129 shutdown_connections 2021-01-28T03:51:59.963 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.963+0000 7fe216d5f700 1 --2- 172.21.15.162:0/1698473129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1f8003250 0x7fe1f80056c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:51:59.964 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.963+0000 7fe216d5f700 1 -- 172.21.15.162:0/1698473129 >> 172.21.15.162:0/1698473129 conn(0x7fe21006abe0 msgr2=0x7fe21006d000 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:51:59.964 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.963+0000 7fe216d5f700 1 -- 172.21.15.162:0/1698473129 shutdown_connections 2021-01-28T03:51:59.964 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.963+0000 7fe216d5f700 1 -- 172.21.15.162:0/1698473129 wait complete. 2021-01-28T03:51:59.965 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.963+0000 7fe216d5f700 1 Processor -- start 2021-01-28T03:51:59.965 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.963+0000 7fe216d5f700 1 -- start start 2021-01-28T03:51:59.965 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.967+0000 7fe216d5f700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe1f8003250 0x7fe21010aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:51:59.966 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.967+0000 7fe216d5f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe21010b3a0 0x7fe21010c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:51:59.966 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.967+0000 7fe216d5f700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe21010c780 0x7fe21010cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:51:59.966 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.967+0000 7fe216d5f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21010b9e0 con 0x7fe21010b3a0 2021-01-28T03:51:59.966 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.967+0000 7fe216d5f700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2101134e0 con 0x7fe21010c780 2021-01-28T03:51:59.966 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.967+0000 7fe216d5f700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe210113620 con 0x7fe1f8003250 2021-01-28T03:51:59.967 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.967+0000 7fe21655e700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe21010c780 0x7fe21010cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:51:59.967 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.967+0000 7fe21655e700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe21010c780 0x7fe21010cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:44702/0 (socket says 172.21.15.162:44702) 2021-01-28T03:51:59.967 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.967+0000 7fe21655e700 1 -- 172.21.15.162:0/642477126 learned_addr learned my addr 172.21.15.162:0/642477126 (peer_addr_for_me v2:172.21.15.162:0/0) 2021-01-28T03:51:59.967 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.967+0000 7fe215d5d700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe1f8003250 0x7fe21010aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:51:59.968 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.967+0000 7fe21555c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe21010b3a0 0x7fe21010c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:51:59.969 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.967+0000 7fe21655e700 1 -- 172.21.15.162:0/642477126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe21010c780 msgr2=0x7fe21010cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2021-01-28T03:51:59.970 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.967+0000 7fe21655e700 1 -- 172.21.15.162:0/642477126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe21010c780 msgr2=0x7fe21010cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2021-01-28T03:51:59.970 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.967+0000 7fe21655e700 1 --2- 172.21.15.162:0/642477126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe21010c780 0x7fe21010cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2021-01-28T03:51:59.970 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.967+0000 7fe21655e700 1 --2- 172.21.15.162:0/642477126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe21010c780 0x7fe21010cc00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2021-01-28T03:51:59.971 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.967+0000 7fe215d5d700 1 -- 172.21.15.162:0/642477126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe21010c780 msgr2=0x7fe21010cc00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2021-01-28T03:51:59.971 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.967+0000 7fe215d5d700 1 --2- 172.21.15.162:0/642477126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe21010c780 0x7fe21010cc00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:51:59.971 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.967+0000 7fe215d5d700 1 -- 172.21.15.162:0/642477126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe21010b3a0 msgr2=0x7fe21010c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:51:59.971 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.967+0000 7fe215d5d700 1 --2- 172.21.15.162:0/642477126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe21010b3a0 0x7fe21010c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:51:59.971 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.967+0000 7fe215d5d700 1 -- 172.21.15.162:0/642477126 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2101137e0 con 0x7fe1f8003250 2021-01-28T03:51:59.972 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.967+0000 7fe21555c700 1 --2- 172.21.15.162:0/642477126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe21010b3a0 0x7fe21010c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-28T03:51:59.972 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.967+0000 7fe215d5d700 1 --2- 172.21.15.162:0/642477126 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe1f8003250 0x7fe21010aeb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fe204018000 tx=0x7fe20400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:51:59.972 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.967+0000 7fe20e7fc700 1 -- 172.21.15.162:0/642477126 <== mon.1 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe204016b80 con 0x7fe1f8003250 2021-01-28T03:51:59.972 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.967+0000 7fe20e7fc700 1 -- 172.21.15.162:0/642477126 <== mon.1 v2:172.21.15.100:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fe204016ce0 con 0x7fe1f8003250 2021-01-28T03:51:59.972 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.967+0000 7fe20e7fc700 1 -- 172.21.15.162:0/642477126 <== mon.1 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2040172a0 con 0x7fe1f8003250 2021-01-28T03:51:59.973 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.967+0000 7fe216d5f700 1 -- 172.21.15.162:0/642477126 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe210113a30 con 0x7fe1f8003250 2021-01-28T03:51:59.973 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.967+0000 7fe216d5f700 1 -- 172.21.15.162:0/642477126 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe210113de0 con 0x7fe1f8003250 2021-01-28T03:51:59.973 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.971+0000 7fe20e7fc700 1 -- 172.21.15.162:0/642477126 <== mon.1 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 13) v1 ==== 35845+0+0 (secure 0 0 0) 0x7fe2040176d0 con 0x7fe1f8003250 2021-01-28T03:51:59.973 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.971+0000 7fe20e7fc700 1 --2- 172.21.15.162:0/642477126 >> v2:172.21.15.100:6800/928846103 conn(0x7fe1fc030100 0x7fe1fc0325c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:51:59.973 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.971+0000 7fe20e7fc700 1 -- 172.21.15.162:0/642477126 <== mon.1 v2:172.21.15.100:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1412+0+0 (secure 0 0 0) 0x7fe204041cd0 con 0x7fe1f8003250 2021-01-28T03:51:59.974 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.971+0000 7fe21555c700 1 --2- 172.21.15.162:0/642477126 >> v2:172.21.15.100:6800/928846103 conn(0x7fe1fc030100 0x7fe1fc0325c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:51:59.974 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.971+0000 7fe216d5f700 1 -- 172.21.15.162:0/642477126 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2100581f0 con 0x7fe1f8003250 2021-01-28T03:51:59.978 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.971+0000 7fe21555c700 1 --2- 172.21.15.162:0/642477126 >> v2:172.21.15.100:6800/928846103 conn(0x7fe1fc030100 0x7fe1fc0325c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fe20000e300 tx=0x7fe200009220).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:51:59.980 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:51:59.983+0000 7fe20e7fc700 1 -- 172.21.15.162:0/642477126 <== mon.1 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fe20401b080 con 0x7fe1f8003250 2021-01-28T03:52:00.210 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:00.211+0000 7fe216d5f700 1 -- 172.21.15.162:0/642477126 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe2100fe530 con 0x7fe1f8003250 2021-01-28T03:52:00.211 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:00.211+0000 7fe20e7fc700 1 -- 172.21.15.162:0/642477126 <== mon.1 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1223 (secure 0 0 0) 0x7fe20401dd60 con 0x7fe1f8003250 2021-01-28T03:52:00.211 INFO:teuthology.orchestra.run.smithi162.stdout: 2021-01-28T03:52:00.212 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":3,"fsid":"c217df96-611b-11eb-8f9e-001a4aab830c","modified":"2021-01-28T03:51:54.221613Z","created":"2021-01-28T03:49:38.774756Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3301","nonce":0},{"type":"v1","addr":"172.21.15.100:6790","nonce":0}]},"addr":"172.21.15.100:6790/0","public_addr":"172.21.15.100:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:3300","nonce":0},{"type":"v1","addr":"172.21.15.162:6789","nonce":0}]},"addr":"172.21.15.162:6789/0","public_addr":"172.21.15.162:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2021-01-28T03:52:00.213 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:00.215+0000 7fe216d5f700 1 -- 172.21.15.162:0/642477126 >> v2:172.21.15.100:6800/928846103 conn(0x7fe1fc030100 msgr2=0x7fe1fc0325c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:52:00.213 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:00.215+0000 7fe216d5f700 1 --2- 172.21.15.162:0/642477126 >> v2:172.21.15.100:6800/928846103 conn(0x7fe1fc030100 0x7fe1fc0325c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fe20000e300 tx=0x7fe200009220).stop 2021-01-28T03:52:00.214 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:00.215+0000 7fe216d5f700 1 -- 172.21.15.162:0/642477126 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe1f8003250 msgr2=0x7fe21010aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:52:00.214 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:00.215+0000 7fe216d5f700 1 --2- 172.21.15.162:0/642477126 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe1f8003250 0x7fe21010aeb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fe204018000 tx=0x7fe20400b040).stop 2021-01-28T03:52:00.214 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:00.215+0000 7fe216d5f700 1 -- 172.21.15.162:0/642477126 shutdown_connections 2021-01-28T03:52:00.214 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:00.215+0000 7fe216d5f700 1 --2- 172.21.15.162:0/642477126 >> v2:172.21.15.100:6800/928846103 conn(0x7fe1fc030100 0x7fe1fc0325c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:52:00.215 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:00.215+0000 7fe216d5f700 1 --2- 172.21.15.162:0/642477126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe21010c780 0x7fe21010cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:52:00.215 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:00.215+0000 7fe216d5f700 1 --2- 172.21.15.162:0/642477126 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe1f8003250 0x7fe21010aeb0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:52:00.215 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:00.215+0000 7fe216d5f700 1 --2- 172.21.15.162:0/642477126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe21010b3a0 0x7fe21010c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:52:00.216 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:00.215+0000 7fe216d5f700 1 -- 172.21.15.162:0/642477126 >> 172.21.15.162:0/642477126 conn(0x7fe21006abe0 msgr2=0x7fe2100ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:52:00.216 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:00.215+0000 7fe216d5f700 1 -- 172.21.15.162:0/642477126 shutdown_connections 2021-01-28T03:52:00.216 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:00.215+0000 7fe216d5f700 1 -- 172.21.15.162:0/642477126 wait complete. 2021-01-28T03:52:00.217 INFO:teuthology.orchestra.run.smithi162.stderr:dumped monmap epoch 3 2021-01-28T03:52:00.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:00 smithi100 bash[9834]: cephadm 2021-01-28T03:51:59.248848+0000 mgr.y (mgr.14138) 53 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2021-01-28T03:52:00.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:00 smithi100 bash[9834]: cephadm 2021-01-28T03:51:59.251504+0000 mgr.y (mgr.14138) 54 : cephadm [INF] Reconfiguring daemon mgr.y on smithi100 2021-01-28T03:52:00.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:00 smithi100 bash[9834]: cluster 2021-01-28T03:51:59.290844+0000 mgr.y (mgr.14138) 55 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:00.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:00 smithi100 bash[9834]: audit 2021-01-28T03:52:00.216103+0000 mon.c (mon.1) 3 : audit [DBG] from='client.? 172.21.15.162:0/642477126' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-01-28T03:52:00.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:00 smithi100 bash[9834]: audit 2021-01-28T03:52:00.221552+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-28T03:52:00.573 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:00 smithi100 bash[13549]: cephadm 2021-01-28T03:51:59.248848+0000 mgr.y (mgr.14138) 53 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2021-01-28T03:52:00.573 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:00 smithi100 bash[13549]: cephadm 2021-01-28T03:51:59.251504+0000 mgr.y (mgr.14138) 54 : cephadm [INF] Reconfiguring daemon mgr.y on smithi100 2021-01-28T03:52:00.573 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:00 smithi100 bash[13549]: cluster 2021-01-28T03:51:59.290844+0000 mgr.y (mgr.14138) 55 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:00.573 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:00 smithi100 bash[13549]: audit 2021-01-28T03:52:00.216103+0000 mon.c (mon.1) 3 : audit [DBG] from='client.? 172.21.15.162:0/642477126' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-01-28T03:52:00.573 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:00 smithi100 bash[13549]: audit 2021-01-28T03:52:00.221552+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-28T03:52:00.893 INFO:tasks.cephadm:Generating final ceph.conf file... 2021-01-28T03:52:00.894 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph config generate-minimal-conf 2021-01-28T03:52:01.509 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:01 smithi162 bash[9856]: cephadm 2021-01-28T03:51:59.248848+0000 mgr.y (mgr.14138) 53 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2021-01-28T03:52:01.509 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:01 smithi162 bash[9856]: cephadm 2021-01-28T03:51:59.251504+0000 mgr.y (mgr.14138) 54 : cephadm [INF] Reconfiguring daemon mgr.y on smithi100 2021-01-28T03:52:01.510 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:01 smithi162 bash[9856]: cluster 2021-01-28T03:51:59.290844+0000 mgr.y (mgr.14138) 55 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:01.510 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:01 smithi162 bash[9856]: audit 2021-01-28T03:52:00.216103+0000 mon.c (mon.1) 3 : audit [DBG] from='client.? 172.21.15.162:0/642477126' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-01-28T03:52:01.510 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:01 smithi162 bash[9856]: audit 2021-01-28T03:52:00.221552+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-28T03:52:01.510 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:01 smithi162 bash[9856]: cluster 2021-01-28T03:51:56.221669+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2021-01-28T03:52:01.511 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:01 smithi162 bash[9856]: cluster 2021-01-28T03:52:01.224372+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2021-01-28T03:52:01.511 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:01 smithi162 bash[9856]: cluster 2021-01-28T03:52:01.227471+0000 mon.c (mon.1) 4 : cluster [INF] mon.c calling monitor election 2021-01-28T03:52:01.511 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:01 smithi162 bash[9856]: cluster 2021-01-28T03:52:01.227554+0000 mon.a (mon.0) 189 : cluster [INF] mon.a calling monitor election 2021-01-28T03:52:01.511 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:01 smithi162 bash[9856]: cluster 2021-01-28T03:52:01.231645+0000 mon.a (mon.0) 190 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-01-28T03:52:01.511 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:01 smithi162 bash[9856]: cluster 2021-01-28T03:52:01.245378+0000 mon.a (mon.0) 191 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0],b=[v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0],c=[v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0]} 2021-01-28T03:52:01.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:01 smithi162 bash[9856]: cluster 2021-01-28T03:52:01.245480+0000 mon.a (mon.0) 192 : cluster [DBG] fsmap 2021-01-28T03:52:01.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:01 smithi162 bash[9856]: cluster 2021-01-28T03:52:01.245534+0000 mon.a (mon.0) 193 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-01-28T03:52:01.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:01 smithi162 bash[9856]: cluster 2021-01-28T03:52:01.245887+0000 mon.a (mon.0) 194 : cluster [DBG] mgrmap e13: y(active, since 86s) 2021-01-28T03:52:01.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:01 smithi162 bash[9856]: cluster 2021-01-28T03:52:01.246197+0000 mon.a (mon.0) 195 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2021-01-28T03:52:01.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:01 smithi162 bash[9856]: cluster 2021-01-28T03:52:01.246245+0000 mon.a (mon.0) 196 : cluster [INF] Cluster is now healthy 2021-01-28T03:52:01.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:01 smithi162 bash[9856]: cluster 2021-01-28T03:52:01.253038+0000 mon.a (mon.0) 197 : cluster [INF] overall HEALTH_OK 2021-01-28T03:52:01.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:01 smithi100 bash[9834]: cluster 2021-01-28T03:51:56.221669+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2021-01-28T03:52:01.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:01 smithi100 bash[9834]: cluster 2021-01-28T03:52:01.224372+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2021-01-28T03:52:01.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:01 smithi100 bash[9834]: cluster 2021-01-28T03:52:01.227471+0000 mon.c (mon.1) 4 : cluster [INF] mon.c calling monitor election 2021-01-28T03:52:01.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:01 smithi100 bash[9834]: cluster 2021-01-28T03:52:01.227554+0000 mon.a (mon.0) 189 : cluster [INF] mon.a calling monitor election 2021-01-28T03:52:01.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:01 smithi100 bash[9834]: cluster 2021-01-28T03:52:01.231645+0000 mon.a (mon.0) 190 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-01-28T03:52:01.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:01 smithi100 bash[9834]: cluster 2021-01-28T03:52:01.245378+0000 mon.a (mon.0) 191 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0],b=[v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0],c=[v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0]} 2021-01-28T03:52:01.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:01 smithi100 bash[9834]: cluster 2021-01-28T03:52:01.245480+0000 mon.a (mon.0) 192 : cluster [DBG] fsmap 2021-01-28T03:52:01.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:01 smithi100 bash[9834]: cluster 2021-01-28T03:52:01.245534+0000 mon.a (mon.0) 193 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-01-28T03:52:01.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:01 smithi100 bash[9834]: cluster 2021-01-28T03:52:01.245887+0000 mon.a (mon.0) 194 : cluster [DBG] mgrmap e13: y(active, since 86s) 2021-01-28T03:52:01.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:01 smithi100 bash[9834]: cluster 2021-01-28T03:52:01.246197+0000 mon.a (mon.0) 195 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2021-01-28T03:52:01.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:01 smithi100 bash[9834]: cluster 2021-01-28T03:52:01.246245+0000 mon.a (mon.0) 196 : cluster [INF] Cluster is now healthy 2021-01-28T03:52:01.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:01 smithi100 bash[9834]: cluster 2021-01-28T03:52:01.253038+0000 mon.a (mon.0) 197 : cluster [INF] overall HEALTH_OK 2021-01-28T03:52:01.575 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:01 smithi100 bash[13549]: cluster 2021-01-28T03:51:56.221669+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2021-01-28T03:52:01.575 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:01 smithi100 bash[13549]: cluster 2021-01-28T03:52:01.224372+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2021-01-28T03:52:01.575 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:01 smithi100 bash[13549]: cluster 2021-01-28T03:52:01.227471+0000 mon.c (mon.1) 4 : cluster [INF] mon.c calling monitor election 2021-01-28T03:52:01.576 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:01 smithi100 bash[13549]: cluster 2021-01-28T03:52:01.227554+0000 mon.a (mon.0) 189 : cluster [INF] mon.a calling monitor election 2021-01-28T03:52:01.576 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:01 smithi100 bash[13549]: cluster 2021-01-28T03:52:01.231645+0000 mon.a (mon.0) 190 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-01-28T03:52:01.576 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:01 smithi100 bash[13549]: cluster 2021-01-28T03:52:01.245378+0000 mon.a (mon.0) 191 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0],b=[v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0],c=[v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0]} 2021-01-28T03:52:01.576 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:01 smithi100 bash[13549]: cluster 2021-01-28T03:52:01.245480+0000 mon.a (mon.0) 192 : cluster [DBG] fsmap 2021-01-28T03:52:01.577 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:01 smithi100 bash[13549]: cluster 2021-01-28T03:52:01.245534+0000 mon.a (mon.0) 193 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-01-28T03:52:01.577 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:01 smithi100 bash[13549]: cluster 2021-01-28T03:52:01.245887+0000 mon.a (mon.0) 194 : cluster [DBG] mgrmap e13: y(active, since 86s) 2021-01-28T03:52:01.577 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:01 smithi100 bash[13549]: cluster 2021-01-28T03:52:01.246197+0000 mon.a (mon.0) 195 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2021-01-28T03:52:01.577 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:01 smithi100 bash[13549]: cluster 2021-01-28T03:52:01.246245+0000 mon.a (mon.0) 196 : cluster [INF] Cluster is now healthy 2021-01-28T03:52:01.578 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:01 smithi100 bash[13549]: cluster 2021-01-28T03:52:01.253038+0000 mon.a (mon.0) 197 : cluster [INF] overall HEALTH_OK 2021-01-28T03:52:02.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:02 smithi100 bash[9834]: cluster 2021-01-28T03:52:01.291367+0000 mgr.y (mgr.14138) 56 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:02.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:02 smithi100 bash[9834]: audit 2021-01-28T03:52:01.736234+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:02.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:02 smithi100 bash[9834]: audit 2021-01-28T03:52:01.737769+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-28T03:52:02.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:02 smithi100 bash[9834]: audit 2021-01-28T03:52:01.739119+0000 mon.a (mon.0) 200 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:52:02.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:02 smithi100 bash[9834]: audit 2021-01-28T03:52:01.741305+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2021-01-28T03:52:02.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:02 smithi100 bash[9834]: audit 2021-01-28T03:52:02.221507+0000 mon.a (mon.0) 202 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-28T03:52:02.573 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:02 smithi100 bash[13549]: cluster 2021-01-28T03:52:01.291367+0000 mgr.y (mgr.14138) 56 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:02.573 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:02 smithi100 bash[13549]: audit 2021-01-28T03:52:01.736234+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:02.573 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:02 smithi100 bash[13549]: audit 2021-01-28T03:52:01.737769+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-28T03:52:02.573 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:02 smithi100 bash[13549]: audit 2021-01-28T03:52:01.739119+0000 mon.a (mon.0) 200 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:52:02.574 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:02 smithi100 bash[13549]: audit 2021-01-28T03:52:01.741305+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2021-01-28T03:52:02.574 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:02 smithi100 bash[13549]: audit 2021-01-28T03:52:02.221507+0000 mon.a (mon.0) 202 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-28T03:52:02.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:02 smithi162 bash[9856]: cluster 2021-01-28T03:52:01.291367+0000 mgr.y (mgr.14138) 56 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:02.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:02 smithi162 bash[9856]: audit 2021-01-28T03:52:01.736234+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:02.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:02 smithi162 bash[9856]: audit 2021-01-28T03:52:01.737769+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-28T03:52:02.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:02 smithi162 bash[9856]: audit 2021-01-28T03:52:01.739119+0000 mon.a (mon.0) 200 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:52:02.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:02 smithi162 bash[9856]: audit 2021-01-28T03:52:01.741305+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2021-01-28T03:52:02.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:02 smithi162 bash[9856]: audit 2021-01-28T03:52:02.221507+0000 mon.a (mon.0) 202 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-28T03:52:03.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:03 smithi100 bash[9834]: cephadm 2021-01-28T03:52:01.737215+0000 mgr.y (mgr.14138) 57 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-01-28T03:52:03.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:03 smithi100 bash[9834]: cephadm 2021-01-28T03:52:01.740331+0000 mgr.y (mgr.14138) 58 : cephadm [INF] Reconfiguring daemon mon.c on smithi100 2021-01-28T03:52:03.572 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:03 smithi100 bash[13549]: cephadm 2021-01-28T03:52:01.737215+0000 mgr.y (mgr.14138) 57 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-01-28T03:52:03.572 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:03 smithi100 bash[13549]: cephadm 2021-01-28T03:52:01.740331+0000 mgr.y (mgr.14138) 58 : cephadm [INF] Reconfiguring daemon mon.c on smithi100 2021-01-28T03:52:03.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:03 smithi162 bash[9856]: cephadm 2021-01-28T03:52:01.737215+0000 mgr.y (mgr.14138) 57 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-01-28T03:52:03.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:03 smithi162 bash[9856]: cephadm 2021-01-28T03:52:01.740331+0000 mgr.y (mgr.14138) 58 : cephadm [INF] Reconfiguring daemon mon.c on smithi100 2021-01-28T03:52:04.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:04 smithi162 bash[9856]: cluster 2021-01-28T03:52:03.291816+0000 mgr.y (mgr.14138) 59 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:04.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:04 smithi100 bash[9834]: cluster 2021-01-28T03:52:03.291816+0000 mgr.y (mgr.14138) 59 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:04.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:04 smithi100 bash[13549]: cluster 2021-01-28T03:52:03.291816+0000 mgr.y (mgr.14138) 59 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:05.533 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.534+0000 7f6c84837700 1 -- 172.21.15.100:0/2251659312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c800f75a0 msgr2=0x7f6c800f79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:52:05.533 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.534+0000 7f6c84837700 1 --2- 172.21.15.100:0/2251659312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c800f75a0 0x7f6c800f79c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f6c70004d00 tx=0x7f6c70009b30).stop 2021-01-28T03:52:05.533 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.534+0000 7f6c84837700 1 -- 172.21.15.100:0/2251659312 shutdown_connections 2021-01-28T03:52:05.534 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.534+0000 7f6c84837700 1 --2- 172.21.15.100:0/2251659312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c800f75a0 0x7f6c800f79c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:52:05.534 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.534+0000 7f6c84837700 1 -- 172.21.15.100:0/2251659312 >> 172.21.15.100:0/2251659312 conn(0x7f6c800601c0 msgr2=0x7f6c800f51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:52:05.534 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.534+0000 7f6c84837700 1 -- 172.21.15.100:0/2251659312 shutdown_connections 2021-01-28T03:52:05.534 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.534+0000 7f6c84837700 1 -- 172.21.15.100:0/2251659312 wait complete. 2021-01-28T03:52:05.535 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.538+0000 7f6c84837700 1 Processor -- start 2021-01-28T03:52:05.536 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.538+0000 7f6c84837700 1 -- start start 2021-01-28T03:52:05.536 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.538+0000 7f6c84837700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6c800f75a0 0x7f6c80106be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:52:05.536 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.538+0000 7f6c84837700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c801070d0 0x7f6c80107fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:52:05.536 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.538+0000 7f6c84837700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c801084b0 0x7f6c80108930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:52:05.536 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.538+0000 7f6c84837700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c80107710 con 0x7f6c801084b0 2021-01-28T03:52:05.537 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.538+0000 7f6c84837700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8010f210 con 0x7f6c801070d0 2021-01-28T03:52:05.537 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.538+0000 7f6c84837700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8010f350 con 0x7f6c800f75a0 2021-01-28T03:52:05.537 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.538+0000 7f6c7f7fe700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6c800f75a0 0x7f6c80106be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:52:05.537 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.538+0000 7f6c7f7fe700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6c800f75a0 0x7f6c80106be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:40072/0 (socket says 172.21.15.100:40072) 2021-01-28T03:52:05.538 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.538+0000 7f6c7f7fe700 1 -- 172.21.15.100:0/1348554430 learned_addr learned my addr 172.21.15.100:0/1348554430 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:52:05.538 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.538+0000 7f6c7ffff700 1 --2- 172.21.15.100:0/1348554430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c801084b0 0x7f6c80108930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:52:05.538 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.538+0000 7f6c7effd700 1 --2- 172.21.15.100:0/1348554430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c801070d0 0x7f6c80107fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:52:05.539 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.538+0000 7f6c7f7fe700 1 -- 172.21.15.100:0/1348554430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c801070d0 msgr2=0x7f6c80107fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:52:05.540 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.538+0000 7f6c7f7fe700 1 --2- 172.21.15.100:0/1348554430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c801070d0 0x7f6c80107fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:52:05.540 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.538+0000 7f6c7f7fe700 1 -- 172.21.15.100:0/1348554430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c801084b0 msgr2=0x7f6c80108930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:52:05.540 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.538+0000 7f6c7f7fe700 1 --2- 172.21.15.100:0/1348554430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c801084b0 0x7f6c80108930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:52:05.541 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.538+0000 7f6c7f7fe700 1 -- 172.21.15.100:0/1348554430 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8010f510 con 0x7f6c800f75a0 2021-01-28T03:52:05.541 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.538+0000 7f6c7ffff700 1 --2- 172.21.15.100:0/1348554430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c801084b0 0x7f6c80108930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-28T03:52:05.541 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.538+0000 7f6c7f7fe700 1 --2- 172.21.15.100:0/1348554430 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6c800f75a0 0x7f6c80106be0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f6c700097a0 tx=0x7f6c70009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:52:05.541 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.538+0000 7f6c77fff700 1 -- 172.21.15.100:0/1348554430 <== mon.1 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7000e030 con 0x7f6c800f75a0 2021-01-28T03:52:05.541 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.538+0000 7f6c77fff700 1 -- 172.21.15.100:0/1348554430 <== mon.1 v2:172.21.15.100:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f6c70013a80 con 0x7f6c800f75a0 2021-01-28T03:52:05.542 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.538+0000 7f6c84837700 1 -- 172.21.15.100:0/1348554430 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c8010f760 con 0x7f6c800f75a0 2021-01-28T03:52:05.543 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.538+0000 7f6c84837700 1 -- 172.21.15.100:0/1348554430 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c8010fbf0 con 0x7f6c800f75a0 2021-01-28T03:52:05.543 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.538+0000 7f6c77fff700 1 -- 172.21.15.100:0/1348554430 <== mon.1 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c70018070 con 0x7f6c800f75a0 2021-01-28T03:52:05.543 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.542+0000 7f6c77fff700 1 -- 172.21.15.100:0/1348554430 <== mon.1 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 13) v1 ==== 35845+0+0 (secure 0 0 0) 0x7f6c70024060 con 0x7f6c800f75a0 2021-01-28T03:52:05.543 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.542+0000 7f6c84837700 1 -- 172.21.15.100:0/1348554430 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c58004da0 con 0x7f6c800f75a0 2021-01-28T03:52:05.544 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.542+0000 7f6c77fff700 1 --2- 172.21.15.100:0/1348554430 >> v2:172.21.15.100:6800/928846103 conn(0x7f6c60030100 0x7f6c600325c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:52:05.544 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.542+0000 7f6c77fff700 1 -- 172.21.15.100:0/1348554430 <== mon.1 v2:172.21.15.100:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1412+0+0 (secure 0 0 0) 0x7f6c700410b0 con 0x7f6c800f75a0 2021-01-28T03:52:05.544 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.542+0000 7f6c7effd700 1 --2- 172.21.15.100:0/1348554430 >> v2:172.21.15.100:6800/928846103 conn(0x7f6c60030100 0x7f6c600325c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:52:05.545 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.542+0000 7f6c7effd700 1 --2- 172.21.15.100:0/1348554430 >> v2:172.21.15.100:6800/928846103 conn(0x7f6c60030100 0x7f6c600325c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f6c6800b9f0 tx=0x7f6c68006e20).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:52:05.545 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.550+0000 7f6c77fff700 1 -- 172.21.15.100:0/1348554430 <== mon.1 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f6c70013dd0 con 0x7f6c800f75a0 2021-01-28T03:52:05.707 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.710+0000 7f6c84837700 1 -- 172.21.15.100:0/1348554430 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f6c58005470 con 0x7f6c800f75a0 2021-01-28T03:52:05.708 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.710+0000 7f6c77fff700 1 -- 172.21.15.100:0/1348554430 <== mon.1 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+277 (secure 0 0 0) 0x7f6c70013dd0 con 0x7f6c800f75a0 2021-01-28T03:52:05.708 INFO:teuthology.orchestra.run.smithi100.stdout:# minimal ceph.conf for c217df96-611b-11eb-8f9e-001a4aab830c 2021-01-28T03:52:05.708 INFO:teuthology.orchestra.run.smithi100.stdout:[global] 2021-01-28T03:52:05.708 INFO:teuthology.orchestra.run.smithi100.stdout: fsid = c217df96-611b-11eb-8f9e-001a4aab830c 2021-01-28T03:52:05.709 INFO:teuthology.orchestra.run.smithi100.stdout: mon_host = [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] 2021-01-28T03:52:05.709 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.710+0000 7f6c84837700 1 -- 172.21.15.100:0/1348554430 >> v2:172.21.15.100:6800/928846103 conn(0x7f6c60030100 msgr2=0x7f6c600325c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:52:05.710 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.710+0000 7f6c84837700 1 --2- 172.21.15.100:0/1348554430 >> v2:172.21.15.100:6800/928846103 conn(0x7f6c60030100 0x7f6c600325c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f6c6800b9f0 tx=0x7f6c68006e20).stop 2021-01-28T03:52:05.710 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.710+0000 7f6c84837700 1 -- 172.21.15.100:0/1348554430 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6c800f75a0 msgr2=0x7f6c80106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:52:05.710 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.710+0000 7f6c84837700 1 --2- 172.21.15.100:0/1348554430 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6c800f75a0 0x7f6c80106be0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f6c700097a0 tx=0x7f6c70009b30).stop 2021-01-28T03:52:05.710 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.710+0000 7f6c84837700 1 -- 172.21.15.100:0/1348554430 shutdown_connections 2021-01-28T03:52:05.711 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.710+0000 7f6c84837700 1 --2- 172.21.15.100:0/1348554430 >> v2:172.21.15.100:6800/928846103 conn(0x7f6c60030100 0x7f6c600325c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:52:05.711 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.710+0000 7f6c84837700 1 --2- 172.21.15.100:0/1348554430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c801084b0 0x7f6c80108930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:52:05.711 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.710+0000 7f6c84837700 1 --2- 172.21.15.100:0/1348554430 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f6c800f75a0 0x7f6c80106be0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:52:05.712 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.710+0000 7f6c84837700 1 --2- 172.21.15.100:0/1348554430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c801070d0 0x7f6c80107fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:52:05.712 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.710+0000 7f6c84837700 1 -- 172.21.15.100:0/1348554430 >> 172.21.15.100:0/1348554430 conn(0x7f6c800601c0 msgr2=0x7f6c800f3590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:52:05.712 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.714+0000 7f6c84837700 1 -- 172.21.15.100:0/1348554430 shutdown_connections 2021-01-28T03:52:05.712 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:05.714+0000 7f6c84837700 1 -- 172.21.15.100:0/1348554430 wait complete. 2021-01-28T03:52:06.408 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2021-01-28T03:52:06.412 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2021-01-28T03:52:06.415 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.conf 2021-01-28T03:52:06.431 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2021-01-28T03:52:06.432 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2021-01-28T03:52:06.484 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:06 smithi100 bash[9834]: audit 2021-01-28T03:52:05.230787+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:06.485 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:06 smithi100 bash[9834]: cephadm 2021-01-28T03:52:05.231769+0000 mgr.y (mgr.14138) 60 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-01-28T03:52:06.485 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:06 smithi100 bash[9834]: audit 2021-01-28T03:52:05.232245+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-28T03:52:06.485 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:06 smithi100 bash[9834]: audit 2021-01-28T03:52:05.233532+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:52:06.486 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:06 smithi100 bash[9834]: cephadm 2021-01-28T03:52:05.234540+0000 mgr.y (mgr.14138) 61 : cephadm [INF] Reconfiguring daemon mon.b on smithi162 2021-01-28T03:52:06.486 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:06 smithi100 bash[9834]: audit 2021-01-28T03:52:05.235395+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2021-01-28T03:52:06.487 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:06 smithi100 bash[9834]: cluster 2021-01-28T03:52:05.292372+0000 mgr.y (mgr.14138) 62 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:06.487 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:06 smithi100 bash[9834]: audit 2021-01-28T03:52:05.712753+0000 mon.c (mon.1) 5 : audit [DBG] from='client.? 172.21.15.100:0/1348554430' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:52:06.488 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:06 smithi100 bash[13549]: audit 2021-01-28T03:52:05.230787+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:06.488 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:06 smithi100 bash[13549]: cephadm 2021-01-28T03:52:05.231769+0000 mgr.y (mgr.14138) 60 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-01-28T03:52:06.489 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:06 smithi100 bash[13549]: audit 2021-01-28T03:52:05.232245+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-28T03:52:06.489 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:06 smithi100 bash[13549]: audit 2021-01-28T03:52:05.233532+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:52:06.490 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:06 smithi100 bash[13549]: cephadm 2021-01-28T03:52:05.234540+0000 mgr.y (mgr.14138) 61 : cephadm [INF] Reconfiguring daemon mon.b on smithi162 2021-01-28T03:52:06.490 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:06 smithi100 bash[13549]: audit 2021-01-28T03:52:05.235395+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2021-01-28T03:52:06.491 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:06 smithi100 bash[13549]: cluster 2021-01-28T03:52:05.292372+0000 mgr.y (mgr.14138) 62 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:06.491 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:06 smithi100 bash[13549]: audit 2021-01-28T03:52:05.712753+0000 mon.c (mon.1) 5 : audit [DBG] from='client.? 172.21.15.100:0/1348554430' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:52:06.493 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2021-01-28T03:52:06.493 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.conf 2021-01-28T03:52:06.509 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:06 smithi162 bash[9856]: audit 2021-01-28T03:52:05.230787+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:06.509 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:06 smithi162 bash[9856]: cephadm 2021-01-28T03:52:05.231769+0000 mgr.y (mgr.14138) 60 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-01-28T03:52:06.509 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:06 smithi162 bash[9856]: audit 2021-01-28T03:52:05.232245+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-28T03:52:06.509 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:06 smithi162 bash[9856]: audit 2021-01-28T03:52:05.233532+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:52:06.510 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:06 smithi162 bash[9856]: cephadm 2021-01-28T03:52:05.234540+0000 mgr.y (mgr.14138) 61 : cephadm [INF] Reconfiguring daemon mon.b on smithi162 2021-01-28T03:52:06.510 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:06 smithi162 bash[9856]: audit 2021-01-28T03:52:05.235395+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2021-01-28T03:52:06.510 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:06 smithi162 bash[9856]: cluster 2021-01-28T03:52:05.292372+0000 mgr.y (mgr.14138) 62 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:06.510 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:06 smithi162 bash[9856]: audit 2021-01-28T03:52:05.712753+0000 mon.c (mon.1) 5 : audit [DBG] from='client.? 172.21.15.100:0/1348554430' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:52:06.512 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2021-01-28T03:52:06.512 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2021-01-28T03:52:06.570 INFO:tasks.cephadm:Adding mgr.y on smithi100 2021-01-28T03:52:06.570 INFO:tasks.cephadm:Adding mgr.x on smithi162 2021-01-28T03:52:06.571 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph orch apply mgr '3;smithi100=y;smithi162=x' 2021-01-28T03:52:07.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:07 smithi162 bash[9856]: cluster 2021-01-28T03:52:07.292881+0000 mgr.y (mgr.14138) 63 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:07.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:07 smithi100 bash[9834]: cluster 2021-01-28T03:52:07.292881+0000 mgr.y (mgr.14138) 63 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:07.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:07 smithi100 bash[13549]: cluster 2021-01-28T03:52:07.292881+0000 mgr.y (mgr.14138) 63 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:09.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:08 smithi100 bash[9834]: audit 2021-01-28T03:52:07.796969+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:09.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:08 smithi100 bash[9834]: audit 2021-01-28T03:52:07.799633+0000 mon.a (mon.0) 208 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:52:09.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:08 smithi100 bash[9834]: audit 2021-01-28T03:52:07.800363+0000 mon.a (mon.0) 209 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:52:09.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:08 smithi100 bash[9834]: audit 2021-01-28T03:52:08.478493+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:09.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:08 smithi100 bash[9834]: audit 2021-01-28T03:52:08.566022+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:09.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:08 smithi100 bash[9834]: audit 2021-01-28T03:52:08.571150+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:09.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:08 smithi100 bash[9834]: audit 2021-01-28T03:52:08.572352+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-28T03:52:09.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:08 smithi100 bash[9834]: audit 2021-01-28T03:52:08.573660+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:52:09.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:08 smithi100 bash[9834]: audit 2021-01-28T03:52:08.574992+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2021-01-28T03:52:09.074 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:08 smithi100 bash[13549]: audit 2021-01-28T03:52:07.796969+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:09.074 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:08 smithi100 bash[13549]: audit 2021-01-28T03:52:07.799633+0000 mon.a (mon.0) 208 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:52:09.074 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:08 smithi100 bash[13549]: audit 2021-01-28T03:52:07.800363+0000 mon.a (mon.0) 209 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:52:09.074 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:08 smithi100 bash[13549]: audit 2021-01-28T03:52:08.478493+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:09.075 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:08 smithi100 bash[13549]: audit 2021-01-28T03:52:08.566022+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:09.075 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:08 smithi100 bash[13549]: audit 2021-01-28T03:52:08.571150+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:09.075 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:08 smithi100 bash[13549]: audit 2021-01-28T03:52:08.572352+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-28T03:52:09.075 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:08 smithi100 bash[13549]: audit 2021-01-28T03:52:08.573660+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:52:09.075 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:08 smithi100 bash[13549]: audit 2021-01-28T03:52:08.574992+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2021-01-28T03:52:09.259 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:08 smithi162 bash[9856]: audit 2021-01-28T03:52:07.796969+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:09.259 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:08 smithi162 bash[9856]: audit 2021-01-28T03:52:07.799633+0000 mon.a (mon.0) 208 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:52:09.259 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:08 smithi162 bash[9856]: audit 2021-01-28T03:52:07.800363+0000 mon.a (mon.0) 209 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:52:09.260 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:08 smithi162 bash[9856]: audit 2021-01-28T03:52:08.478493+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:09.260 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:08 smithi162 bash[9856]: audit 2021-01-28T03:52:08.566022+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:09.260 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:08 smithi162 bash[9856]: audit 2021-01-28T03:52:08.571150+0000 mon.a (mon.0) 212 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:09.260 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:08 smithi162 bash[9856]: audit 2021-01-28T03:52:08.572352+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-28T03:52:09.261 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:08 smithi162 bash[9856]: audit 2021-01-28T03:52:08.573660+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:52:09.261 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:08 smithi162 bash[9856]: audit 2021-01-28T03:52:08.574992+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2021-01-28T03:52:10.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:09 smithi100 bash[9834]: cephadm 2021-01-28T03:52:08.571830+0000 mgr.y (mgr.14138) 64 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-01-28T03:52:10.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:09 smithi100 bash[9834]: cephadm 2021-01-28T03:52:08.574475+0000 mgr.y (mgr.14138) 65 : cephadm [INF] Reconfiguring daemon mon.a on smithi100 2021-01-28T03:52:10.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:09 smithi100 bash[9834]: cluster 2021-01-28T03:52:09.293410+0000 mgr.y (mgr.14138) 66 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:10.074 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:09 smithi100 bash[13549]: cephadm 2021-01-28T03:52:08.571830+0000 mgr.y (mgr.14138) 64 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-01-28T03:52:10.074 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:09 smithi100 bash[13549]: cephadm 2021-01-28T03:52:08.574475+0000 mgr.y (mgr.14138) 65 : cephadm [INF] Reconfiguring daemon mon.a on smithi100 2021-01-28T03:52:10.074 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:09 smithi100 bash[13549]: cluster 2021-01-28T03:52:09.293410+0000 mgr.y (mgr.14138) 66 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:10.088 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.087+0000 7fd33af05700 1 -- 172.21.15.162:0/4170989076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3340f58a0 msgr2=0x7fd3340f5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:52:10.089 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.087+0000 7fd33af05700 1 --2- 172.21.15.162:0/4170989076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3340f58a0 0x7fd3340f5cc0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fd324004e30 tx=0x7fd324009b30).stop 2021-01-28T03:52:10.089 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.087+0000 7fd33af05700 1 -- 172.21.15.162:0/4170989076 shutdown_connections 2021-01-28T03:52:10.090 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.087+0000 7fd33af05700 1 --2- 172.21.15.162:0/4170989076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3340f58a0 0x7fd3340f5cc0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:52:10.090 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.087+0000 7fd33af05700 1 --2- 172.21.15.162:0/4170989076 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd3340f7490 0x7fd3340fdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:52:10.091 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.087+0000 7fd33af05700 1 --2- 172.21.15.162:0/4170989076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3340f6b40 0x7fd3340f6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:52:10.092 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.087+0000 7fd33af05700 1 -- 172.21.15.162:0/4170989076 >> 172.21.15.162:0/4170989076 conn(0x7fd3340f10a0 msgr2=0x7fd3340f34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:52:10.094 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.087+0000 7fd33af05700 1 -- 172.21.15.162:0/4170989076 shutdown_connections 2021-01-28T03:52:10.094 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.087+0000 7fd33af05700 1 -- 172.21.15.162:0/4170989076 wait complete. 2021-01-28T03:52:10.095 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.087+0000 7fd33af05700 1 Processor -- start 2021-01-28T03:52:10.095 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.087+0000 7fd33af05700 1 -- start start 2021-01-28T03:52:10.097 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.091+0000 7fd33af05700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3340f58a0 0x7fd33406aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:52:10.098 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.091+0000 7fd33af05700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3340f6b40 0x7fd334068f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:52:10.098 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.091+0000 7fd33af05700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd3340f7490 0x7fd334069560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:52:10.098 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.091+0000 7fd33af05700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd334069c50 con 0x7fd3340f6b40 2021-01-28T03:52:10.098 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.091+0000 7fd33af05700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd334069dc0 con 0x7fd3340f58a0 2021-01-28T03:52:10.099 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.091+0000 7fd33af05700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33410f8d0 con 0x7fd3340f7490 2021-01-28T03:52:10.099 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.091+0000 7fd339f03700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3340f58a0 0x7fd33406aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:52:10.099 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.091+0000 7fd339f03700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3340f58a0 0x7fd33406aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:44720/0 (socket says 172.21.15.162:44720) 2021-01-28T03:52:10.099 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.091+0000 7fd339f03700 1 -- 172.21.15.162:0/2907062954 learned_addr learned my addr 172.21.15.162:0/2907062954 (peer_addr_for_me v2:172.21.15.162:0/0) 2021-01-28T03:52:10.100 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.091+0000 7fd339702700 1 --2- 172.21.15.162:0/2907062954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3340f6b40 0x7fd334068f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:52:10.100 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.091+0000 7fd33a704700 1 --2- 172.21.15.162:0/2907062954 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd3340f7490 0x7fd334069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:52:10.100 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.091+0000 7fd339f03700 1 -- 172.21.15.162:0/2907062954 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd3340f7490 msgr2=0x7fd334069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:52:10.100 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.091+0000 7fd339f03700 1 --2- 172.21.15.162:0/2907062954 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd3340f7490 0x7fd334069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:52:10.101 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.091+0000 7fd339f03700 1 -- 172.21.15.162:0/2907062954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3340f6b40 msgr2=0x7fd334068f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:52:10.101 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.091+0000 7fd339f03700 1 --2- 172.21.15.162:0/2907062954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3340f6b40 0x7fd334068f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:52:10.101 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.091+0000 7fd339f03700 1 -- 172.21.15.162:0/2907062954 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33410fa90 con 0x7fd3340f58a0 2021-01-28T03:52:10.101 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.091+0000 7fd33a704700 1 --2- 172.21.15.162:0/2907062954 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd3340f7490 0x7fd334069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-28T03:52:10.101 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.091+0000 7fd339f03700 1 --2- 172.21.15.162:0/2907062954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3340f58a0 0x7fd33406aa90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fd324000e50 tx=0x7fd324009b30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:52:10.102 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.091+0000 7fd32a7fc700 1 -- 172.21.15.162:0/2907062954 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd32400e030 con 0x7fd3340f58a0 2021-01-28T03:52:10.102 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.091+0000 7fd32a7fc700 1 -- 172.21.15.162:0/2907062954 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fd3240041a0 con 0x7fd3340f58a0 2021-01-28T03:52:10.102 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.091+0000 7fd33af05700 1 -- 172.21.15.162:0/2907062954 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd33410fce0 con 0x7fd3340f58a0 2021-01-28T03:52:10.102 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.091+0000 7fd32a7fc700 1 -- 172.21.15.162:0/2907062954 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd324018070 con 0x7fd3340f58a0 2021-01-28T03:52:10.103 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.091+0000 7fd33af05700 1 -- 172.21.15.162:0/2907062954 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd334110140 con 0x7fd3340f58a0 2021-01-28T03:52:10.103 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.091+0000 7fd32a7fc700 1 -- 172.21.15.162:0/2907062954 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 13) v1 ==== 35845+0+0 (secure 0 0 0) 0x7fd32401d420 con 0x7fd3340f58a0 2021-01-28T03:52:10.103 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.091+0000 7fd32a7fc700 1 --2- 172.21.15.162:0/2907062954 >> v2:172.21.15.100:6800/928846103 conn(0x7fd32002fe60 0x7fd320032320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:52:10.104 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.095+0000 7fd32a7fc700 1 -- 172.21.15.162:0/2907062954 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1412+0+0 (secure 0 0 0) 0x7fd3240414d0 con 0x7fd3340f58a0 2021-01-28T03:52:10.104 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.095+0000 7fd33af05700 1 -- 172.21.15.162:0/2907062954 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3340f4c90 con 0x7fd3340f58a0 2021-01-28T03:52:10.104 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.095+0000 7fd339702700 1 --2- 172.21.15.162:0/2907062954 >> v2:172.21.15.100:6800/928846103 conn(0x7fd32002fe60 0x7fd320032320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:52:10.104 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.095+0000 7fd339702700 1 --2- 172.21.15.162:0/2907062954 >> v2:172.21.15.100:6800/928846103 conn(0x7fd32002fe60 0x7fd320032320 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fd330009fd0 tx=0x7fd33000b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:52:10.105 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.099+0000 7fd32a7fc700 1 -- 172.21.15.162:0/2907062954 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fd32400ba70 con 0x7fd3340f58a0 2021-01-28T03:52:10.258 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:09 smithi162 bash[9856]: cephadm 2021-01-28T03:52:08.571830+0000 mgr.y (mgr.14138) 64 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-01-28T03:52:10.259 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:09 smithi162 bash[9856]: cephadm 2021-01-28T03:52:08.574475+0000 mgr.y (mgr.14138) 65 : cephadm [INF] Reconfiguring daemon mon.a on smithi100 2021-01-28T03:52:10.259 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:09 smithi162 bash[9856]: cluster 2021-01-28T03:52:09.293410+0000 mgr.y (mgr.14138) 66 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:10.286 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.287+0000 7fd33af05700 1 -- 172.21.15.162:0/2907062954 --> v2:172.21.15.100:6800/928846103 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi100=y;smithi162=x", "target": ["mon-mgr", ""]}) v1 -- 0x7fd334100560 con 0x7fd32002fe60 2021-01-28T03:52:10.298 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.299+0000 7fd32a7fc700 1 -- 172.21.15.162:0/2907062954 <== mgr.14138 v2:172.21.15.100:6800/928846103 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fd334100560 con 0x7fd32002fe60 2021-01-28T03:52:10.299 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled mgr update... 2021-01-28T03:52:10.300 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.299+0000 7fd33af05700 1 -- 172.21.15.162:0/2907062954 >> v2:172.21.15.100:6800/928846103 conn(0x7fd32002fe60 msgr2=0x7fd320032320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:52:10.301 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.303+0000 7fd33af05700 1 --2- 172.21.15.162:0/2907062954 >> v2:172.21.15.100:6800/928846103 conn(0x7fd32002fe60 0x7fd320032320 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fd330009fd0 tx=0x7fd33000b040).stop 2021-01-28T03:52:10.301 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.303+0000 7fd33af05700 1 -- 172.21.15.162:0/2907062954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3340f58a0 msgr2=0x7fd33406aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:52:10.302 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.303+0000 7fd33af05700 1 --2- 172.21.15.162:0/2907062954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3340f58a0 0x7fd33406aa90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fd324000e50 tx=0x7fd324009b30).stop 2021-01-28T03:52:10.302 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.303+0000 7fd33af05700 1 -- 172.21.15.162:0/2907062954 shutdown_connections 2021-01-28T03:52:10.303 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.303+0000 7fd33af05700 1 --2- 172.21.15.162:0/2907062954 >> v2:172.21.15.100:6800/928846103 conn(0x7fd32002fe60 0x7fd320032320 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:52:10.304 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.303+0000 7fd33af05700 1 --2- 172.21.15.162:0/2907062954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3340f58a0 0x7fd33406aa90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:52:10.304 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.303+0000 7fd33af05700 1 --2- 172.21.15.162:0/2907062954 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd3340f7490 0x7fd334069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:52:10.305 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.303+0000 7fd33af05700 1 --2- 172.21.15.162:0/2907062954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3340f6b40 0x7fd334068f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:52:10.305 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.303+0000 7fd33af05700 1 -- 172.21.15.162:0/2907062954 >> 172.21.15.162:0/2907062954 conn(0x7fd3340f10a0 msgr2=0x7fd3340f9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:52:10.305 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.303+0000 7fd33af05700 1 -- 172.21.15.162:0/2907062954 shutdown_connections 2021-01-28T03:52:10.305 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:52:10.303+0000 7fd33af05700 1 -- 172.21.15.162:0/2907062954 wait complete. 2021-01-28T03:52:11.004 DEBUG:teuthology.orchestra.run.smithi162:mgr.x> sudo journalctl -f -n 0 -u ceph-c217df96-611b-11eb-8f9e-001a4aab830c@mgr.x.service 2021-01-28T03:52:11.009 INFO:tasks.cephadm:Deploying OSDs... 2021-01-28T03:52:11.009 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2021-01-28T03:52:11.011 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/scratch_devs of=/dev/stdout 2021-01-28T03:52:11.018 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-01-28T03:52:11.019 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-01-28T03:52:11.026 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-01-28T03:52:11.026 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-28T03:52:11.026 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 6h/6d Inode: 346 Links: 1 2021-01-28T03:52:11.027 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-28T03:52:11.027 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2021-01-28 03:46:06.141829480 +0000 2021-01-28T03:52:11.027 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2021-01-28 03:46:06.137829480 +0000 2021-01-28T03:52:11.028 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2021-01-28 03:46:06.137829480 +0000 2021-01-28T03:52:11.028 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: - 2021-01-28T03:52:11.034 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2021-01-28T03:52:11.035 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2021-01-28T03:52:11.035 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000371483 s, 1.4 MB/s 2021-01-28T03:52:11.039 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-01-28T03:52:11.039 INFO:journalctl@ceph.mgr.x.smithi162.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T03:52:11.088 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-01-28T03:52:11.088 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-28T03:52:11.089 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 6h/6d Inode: 355 Links: 1 2021-01-28T03:52:11.089 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-28T03:52:11.089 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2021-01-28 03:46:06.685829474 +0000 2021-01-28T03:52:11.089 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2021-01-28 03:46:06.525829476 +0000 2021-01-28T03:52:11.089 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2021-01-28 03:46:06.525829476 +0000 2021-01-28T03:52:11.090 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: - 2021-01-28T03:52:11.099 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2021-01-28T03:52:11.099 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2021-01-28T03:52:11.099 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000385283 s, 1.3 MB/s 2021-01-28T03:52:11.103 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-01-28T03:52:11.110 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-01-28T03:52:11.111 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-28T03:52:11.111 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 6h/6d Inode: 360 Links: 1 2021-01-28T03:52:11.111 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-28T03:52:11.112 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2021-01-28 03:46:07.109829470 +0000 2021-01-28T03:52:11.112 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2021-01-28 03:46:06.933829472 +0000 2021-01-28T03:52:11.112 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2021-01-28 03:46:06.933829472 +0000 2021-01-28T03:52:11.112 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: - 2021-01-28T03:52:11.119 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2021-01-28T03:52:11.119 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2021-01-28T03:52:11.119 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.00038812 s, 1.3 MB/s 2021-01-28T03:52:11.123 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-01-28T03:52:11.129 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-01-28T03:52:11.129 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-28T03:52:11.129 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 6h/6d Inode: 368 Links: 1 2021-01-28T03:52:11.129 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-28T03:52:11.130 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2021-01-28 03:46:07.337829467 +0000 2021-01-28T03:52:11.130 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2021-01-28 03:46:07.333829467 +0000 2021-01-28T03:52:11.130 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2021-01-28 03:46:07.333829467 +0000 2021-01-28T03:52:11.130 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: - 2021-01-28T03:52:11.137 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2021-01-28T03:52:11.137 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2021-01-28T03:52:11.137 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000320701 s, 1.6 MB/s 2021-01-28T03:52:11.141 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2021-01-28T03:52:11.141 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/scratch_devs of=/dev/stdout 2021-01-28T03:52:11.148 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-01-28T03:52:11.149 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-01-28T03:52:11.198 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-01-28T03:52:11.199 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-28T03:52:11.199 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 6h/6d Inode: 346 Links: 1 2021-01-28T03:52:11.199 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-28T03:52:11.199 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2021-01-28 03:46:06.267196589 +0000 2021-01-28T03:52:11.199 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2021-01-28 03:46:06.099196593 +0000 2021-01-28T03:52:11.200 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2021-01-28 03:46:06.099196593 +0000 2021-01-28T03:52:11.200 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: - 2021-01-28T03:52:11.209 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2021-01-28T03:52:11.209 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2021-01-28T03:52:11.209 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000391618 s, 1.3 MB/s 2021-01-28T03:52:11.214 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-01-28T03:52:11.221 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-01-28T03:52:11.221 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-28T03:52:11.222 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 6h/6d Inode: 355 Links: 1 2021-01-28T03:52:11.222 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-28T03:52:11.222 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2021-01-28 03:46:06.491196584 +0000 2021-01-28T03:52:11.222 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2021-01-28 03:46:06.487196584 +0000 2021-01-28T03:52:11.222 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2021-01-28 03:46:06.487196584 +0000 2021-01-28T03:52:11.223 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: - 2021-01-28T03:52:11.228 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2021-01-28T03:52:11.228 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2021-01-28T03:52:11.228 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000374115 s, 1.4 MB/s 2021-01-28T03:52:11.232 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-01-28T03:52:11.239 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-01-28T03:52:11.239 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-28T03:52:11.240 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 6h/6d Inode: 361 Links: 1 2021-01-28T03:52:11.240 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-28T03:52:11.240 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2021-01-28 03:46:06.895196575 +0000 2021-01-28T03:52:11.240 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2021-01-28 03:46:06.891196575 +0000 2021-01-28T03:52:11.241 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2021-01-28 03:46:06.891196575 +0000 2021-01-28T03:52:11.241 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: - 2021-01-28T03:52:11.249 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2021-01-28T03:52:11.250 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2021-01-28T03:52:11.250 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000347949 s, 1.5 MB/s 2021-01-28T03:52:11.254 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-01-28T03:52:11.304 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-01-28T03:52:11.305 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-28T03:52:11.305 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 6h/6d Inode: 365 Links: 1 2021-01-28T03:52:11.305 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-28T03:52:11.306 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2021-01-28 03:46:07.407196564 +0000 2021-01-28T03:52:11.306 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2021-01-28 03:46:07.271196567 +0000 2021-01-28T03:52:11.306 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2021-01-28 03:46:07.271196567 +0000 2021-01-28T03:52:11.306 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: - 2021-01-28T03:52:11.314 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2021-01-28T03:52:11.315 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2021-01-28T03:52:11.315 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000424484 s, 1.2 MB/s 2021-01-28T03:52:11.319 INFO:tasks.cephadm:Deploying osd.0 on smithi100 with /dev/vg_nvme/lv_4... 2021-01-28T03:52:11.321 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2021-01-28T03:52:11.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:11 smithi100 bash[9834]: audit 2021-01-28T03:52:10.293988+0000 mgr.y (mgr.14138) 67 : audit [DBG] from='client.34106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi100=y;smithi162=x", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:52:11.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:11 smithi100 bash[9834]: cephadm 2021-01-28T03:52:10.296089+0000 mgr.y (mgr.14138) 68 : cephadm [INF] Saving service mgr spec with placement smithi100=y;smithi162=x;count:3 2021-01-28T03:52:11.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:11 smithi100 bash[9834]: audit 2021-01-28T03:52:10.302165+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:11.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:11 smithi100 bash[9834]: audit 2021-01-28T03:52:10.816953+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:11.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:11 smithi100 bash[9834]: audit 2021-01-28T03:52:10.819284+0000 mon.a (mon.0) 218 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:52:11.572 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:11 smithi100 bash[13549]: audit 2021-01-28T03:52:10.293988+0000 mgr.y (mgr.14138) 67 : audit [DBG] from='client.34106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi100=y;smithi162=x", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:52:11.572 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:11 smithi100 bash[13549]: cephadm 2021-01-28T03:52:10.296089+0000 mgr.y (mgr.14138) 68 : cephadm [INF] Saving service mgr spec with placement smithi100=y;smithi162=x;count:3 2021-01-28T03:52:11.573 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:11 smithi100 bash[13549]: audit 2021-01-28T03:52:10.302165+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:11.573 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:11 smithi100 bash[13549]: audit 2021-01-28T03:52:10.816953+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:11.573 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:11 smithi100 bash[13549]: audit 2021-01-28T03:52:10.819284+0000 mon.a (mon.0) 218 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:52:11.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:11 smithi162 bash[9856]: audit 2021-01-28T03:52:10.293988+0000 mgr.y (mgr.14138) 67 : audit [DBG] from='client.34106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi100=y;smithi162=x", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:52:11.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:11 smithi162 bash[9856]: cephadm 2021-01-28T03:52:10.296089+0000 mgr.y (mgr.14138) 68 : cephadm [INF] Saving service mgr spec with placement smithi100=y;smithi162=x;count:3 2021-01-28T03:52:11.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:11 smithi162 bash[9856]: audit 2021-01-28T03:52:10.302165+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:11.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:11 smithi162 bash[9856]: audit 2021-01-28T03:52:10.816953+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:11.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:11 smithi162 bash[9856]: audit 2021-01-28T03:52:10.819284+0000 mon.a (mon.0) 218 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:52:12.509 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:12 smithi162 bash[9856]: cluster 2021-01-28T03:52:11.293874+0000 mgr.y (mgr.14138) 69 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:12.509 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:12 smithi162 bash[9856]: audit 2021-01-28T03:52:11.644407+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:12.510 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:12 smithi162 bash[9856]: audit 2021-01-28T03:52:11.650659+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:12.510 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:12 smithi162 bash[9856]: audit 2021-01-28T03:52:11.652381+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-01-28T03:52:12.510 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:12 smithi162 bash[9856]: audit 2021-01-28T03:52:11.656707+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-01-28T03:52:12.510 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:12 smithi162 bash[9856]: audit 2021-01-28T03:52:11.658030+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-01-28T03:52:12.511 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:12 smithi162 bash[9856]: audit 2021-01-28T03:52:11.659546+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:52:12.511 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:12 smithi162 bash[9856]: audit 2021-01-28T03:52:11.661442+0000 mon.a (mon.0) 225 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-01-28T03:52:12.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:12 smithi100 bash[9834]: cluster 2021-01-28T03:52:11.293874+0000 mgr.y (mgr.14138) 69 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:12.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:12 smithi100 bash[9834]: audit 2021-01-28T03:52:11.644407+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:12.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:12 smithi100 bash[9834]: audit 2021-01-28T03:52:11.650659+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:12.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:12 smithi100 bash[9834]: audit 2021-01-28T03:52:11.652381+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-01-28T03:52:12.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:12 smithi100 bash[9834]: audit 2021-01-28T03:52:11.656707+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-01-28T03:52:12.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:12 smithi100 bash[9834]: audit 2021-01-28T03:52:11.658030+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-01-28T03:52:12.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:12 smithi100 bash[9834]: audit 2021-01-28T03:52:11.659546+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:52:12.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:12 smithi100 bash[9834]: audit 2021-01-28T03:52:11.661442+0000 mon.a (mon.0) 225 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-01-28T03:52:12.573 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:12 smithi100 bash[13549]: cluster 2021-01-28T03:52:11.293874+0000 mgr.y (mgr.14138) 69 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:12.573 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:12 smithi100 bash[13549]: audit 2021-01-28T03:52:11.644407+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:12.573 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:12 smithi100 bash[13549]: audit 2021-01-28T03:52:11.650659+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:12.574 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:12 smithi100 bash[13549]: audit 2021-01-28T03:52:11.652381+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-01-28T03:52:12.574 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:12 smithi100 bash[13549]: audit 2021-01-28T03:52:11.656707+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-01-28T03:52:12.574 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:12 smithi100 bash[13549]: audit 2021-01-28T03:52:11.658030+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-01-28T03:52:12.574 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:12 smithi100 bash[13549]: audit 2021-01-28T03:52:11.659546+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:52:12.574 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:12 smithi100 bash[13549]: audit 2021-01-28T03:52:11.661442+0000 mon.a (mon.0) 225 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-01-28T03:52:13.405 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:13 smithi162 bash[9856]: cephadm 2021-01-28T03:52:11.651669+0000 mgr.y (mgr.14138) 70 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y')] + new hosts [HostPlacementSpec(hostname='smithi162', network='', name='x')] 2021-01-28T03:52:13.405 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:13 smithi162 bash[9856]: cephadm 2021-01-28T03:52:11.660598+0000 mgr.y (mgr.14138) 71 : cephadm [INF] Deploying daemon mgr.x on smithi162 2021-01-28T03:52:13.571 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:13 smithi100 bash[13549]: cephadm 2021-01-28T03:52:11.651669+0000 mgr.y (mgr.14138) 70 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y')] + new hosts [HostPlacementSpec(hostname='smithi162', network='', name='x')] 2021-01-28T03:52:13.571 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:13 smithi100 bash[13549]: cephadm 2021-01-28T03:52:11.660598+0000 mgr.y (mgr.14138) 71 : cephadm [INF] Deploying daemon mgr.x on smithi162 2021-01-28T03:52:13.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:13 smithi100 bash[9834]: cephadm 2021-01-28T03:52:11.651669+0000 mgr.y (mgr.14138) 70 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y')] + new hosts [HostPlacementSpec(hostname='smithi162', network='', name='x')] 2021-01-28T03:52:13.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:13 smithi100 bash[9834]: cephadm 2021-01-28T03:52:11.660598+0000 mgr.y (mgr.14138) 71 : cephadm [INF] Deploying daemon mgr.x on smithi162 2021-01-28T03:52:14.508 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:14 smithi162 bash[9856]: cluster 2021-01-28T03:52:13.294427+0000 mgr.y (mgr.14138) 72 : cluster [DBG] pgmap v45: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:14.571 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:14 smithi100 bash[13549]: cluster 2021-01-28T03:52:13.294427+0000 mgr.y (mgr.14138) 72 : cluster [DBG] pgmap v45: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:14.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:14 smithi100 bash[9834]: cluster 2021-01-28T03:52:13.294427+0000 mgr.y (mgr.14138) 72 : cluster [DBG] pgmap v45: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:15.042 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping: /dev/vg_nvme/lv_4 2021-01-28T03:52:15.043 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2021-01-28T03:52:15.043 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10+0 records in 2021-01-28T03:52:15.043 INFO:teuthology.orchestra.run.smithi100.stderr:10+0 records out 2021-01-28T03:52:15.043 INFO:teuthology.orchestra.run.smithi100.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0150159 s, 698 MB/s 2021-01-28T03:52:15.044 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping successful for: 2021-01-28T03:52:15.571 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:15 smithi100 bash[9834]: audit 2021-01-28T03:52:14.425228+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:15.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:15 smithi100 bash[9834]: audit 2021-01-28T03:52:14.427332+0000 mon.a (mon.0) 227 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:52:15.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:15 smithi100 bash[9834]: audit 2021-01-28T03:52:14.427754+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:52:15.572 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:15 smithi100 bash[9834]: audit 2021-01-28T03:52:15.189781+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:15.573 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:15 smithi100 bash[9834]: cluster 2021-01-28T03:52:15.294971+0000 mgr.y (mgr.14138) 73 : cluster [DBG] pgmap v46: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:15.573 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:15 smithi100 bash[13549]: audit 2021-01-28T03:52:14.425228+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:15.574 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:15 smithi100 bash[13549]: audit 2021-01-28T03:52:14.427332+0000 mon.a (mon.0) 227 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:52:15.574 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:15 smithi100 bash[13549]: audit 2021-01-28T03:52:14.427754+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:52:15.575 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:15 smithi100 bash[13549]: audit 2021-01-28T03:52:15.189781+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:15.575 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:15 smithi100 bash[13549]: cluster 2021-01-28T03:52:15.294971+0000 mgr.y (mgr.14138) 73 : cluster [DBG] pgmap v46: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:15.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:15 smithi162 bash[9856]: audit 2021-01-28T03:52:14.425228+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:15.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:15 smithi162 bash[9856]: audit 2021-01-28T03:52:14.427332+0000 mon.a (mon.0) 227 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:52:15.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:15 smithi162 bash[9856]: audit 2021-01-28T03:52:14.427754+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:52:15.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:15 smithi162 bash[9856]: audit 2021-01-28T03:52:15.189781+0000 mon.a (mon.0) 229 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:15.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:15 smithi162 bash[9856]: cluster 2021-01-28T03:52:15.294971+0000 mgr.y (mgr.14138) 73 : cluster [DBG] pgmap v46: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:15.760 INFO:journalctl@ceph.mgr.x.smithi162.stdout:Jan 28 03:52:15 smithi162 bash[10600]: debug 2021-01-28T03:52:15.547+0000 7f7e8b0af700 1 -- 172.21.15.162:0/313595172 <== mon.2 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564594cb44e0 con 0x564594da0c00 2021-01-28T03:52:15.791 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph orch daemon add osd smithi100:vg_nvme/lv_4 2021-01-28T03:52:17.008 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:16 smithi162 bash[9856]: audit 2021-01-28T03:52:15.626638+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:17.009 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:16 smithi162 bash[9856]: audit 2021-01-28T03:52:15.634968+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:17.009 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:16 smithi162 bash[9856]: cephadm 2021-01-28T03:52:15.635968+0000 mgr.y (mgr.14138) 74 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:52:17.009 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:16 smithi162 bash[9856]: audit 2021-01-28T03:52:15.638036+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:52:17.009 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:16 smithi162 bash[9856]: audit 2021-01-28T03:52:16.500085+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:17.010 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:16 smithi162 bash[9856]: audit 2021-01-28T03:52:16.505317+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:17.058 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:16 smithi100 bash[9834]: audit 2021-01-28T03:52:15.626638+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:17.059 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:16 smithi100 bash[9834]: audit 2021-01-28T03:52:15.634968+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:17.059 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:16 smithi100 bash[9834]: cephadm 2021-01-28T03:52:15.635968+0000 mgr.y (mgr.14138) 74 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:52:17.060 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:16 smithi100 bash[9834]: audit 2021-01-28T03:52:15.638036+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:52:17.060 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:16 smithi100 bash[9834]: audit 2021-01-28T03:52:16.500085+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:17.061 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:16 smithi100 bash[9834]: audit 2021-01-28T03:52:16.505317+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:17.061 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:16 smithi100 bash[13549]: audit 2021-01-28T03:52:15.626638+0000 mon.a (mon.0) 230 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:17.062 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:16 smithi100 bash[13549]: audit 2021-01-28T03:52:15.634968+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:17.062 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:16 smithi100 bash[13549]: cephadm 2021-01-28T03:52:15.635968+0000 mgr.y (mgr.14138) 74 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:52:17.062 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:16 smithi100 bash[13549]: audit 2021-01-28T03:52:15.638036+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:52:17.063 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:16 smithi100 bash[13549]: audit 2021-01-28T03:52:16.500085+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:17.063 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:16 smithi100 bash[13549]: audit 2021-01-28T03:52:16.505317+0000 mon.a (mon.0) 234 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:17.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:17 smithi100 bash[9834]: cephadm 2021-01-28T03:52:16.506388+0000 mgr.y (mgr.14138) 75 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:52:17.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:17 smithi100 bash[9834]: cluster 2021-01-28T03:52:17.295497+0000 mgr.y (mgr.14138) 76 : cluster [DBG] pgmap v47: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:17.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:17 smithi100 bash[13549]: cephadm 2021-01-28T03:52:16.506388+0000 mgr.y (mgr.14138) 75 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:52:17.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:17 smithi100 bash[13549]: cluster 2021-01-28T03:52:17.295497+0000 mgr.y (mgr.14138) 76 : cluster [DBG] pgmap v47: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:18.008 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:17 smithi162 bash[9856]: cephadm 2021-01-28T03:52:16.506388+0000 mgr.y (mgr.14138) 75 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:52:18.009 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:17 smithi162 bash[9856]: cluster 2021-01-28T03:52:17.295497+0000 mgr.y (mgr.14138) 76 : cluster [DBG] pgmap v47: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:19.083 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.086+0000 7ffa0359e700 1 -- 172.21.15.100:0/3781363717 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffa040f47a0 msgr2=0x7ffa040f4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:52:19.083 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.086+0000 7ffa0359e700 1 --2- 172.21.15.100:0/3781363717 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffa040f47a0 0x7ffa040f4bc0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7ff9fc004e30 tx=0x7ff9fc009b30).stop 2021-01-28T03:52:19.083 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.086+0000 7ffa0359e700 1 -- 172.21.15.100:0/3781363717 shutdown_connections 2021-01-28T03:52:19.083 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.086+0000 7ffa0359e700 1 --2- 172.21.15.100:0/3781363717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa040f6390 0x7ffa040fcc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:52:19.084 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.086+0000 7ffa0359e700 1 --2- 172.21.15.100:0/3781363717 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffa040f47a0 0x7ffa040f4bc0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:52:19.084 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.086+0000 7ffa0359e700 1 --2- 172.21.15.100:0/3781363717 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa040f5a40 0x7ffa040f5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:52:19.084 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.086+0000 7ffa0359e700 1 -- 172.21.15.100:0/3781363717 >> 172.21.15.100:0/3781363717 conn(0x7ffa040effa0 msgr2=0x7ffa040f23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:52:19.084 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.086+0000 7ffa0359e700 1 -- 172.21.15.100:0/3781363717 shutdown_connections 2021-01-28T03:52:19.085 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.086+0000 7ffa0359e700 1 -- 172.21.15.100:0/3781363717 wait complete. 2021-01-28T03:52:19.086 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.086+0000 7ffa0359e700 1 Processor -- start 2021-01-28T03:52:19.087 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.086+0000 7ffa0359e700 1 -- start start 2021-01-28T03:52:19.087 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.086+0000 7ffa0359e700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa040f47a0 0x7ffa041085f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:52:19.087 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.086+0000 7ffa0359e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa040f5a40 0x7ffa0410aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:52:19.087 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.086+0000 7ffa0359e700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffa040f6390 0x7ffa0410cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:52:19.087 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.086+0000 7ffa0359e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0410d4e0 con 0x7ffa040f5a40 2021-01-28T03:52:19.088 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.086+0000 7ffa0359e700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0410d620 con 0x7ffa040f47a0 2021-01-28T03:52:19.088 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.086+0000 7ffa0359e700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa0410d7e0 con 0x7ffa040f6390 2021-01-28T03:52:19.088 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.086+0000 7ffa01d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa040f5a40 0x7ffa0410aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:52:19.088 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.086+0000 7ffa01d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa040f5a40 0x7ffa0410aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59106/0 (socket says 172.21.15.100:59106) 2021-01-28T03:52:19.089 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.086+0000 7ffa01d9b700 1 -- 172.21.15.100:0/3501919392 learned_addr learned my addr 172.21.15.100:0/3501919392 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:52:19.089 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.086+0000 7ffa02d9d700 1 --2- 172.21.15.100:0/3501919392 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffa040f6390 0x7ffa0410cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:52:19.089 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.086+0000 7ffa0259c700 1 --2- 172.21.15.100:0/3501919392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa040f47a0 0x7ffa041085f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:52:19.089 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.086+0000 7ffa01d9b700 1 -- 172.21.15.100:0/3501919392 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffa040f6390 msgr2=0x7ffa0410cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:52:19.089 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.086+0000 7ffa01d9b700 1 --2- 172.21.15.100:0/3501919392 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffa040f6390 0x7ffa0410cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:52:19.090 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.086+0000 7ffa01d9b700 1 -- 172.21.15.100:0/3501919392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa040f47a0 msgr2=0x7ffa041085f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:52:19.090 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.086+0000 7ffa01d9b700 1 --2- 172.21.15.100:0/3501919392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa040f47a0 0x7ffa041085f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:52:19.090 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.086+0000 7ffa01d9b700 1 -- 172.21.15.100:0/3501919392 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa0410d9a0 con 0x7ffa040f5a40 2021-01-28T03:52:19.090 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.086+0000 7ffa0259c700 1 --2- 172.21.15.100:0/3501919392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa040f47a0 0x7ffa041085f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-28T03:52:19.090 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.086+0000 7ffa01d9b700 1 --2- 172.21.15.100:0/3501919392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa040f5a40 0x7ffa0410aaf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7ff9ec00ebc0 tx=0x7ff9ec00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:52:19.091 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.086+0000 7ff9faffd700 1 -- 172.21.15.100:0/3501919392 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec0092e0 con 0x7ffa040f5a40 2021-01-28T03:52:19.091 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.086+0000 7ff9faffd700 1 -- 172.21.15.100:0/3501919392 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7ff9ec00f040 con 0x7ffa040f5a40 2021-01-28T03:52:19.091 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.086+0000 7ffa0359e700 1 -- 172.21.15.100:0/3501919392 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa0410dc50 con 0x7ffa040f5a40 2021-01-28T03:52:19.091 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.086+0000 7ff9faffd700 1 -- 172.21.15.100:0/3501919392 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec00c940 con 0x7ffa040f5a40 2021-01-28T03:52:19.092 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.090+0000 7ffa0359e700 1 -- 172.21.15.100:0/3501919392 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa0410e140 con 0x7ffa040f5a40 2021-01-28T03:52:19.092 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.090+0000 7ff9faffd700 1 -- 172.21.15.100:0/3501919392 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 13) v1 ==== 35845+0+0 (secure 0 0 0) 0x7ff9ec00cd30 con 0x7ffa040f5a40 2021-01-28T03:52:19.092 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.090+0000 7ff9faffd700 1 --2- 172.21.15.100:0/3501919392 >> v2:172.21.15.100:6800/928846103 conn(0x7ff9f002fe60 0x7ff9f0032320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:52:19.092 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.090+0000 7ff9faffd700 1 -- 172.21.15.100:0/3501919392 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1412+0+0 (secure 0 0 0) 0x7ff9ec040470 con 0x7ffa040f5a40 2021-01-28T03:52:19.093 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.090+0000 7ffa0259c700 1 --2- 172.21.15.100:0/3501919392 >> v2:172.21.15.100:6800/928846103 conn(0x7ff9f002fe60 0x7ff9f0032320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:52:19.093 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.090+0000 7ffa0359e700 1 -- 172.21.15.100:0/3501919392 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa040f3b90 con 0x7ffa040f5a40 2021-01-28T03:52:19.093 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.090+0000 7ffa0259c700 1 --2- 172.21.15.100:0/3501919392 >> v2:172.21.15.100:6800/928846103 conn(0x7ff9f002fe60 0x7ff9f0032320 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7ff9fc00bcb0 tx=0x7ff9fc009b30).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:52:19.094 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.094+0000 7ff9faffd700 1 -- 172.21.15.100:0/3501919392 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7ff9ec011ce0 con 0x7ffa040f5a40 2021-01-28T03:52:19.283 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:19.286+0000 7ffa0359e700 1 -- 172.21.15.100:0/3501919392 --> v2:172.21.15.100:6800/928846103 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa040ff560 con 0x7ff9f002fe60 2021-01-28T03:52:19.667 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:19 smithi100 bash[13549]: audit 2021-01-28T03:52:19.293136+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T03:52:19.667 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:19 smithi100 bash[13549]: audit 2021-01-28T03:52:19.297124+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T03:52:19.668 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:19 smithi100 bash[13549]: audit 2021-01-28T03:52:19.298489+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:52:19.668 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:19 smithi100 bash[13549]: audit 2021-01-28T03:52:19.300204+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:52:19.668 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:19 smithi100 bash[9834]: audit 2021-01-28T03:52:19.293136+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T03:52:19.668 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:19 smithi100 bash[9834]: audit 2021-01-28T03:52:19.297124+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T03:52:19.669 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:19 smithi100 bash[9834]: audit 2021-01-28T03:52:19.298489+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:52:19.669 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:19 smithi100 bash[9834]: audit 2021-01-28T03:52:19.300204+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:52:19.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:19 smithi162 bash[9856]: audit 2021-01-28T03:52:19.293136+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T03:52:19.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:19 smithi162 bash[9856]: audit 2021-01-28T03:52:19.297124+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T03:52:19.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:19 smithi162 bash[9856]: audit 2021-01-28T03:52:19.298489+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:52:19.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:19 smithi162 bash[9856]: audit 2021-01-28T03:52:19.300204+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:52:20.730 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:20 smithi100 bash[9834]: audit 2021-01-28T03:52:19.290924+0000 mgr.y (mgr.14138) 77 : audit [DBG] from='client.14199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:52:20.730 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:20 smithi100 bash[9834]: cluster 2021-01-28T03:52:19.295915+0000 mgr.y (mgr.14138) 78 : cluster [DBG] pgmap v48: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:20.730 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:20 smithi100 bash[9834]: cephadm 2021-01-28T03:52:19.296666+0000 mgr.y (mgr.14138) 79 : cephadm [INF] Applying drive group None on host smithi100... 2021-01-28T03:52:20.731 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:20 smithi100 bash[13549]: audit 2021-01-28T03:52:19.290924+0000 mgr.y (mgr.14138) 77 : audit [DBG] from='client.14199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:52:20.731 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:20 smithi100 bash[13549]: cluster 2021-01-28T03:52:19.295915+0000 mgr.y (mgr.14138) 78 : cluster [DBG] pgmap v48: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:20.731 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:20 smithi100 bash[13549]: cephadm 2021-01-28T03:52:19.296666+0000 mgr.y (mgr.14138) 79 : cephadm [INF] Applying drive group None on host smithi100... 2021-01-28T03:52:20.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:20 smithi162 bash[9856]: audit 2021-01-28T03:52:19.290924+0000 mgr.y (mgr.14138) 77 : audit [DBG] from='client.14199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:52:20.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:20 smithi162 bash[9856]: cluster 2021-01-28T03:52:19.295915+0000 mgr.y (mgr.14138) 78 : cluster [DBG] pgmap v48: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:20.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:20 smithi162 bash[9856]: cephadm 2021-01-28T03:52:19.296666+0000 mgr.y (mgr.14138) 79 : cephadm [INF] Applying drive group None on host smithi100... 2021-01-28T03:52:21.364 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:21.366+0000 7ff9faffd700 1 -- 172.21.15.100:0/3501919392 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mgrmap(e 14) v1 ==== 71316+0+0 (secure 0 0 0) 0x7ff9ec013930 con 0x7ffa040f5a40 2021-01-28T03:52:21.628 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:21 smithi100 bash[9834]: audit 2021-01-28T03:52:21.332728+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.162:0/2977914645' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-01-28T03:52:21.628 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:21 smithi100 bash[9834]: cluster 2021-01-28T03:52:21.333661+0000 mon.a (mon.0) 239 : cluster [DBG] Standby manager daemon x started 2021-01-28T03:52:21.629 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:21 smithi100 bash[9834]: audit 2021-01-28T03:52:21.334441+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.15.162:0/2977914645' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-01-28T03:52:21.629 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:21 smithi100 bash[13549]: audit 2021-01-28T03:52:21.332728+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.162:0/2977914645' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-01-28T03:52:21.629 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:21 smithi100 bash[13549]: cluster 2021-01-28T03:52:21.333661+0000 mon.a (mon.0) 239 : cluster [DBG] Standby manager daemon x started 2021-01-28T03:52:21.629 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:21 smithi100 bash[13549]: audit 2021-01-28T03:52:21.334441+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.15.162:0/2977914645' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-01-28T03:52:21.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:21 smithi162 bash[9856]: audit 2021-01-28T03:52:21.332728+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.162:0/2977914645' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-01-28T03:52:21.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:21 smithi162 bash[9856]: cluster 2021-01-28T03:52:21.333661+0000 mon.a (mon.0) 239 : cluster [DBG] Standby manager daemon x started 2021-01-28T03:52:21.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:21 smithi162 bash[9856]: audit 2021-01-28T03:52:21.334441+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.15.162:0/2977914645' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-01-28T03:52:22.652 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:22 smithi100 bash[9834]: cluster 2021-01-28T03:52:21.296365+0000 mgr.y (mgr.14138) 80 : cluster [DBG] pgmap v49: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:22.652 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:22 smithi100 bash[9834]: cluster 2021-01-28T03:52:21.371520+0000 mon.a (mon.0) 240 : cluster [DBG] mgrmap e14: y(active, since 106s), standbys: x 2021-01-28T03:52:22.653 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:22 smithi100 bash[9834]: audit 2021-01-28T03:52:21.371690+0000 mon.a (mon.0) 241 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-01-28T03:52:22.653 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:22 smithi100 bash[13549]: cluster 2021-01-28T03:52:21.296365+0000 mgr.y (mgr.14138) 80 : cluster [DBG] pgmap v49: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:22.653 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:22 smithi100 bash[13549]: cluster 2021-01-28T03:52:21.371520+0000 mon.a (mon.0) 240 : cluster [DBG] mgrmap e14: y(active, since 106s), standbys: x 2021-01-28T03:52:22.653 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:22 smithi100 bash[13549]: audit 2021-01-28T03:52:21.371690+0000 mon.a (mon.0) 241 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-01-28T03:52:22.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:22 smithi162 bash[9856]: cluster 2021-01-28T03:52:21.296365+0000 mgr.y (mgr.14138) 80 : cluster [DBG] pgmap v49: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:22.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:22 smithi162 bash[9856]: cluster 2021-01-28T03:52:21.371520+0000 mon.a (mon.0) 240 : cluster [DBG] mgrmap e14: y(active, since 106s), standbys: x 2021-01-28T03:52:22.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:22 smithi162 bash[9856]: audit 2021-01-28T03:52:21.371690+0000 mon.a (mon.0) 241 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-01-28T03:52:24.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:24 smithi162 bash[9856]: cluster 2021-01-28T03:52:23.296840+0000 mgr.y (mgr.14138) 81 : cluster [DBG] pgmap v50: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:24.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:24 smithi162 bash[9856]: audit 2021-01-28T03:52:23.421547+0000 mon.c (mon.1) 6 : audit [INF] from='client.? 172.21.15.100:0/260725470' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b19e5679-7a32-467e-bef2-460c896020db"}]: dispatch 2021-01-28T03:52:24.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:24 smithi162 bash[9856]: audit 2021-01-28T03:52:23.422208+0000 mon.a (mon.0) 242 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b19e5679-7a32-467e-bef2-460c896020db"}]: dispatch 2021-01-28T03:52:24.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:24 smithi162 bash[9856]: audit 2021-01-28T03:52:23.429296+0000 mon.a (mon.0) 243 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b19e5679-7a32-467e-bef2-460c896020db"}]': finished 2021-01-28T03:52:24.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:24 smithi162 bash[9856]: cluster 2021-01-28T03:52:23.429494+0000 mon.a (mon.0) 244 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2021-01-28T03:52:24.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:24 smithi162 bash[9856]: audit 2021-01-28T03:52:23.429751+0000 mon.a (mon.0) 245 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-28T03:52:24.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:24 smithi162 bash[9856]: audit 2021-01-28T03:52:24.058489+0000 mon.a (mon.0) 246 : audit [DBG] from='client.? 172.21.15.100:0/2656124308' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T03:52:24.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:24 smithi100 bash[9834]: cluster 2021-01-28T03:52:23.296840+0000 mgr.y (mgr.14138) 81 : cluster [DBG] pgmap v50: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:24.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:24 smithi100 bash[9834]: audit 2021-01-28T03:52:23.421547+0000 mon.c (mon.1) 6 : audit [INF] from='client.? 172.21.15.100:0/260725470' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b19e5679-7a32-467e-bef2-460c896020db"}]: dispatch 2021-01-28T03:52:24.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:24 smithi100 bash[9834]: audit 2021-01-28T03:52:23.422208+0000 mon.a (mon.0) 242 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b19e5679-7a32-467e-bef2-460c896020db"}]: dispatch 2021-01-28T03:52:24.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:24 smithi100 bash[9834]: audit 2021-01-28T03:52:23.429296+0000 mon.a (mon.0) 243 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b19e5679-7a32-467e-bef2-460c896020db"}]': finished 2021-01-28T03:52:24.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:24 smithi100 bash[9834]: cluster 2021-01-28T03:52:23.429494+0000 mon.a (mon.0) 244 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2021-01-28T03:52:24.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:24 smithi100 bash[9834]: audit 2021-01-28T03:52:23.429751+0000 mon.a (mon.0) 245 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-28T03:52:24.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:24 smithi100 bash[9834]: audit 2021-01-28T03:52:24.058489+0000 mon.a (mon.0) 246 : audit [DBG] from='client.? 172.21.15.100:0/2656124308' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T03:52:24.823 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:24 smithi100 bash[13549]: cluster 2021-01-28T03:52:23.296840+0000 mgr.y (mgr.14138) 81 : cluster [DBG] pgmap v50: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:24.823 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:24 smithi100 bash[13549]: audit 2021-01-28T03:52:23.421547+0000 mon.c (mon.1) 6 : audit [INF] from='client.? 172.21.15.100:0/260725470' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b19e5679-7a32-467e-bef2-460c896020db"}]: dispatch 2021-01-28T03:52:24.823 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:24 smithi100 bash[13549]: audit 2021-01-28T03:52:23.422208+0000 mon.a (mon.0) 242 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b19e5679-7a32-467e-bef2-460c896020db"}]: dispatch 2021-01-28T03:52:24.823 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:24 smithi100 bash[13549]: audit 2021-01-28T03:52:23.429296+0000 mon.a (mon.0) 243 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b19e5679-7a32-467e-bef2-460c896020db"}]': finished 2021-01-28T03:52:24.823 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:24 smithi100 bash[13549]: cluster 2021-01-28T03:52:23.429494+0000 mon.a (mon.0) 244 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2021-01-28T03:52:24.824 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:24 smithi100 bash[13549]: audit 2021-01-28T03:52:23.429751+0000 mon.a (mon.0) 245 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-28T03:52:24.824 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:24 smithi100 bash[13549]: audit 2021-01-28T03:52:24.058489+0000 mon.a (mon.0) 246 : audit [DBG] from='client.? 172.21.15.100:0/2656124308' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T03:52:26.656 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:26 smithi100 bash[9834]: cluster 2021-01-28T03:52:25.297364+0000 mgr.y (mgr.14138) 82 : cluster [DBG] pgmap v52: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:26.656 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:26 smithi100 bash[13549]: cluster 2021-01-28T03:52:25.297364+0000 mgr.y (mgr.14138) 82 : cluster [DBG] pgmap v52: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:26.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:26 smithi162 bash[9856]: cluster 2021-01-28T03:52:25.297364+0000 mgr.y (mgr.14138) 82 : cluster [DBG] pgmap v52: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:27.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:27 smithi162 bash[9856]: audit 2021-01-28T03:52:27.232920+0000 mon.a (mon.0) 247 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:52:27.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:27 smithi162 bash[9856]: cluster 2021-01-28T03:52:27.297853+0000 mgr.y (mgr.14138) 83 : cluster [DBG] pgmap v53: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:27.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:27 smithi100 bash[13549]: audit 2021-01-28T03:52:27.232920+0000 mon.a (mon.0) 247 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:52:27.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:27 smithi100 bash[13549]: cluster 2021-01-28T03:52:27.297853+0000 mgr.y (mgr.14138) 83 : cluster [DBG] pgmap v53: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:27.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:27 smithi100 bash[9834]: audit 2021-01-28T03:52:27.232920+0000 mon.a (mon.0) 247 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:52:27.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:27 smithi100 bash[9834]: cluster 2021-01-28T03:52:27.297853+0000 mgr.y (mgr.14138) 83 : cluster [DBG] pgmap v53: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:29.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:29 smithi162 bash[9856]: cluster 2021-01-28T03:52:29.349455+0000 mon.a (mon.0) 248 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-01-28T03:52:29.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:29 smithi100 bash[13549]: cluster 2021-01-28T03:52:29.349455+0000 mon.a (mon.0) 248 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-01-28T03:52:29.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:29 smithi100 bash[9834]: cluster 2021-01-28T03:52:29.349455+0000 mon.a (mon.0) 248 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-01-28T03:52:30.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:30 smithi162 bash[9856]: cluster 2021-01-28T03:52:29.298437+0000 mgr.y (mgr.14138) 84 : cluster [DBG] pgmap v54: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:30.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:30 smithi100 bash[9834]: cluster 2021-01-28T03:52:29.298437+0000 mgr.y (mgr.14138) 84 : cluster [DBG] pgmap v54: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:30.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:30 smithi100 bash[13549]: cluster 2021-01-28T03:52:29.298437+0000 mgr.y (mgr.14138) 84 : cluster [DBG] pgmap v54: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:32.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:32 smithi162 bash[9856]: cluster 2021-01-28T03:52:31.298976+0000 mgr.y (mgr.14138) 85 : cluster [DBG] pgmap v55: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:32.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:32 smithi162 bash[9856]: audit 2021-01-28T03:52:31.679809+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-01-28T03:52:32.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:32 smithi162 bash[9856]: audit 2021-01-28T03:52:31.681555+0000 mon.a (mon.0) 250 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:52:32.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:32 smithi162 bash[9856]: audit 2021-01-28T03:52:31.683829+0000 mon.a (mon.0) 251 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2021-01-28T03:52:32.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:32 smithi100 bash[9834]: cluster 2021-01-28T03:52:31.298976+0000 mgr.y (mgr.14138) 85 : cluster [DBG] pgmap v55: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:32.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:32 smithi100 bash[9834]: audit 2021-01-28T03:52:31.679809+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-01-28T03:52:32.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:32 smithi100 bash[9834]: audit 2021-01-28T03:52:31.681555+0000 mon.a (mon.0) 250 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:52:32.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:32 smithi100 bash[9834]: audit 2021-01-28T03:52:31.683829+0000 mon.a (mon.0) 251 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2021-01-28T03:52:32.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:32 smithi100 bash[13549]: cluster 2021-01-28T03:52:31.298976+0000 mgr.y (mgr.14138) 85 : cluster [DBG] pgmap v55: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:32.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:32 smithi100 bash[13549]: audit 2021-01-28T03:52:31.679809+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-01-28T03:52:32.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:32 smithi100 bash[13549]: audit 2021-01-28T03:52:31.681555+0000 mon.a (mon.0) 250 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:52:32.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:32 smithi100 bash[13549]: audit 2021-01-28T03:52:31.683829+0000 mon.a (mon.0) 251 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2021-01-28T03:52:33.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:33 smithi162 bash[9856]: cephadm 2021-01-28T03:52:31.682901+0000 mgr.y (mgr.14138) 86 : cephadm [INF] Deploying daemon osd.0 on smithi100 2021-01-28T03:52:33.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:33 smithi100 bash[9834]: cephadm 2021-01-28T03:52:31.682901+0000 mgr.y (mgr.14138) 86 : cephadm [INF] Deploying daemon osd.0 on smithi100 2021-01-28T03:52:33.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:33 smithi100 bash[13549]: cephadm 2021-01-28T03:52:31.682901+0000 mgr.y (mgr.14138) 86 : cephadm [INF] Deploying daemon osd.0 on smithi100 2021-01-28T03:52:34.410 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:34.414+0000 7ff9faffd700 1 -- 172.21.15.100:0/3501919392 <== mgr.14138 v2:172.21.15.100:6800/928846103 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ffa040ff560 con 0x7ff9f002fe60 2021-01-28T03:52:34.410 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 0 on host 'smithi100' 2021-01-28T03:52:34.412 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:34.414+0000 7ffa0359e700 1 -- 172.21.15.100:0/3501919392 >> v2:172.21.15.100:6800/928846103 conn(0x7ff9f002fe60 msgr2=0x7ff9f0032320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:52:34.412 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:34.414+0000 7ffa0359e700 1 --2- 172.21.15.100:0/3501919392 >> v2:172.21.15.100:6800/928846103 conn(0x7ff9f002fe60 0x7ff9f0032320 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7ff9fc00bcb0 tx=0x7ff9fc009b30).stop 2021-01-28T03:52:34.412 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:34.414+0000 7ffa0359e700 1 -- 172.21.15.100:0/3501919392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa040f5a40 msgr2=0x7ffa0410aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:52:34.412 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:34.414+0000 7ffa0359e700 1 --2- 172.21.15.100:0/3501919392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa040f5a40 0x7ffa0410aaf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7ff9ec00ebc0 tx=0x7ff9ec00b040).stop 2021-01-28T03:52:34.412 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:34.414+0000 7ffa0359e700 1 -- 172.21.15.100:0/3501919392 shutdown_connections 2021-01-28T03:52:34.413 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:34.414+0000 7ffa0359e700 1 --2- 172.21.15.100:0/3501919392 >> v2:172.21.15.100:6800/928846103 conn(0x7ff9f002fe60 0x7ff9f0032320 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:52:34.413 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:34.414+0000 7ffa0359e700 1 --2- 172.21.15.100:0/3501919392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa040f47a0 0x7ffa041085f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:52:34.414 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:34.414+0000 7ffa0359e700 1 --2- 172.21.15.100:0/3501919392 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffa040f6390 0x7ffa0410cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:52:34.414 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:34.414+0000 7ffa0359e700 1 --2- 172.21.15.100:0/3501919392 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa040f5a40 0x7ffa0410aaf0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:52:34.414 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:34.414+0000 7ffa0359e700 1 -- 172.21.15.100:0/3501919392 >> 172.21.15.100:0/3501919392 conn(0x7ffa040effa0 msgr2=0x7ffa040f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:52:34.415 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:34.414+0000 7ffa0359e700 1 -- 172.21.15.100:0/3501919392 shutdown_connections 2021-01-28T03:52:34.416 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:34.414+0000 7ffa0359e700 1 -- 172.21.15.100:0/3501919392 wait complete. 2021-01-28T03:52:34.598 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:34 smithi100 bash[9834]: cluster 2021-01-28T03:52:33.299554+0000 mgr.y (mgr.14138) 87 : cluster [DBG] pgmap v56: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:34.598 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:34 smithi100 bash[9834]: audit 2021-01-28T03:52:34.406766+0000 mon.a (mon.0) 252 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:52:34.598 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:34 smithi100 bash[9834]: audit 2021-01-28T03:52:34.411706+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:34.599 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:34 smithi100 bash[13549]: cluster 2021-01-28T03:52:33.299554+0000 mgr.y (mgr.14138) 87 : cluster [DBG] pgmap v56: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:34.599 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:34 smithi100 bash[13549]: audit 2021-01-28T03:52:34.406766+0000 mon.a (mon.0) 252 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:52:34.599 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:34 smithi100 bash[13549]: audit 2021-01-28T03:52:34.411706+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:34.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:34 smithi162 bash[9856]: cluster 2021-01-28T03:52:33.299554+0000 mgr.y (mgr.14138) 87 : cluster [DBG] pgmap v56: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:34.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:34 smithi162 bash[9856]: audit 2021-01-28T03:52:34.406766+0000 mon.a (mon.0) 252 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:52:34.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:34 smithi162 bash[9856]: audit 2021-01-28T03:52:34.411706+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:35.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:35 smithi100 bash[13549]: cephadm 2021-01-28T03:52:34.406575+0000 mgr.y (mgr.14138) 88 : cephadm [INF] refreshing smithi162 facts 2021-01-28T03:52:35.674 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:35 smithi100 bash[13549]: audit 2021-01-28T03:52:35.303416+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:35.675 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:35 smithi100 bash[13549]: audit 2021-01-28T03:52:35.304749+0000 mon.a (mon.0) 255 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:52:35.675 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:35 smithi100 bash[9834]: cephadm 2021-01-28T03:52:34.406575+0000 mgr.y (mgr.14138) 88 : cephadm [INF] refreshing smithi162 facts 2021-01-28T03:52:35.676 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:35 smithi100 bash[9834]: audit 2021-01-28T03:52:35.303416+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:35.676 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:35 smithi100 bash[9834]: audit 2021-01-28T03:52:35.304749+0000 mon.a (mon.0) 255 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:52:35.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:35 smithi162 bash[9856]: cephadm 2021-01-28T03:52:34.406575+0000 mgr.y (mgr.14138) 88 : cephadm [INF] refreshing smithi162 facts 2021-01-28T03:52:35.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:35 smithi162 bash[9856]: audit 2021-01-28T03:52:35.303416+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:35.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:35 smithi162 bash[9856]: audit 2021-01-28T03:52:35.304749+0000 mon.a (mon.0) 255 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:52:35.897 DEBUG:teuthology.orchestra.run.smithi100:osd.0> sudo journalctl -f -n 0 -u ceph-c217df96-611b-11eb-8f9e-001a4aab830c@osd.0.service 2021-01-28T03:52:35.903 INFO:tasks.cephadm:Deploying osd.1 on smithi100 with /dev/vg_nvme/lv_3... 2021-01-28T03:52:35.903 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2021-01-28T03:52:36.025 INFO:journalctl@ceph.osd.0.smithi100.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T03:52:36.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:36 smithi162 bash[9856]: cluster 2021-01-28T03:52:35.300131+0000 mgr.y (mgr.14138) 89 : cluster [DBG] pgmap v57: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:36.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:36 smithi162 bash[9856]: audit 2021-01-28T03:52:35.471279+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T03:52:36.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:36 smithi162 bash[9856]: audit 2021-01-28T03:52:35.483227+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T03:52:36.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:36 smithi100 bash[9834]: cluster 2021-01-28T03:52:35.300131+0000 mgr.y (mgr.14138) 89 : cluster [DBG] pgmap v57: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:36.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:36 smithi100 bash[9834]: audit 2021-01-28T03:52:35.471279+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T03:52:36.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:36 smithi100 bash[9834]: audit 2021-01-28T03:52:35.483227+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T03:52:36.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:36 smithi100 bash[13549]: cluster 2021-01-28T03:52:35.300131+0000 mgr.y (mgr.14138) 89 : cluster [DBG] pgmap v57: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:36.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:36 smithi100 bash[13549]: audit 2021-01-28T03:52:35.471279+0000 mon.a (mon.0) 256 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T03:52:36.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:36 smithi100 bash[13549]: audit 2021-01-28T03:52:35.483227+0000 mon.a (mon.0) 257 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T03:52:37.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:37 smithi162 bash[9856]: cluster 2021-01-28T03:52:37.300690+0000 mgr.y (mgr.14138) 90 : cluster [DBG] pgmap v58: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:37.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:37 smithi100 bash[9834]: cluster 2021-01-28T03:52:37.300690+0000 mgr.y (mgr.14138) 90 : cluster [DBG] pgmap v58: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:37.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:37 smithi100 bash[13549]: cluster 2021-01-28T03:52:37.300690+0000 mgr.y (mgr.14138) 90 : cluster [DBG] pgmap v58: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:37.831 INFO:journalctl@ceph.osd.0.smithi100.stdout:Jan 28 03:52:37 smithi100 bash[16327]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-01-28T03:52:37.832 INFO:journalctl@ceph.osd.0.smithi100.stdout:Jan 28 03:52:37 smithi100 bash[16327]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2021-01-28T03:52:37.832 INFO:journalctl@ceph.osd.0.smithi100.stdout:Jan 28 03:52:37 smithi100 bash[16327]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2021-01-28T03:52:37.832 INFO:journalctl@ceph.osd.0.smithi100.stdout:Jan 28 03:52:37 smithi100 bash[16327]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2021-01-28T03:52:37.832 INFO:journalctl@ceph.osd.0.smithi100.stdout:Jan 28 03:52:37 smithi100 bash[16327]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2021-01-28T03:52:37.833 INFO:journalctl@ceph.osd.0.smithi100.stdout:Jan 28 03:52:37 smithi100 bash[16327]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-01-28T03:52:37.833 INFO:journalctl@ceph.osd.0.smithi100.stdout:Jan 28 03:52:37 smithi100 bash[16327]: --> ceph-volume lvm activate successful for osd ID: 0 2021-01-28T03:52:40.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:40 smithi100 bash[9834]: cluster 2021-01-28T03:52:39.301249+0000 mgr.y (mgr.14138) 91 : cluster [DBG] pgmap v59: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:40.571 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:40 smithi100 bash[13549]: cluster 2021-01-28T03:52:39.301249+0000 mgr.y (mgr.14138) 91 : cluster [DBG] pgmap v59: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:40.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:40 smithi162 bash[9856]: cluster 2021-01-28T03:52:39.301249+0000 mgr.y (mgr.14138) 91 : cluster [DBG] pgmap v59: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:42.177 INFO:journalctl@ceph.osd.0.smithi100.stdout:Jan 28 03:52:41 smithi100 bash[16657]: debug 2021-01-28T03:52:41.910+0000 7f5fded57700 10 -- 172.21.15.100:0/24254141 dispatch_throttle_release 413 to dispatch throttler 413/104857600 2021-01-28T03:52:42.177 INFO:journalctl@ceph.osd.0.smithi100.stdout:Jan 28 03:52:41 smithi100 bash[16657]: debug 2021-01-28T03:52:41.910+0000 7f5fded57700 20 -- 172.21.15.100:0/24254141 done calling dispatch on 0x557d13676c60 2021-01-28T03:52:42.178 INFO:journalctl@ceph.osd.0.smithi100.stdout:Jan 28 03:52:41 smithi100 bash[16657]: debug 2021-01-28T03:52:41.910+0000 7f5fdfd59700 20 -- 172.21.15.100:0/24254141 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x557d136fec00 msgr2=0x557d1366b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2021-01-28T03:52:42.178 INFO:journalctl@ceph.osd.0.smithi100.stdout:Jan 28 03:52:41 smithi100 bash[16657]: debug 2021-01-28T03:52:41.910+0000 7f5fdfd59700 20 -- 172.21.15.100:0/24254141 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x557d136fec00 msgr2=0x557d1366b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=96 2021-01-28T03:52:42.179 INFO:journalctl@ceph.osd.0.smithi100.stdout:Jan 28 03:52:41 smithi100 bash[16657]: debug 2021-01-28T03:52:41.910+0000 7f5fdfd59700 20 --2- 172.21.15.100:0/24254141 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x557d136fec00 0x557d1366b400 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x557d1367be60 tx=0x557d136b0d80).handle_read_frame_preamble_main r=0 2021-01-28T03:52:42.179 INFO:journalctl@ceph.osd.0.smithi100.stdout:Jan 28 03:52:41 smithi100 bash[16657]: debug 2021-01-28T03:52:41.910+0000 7f5fdfd59700 20 --2- 172.21.15.100:0/24254141 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x557d136fec00 0x557d1366b400 secure :-1 s=THROTTLE_MESSAGE pgs=9 cs=0 l=1 rev1=1 rx=0x557d1367be60 tx=0x557d136b0d80).throttle_message 2021-01-28T03:52:42.179 INFO:journalctl@ceph.osd.0.smithi100.stdout:Jan 28 03:52:41 smithi100 bash[16657]: debug 2021-01-28T03:52:41.910+0000 7f5fdfd59700 20 --2- 172.21.15.100:0/24254141 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x557d136fec00 0x557d1366b400 secure :-1 s=THROTTLE_BYTES pgs=9 cs=0 l=1 rev1=1 rx=0x557d1367be60 tx=0x557d136b0d80).throttle_bytes 2021-01-28T03:52:42.180 INFO:journalctl@ceph.osd.0.smithi100.stdout:Jan 28 03:52:41 smithi100 bash[16657]: debug 2021-01-28T03:52:41.910+0000 7f5fdfd59700 20 --2- 172.21.15.100:0/24254141 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x557d136fec00 0x557d1366b400 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=9 cs=0 l=1 rev1=1 rx=0x557d1367be60 tx=0x557d136b0d80).throttle_dispatch_queue 2021-01-28T03:52:42.180 INFO:journalctl@ceph.osd.0.smithi100.stdout:Jan 28 03:52:41 smithi100 bash[16657]: debug 2021-01-28T03:52:41.910+0000 7f5fdfd59700 20 --2- 172.21.15.100:0/24254141 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x557d136fec00 0x557d1366b400 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rev1=1 rx=0x557d1367be60 tx=0x557d136b0d80).read_frame_segment seg_idx=0 2021-01-28T03:52:42.180 INFO:journalctl@ceph.osd.0.smithi100.stdout:Jan 28 03:52:41 smithi100 bash[16657]: debug 2021-01-28T03:52:41.910+0000 7f5fdfd59700 20 --2- 172.21.15.100:0/24254141 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x557d136fec00 0x557d1366b400 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rev1=1 rx=0x557d1367be60 tx=0x557d136b0d80).read_frame_segment seg_idx=1 2021-01-28T03:52:42.181 INFO:journalctl@ceph.osd.0.smithi100.stdout:Jan 28 03:52:41 smithi100 bash[16657]: debug 2021-01-28T03:52:41.910+0000 7f5fdfd59700 20 -- 172.21.15.100:0/24254141 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x557d136fec00 msgr2=0x557d1366b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2021-01-28T03:52:42.181 INFO:journalctl@ceph.osd.0.smithi100.stdout:Jan 28 03:52:41 smithi100 bash[16657]: debug 2021-01-28T03:52:41.910+0000 7f5fdfd59700 20 --2- 172.21.15.100:0/24254141 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x557d136fec00 0x557d1366b400 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rev1=1 rx=0x557d1367be60 tx=0x557d136b0d80).handle_read_frame_segment r=0 2021-01-28T03:52:42.181 INFO:journalctl@ceph.osd.0.smithi100.stdout:Jan 28 03:52:41 smithi100 bash[16657]: debug 2021-01-28T03:52:41.910+0000 7f5fdfd59700 20 -- 172.21.15.100:0/24254141 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x557d136fec00 msgr2=0x557d1366b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2021-01-28T03:52:42.182 INFO:journalctl@ceph.osd.0.smithi100.stdout:Jan 28 03:52:41 smithi100 bash[16657]: debug 2021-01-28T03:52:41.910+0000 7f5fdfd59700 20 --2- 172.21.15.100:0/24254141 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x557d136fec00 0x557d1366b400 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rev1=1 rx=0x557d1367be60 tx=0x557d136b0d80).handle_read_frame_epilogue_main r=0 2021-01-28T03:52:42.182 INFO:journalctl@ceph.osd.0.smithi100.stdout:Jan 28 03:52:41 smithi100 bash[16657]: debug 2021-01-28T03:52:41.910+0000 7f5fdfd59700 10 --2- 172.21.15.100:0/24254141 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x557d136fec00 0x557d1366b400 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rev1=1 rx=0x557d1367be60 tx=0x557d136b0d80).handle_read_frame_dispatch tag=17 2021-01-28T03:52:42.183 INFO:journalctl@ceph.osd.0.smithi100.stdout:Jan 28 03:52:41 smithi100 bash[16657]: debug 2021-01-28T03:52:41.910+0000 7f5fdfd59700 20 --2- 172.21.15.100:0/24254141 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x557d136fec00 0x557d1366b400 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rev1=1 rx=0x557d1367be60 tx=0x557d136b0d80).handle_message 2021-01-28T03:52:42.183 INFO:journalctl@ceph.osd.0.smithi100.stdout:Jan 28 03:52:41 smithi100 bash[16657]: debug 2021-01-28T03:52:41.910+0000 7f5fdfd59700 5 --2- 172.21.15.100:0/24254141 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x557d136fec00 0x557d1366b400 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rev1=1 rx=0x557d1367be60 tx=0x557d136b0d80).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.1 off 0 2021-01-28T03:52:42.184 INFO:journalctl@ceph.osd.0.smithi100.stdout:Jan 28 03:52:41 smithi100 bash[16657]: debug 2021-01-28T03:52:41.910+0000 7f5fdfd59700 5 --2- 172.21.15.100:0/24254141 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x557d136fec00 0x557d1366b400 secure :-1 s=READ_MESSAGE_COMPLETE pgs=9 cs=0 l=1 rev1=1 rx=0x557d1367be60 tx=0x557d136b0d80).handle_message received message m=0x557d136804e0 seq=4 from=mon.1 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-28T03:52:42.184 INFO:journalctl@ceph.osd.0.smithi100.stdout:Jan 28 03:52:41 smithi100 bash[16657]: debug 2021-01-28T03:52:41.910+0000 7f5fdfd59700 20 -- 172.21.15.100:0/24254141 queue 0x557d136804e0 prio 196 2021-01-28T03:52:42.184 INFO:journalctl@ceph.osd.0.smithi100.stdout:Jan 28 03:52:41 smithi100 bash[16657]: debug 2021-01-28T03:52:41.910+0000 7f5fdfd59700 20 --2- 172.21.15.100:0/24254141 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x557d136fec00 0x557d1366b400 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x557d1367be60 tx=0x557d136b0d80).read_frame 2021-01-28T03:52:42.185 INFO:journalctl@ceph.osd.0.smithi100.stdout:Jan 28 03:52:41 smithi100 bash[16657]: debug 2021-01-28T03:52:41.910+0000 7f5fdfd59700 20 -- 172.21.15.100:0/24254141 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x557d136fec00 msgr2=0x557d1366b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-28T03:52:42.185 INFO:journalctl@ceph.osd.0.smithi100.stdout:Jan 28 03:52:41 smithi100 bash[16657]: debug 2021-01-28T03:52:41.910+0000 7f5fded57700 1 -- 172.21.15.100:0/24254141 <== mon.1 v2:172.21.15.100:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557d136804e0 con 0x557d136fec00 2021-01-28T03:52:42.186 INFO:journalctl@ceph.osd.0.smithi100.stdout:Jan 28 03:52:41 smithi100 bash[16657]: debug 2021-01-28T03:52:41.910+0000 7f5fded57700 10 -- 172.21.15.100:0/24254141 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-28T03:52:42.186 INFO:journalctl@ceph.osd.0.smithi100.stdout:Jan 28 03:52:41 smithi100 bash[16657]: debug 2021-01-28T03:52:41.910+0000 7f5fded57700 20 -- 172.21.15.100:0/24254141 done calling dispatch on 0x557d136804e0 2021-01-28T03:52:42.468 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:42 smithi100 bash[9834]: cluster 2021-01-28T03:52:41.301752+0000 mgr.y (mgr.14138) 92 : cluster [DBG] pgmap v60: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:42.468 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:42 smithi100 bash[13549]: cluster 2021-01-28T03:52:41.301752+0000 mgr.y (mgr.14138) 92 : cluster [DBG] pgmap v60: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:42.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:42 smithi162 bash[9856]: cluster 2021-01-28T03:52:41.301752+0000 mgr.y (mgr.14138) 92 : cluster [DBG] pgmap v60: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:42.820 INFO:journalctl@ceph.osd.0.smithi100.stdout:Jan 28 03:52:42 smithi100 bash[16657]: debug 2021-01-28T03:52:42.478+0000 7f5fe67e2200 -1 Falling back to public interface 2021-01-28T03:52:43.073 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping: /dev/vg_nvme/lv_3 2021-01-28T03:52:43.074 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2021-01-28T03:52:43.074 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10+0 records in 2021-01-28T03:52:43.074 INFO:teuthology.orchestra.run.smithi100.stderr:10+0 records out 2021-01-28T03:52:43.074 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0165968 s, 632 MB/s 2021-01-28T03:52:43.075 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping successful for: 2021-01-28T03:52:44.101 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph orch daemon add osd smithi100:vg_nvme/lv_3 2021-01-28T03:52:44.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:44 smithi100 bash[9834]: cluster 2021-01-28T03:52:43.302317+0000 mgr.y (mgr.14138) 93 : cluster [DBG] pgmap v61: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:44.571 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:44 smithi100 bash[13549]: cluster 2021-01-28T03:52:43.302317+0000 mgr.y (mgr.14138) 93 : cluster [DBG] pgmap v61: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:44.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:44 smithi162 bash[9856]: cluster 2021-01-28T03:52:43.302317+0000 mgr.y (mgr.14138) 93 : cluster [DBG] pgmap v61: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:45.715 INFO:journalctl@ceph.osd.0.smithi100.stdout:Jan 28 03:52:45 smithi100 bash[16657]: debug 2021-01-28T03:52:45.566+0000 7f5fe67e2200 -1 osd.0 0 log_to_monitors {default=true} 2021-01-28T03:52:45.716 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:45 smithi100 bash[9834]: audit 2021-01-28T03:52:44.882756+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:52:45.716 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:45 smithi100 bash[9834]: audit 2021-01-28T03:52:45.253929+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:45.716 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:45 smithi100 bash[9834]: audit 2021-01-28T03:52:45.259409+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:45.716 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:45 smithi100 bash[9834]: audit 2021-01-28T03:52:45.265310+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:45.717 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:45 smithi100 bash[13549]: audit 2021-01-28T03:52:44.882756+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:52:45.717 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:45 smithi100 bash[13549]: audit 2021-01-28T03:52:45.253929+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:45.717 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:45 smithi100 bash[13549]: audit 2021-01-28T03:52:45.259409+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:45.717 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:45 smithi100 bash[13549]: audit 2021-01-28T03:52:45.265310+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:45.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:45 smithi162 bash[9856]: audit 2021-01-28T03:52:44.882756+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:52:45.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:45 smithi162 bash[9856]: audit 2021-01-28T03:52:45.253929+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:45.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:45 smithi162 bash[9856]: audit 2021-01-28T03:52:45.259409+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:45.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:45 smithi162 bash[9856]: audit 2021-01-28T03:52:45.265310+0000 mon.a (mon.0) 261 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:52:46.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:46 smithi162 bash[9856]: cephadm 2021-01-28T03:52:45.260223+0000 mgr.y (mgr.14138) 94 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:52:46.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:46 smithi162 bash[9856]: cephadm 2021-01-28T03:52:45.266301+0000 mgr.y (mgr.14138) 95 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:52:46.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:46 smithi162 bash[9856]: cluster 2021-01-28T03:52:45.302849+0000 mgr.y (mgr.14138) 96 : cluster [DBG] pgmap v62: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:46.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:46 smithi162 bash[9856]: audit 2021-01-28T03:52:45.577740+0000 mon.c (mon.1) 7 : audit [INF] from='osd.0 v2:172.21.15.100:6801/2076626497' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-01-28T03:52:46.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:46 smithi162 bash[9856]: audit 2021-01-28T03:52:45.579930+0000 mon.a (mon.0) 262 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-01-28T03:52:46.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:46 smithi100 bash[9834]: cephadm 2021-01-28T03:52:45.260223+0000 mgr.y (mgr.14138) 94 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:52:46.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:46 smithi100 bash[9834]: cephadm 2021-01-28T03:52:45.266301+0000 mgr.y (mgr.14138) 95 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:52:46.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:46 smithi100 bash[9834]: cluster 2021-01-28T03:52:45.302849+0000 mgr.y (mgr.14138) 96 : cluster [DBG] pgmap v62: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:46.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:46 smithi100 bash[9834]: audit 2021-01-28T03:52:45.577740+0000 mon.c (mon.1) 7 : audit [INF] from='osd.0 v2:172.21.15.100:6801/2076626497' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-01-28T03:52:46.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:46 smithi100 bash[9834]: audit 2021-01-28T03:52:45.579930+0000 mon.a (mon.0) 262 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-01-28T03:52:46.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:46 smithi100 bash[13549]: cephadm 2021-01-28T03:52:45.260223+0000 mgr.y (mgr.14138) 94 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:52:46.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:46 smithi100 bash[13549]: cephadm 2021-01-28T03:52:45.266301+0000 mgr.y (mgr.14138) 95 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:52:46.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:46 smithi100 bash[13549]: cluster 2021-01-28T03:52:45.302849+0000 mgr.y (mgr.14138) 96 : cluster [DBG] pgmap v62: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:46.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:46 smithi100 bash[13549]: audit 2021-01-28T03:52:45.577740+0000 mon.c (mon.1) 7 : audit [INF] from='osd.0 v2:172.21.15.100:6801/2076626497' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-01-28T03:52:46.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:46 smithi100 bash[13549]: audit 2021-01-28T03:52:45.579930+0000 mon.a (mon.0) 262 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-01-28T03:52:47.626 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.630+0000 7fbc6eb5c700 1 -- 172.21.15.100:0/1281642351 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc680fb4c0 msgr2=0x7fbc680fd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:52:47.627 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.630+0000 7fbc6eb5c700 1 --2- 172.21.15.100:0/1281642351 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc680fb4c0 0x7fbc680fd950 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fbc60009dc0 tx=0x7fbc60004d10).stop 2021-01-28T03:52:47.627 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.630+0000 7fbc6eb5c700 1 -- 172.21.15.100:0/1281642351 shutdown_connections 2021-01-28T03:52:47.627 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.630+0000 7fbc6eb5c700 1 --2- 172.21.15.100:0/1281642351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc6805f730 0x7fbc680f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:52:47.628 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.630+0000 7fbc6eb5c700 1 --2- 172.21.15.100:0/1281642351 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc680fb4c0 0x7fbc680fd950 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:52:47.628 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.630+0000 7fbc6eb5c700 1 --2- 172.21.15.100:0/1281642351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc680f8a30 0x7fbc680fae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:52:47.628 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.630+0000 7fbc6eb5c700 1 -- 172.21.15.100:0/1281642351 >> 172.21.15.100:0/1281642351 conn(0x7fbc680effe0 msgr2=0x7fbc680f2400 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:52:47.628 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.630+0000 7fbc6eb5c700 1 -- 172.21.15.100:0/1281642351 shutdown_connections 2021-01-28T03:52:47.629 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.630+0000 7fbc6eb5c700 1 -- 172.21.15.100:0/1281642351 wait complete. 2021-01-28T03:52:47.630 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.630+0000 7fbc6eb5c700 1 Processor -- start 2021-01-28T03:52:47.630 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.630+0000 7fbc6eb5c700 1 -- start start 2021-01-28T03:52:47.631 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.630+0000 7fbc6eb5c700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc6805f730 0x7fbc680f5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:52:47.631 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.630+0000 7fbc6eb5c700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc680f8a30 0x7fbc680f4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:52:47.631 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.630+0000 7fbc6eb5c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc680fb4c0 0x7fbc680f4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:52:47.631 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.630+0000 7fbc6eb5c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc680f5180 con 0x7fbc680fb4c0 2021-01-28T03:52:47.632 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.630+0000 7fbc6eb5c700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc680f52f0 con 0x7fbc680f8a30 2021-01-28T03:52:47.632 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.630+0000 7fbc6eb5c700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6810f7b0 con 0x7fbc6805f730 2021-01-28T03:52:47.633 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.630+0000 7fbc6db5a700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc6805f730 0x7fbc680f5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:52:47.633 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.630+0000 7fbc6e35b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc680fb4c0 0x7fbc680f4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:52:47.633 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.630+0000 7fbc6db5a700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc6805f730 0x7fbc680f5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:40150/0 (socket says 172.21.15.100:40150) 2021-01-28T03:52:47.633 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.630+0000 7fbc6db5a700 1 -- 172.21.15.100:0/2121027421 learned_addr learned my addr 172.21.15.100:0/2121027421 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:52:47.633 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.630+0000 7fbc6d359700 1 --2- 172.21.15.100:0/2121027421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc680f8a30 0x7fbc680f4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:52:47.634 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.630+0000 7fbc6e35b700 1 -- 172.21.15.100:0/2121027421 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc6805f730 msgr2=0x7fbc680f5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:52:47.634 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.634+0000 7fbc6e35b700 1 --2- 172.21.15.100:0/2121027421 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc6805f730 0x7fbc680f5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:52:47.634 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.634+0000 7fbc6e35b700 1 -- 172.21.15.100:0/2121027421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc680f8a30 msgr2=0x7fbc680f4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:52:47.634 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.634+0000 7fbc6e35b700 1 --2- 172.21.15.100:0/2121027421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc680f8a30 0x7fbc680f4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:52:47.635 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.634+0000 7fbc6e35b700 1 -- 172.21.15.100:0/2121027421 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6810f970 con 0x7fbc680fb4c0 2021-01-28T03:52:47.635 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.634+0000 7fbc6db5a700 1 --2- 172.21.15.100:0/2121027421 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc6805f730 0x7fbc680f5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-28T03:52:47.636 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.634+0000 7fbc6e35b700 1 --2- 172.21.15.100:0/2121027421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc680fb4c0 0x7fbc680f4a90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fbc60004750 tx=0x7fbc60007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:52:47.636 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.634+0000 7fbc667fc700 1 -- 172.21.15.100:0/2121027421 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6000e070 con 0x7fbc680fb4c0 2021-01-28T03:52:47.636 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.634+0000 7fbc667fc700 1 -- 172.21.15.100:0/2121027421 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fbc60004e90 con 0x7fbc680fb4c0 2021-01-28T03:52:47.636 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.634+0000 7fbc6eb5c700 1 -- 172.21.15.100:0/2121027421 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc6810fbc0 con 0x7fbc680fb4c0 2021-01-28T03:52:47.637 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.634+0000 7fbc667fc700 1 -- 172.21.15.100:0/2121027421 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc60018070 con 0x7fbc680fb4c0 2021-01-28T03:52:47.637 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.634+0000 7fbc6eb5c700 1 -- 172.21.15.100:0/2121027421 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc6810ffc0 con 0x7fbc680fb4c0 2021-01-28T03:52:47.638 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.634+0000 7fbc6eb5c700 1 -- 172.21.15.100:0/2121027421 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc680f3bb0 con 0x7fbc680fb4c0 2021-01-28T03:52:47.638 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.634+0000 7fbc667fc700 1 -- 172.21.15.100:0/2121027421 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 14) v1 ==== 71316+0+0 (secure 0 0 0) 0x7fbc60024070 con 0x7fbc680fb4c0 2021-01-28T03:52:47.638 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.638+0000 7fbc667fc700 1 --2- 172.21.15.100:0/2121027421 >> v2:172.21.15.100:6800/928846103 conn(0x7fbc5005bc30 0x7fbc5005e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:52:47.639 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.638+0000 7fbc667fc700 1 -- 172.21.15.100:0/2121027421 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1744+0+0 (secure 0 0 0) 0x7fbc60075dd0 con 0x7fbc680fb4c0 2021-01-28T03:52:47.639 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.638+0000 7fbc6db5a700 1 --2- 172.21.15.100:0/2121027421 >> v2:172.21.15.100:6800/928846103 conn(0x7fbc5005bc30 0x7fbc5005e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:52:47.639 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.638+0000 7fbc6db5a700 1 --2- 172.21.15.100:0/2121027421 >> v2:172.21.15.100:6800/928846103 conn(0x7fbc5005bc30 0x7fbc5005e0f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fbc680f5d50 tx=0x7fbc5800b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:52:47.640 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.642+0000 7fbc667fc700 1 -- 172.21.15.100:0/2121027421 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fbc60049bc0 con 0x7fbc680fb4c0 2021-01-28T03:52:47.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:47 smithi162 bash[9856]: audit 2021-01-28T03:52:46.377098+0000 mon.a (mon.0) 263 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-01-28T03:52:47.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:47 smithi162 bash[9856]: cluster 2021-01-28T03:52:46.377295+0000 mon.a (mon.0) 264 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2021-01-28T03:52:47.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:47 smithi162 bash[9856]: audit 2021-01-28T03:52:46.378348+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-28T03:52:47.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:47 smithi162 bash[9856]: audit 2021-01-28T03:52:46.386754+0000 mon.c (mon.1) 8 : audit [INF] from='osd.0 v2:172.21.15.100:6801/2076626497' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2021-01-28T03:52:47.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:47 smithi162 bash[9856]: audit 2021-01-28T03:52:46.387443+0000 mon.a (mon.0) 266 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2021-01-28T03:52:47.820 INFO:journalctl@ceph.osd.0.smithi100.stdout:Jan 28 03:52:47 smithi100 bash[16657]: debug 2021-01-28T03:52:47.402+0000 7f5fdcd53700 -1 osd.0 0 waiting for initial osdmap 2021-01-28T03:52:47.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:47 smithi100 bash[9834]: audit 2021-01-28T03:52:46.377098+0000 mon.a (mon.0) 263 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-01-28T03:52:47.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:47 smithi100 bash[9834]: cluster 2021-01-28T03:52:46.377295+0000 mon.a (mon.0) 264 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2021-01-28T03:52:47.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:47 smithi100 bash[9834]: audit 2021-01-28T03:52:46.378348+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-28T03:52:47.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:47 smithi100 bash[9834]: audit 2021-01-28T03:52:46.386754+0000 mon.c (mon.1) 8 : audit [INF] from='osd.0 v2:172.21.15.100:6801/2076626497' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2021-01-28T03:52:47.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:47 smithi100 bash[9834]: audit 2021-01-28T03:52:46.387443+0000 mon.a (mon.0) 266 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2021-01-28T03:52:47.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:47 smithi100 bash[13549]: audit 2021-01-28T03:52:46.377098+0000 mon.a (mon.0) 263 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-01-28T03:52:47.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:47 smithi100 bash[13549]: cluster 2021-01-28T03:52:46.377295+0000 mon.a (mon.0) 264 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2021-01-28T03:52:47.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:47 smithi100 bash[13549]: audit 2021-01-28T03:52:46.378348+0000 mon.a (mon.0) 265 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-28T03:52:47.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:47 smithi100 bash[13549]: audit 2021-01-28T03:52:46.386754+0000 mon.c (mon.1) 8 : audit [INF] from='osd.0 v2:172.21.15.100:6801/2076626497' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2021-01-28T03:52:47.823 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:47 smithi100 bash[13549]: audit 2021-01-28T03:52:46.387443+0000 mon.a (mon.0) 266 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2021-01-28T03:52:47.832 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:47.834+0000 7fbc6eb5c700 1 -- 172.21.15.100:0/2121027421 --> v2:172.21.15.100:6800/928846103 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc68100670 con 0x7fbc5005bc30 2021-01-28T03:52:48.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:48 smithi162 bash[9856]: cluster 2021-01-28T03:52:47.303415+0000 mgr.y (mgr.14138) 97 : cluster [DBG] pgmap v64: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:48.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:48 smithi162 bash[9856]: audit 2021-01-28T03:52:47.391799+0000 mon.a (mon.0) 267 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2021-01-28T03:52:48.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:48 smithi162 bash[9856]: cluster 2021-01-28T03:52:47.391930+0000 mon.a (mon.0) 268 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2021-01-28T03:52:48.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:48 smithi162 bash[9856]: audit 2021-01-28T03:52:47.392854+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-28T03:52:48.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:48 smithi162 bash[9856]: audit 2021-01-28T03:52:47.403438+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-28T03:52:48.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:48 smithi162 bash[9856]: audit 2021-01-28T03:52:47.842398+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T03:52:48.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:48 smithi162 bash[9856]: audit 2021-01-28T03:52:47.845358+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T03:52:48.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:48 smithi162 bash[9856]: audit 2021-01-28T03:52:47.846904+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:52:48.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:48 smithi162 bash[9856]: audit 2021-01-28T03:52:47.848905+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:52:48.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:48 smithi100 bash[9834]: cluster 2021-01-28T03:52:47.303415+0000 mgr.y (mgr.14138) 97 : cluster [DBG] pgmap v64: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:48.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:48 smithi100 bash[9834]: audit 2021-01-28T03:52:47.391799+0000 mon.a (mon.0) 267 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2021-01-28T03:52:48.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:48 smithi100 bash[9834]: cluster 2021-01-28T03:52:47.391930+0000 mon.a (mon.0) 268 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2021-01-28T03:52:48.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:48 smithi100 bash[9834]: audit 2021-01-28T03:52:47.392854+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-28T03:52:48.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:48 smithi100 bash[9834]: audit 2021-01-28T03:52:47.403438+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-28T03:52:48.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:48 smithi100 bash[9834]: audit 2021-01-28T03:52:47.842398+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T03:52:48.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:48 smithi100 bash[9834]: audit 2021-01-28T03:52:47.845358+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T03:52:48.824 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:48 smithi100 bash[9834]: audit 2021-01-28T03:52:47.846904+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:52:48.824 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:48 smithi100 bash[9834]: audit 2021-01-28T03:52:47.848905+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:52:48.825 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:48 smithi100 bash[13549]: cluster 2021-01-28T03:52:47.303415+0000 mgr.y (mgr.14138) 97 : cluster [DBG] pgmap v64: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:48.825 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:48 smithi100 bash[13549]: audit 2021-01-28T03:52:47.391799+0000 mon.a (mon.0) 267 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2021-01-28T03:52:48.825 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:48 smithi100 bash[13549]: cluster 2021-01-28T03:52:47.391930+0000 mon.a (mon.0) 268 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2021-01-28T03:52:48.826 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:48 smithi100 bash[13549]: audit 2021-01-28T03:52:47.392854+0000 mon.a (mon.0) 269 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-28T03:52:48.826 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:48 smithi100 bash[13549]: audit 2021-01-28T03:52:47.403438+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-28T03:52:48.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:48 smithi100 bash[13549]: audit 2021-01-28T03:52:47.842398+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T03:52:48.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:48 smithi100 bash[13549]: audit 2021-01-28T03:52:47.845358+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T03:52:48.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:48 smithi100 bash[13549]: audit 2021-01-28T03:52:47.846904+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:52:48.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:48 smithi100 bash[13549]: audit 2021-01-28T03:52:47.848905+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:52:49.727 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:49 smithi100 bash[9834]: cluster 2021-01-28T03:52:46.582435+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T03:52:49.728 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:49 smithi100 bash[9834]: cluster 2021-01-28T03:52:46.582658+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T03:52:49.728 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:49 smithi100 bash[9834]: audit 2021-01-28T03:52:47.840447+0000 mgr.y (mgr.14138) 98 : audit [DBG] from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:52:49.728 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:49 smithi100 bash[9834]: cephadm 2021-01-28T03:52:47.844827+0000 mgr.y (mgr.14138) 99 : cephadm [INF] Applying drive group None on host smithi100... 2021-01-28T03:52:49.728 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:49 smithi100 bash[9834]: cluster 2021-01-28T03:52:48.403738+0000 mon.a (mon.0) 275 : cluster [INF] osd.0 v2:172.21.15.100:6801/2076626497 boot 2021-01-28T03:52:49.728 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:49 smithi100 bash[9834]: cluster 2021-01-28T03:52:48.403860+0000 mon.a (mon.0) 276 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2021-01-28T03:52:49.729 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:49 smithi100 bash[9834]: audit 2021-01-28T03:52:48.404875+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-28T03:52:49.729 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:49 smithi100 bash[9834]: cluster 2021-01-28T03:52:49.407523+0000 mon.a (mon.0) 278 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2021-01-28T03:52:49.730 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:49 smithi100 bash[13549]: cluster 2021-01-28T03:52:46.582435+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T03:52:49.730 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:49 smithi100 bash[13549]: cluster 2021-01-28T03:52:46.582658+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T03:52:49.730 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:49 smithi100 bash[13549]: audit 2021-01-28T03:52:47.840447+0000 mgr.y (mgr.14138) 98 : audit [DBG] from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:52:49.731 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:49 smithi100 bash[13549]: cephadm 2021-01-28T03:52:47.844827+0000 mgr.y (mgr.14138) 99 : cephadm [INF] Applying drive group None on host smithi100... 2021-01-28T03:52:49.731 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:49 smithi100 bash[13549]: cluster 2021-01-28T03:52:48.403738+0000 mon.a (mon.0) 275 : cluster [INF] osd.0 v2:172.21.15.100:6801/2076626497 boot 2021-01-28T03:52:49.732 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:49 smithi100 bash[13549]: cluster 2021-01-28T03:52:48.403860+0000 mon.a (mon.0) 276 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2021-01-28T03:52:49.732 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:49 smithi100 bash[13549]: audit 2021-01-28T03:52:48.404875+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-28T03:52:49.733 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:49 smithi100 bash[13549]: cluster 2021-01-28T03:52:49.407523+0000 mon.a (mon.0) 278 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2021-01-28T03:52:49.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:49 smithi162 bash[9856]: cluster 2021-01-28T03:52:46.582435+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T03:52:49.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:49 smithi162 bash[9856]: cluster 2021-01-28T03:52:46.582658+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T03:52:49.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:49 smithi162 bash[9856]: audit 2021-01-28T03:52:47.840447+0000 mgr.y (mgr.14138) 98 : audit [DBG] from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:52:49.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:49 smithi162 bash[9856]: cephadm 2021-01-28T03:52:47.844827+0000 mgr.y (mgr.14138) 99 : cephadm [INF] Applying drive group None on host smithi100... 2021-01-28T03:52:49.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:49 smithi162 bash[9856]: cluster 2021-01-28T03:52:48.403738+0000 mon.a (mon.0) 275 : cluster [INF] osd.0 v2:172.21.15.100:6801/2076626497 boot 2021-01-28T03:52:49.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:49 smithi162 bash[9856]: cluster 2021-01-28T03:52:48.403860+0000 mon.a (mon.0) 276 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2021-01-28T03:52:49.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:49 smithi162 bash[9856]: audit 2021-01-28T03:52:48.404875+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-28T03:52:49.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:49 smithi162 bash[9856]: cluster 2021-01-28T03:52:49.407523+0000 mon.a (mon.0) 278 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2021-01-28T03:52:50.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:50 smithi100 bash[9834]: cluster 2021-01-28T03:52:49.303908+0000 mgr.y (mgr.14138) 100 : cluster [DBG] pgmap v67: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:50.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:50 smithi100 bash[9834]: cluster 2021-01-28T03:52:50.408036+0000 mon.a (mon.0) 279 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2021-01-28T03:52:50.571 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:50 smithi100 bash[13549]: cluster 2021-01-28T03:52:49.303908+0000 mgr.y (mgr.14138) 100 : cluster [DBG] pgmap v67: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:50.571 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:50 smithi100 bash[13549]: cluster 2021-01-28T03:52:50.408036+0000 mon.a (mon.0) 279 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2021-01-28T03:52:50.632 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:50.630+0000 7fbc657fa700 1 -- 172.21.15.100:0/2121027421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc680fb4c0 msgr2=0x7fbc680f4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:52:50.632 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:50.630+0000 7fbc657fa700 1 --2- 172.21.15.100:0/2121027421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc680fb4c0 0x7fbc680f4a90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fbc60004750 tx=0x7fbc60007f90).stop 2021-01-28T03:52:50.633 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:50.630+0000 7fbc657fa700 1 --2- 172.21.15.100:0/2121027421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc4c003380 0x7fbc4c0057d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:52:50.633 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:50.634+0000 7fbc6d359700 1 --2- 172.21.15.100:0/2121027421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc4c003380 0x7fbc4c0057d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:52:50.633 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:50.634+0000 7fbc657fa700 1 --2- 172.21.15.100:0/2121027421 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc6805f730 0x7fbc4c007ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:52:50.633 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:50.634+0000 7fbc657fa700 1 --2- 172.21.15.100:0/2121027421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc680f8a30 0x7fbc4c00a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:52:50.634 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:50.634+0000 7fbc6e35b700 1 --2- 172.21.15.100:0/2121027421 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc6805f730 0x7fbc4c007ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:52:50.634 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:50.634+0000 7fbc657fa700 1 -- 172.21.15.100:0/2121027421 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c00a9c0 con 0x7fbc4c003380 2021-01-28T03:52:50.634 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:50.634+0000 7fbc657fa700 1 -- 172.21.15.100:0/2121027421 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c00ab00 con 0x7fbc680f8a30 2021-01-28T03:52:50.634 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:50.634+0000 7fbc657fa700 1 -- 172.21.15.100:0/2121027421 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4c00acc0 con 0x7fbc6805f730 2021-01-28T03:52:50.634 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:50.634+0000 7fbc6db5a700 1 --2- 172.21.15.100:0/2121027421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc680f8a30 0x7fbc4c00a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:52:50.635 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:50.634+0000 7fbc6d359700 1 -- 172.21.15.100:0/2121027421 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc6805f730 msgr2=0x7fbc4c007ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:52:50.635 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:50.634+0000 7fbc6d359700 1 --2- 172.21.15.100:0/2121027421 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc6805f730 0x7fbc4c007ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:52:50.635 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:50.634+0000 7fbc6d359700 1 -- 172.21.15.100:0/2121027421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc680f8a30 msgr2=0x7fbc4c00a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:52:50.635 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:50.634+0000 7fbc6d359700 1 --2- 172.21.15.100:0/2121027421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc680f8a30 0x7fbc4c00a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:52:50.636 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:50.634+0000 7fbc6d359700 1 -- 172.21.15.100:0/2121027421 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,mgrmap=0+,monmap=4+}) v3 -- 0x7fbc4c00afa0 con 0x7fbc4c003380 2021-01-28T03:52:50.636 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:50.634+0000 7fbc6d359700 1 --2- 172.21.15.100:0/2121027421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc4c003380 0x7fbc4c0057d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fbc6805f500 tx=0x7fbc5c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:52:50.636 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:50.638+0000 7fbc667fc700 1 -- 172.21.15.100:0/2121027421 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5c00e030 con 0x7fbc4c003380 2021-01-28T03:52:50.637 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:50.638+0000 7fbc667fc700 1 -- 172.21.15.100:0/2121027421 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fbc5c00f040 con 0x7fbc4c003380 2021-01-28T03:52:50.637 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:52:50.638+0000 7fbc667fc700 1 -- 172.21.15.100:0/2121027421 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mgrmap(e 14) v1 ==== 71316+0+0 (secure 0 0 0) 0x7fbc5c015780 con 0x7fbc4c003380 2021-01-28T03:52:50.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:50 smithi162 bash[9856]: cluster 2021-01-28T03:52:49.303908+0000 mgr.y (mgr.14138) 100 : cluster [DBG] pgmap v67: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T03:52:50.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:50 smithi162 bash[9856]: cluster 2021-01-28T03:52:50.408036+0000 mon.a (mon.0) 279 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2021-01-28T03:52:51.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:51 smithi162 bash[9856]: cluster 2021-01-28T03:52:51.304501+0000 mgr.y (mgr.14138) 101 : cluster [DBG] pgmap v70: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:52:51.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:51 smithi162 bash[9856]: cluster 2021-01-28T03:52:51.422256+0000 mon.a (mon.0) 280 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-01-28T03:52:51.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:51 smithi100 bash[9834]: cluster 2021-01-28T03:52:51.304501+0000 mgr.y (mgr.14138) 101 : cluster [DBG] pgmap v70: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:52:51.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:51 smithi100 bash[9834]: cluster 2021-01-28T03:52:51.422256+0000 mon.a (mon.0) 280 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-01-28T03:52:51.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:51 smithi100 bash[13549]: cluster 2021-01-28T03:52:51.304501+0000 mgr.y (mgr.14138) 101 : cluster [DBG] pgmap v70: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:52:51.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:51 smithi100 bash[13549]: cluster 2021-01-28T03:52:51.422256+0000 mon.a (mon.0) 280 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-01-28T03:52:52.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:52 smithi162 bash[9856]: audit 2021-01-28T03:52:52.228866+0000 mon.c (mon.1) 9 : audit [INF] from='client.? 172.21.15.100:0/870294548' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a144678-be9c-4a85-acc7-4a7522a434d6"}]: dispatch 2021-01-28T03:52:52.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:52 smithi162 bash[9856]: audit 2021-01-28T03:52:52.229479+0000 mon.a (mon.0) 281 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a144678-be9c-4a85-acc7-4a7522a434d6"}]: dispatch 2021-01-28T03:52:52.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:52 smithi162 bash[9856]: audit 2021-01-28T03:52:52.234648+0000 mon.a (mon.0) 282 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a144678-be9c-4a85-acc7-4a7522a434d6"}]': finished 2021-01-28T03:52:52.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:52 smithi162 bash[9856]: cluster 2021-01-28T03:52:52.234736+0000 mon.a (mon.0) 283 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2021-01-28T03:52:52.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:52 smithi162 bash[9856]: audit 2021-01-28T03:52:52.234835+0000 mon.a (mon.0) 284 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-28T03:52:52.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:52 smithi100 bash[9834]: audit 2021-01-28T03:52:52.228866+0000 mon.c (mon.1) 9 : audit [INF] from='client.? 172.21.15.100:0/870294548' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a144678-be9c-4a85-acc7-4a7522a434d6"}]: dispatch 2021-01-28T03:52:52.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:52 smithi100 bash[9834]: audit 2021-01-28T03:52:52.229479+0000 mon.a (mon.0) 281 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a144678-be9c-4a85-acc7-4a7522a434d6"}]: dispatch 2021-01-28T03:52:52.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:52 smithi100 bash[9834]: audit 2021-01-28T03:52:52.234648+0000 mon.a (mon.0) 282 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a144678-be9c-4a85-acc7-4a7522a434d6"}]': finished 2021-01-28T03:52:52.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:52 smithi100 bash[9834]: cluster 2021-01-28T03:52:52.234736+0000 mon.a (mon.0) 283 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2021-01-28T03:52:52.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:52 smithi100 bash[9834]: audit 2021-01-28T03:52:52.234835+0000 mon.a (mon.0) 284 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-28T03:52:52.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:52 smithi100 bash[13549]: audit 2021-01-28T03:52:52.228866+0000 mon.c (mon.1) 9 : audit [INF] from='client.? 172.21.15.100:0/870294548' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a144678-be9c-4a85-acc7-4a7522a434d6"}]: dispatch 2021-01-28T03:52:52.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:52 smithi100 bash[13549]: audit 2021-01-28T03:52:52.229479+0000 mon.a (mon.0) 281 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7a144678-be9c-4a85-acc7-4a7522a434d6"}]: dispatch 2021-01-28T03:52:52.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:52 smithi100 bash[13549]: audit 2021-01-28T03:52:52.234648+0000 mon.a (mon.0) 282 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7a144678-be9c-4a85-acc7-4a7522a434d6"}]': finished 2021-01-28T03:52:52.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:52 smithi100 bash[13549]: cluster 2021-01-28T03:52:52.234736+0000 mon.a (mon.0) 283 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2021-01-28T03:52:52.823 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:52 smithi100 bash[13549]: audit 2021-01-28T03:52:52.234835+0000 mon.a (mon.0) 284 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-28T03:52:53.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:53 smithi100 bash[9834]: audit 2021-01-28T03:52:52.893538+0000 mon.a (mon.0) 285 : audit [DBG] from='client.? 172.21.15.100:0/2742524139' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T03:52:53.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:53 smithi100 bash[9834]: cluster 2021-01-28T03:52:53.305132+0000 mgr.y (mgr.14138) 102 : cluster [DBG] pgmap v72: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:52:53.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:53 smithi100 bash[13549]: audit 2021-01-28T03:52:52.893538+0000 mon.a (mon.0) 285 : audit [DBG] from='client.? 172.21.15.100:0/2742524139' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T03:52:53.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:53 smithi100 bash[13549]: cluster 2021-01-28T03:52:53.305132+0000 mgr.y (mgr.14138) 102 : cluster [DBG] pgmap v72: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:52:54.008 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:53 smithi162 bash[9856]: audit 2021-01-28T03:52:52.893538+0000 mon.a (mon.0) 285 : audit [DBG] from='client.? 172.21.15.100:0/2742524139' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T03:52:54.008 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:53 smithi162 bash[9856]: cluster 2021-01-28T03:52:53.305132+0000 mgr.y (mgr.14138) 102 : cluster [DBG] pgmap v72: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:52:56.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:56 smithi162 bash[9856]: cluster 2021-01-28T03:52:55.305655+0000 mgr.y (mgr.14138) 103 : cluster [DBG] pgmap v73: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:52:56.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:56 smithi162 bash[9856]: audit 2021-01-28T03:52:56.168288+0000 mon.a (mon.0) 286 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:52:56.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:56 smithi100 bash[13549]: cluster 2021-01-28T03:52:55.305655+0000 mgr.y (mgr.14138) 103 : cluster [DBG] pgmap v73: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:52:56.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:56 smithi100 bash[13549]: audit 2021-01-28T03:52:56.168288+0000 mon.a (mon.0) 286 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:52:56.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:56 smithi100 bash[9834]: cluster 2021-01-28T03:52:55.305655+0000 mgr.y (mgr.14138) 103 : cluster [DBG] pgmap v73: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:52:56.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:56 smithi100 bash[9834]: audit 2021-01-28T03:52:56.168288+0000 mon.a (mon.0) 286 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:52:57.677 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:57 smithi100 bash[9834]: cluster 2021-01-28T03:52:56.501104+0000 mon.a (mon.0) 287 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-01-28T03:52:57.678 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:57 smithi100 bash[13549]: cluster 2021-01-28T03:52:56.501104+0000 mon.a (mon.0) 287 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-01-28T03:52:57.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:57 smithi162 bash[9856]: cluster 2021-01-28T03:52:56.501104+0000 mon.a (mon.0) 287 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-01-28T03:52:58.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:52:58 smithi162 bash[9856]: cluster 2021-01-28T03:52:57.306259+0000 mgr.y (mgr.14138) 104 : cluster [DBG] pgmap v74: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:52:58.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:52:58 smithi100 bash[13549]: cluster 2021-01-28T03:52:57.306259+0000 mgr.y (mgr.14138) 104 : cluster [DBG] pgmap v74: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:52:58.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:52:58 smithi100 bash[9834]: cluster 2021-01-28T03:52:57.306259+0000 mgr.y (mgr.14138) 104 : cluster [DBG] pgmap v74: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:53:00.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:00 smithi100 bash[9834]: cluster 2021-01-28T03:52:59.306809+0000 mgr.y (mgr.14138) 105 : cluster [DBG] pgmap v75: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:53:00.570 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:00 smithi100 bash[13549]: cluster 2021-01-28T03:52:59.306809+0000 mgr.y (mgr.14138) 105 : cluster [DBG] pgmap v75: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:53:00.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:00 smithi162 bash[9856]: cluster 2021-01-28T03:52:59.306809+0000 mgr.y (mgr.14138) 105 : cluster [DBG] pgmap v75: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:53:01.572 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:01 smithi100 bash[13549]: audit 2021-01-28T03:53:00.776915+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-01-28T03:53:01.573 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:01 smithi100 bash[13549]: audit 2021-01-28T03:53:00.778470+0000 mon.a (mon.0) 289 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:53:01.573 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:01 smithi100 bash[13549]: audit 2021-01-28T03:53:00.780456+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2021-01-28T03:53:01.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:01 smithi100 bash[9834]: audit 2021-01-28T03:53:00.776915+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-01-28T03:53:01.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:01 smithi100 bash[9834]: audit 2021-01-28T03:53:00.778470+0000 mon.a (mon.0) 289 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:53:01.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:01 smithi100 bash[9834]: audit 2021-01-28T03:53:00.780456+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2021-01-28T03:53:01.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:01 smithi162 bash[9856]: audit 2021-01-28T03:53:00.776915+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-01-28T03:53:01.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:01 smithi162 bash[9856]: audit 2021-01-28T03:53:00.778470+0000 mon.a (mon.0) 289 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:53:01.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:01 smithi162 bash[9856]: audit 2021-01-28T03:53:00.780456+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2021-01-28T03:53:02.534 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:02 smithi100 bash[9834]: cephadm 2021-01-28T03:53:00.779653+0000 mgr.y (mgr.14138) 106 : cephadm [INF] Deploying daemon osd.1 on smithi100 2021-01-28T03:53:02.534 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:02 smithi100 bash[9834]: cluster 2021-01-28T03:53:01.307428+0000 mgr.y (mgr.14138) 107 : cluster [DBG] pgmap v76: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:53:02.534 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:02 smithi100 bash[13549]: cephadm 2021-01-28T03:53:00.779653+0000 mgr.y (mgr.14138) 106 : cephadm [INF] Deploying daemon osd.1 on smithi100 2021-01-28T03:53:02.535 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:02 smithi100 bash[13549]: cluster 2021-01-28T03:53:01.307428+0000 mgr.y (mgr.14138) 107 : cluster [DBG] pgmap v76: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:53:02.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:02 smithi162 bash[9856]: cephadm 2021-01-28T03:53:00.779653+0000 mgr.y (mgr.14138) 106 : cephadm [INF] Deploying daemon osd.1 on smithi100 2021-01-28T03:53:02.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:02 smithi162 bash[9856]: cluster 2021-01-28T03:53:01.307428+0000 mgr.y (mgr.14138) 107 : cluster [DBG] pgmap v76: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:53:03.539 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 1 on host 'smithi100' 2021-01-28T03:53:03.540 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:03.542+0000 7fbc667fc700 1 -- 172.21.15.100:0/2121027421 <== mgr.14138 v2:172.21.15.100:6800/928846103 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fbc68100670 con 0x7fbc5005bc30 2021-01-28T03:53:03.552 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:03.546+0000 7fbc6eb5c700 1 -- 172.21.15.100:0/2121027421 >> v2:172.21.15.100:6800/928846103 conn(0x7fbc5005bc30 msgr2=0x7fbc5005e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:53:03.552 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:03.546+0000 7fbc6eb5c700 1 --2- 172.21.15.100:0/2121027421 >> v2:172.21.15.100:6800/928846103 conn(0x7fbc5005bc30 0x7fbc5005e0f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fbc680f5d50 tx=0x7fbc5800b040).stop 2021-01-28T03:53:03.553 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:03.546+0000 7fbc6eb5c700 1 -- 172.21.15.100:0/2121027421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc4c003380 msgr2=0x7fbc4c0057d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:53:03.553 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:03.546+0000 7fbc6eb5c700 1 --2- 172.21.15.100:0/2121027421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc4c003380 0x7fbc4c0057d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fbc6805f500 tx=0x7fbc5c00b040).stop 2021-01-28T03:53:03.553 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:03.546+0000 7fbc6eb5c700 1 -- 172.21.15.100:0/2121027421 shutdown_connections 2021-01-28T03:53:03.553 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:03.546+0000 7fbc6eb5c700 1 --2- 172.21.15.100:0/2121027421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc680f8a30 0x7fbc4c00a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:53:03.554 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:03.546+0000 7fbc6eb5c700 1 --2- 172.21.15.100:0/2121027421 >> v2:172.21.15.100:6800/928846103 conn(0x7fbc5005bc30 0x7fbc5005e0f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:53:03.554 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:03.546+0000 7fbc6eb5c700 1 --2- 172.21.15.100:0/2121027421 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fbc6805f730 0x7fbc4c007ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:53:03.554 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:03.546+0000 7fbc6eb5c700 1 --2- 172.21.15.100:0/2121027421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbc4c003380 0x7fbc4c0057d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:53:03.554 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:03.546+0000 7fbc6eb5c700 1 -- 172.21.15.100:0/2121027421 >> 172.21.15.100:0/2121027421 conn(0x7fbc680effe0 msgr2=0x7fbc680fa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:53:03.554 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:03.546+0000 7fbc6eb5c700 1 -- 172.21.15.100:0/2121027421 shutdown_connections 2021-01-28T03:53:03.555 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:03.546+0000 7fbc6eb5c700 1 -- 172.21.15.100:0/2121027421 wait complete. 2021-01-28T03:53:04.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:04 smithi100 bash[9834]: cluster 2021-01-28T03:53:03.307984+0000 mgr.y (mgr.14138) 108 : cluster [DBG] pgmap v77: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:53:04.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:04 smithi100 bash[9834]: audit 2021-01-28T03:53:03.537392+0000 mon.a (mon.0) 291 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:53:04.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:04 smithi100 bash[9834]: audit 2021-01-28T03:53:03.542743+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:53:04.571 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:04 smithi100 bash[13549]: cluster 2021-01-28T03:53:03.307984+0000 mgr.y (mgr.14138) 108 : cluster [DBG] pgmap v77: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:53:04.571 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:04 smithi100 bash[13549]: audit 2021-01-28T03:53:03.537392+0000 mon.a (mon.0) 291 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:53:04.571 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:04 smithi100 bash[13549]: audit 2021-01-28T03:53:03.542743+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:53:04.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:04 smithi162 bash[9856]: cluster 2021-01-28T03:53:03.307984+0000 mgr.y (mgr.14138) 108 : cluster [DBG] pgmap v77: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:53:04.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:04 smithi162 bash[9856]: audit 2021-01-28T03:53:03.537392+0000 mon.a (mon.0) 291 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:53:04.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:04 smithi162 bash[9856]: audit 2021-01-28T03:53:03.542743+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:53:05.034 DEBUG:teuthology.orchestra.run.smithi100:osd.1> sudo journalctl -f -n 0 -u ceph-c217df96-611b-11eb-8f9e-001a4aab830c@osd.1.service 2021-01-28T03:53:05.045 INFO:tasks.cephadm:Deploying osd.2 on smithi100 with /dev/vg_nvme/lv_2... 2021-01-28T03:53:05.045 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2021-01-28T03:53:05.319 INFO:journalctl@ceph.osd.1.smithi100.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T03:53:05.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:05 smithi100 bash[9834]: audit 2021-01-28T03:53:04.462086+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:53:05.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:05 smithi100 bash[9834]: audit 2021-01-28T03:53:04.463811+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:53:05.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:05 smithi100 bash[9834]: cluster 2021-01-28T03:53:05.308516+0000 mgr.y (mgr.14138) 109 : cluster [DBG] pgmap v78: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:53:05.570 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:05 smithi100 bash[13549]: audit 2021-01-28T03:53:04.462086+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:53:05.571 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:05 smithi100 bash[13549]: audit 2021-01-28T03:53:04.463811+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:53:05.571 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:05 smithi100 bash[13549]: cluster 2021-01-28T03:53:05.308516+0000 mgr.y (mgr.14138) 109 : cluster [DBG] pgmap v78: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:53:05.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:05 smithi162 bash[9856]: audit 2021-01-28T03:53:04.462086+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:53:05.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:05 smithi162 bash[9856]: audit 2021-01-28T03:53:04.463811+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:53:05.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:05 smithi162 bash[9856]: cluster 2021-01-28T03:53:05.308516+0000 mgr.y (mgr.14138) 109 : cluster [DBG] pgmap v78: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:53:07.070 INFO:journalctl@ceph.osd.1.smithi100.stdout:Jan 28 03:53:06 smithi100 bash[18794]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-01-28T03:53:07.070 INFO:journalctl@ceph.osd.1.smithi100.stdout:Jan 28 03:53:06 smithi100 bash[18794]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2021-01-28T03:53:07.070 INFO:journalctl@ceph.osd.1.smithi100.stdout:Jan 28 03:53:06 smithi100 bash[18794]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2021-01-28T03:53:07.070 INFO:journalctl@ceph.osd.1.smithi100.stdout:Jan 28 03:53:06 smithi100 bash[18794]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2021-01-28T03:53:07.071 INFO:journalctl@ceph.osd.1.smithi100.stdout:Jan 28 03:53:06 smithi100 bash[18794]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-01-28T03:53:07.071 INFO:journalctl@ceph.osd.1.smithi100.stdout:Jan 28 03:53:06 smithi100 bash[18794]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-01-28T03:53:07.071 INFO:journalctl@ceph.osd.1.smithi100.stdout:Jan 28 03:53:06 smithi100 bash[18794]: --> ceph-volume lvm activate successful for osd ID: 1 2021-01-28T03:53:07.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:07 smithi100 bash[9834]: cluster 2021-01-28T03:53:07.308970+0000 mgr.y (mgr.14138) 110 : cluster [DBG] pgmap v79: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:53:07.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:07 smithi100 bash[13549]: cluster 2021-01-28T03:53:07.308970+0000 mgr.y (mgr.14138) 110 : cluster [DBG] pgmap v79: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:53:08.007 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:07 smithi162 bash[9856]: cluster 2021-01-28T03:53:07.308970+0000 mgr.y (mgr.14138) 110 : cluster [DBG] pgmap v79: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:53:10.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:10 smithi162 bash[9856]: cluster 2021-01-28T03:53:09.309529+0000 mgr.y (mgr.14138) 111 : cluster [DBG] pgmap v80: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:53:10.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:10 smithi100 bash[9834]: cluster 2021-01-28T03:53:09.309529+0000 mgr.y (mgr.14138) 111 : cluster [DBG] pgmap v80: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:53:10.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:10 smithi100 bash[13549]: cluster 2021-01-28T03:53:09.309529+0000 mgr.y (mgr.14138) 111 : cluster [DBG] pgmap v80: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:53:11.436 INFO:journalctl@ceph.osd.1.smithi100.stdout:Jan 28 03:53:11 smithi100 bash[19166]: debug 2021-01-28T03:53:11.238+0000 7fb96c936700 20 -- 172.21.15.100:0/432545733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562ce4e0c00 msgr2=0x5562ce44d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2021-01-28T03:53:11.437 INFO:journalctl@ceph.osd.1.smithi100.stdout:Jan 28 03:53:11 smithi100 bash[19166]: debug 2021-01-28T03:53:11.238+0000 7fb96c936700 20 -- 172.21.15.100:0/432545733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562ce4e0c00 msgr2=0x5562ce44d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=96 2021-01-28T03:53:11.437 INFO:journalctl@ceph.osd.1.smithi100.stdout:Jan 28 03:53:11 smithi100 bash[19166]: debug 2021-01-28T03:53:11.238+0000 7fb96c936700 20 --2- 172.21.15.100:0/432545733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562ce4e0c00 0x5562ce44d400 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x5562ce45dec0 tx=0x5562ce492d80).handle_read_frame_preamble_main r=0 2021-01-28T03:53:11.438 INFO:journalctl@ceph.osd.1.smithi100.stdout:Jan 28 03:53:11 smithi100 bash[19166]: debug 2021-01-28T03:53:11.238+0000 7fb96c936700 20 --2- 172.21.15.100:0/432545733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562ce4e0c00 0x5562ce44d400 secure :-1 s=THROTTLE_MESSAGE pgs=88 cs=0 l=1 rev1=1 rx=0x5562ce45dec0 tx=0x5562ce492d80).throttle_message 2021-01-28T03:53:11.438 INFO:journalctl@ceph.osd.1.smithi100.stdout:Jan 28 03:53:11 smithi100 bash[19166]: debug 2021-01-28T03:53:11.238+0000 7fb96c936700 20 --2- 172.21.15.100:0/432545733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562ce4e0c00 0x5562ce44d400 secure :-1 s=THROTTLE_BYTES pgs=88 cs=0 l=1 rev1=1 rx=0x5562ce45dec0 tx=0x5562ce492d80).throttle_bytes 2021-01-28T03:53:11.438 INFO:journalctl@ceph.osd.1.smithi100.stdout:Jan 28 03:53:11 smithi100 bash[19166]: debug 2021-01-28T03:53:11.238+0000 7fb96c936700 20 --2- 172.21.15.100:0/432545733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562ce4e0c00 0x5562ce44d400 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=88 cs=0 l=1 rev1=1 rx=0x5562ce45dec0 tx=0x5562ce492d80).throttle_dispatch_queue 2021-01-28T03:53:11.439 INFO:journalctl@ceph.osd.1.smithi100.stdout:Jan 28 03:53:11 smithi100 bash[19166]: debug 2021-01-28T03:53:11.238+0000 7fb96c936700 20 --2- 172.21.15.100:0/432545733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562ce4e0c00 0x5562ce44d400 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rev1=1 rx=0x5562ce45dec0 tx=0x5562ce492d80).read_frame_segment seg_idx=0 2021-01-28T03:53:11.439 INFO:journalctl@ceph.osd.1.smithi100.stdout:Jan 28 03:53:11 smithi100 bash[19166]: debug 2021-01-28T03:53:11.238+0000 7fb96c936700 20 --2- 172.21.15.100:0/432545733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562ce4e0c00 0x5562ce44d400 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rev1=1 rx=0x5562ce45dec0 tx=0x5562ce492d80).read_frame_segment seg_idx=1 2021-01-28T03:53:11.439 INFO:journalctl@ceph.osd.1.smithi100.stdout:Jan 28 03:53:11 smithi100 bash[19166]: debug 2021-01-28T03:53:11.238+0000 7fb96c936700 20 -- 172.21.15.100:0/432545733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562ce4e0c00 msgr2=0x5562ce44d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2021-01-28T03:53:11.439 INFO:journalctl@ceph.osd.1.smithi100.stdout:Jan 28 03:53:11 smithi100 bash[19166]: debug 2021-01-28T03:53:11.238+0000 7fb96c936700 20 --2- 172.21.15.100:0/432545733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562ce4e0c00 0x5562ce44d400 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rev1=1 rx=0x5562ce45dec0 tx=0x5562ce492d80).handle_read_frame_segment r=0 2021-01-28T03:53:11.440 INFO:journalctl@ceph.osd.1.smithi100.stdout:Jan 28 03:53:11 smithi100 bash[19166]: debug 2021-01-28T03:53:11.238+0000 7fb96c936700 20 -- 172.21.15.100:0/432545733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562ce4e0c00 msgr2=0x5562ce44d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2021-01-28T03:53:11.440 INFO:journalctl@ceph.osd.1.smithi100.stdout:Jan 28 03:53:11 smithi100 bash[19166]: debug 2021-01-28T03:53:11.238+0000 7fb96c936700 20 --2- 172.21.15.100:0/432545733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562ce4e0c00 0x5562ce44d400 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rev1=1 rx=0x5562ce45dec0 tx=0x5562ce492d80).handle_read_frame_epilogue_main r=0 2021-01-28T03:53:11.440 INFO:journalctl@ceph.osd.1.smithi100.stdout:Jan 28 03:53:11 smithi100 bash[19166]: debug 2021-01-28T03:53:11.238+0000 7fb96c936700 10 --2- 172.21.15.100:0/432545733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562ce4e0c00 0x5562ce44d400 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rev1=1 rx=0x5562ce45dec0 tx=0x5562ce492d80).handle_read_frame_dispatch tag=17 2021-01-28T03:53:11.440 INFO:journalctl@ceph.osd.1.smithi100.stdout:Jan 28 03:53:11 smithi100 bash[19166]: debug 2021-01-28T03:53:11.238+0000 7fb96c936700 20 --2- 172.21.15.100:0/432545733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562ce4e0c00 0x5562ce44d400 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rev1=1 rx=0x5562ce45dec0 tx=0x5562ce492d80).handle_message 2021-01-28T03:53:11.441 INFO:journalctl@ceph.osd.1.smithi100.stdout:Jan 28 03:53:11 smithi100 bash[19166]: debug 2021-01-28T03:53:11.238+0000 7fb96c936700 5 --2- 172.21.15.100:0/432545733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562ce4e0c00 0x5562ce44d400 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rev1=1 rx=0x5562ce45dec0 tx=0x5562ce492d80).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.0 off 0 2021-01-28T03:53:11.441 INFO:journalctl@ceph.osd.1.smithi100.stdout:Jan 28 03:53:11 smithi100 bash[19166]: debug 2021-01-28T03:53:11.238+0000 7fb96c936700 5 --2- 172.21.15.100:0/432545733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562ce4e0c00 0x5562ce44d400 secure :-1 s=READ_MESSAGE_COMPLETE pgs=88 cs=0 l=1 rev1=1 rx=0x5562ce45dec0 tx=0x5562ce492d80).handle_message received message m=0x5562ce4624e0 seq=4 from=mon.0 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-28T03:53:11.441 INFO:journalctl@ceph.osd.1.smithi100.stdout:Jan 28 03:53:11 smithi100 bash[19166]: debug 2021-01-28T03:53:11.238+0000 7fb96c936700 20 -- 172.21.15.100:0/432545733 queue 0x5562ce4624e0 prio 196 2021-01-28T03:53:11.441 INFO:journalctl@ceph.osd.1.smithi100.stdout:Jan 28 03:53:11 smithi100 bash[19166]: debug 2021-01-28T03:53:11.238+0000 7fb96c936700 20 --2- 172.21.15.100:0/432545733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562ce4e0c00 0x5562ce44d400 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x5562ce45dec0 tx=0x5562ce492d80).read_frame 2021-01-28T03:53:11.442 INFO:journalctl@ceph.osd.1.smithi100.stdout:Jan 28 03:53:11 smithi100 bash[19166]: debug 2021-01-28T03:53:11.238+0000 7fb96c936700 20 -- 172.21.15.100:0/432545733 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5562ce4e0c00 msgr2=0x5562ce44d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-28T03:53:11.442 INFO:journalctl@ceph.osd.1.smithi100.stdout:Jan 28 03:53:11 smithi100 bash[19166]: debug 2021-01-28T03:53:11.238+0000 7fb96b934700 1 -- 172.21.15.100:0/432545733 <== mon.0 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5562ce4624e0 con 0x5562ce4e0c00 2021-01-28T03:53:11.442 INFO:journalctl@ceph.osd.1.smithi100.stdout:Jan 28 03:53:11 smithi100 bash[19166]: debug 2021-01-28T03:53:11.238+0000 7fb96b934700 10 -- 172.21.15.100:0/432545733 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-28T03:53:11.442 INFO:journalctl@ceph.osd.1.smithi100.stdout:Jan 28 03:53:11 smithi100 bash[19166]: debug 2021-01-28T03:53:11.238+0000 7fb96b934700 20 -- 172.21.15.100:0/432545733 done calling dispatch on 0x5562ce4624e0 2021-01-28T03:53:11.819 INFO:journalctl@ceph.osd.1.smithi100.stdout:Jan 28 03:53:11 smithi100 bash[19166]: debug 2021-01-28T03:53:11.798+0000 7fb9733bf200 -1 Falling back to public interface 2021-01-28T03:53:12.166 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping: /dev/vg_nvme/lv_2 2021-01-28T03:53:12.167 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2021-01-28T03:53:12.167 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10+0 records in 2021-01-28T03:53:12.167 INFO:teuthology.orchestra.run.smithi100.stderr:10+0 records out 2021-01-28T03:53:12.168 INFO:teuthology.orchestra.run.smithi100.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0195102 s, 537 MB/s 2021-01-28T03:53:12.168 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping successful for: 2021-01-28T03:53:12.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:12 smithi100 bash[9834]: cluster 2021-01-28T03:53:11.310171+0000 mgr.y (mgr.14138) 112 : cluster [DBG] pgmap v81: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:53:12.570 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:12 smithi100 bash[13549]: cluster 2021-01-28T03:53:11.310171+0000 mgr.y (mgr.14138) 112 : cluster [DBG] pgmap v81: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:53:12.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:12 smithi162 bash[9856]: cluster 2021-01-28T03:53:11.310171+0000 mgr.y (mgr.14138) 112 : cluster [DBG] pgmap v81: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:53:13.097 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph orch daemon add osd smithi100:vg_nvme/lv_2 2021-01-28T03:53:14.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:14 smithi162 bash[9856]: cluster 2021-01-28T03:53:13.310650+0000 mgr.y (mgr.14138) 113 : cluster [DBG] pgmap v82: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:53:14.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:14 smithi162 bash[9856]: audit 2021-01-28T03:53:13.856830+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:53:14.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:14 smithi162 bash[9856]: audit 2021-01-28T03:53:14.221811+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:53:14.788 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:14 smithi100 bash[9834]: cluster 2021-01-28T03:53:13.310650+0000 mgr.y (mgr.14138) 113 : cluster [DBG] pgmap v82: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:53:14.789 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:14 smithi100 bash[9834]: audit 2021-01-28T03:53:13.856830+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:53:14.789 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:14 smithi100 bash[9834]: audit 2021-01-28T03:53:14.221811+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:53:14.789 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:14 smithi100 bash[13549]: cluster 2021-01-28T03:53:13.310650+0000 mgr.y (mgr.14138) 113 : cluster [DBG] pgmap v82: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:53:14.790 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:14 smithi100 bash[13549]: audit 2021-01-28T03:53:13.856830+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:53:14.790 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:14 smithi100 bash[13549]: audit 2021-01-28T03:53:14.221811+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:53:15.069 INFO:journalctl@ceph.osd.1.smithi100.stdout:Jan 28 03:53:14 smithi100 bash[19166]: debug 2021-01-28T03:53:14.818+0000 7fb9733bf200 -1 osd.1 0 log_to_monitors {default=true} 2021-01-28T03:53:15.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:15 smithi162 bash[9856]: cephadm 2021-01-28T03:53:14.222922+0000 mgr.y (mgr.14138) 114 : cephadm [INF] refreshing smithi100 facts 2021-01-28T03:53:15.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:15 smithi162 bash[9856]: audit 2021-01-28T03:53:14.640804+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:53:15.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:15 smithi162 bash[9856]: audit 2021-01-28T03:53:14.648404+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:53:15.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:15 smithi162 bash[9856]: audit 2021-01-28T03:53:14.824727+0000 mon.a (mon.0) 299 : audit [INF] from='osd.1 v2:172.21.15.100:6805/315903268' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-01-28T03:53:15.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:15 smithi100 bash[13549]: cephadm 2021-01-28T03:53:14.222922+0000 mgr.y (mgr.14138) 114 : cephadm [INF] refreshing smithi100 facts 2021-01-28T03:53:15.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:15 smithi100 bash[13549]: audit 2021-01-28T03:53:14.640804+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:53:15.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:15 smithi100 bash[13549]: audit 2021-01-28T03:53:14.648404+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:53:15.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:15 smithi100 bash[13549]: audit 2021-01-28T03:53:14.824727+0000 mon.a (mon.0) 299 : audit [INF] from='osd.1 v2:172.21.15.100:6805/315903268' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-01-28T03:53:15.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:15 smithi100 bash[9834]: cephadm 2021-01-28T03:53:14.222922+0000 mgr.y (mgr.14138) 114 : cephadm [INF] refreshing smithi100 facts 2021-01-28T03:53:15.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:15 smithi100 bash[9834]: audit 2021-01-28T03:53:14.640804+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:53:15.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:15 smithi100 bash[9834]: audit 2021-01-28T03:53:14.648404+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:53:15.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:15 smithi100 bash[9834]: audit 2021-01-28T03:53:14.824727+0000 mon.a (mon.0) 299 : audit [INF] from='osd.1 v2:172.21.15.100:6805/315903268' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-01-28T03:53:16.570 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.574+0000 7faf4ca1b700 1 -- 172.21.15.100:0/3007917476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf480f74c0 msgr2=0x7faf480fddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:53:16.571 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.574+0000 7faf4ca1b700 1 --2- 172.21.15.100:0/3007917476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf480f74c0 0x7faf480fddc0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7faf40004e00 tx=0x7faf40009b30).stop 2021-01-28T03:53:16.571 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.574+0000 7faf4ca1b700 1 -- 172.21.15.100:0/3007917476 shutdown_connections 2021-01-28T03:53:16.571 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.574+0000 7faf4ca1b700 1 --2- 172.21.15.100:0/3007917476 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf480f74c0 0x7faf480fddc0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:53:16.572 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.574+0000 7faf4ca1b700 1 --2- 172.21.15.100:0/3007917476 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faf480f58d0 0x7faf480f5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:53:16.572 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.574+0000 7faf4ca1b700 1 --2- 172.21.15.100:0/3007917476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf480f6b70 0x7faf480f6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:53:16.572 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.574+0000 7faf4ca1b700 1 -- 172.21.15.100:0/3007917476 >> 172.21.15.100:0/3007917476 conn(0x7faf480f10d0 msgr2=0x7faf480f34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:53:16.572 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.574+0000 7faf4ca1b700 1 -- 172.21.15.100:0/3007917476 shutdown_connections 2021-01-28T03:53:16.572 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.574+0000 7faf4ca1b700 1 -- 172.21.15.100:0/3007917476 wait complete. 2021-01-28T03:53:16.574 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.574+0000 7faf4ca1b700 1 Processor -- start 2021-01-28T03:53:16.574 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.574+0000 7faf4ca1b700 1 -- start start 2021-01-28T03:53:16.574 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.574+0000 7faf4ca1b700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faf480f58d0 0x7faf4806aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:53:16.574 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.574+0000 7faf4ca1b700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf480f6b70 0x7faf48068f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:53:16.575 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.574+0000 7faf4ca1b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf480f74c0 0x7faf48069560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:53:16.575 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.574+0000 7faf4ca1b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf48069c50 con 0x7faf480f74c0 2021-01-28T03:53:16.575 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.574+0000 7faf4ca1b700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf48069dc0 con 0x7faf480f6b70 2021-01-28T03:53:16.575 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.574+0000 7faf4ca1b700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4810f720 con 0x7faf480f58d0 2021-01-28T03:53:16.576 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.574+0000 7faf47fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf480f74c0 0x7faf48069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:53:16.576 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.574+0000 7faf477fe700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faf480f58d0 0x7faf4806aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:53:16.576 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.574+0000 7faf47fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf480f74c0 0x7faf48069560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59240/0 (socket says 172.21.15.100:59240) 2021-01-28T03:53:16.576 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.574+0000 7faf47fff700 1 -- 172.21.15.100:0/1168678970 learned_addr learned my addr 172.21.15.100:0/1168678970 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:53:16.576 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.574+0000 7faf46ffd700 1 --2- 172.21.15.100:0/1168678970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf480f6b70 0x7faf48068f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:53:16.577 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.578+0000 7faf47fff700 1 -- 172.21.15.100:0/1168678970 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faf480f58d0 msgr2=0x7faf4806aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:53:16.577 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.578+0000 7faf47fff700 1 --2- 172.21.15.100:0/1168678970 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faf480f58d0 0x7faf4806aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:53:16.577 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.578+0000 7faf47fff700 1 -- 172.21.15.100:0/1168678970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf480f6b70 msgr2=0x7faf48068f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:53:16.577 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.578+0000 7faf47fff700 1 --2- 172.21.15.100:0/1168678970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf480f6b70 0x7faf48068f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:53:16.577 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.578+0000 7faf47fff700 1 -- 172.21.15.100:0/1168678970 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4810f8e0 con 0x7faf480f74c0 2021-01-28T03:53:16.578 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.578+0000 7faf46ffd700 1 --2- 172.21.15.100:0/1168678970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf480f6b70 0x7faf48068f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-28T03:53:16.578 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.578+0000 7faf47fff700 1 --2- 172.21.15.100:0/1168678970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf480f74c0 0x7faf48069560 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7faf400043d0 tx=0x7faf40009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:53:16.578 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.578+0000 7faf3ffff700 1 -- 172.21.15.100:0/1168678970 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4000e030 con 0x7faf480f74c0 2021-01-28T03:53:16.578 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.578+0000 7faf4ca1b700 1 -- 172.21.15.100:0/1168678970 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf4810fb30 con 0x7faf480f74c0 2021-01-28T03:53:16.579 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.578+0000 7faf4ca1b700 1 -- 172.21.15.100:0/1168678970 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf4810ff30 con 0x7faf480f74c0 2021-01-28T03:53:16.579 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.578+0000 7faf3ffff700 1 -- 172.21.15.100:0/1168678970 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7faf40004490 con 0x7faf480f74c0 2021-01-28T03:53:16.579 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.578+0000 7faf3ffff700 1 -- 172.21.15.100:0/1168678970 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf40018070 con 0x7faf480f74c0 2021-01-28T03:53:16.579 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.578+0000 7faf4ca1b700 1 -- 172.21.15.100:0/1168678970 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf2c004da0 con 0x7faf480f74c0 2021-01-28T03:53:16.580 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.578+0000 7faf3ffff700 1 -- 172.21.15.100:0/1168678970 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 14) v1 ==== 71316+0+0 (secure 0 0 0) 0x7faf4001d420 con 0x7faf480f74c0 2021-01-28T03:53:16.580 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.578+0000 7faf3ffff700 1 --2- 172.21.15.100:0/1168678970 >> v2:172.21.15.100:6800/928846103 conn(0x7faf3405bc30 0x7faf3405e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:53:16.581 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.578+0000 7faf3ffff700 1 -- 172.21.15.100:0/1168678970 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2020+0+0 (secure 0 0 0) 0x7faf40076680 con 0x7faf480f74c0 2021-01-28T03:53:16.581 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.578+0000 7faf477fe700 1 --2- 172.21.15.100:0/1168678970 >> v2:172.21.15.100:6800/928846103 conn(0x7faf3405bc30 0x7faf3405e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:53:16.581 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.582+0000 7faf477fe700 1 --2- 172.21.15.100:0/1168678970 >> v2:172.21.15.100:6800/928846103 conn(0x7faf3405bc30 0x7faf3405e0f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7faf4806a820 tx=0x7faf3800b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:53:16.583 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.586+0000 7faf3ffff700 1 -- 172.21.15.100:0/1168678970 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7faf4004a220 con 0x7faf480f74c0 2021-01-28T03:53:16.661 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:16 smithi100 bash[13549]: cephadm 2021-01-28T03:53:14.641690+0000 mgr.y (mgr.14138) 115 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:53:16.661 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:16 smithi100 bash[13549]: cephadm 2021-01-28T03:53:14.649526+0000 mgr.y (mgr.14138) 116 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:53:16.662 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:16 smithi100 bash[13549]: cluster 2021-01-28T03:53:15.311237+0000 mgr.y (mgr.14138) 117 : cluster [DBG] pgmap v83: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:53:16.662 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:16 smithi100 bash[13549]: audit 2021-01-28T03:53:15.659332+0000 mon.a (mon.0) 300 : audit [INF] from='osd.1 v2:172.21.15.100:6805/315903268' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-01-28T03:53:16.663 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:16 smithi100 bash[13549]: cluster 2021-01-28T03:53:15.659513+0000 mon.a (mon.0) 301 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2021-01-28T03:53:16.663 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:16 smithi100 bash[13549]: audit 2021-01-28T03:53:15.659772+0000 mon.a (mon.0) 302 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-28T03:53:16.663 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:16 smithi100 bash[13549]: audit 2021-01-28T03:53:15.660656+0000 mon.a (mon.0) 303 : audit [INF] from='osd.1 v2:172.21.15.100:6805/315903268' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2021-01-28T03:53:16.664 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:16 smithi100 bash[9834]: cephadm 2021-01-28T03:53:14.641690+0000 mgr.y (mgr.14138) 115 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:53:16.664 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:16 smithi100 bash[9834]: cephadm 2021-01-28T03:53:14.649526+0000 mgr.y (mgr.14138) 116 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:53:16.665 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:16 smithi100 bash[9834]: cluster 2021-01-28T03:53:15.311237+0000 mgr.y (mgr.14138) 117 : cluster [DBG] pgmap v83: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:53:16.665 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:16 smithi100 bash[9834]: audit 2021-01-28T03:53:15.659332+0000 mon.a (mon.0) 300 : audit [INF] from='osd.1 v2:172.21.15.100:6805/315903268' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-01-28T03:53:16.666 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:16 smithi100 bash[9834]: cluster 2021-01-28T03:53:15.659513+0000 mon.a (mon.0) 301 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2021-01-28T03:53:16.666 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:16 smithi100 bash[9834]: audit 2021-01-28T03:53:15.659772+0000 mon.a (mon.0) 302 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-28T03:53:16.666 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:16 smithi100 bash[9834]: audit 2021-01-28T03:53:15.660656+0000 mon.a (mon.0) 303 : audit [INF] from='osd.1 v2:172.21.15.100:6805/315903268' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2021-01-28T03:53:16.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:16 smithi162 bash[9856]: cephadm 2021-01-28T03:53:14.641690+0000 mgr.y (mgr.14138) 115 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:53:16.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:16 smithi162 bash[9856]: cephadm 2021-01-28T03:53:14.649526+0000 mgr.y (mgr.14138) 116 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:53:16.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:16 smithi162 bash[9856]: cluster 2021-01-28T03:53:15.311237+0000 mgr.y (mgr.14138) 117 : cluster [DBG] pgmap v83: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:53:16.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:16 smithi162 bash[9856]: audit 2021-01-28T03:53:15.659332+0000 mon.a (mon.0) 300 : audit [INF] from='osd.1 v2:172.21.15.100:6805/315903268' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-01-28T03:53:16.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:16 smithi162 bash[9856]: cluster 2021-01-28T03:53:15.659513+0000 mon.a (mon.0) 301 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2021-01-28T03:53:16.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:16 smithi162 bash[9856]: audit 2021-01-28T03:53:15.659772+0000 mon.a (mon.0) 302 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-28T03:53:16.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:16 smithi162 bash[9856]: audit 2021-01-28T03:53:15.660656+0000 mon.a (mon.0) 303 : audit [INF] from='osd.1 v2:172.21.15.100:6805/315903268' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2021-01-28T03:53:16.782 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:16.786+0000 7faf4ca1b700 1 -- 172.21.15.100:0/1168678970 --> v2:172.21.15.100:6800/928846103 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7faf2c000bc0 con 0x7faf3405bc30 2021-01-28T03:53:17.069 INFO:journalctl@ceph.osd.1.smithi100.stdout:Jan 28 03:53:16 smithi100 bash[19166]: debug 2021-01-28T03:53:16.666+0000 7fb96b133700 -1 osd.1 0 waiting for initial osdmap 2021-01-28T03:53:18.007 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:17 smithi162 bash[9856]: audit 2021-01-28T03:53:16.660673+0000 mon.a (mon.0) 304 : audit [INF] from='osd.1 v2:172.21.15.100:6805/315903268' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2021-01-28T03:53:18.008 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:17 smithi162 bash[9856]: cluster 2021-01-28T03:53:16.660832+0000 mon.a (mon.0) 305 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2021-01-28T03:53:18.008 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:17 smithi162 bash[9856]: audit 2021-01-28T03:53:16.661201+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-28T03:53:18.008 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:17 smithi162 bash[9856]: audit 2021-01-28T03:53:16.668209+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-28T03:53:18.009 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:17 smithi162 bash[9856]: audit 2021-01-28T03:53:16.790790+0000 mgr.y (mgr.14138) 118 : audit [DBG] from='client.14253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:53:18.009 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:17 smithi162 bash[9856]: audit 2021-01-28T03:53:16.792809+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T03:53:18.009 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:17 smithi162 bash[9856]: cephadm 2021-01-28T03:53:16.795134+0000 mgr.y (mgr.14138) 119 : cephadm [INF] Applying drive group None on host smithi100... 2021-01-28T03:53:18.009 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:17 smithi162 bash[9856]: audit 2021-01-28T03:53:16.795572+0000 mon.a (mon.0) 309 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T03:53:18.009 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:17 smithi162 bash[9856]: audit 2021-01-28T03:53:16.797116+0000 mon.a (mon.0) 310 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:53:18.010 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:17 smithi162 bash[9856]: audit 2021-01-28T03:53:16.798941+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:53:18.010 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:17 smithi162 bash[9856]: cluster 2021-01-28T03:53:17.311868+0000 mgr.y (mgr.14138) 120 : cluster [DBG] pgmap v86: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:53:18.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:17 smithi100 bash[9834]: audit 2021-01-28T03:53:16.660673+0000 mon.a (mon.0) 304 : audit [INF] from='osd.1 v2:172.21.15.100:6805/315903268' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2021-01-28T03:53:18.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:17 smithi100 bash[9834]: cluster 2021-01-28T03:53:16.660832+0000 mon.a (mon.0) 305 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2021-01-28T03:53:18.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:17 smithi100 bash[9834]: audit 2021-01-28T03:53:16.661201+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-28T03:53:18.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:17 smithi100 bash[9834]: audit 2021-01-28T03:53:16.668209+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-28T03:53:18.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:17 smithi100 bash[9834]: audit 2021-01-28T03:53:16.790790+0000 mgr.y (mgr.14138) 118 : audit [DBG] from='client.14253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:53:18.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:17 smithi100 bash[9834]: audit 2021-01-28T03:53:16.792809+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T03:53:18.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:17 smithi100 bash[9834]: cephadm 2021-01-28T03:53:16.795134+0000 mgr.y (mgr.14138) 119 : cephadm [INF] Applying drive group None on host smithi100... 2021-01-28T03:53:18.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:17 smithi100 bash[9834]: audit 2021-01-28T03:53:16.795572+0000 mon.a (mon.0) 309 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T03:53:18.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:17 smithi100 bash[9834]: audit 2021-01-28T03:53:16.797116+0000 mon.a (mon.0) 310 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:53:18.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:17 smithi100 bash[9834]: audit 2021-01-28T03:53:16.798941+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:53:18.072 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:17 smithi100 bash[9834]: cluster 2021-01-28T03:53:17.311868+0000 mgr.y (mgr.14138) 120 : cluster [DBG] pgmap v86: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:53:18.072 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:17 smithi100 bash[13549]: audit 2021-01-28T03:53:16.660673+0000 mon.a (mon.0) 304 : audit [INF] from='osd.1 v2:172.21.15.100:6805/315903268' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2021-01-28T03:53:18.073 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:17 smithi100 bash[13549]: cluster 2021-01-28T03:53:16.660832+0000 mon.a (mon.0) 305 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2021-01-28T03:53:18.073 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:17 smithi100 bash[13549]: audit 2021-01-28T03:53:16.661201+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-28T03:53:18.073 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:17 smithi100 bash[13549]: audit 2021-01-28T03:53:16.668209+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-28T03:53:18.073 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:17 smithi100 bash[13549]: audit 2021-01-28T03:53:16.790790+0000 mgr.y (mgr.14138) 118 : audit [DBG] from='client.14253 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:53:18.074 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:17 smithi100 bash[13549]: audit 2021-01-28T03:53:16.792809+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T03:53:18.074 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:17 smithi100 bash[13549]: cephadm 2021-01-28T03:53:16.795134+0000 mgr.y (mgr.14138) 119 : cephadm [INF] Applying drive group None on host smithi100... 2021-01-28T03:53:18.074 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:17 smithi100 bash[13549]: audit 2021-01-28T03:53:16.795572+0000 mon.a (mon.0) 309 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T03:53:18.074 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:17 smithi100 bash[13549]: audit 2021-01-28T03:53:16.797116+0000 mon.a (mon.0) 310 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:53:18.074 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:17 smithi100 bash[13549]: audit 2021-01-28T03:53:16.798941+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:53:18.075 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:17 smithi100 bash[13549]: cluster 2021-01-28T03:53:17.311868+0000 mgr.y (mgr.14138) 120 : cluster [DBG] pgmap v86: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T03:53:19.007 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:18 smithi162 bash[9856]: cluster 2021-01-28T03:53:15.777559+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T03:53:19.008 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:18 smithi162 bash[9856]: cluster 2021-01-28T03:53:15.777773+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T03:53:19.008 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:18 smithi162 bash[9856]: cluster 2021-01-28T03:53:17.667109+0000 mon.a (mon.0) 312 : cluster [INF] osd.1 v2:172.21.15.100:6805/315903268 boot 2021-01-28T03:53:19.009 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:18 smithi162 bash[9856]: cluster 2021-01-28T03:53:17.667224+0000 mon.a (mon.0) 313 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2021-01-28T03:53:19.009 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:18 smithi162 bash[9856]: audit 2021-01-28T03:53:17.668929+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-28T03:53:19.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:18 smithi100 bash[9834]: cluster 2021-01-28T03:53:15.777559+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T03:53:19.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:18 smithi100 bash[9834]: cluster 2021-01-28T03:53:15.777773+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T03:53:19.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:18 smithi100 bash[9834]: cluster 2021-01-28T03:53:17.667109+0000 mon.a (mon.0) 312 : cluster [INF] osd.1 v2:172.21.15.100:6805/315903268 boot 2021-01-28T03:53:19.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:18 smithi100 bash[9834]: cluster 2021-01-28T03:53:17.667224+0000 mon.a (mon.0) 313 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2021-01-28T03:53:19.071 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:18 smithi100 bash[9834]: audit 2021-01-28T03:53:17.668929+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-28T03:53:19.072 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:18 smithi100 bash[13549]: cluster 2021-01-28T03:53:15.777559+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T03:53:19.072 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:18 smithi100 bash[13549]: cluster 2021-01-28T03:53:15.777773+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T03:53:19.072 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:18 smithi100 bash[13549]: cluster 2021-01-28T03:53:17.667109+0000 mon.a (mon.0) 312 : cluster [INF] osd.1 v2:172.21.15.100:6805/315903268 boot 2021-01-28T03:53:19.073 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:18 smithi100 bash[13549]: cluster 2021-01-28T03:53:17.667224+0000 mon.a (mon.0) 313 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2021-01-28T03:53:19.073 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:18 smithi100 bash[13549]: audit 2021-01-28T03:53:17.668929+0000 mon.a (mon.0) 314 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-28T03:53:20.007 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:19 smithi162 bash[9856]: cluster 2021-01-28T03:53:18.678266+0000 mon.a (mon.0) 315 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2021-01-28T03:53:20.007 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:19 smithi162 bash[9856]: cluster 2021-01-28T03:53:19.312498+0000 mgr.y (mgr.14138) 121 : cluster [DBG] pgmap v89: 1 pgs: 1 undersized+peered; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:20.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:19 smithi100 bash[9834]: cluster 2021-01-28T03:53:18.678266+0000 mon.a (mon.0) 315 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2021-01-28T03:53:20.070 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:19 smithi100 bash[9834]: cluster 2021-01-28T03:53:19.312498+0000 mgr.y (mgr.14138) 121 : cluster [DBG] pgmap v89: 1 pgs: 1 undersized+peered; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:20.070 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:19 smithi100 bash[13549]: cluster 2021-01-28T03:53:18.678266+0000 mon.a (mon.0) 315 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2021-01-28T03:53:20.070 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:19 smithi100 bash[13549]: cluster 2021-01-28T03:53:19.312498+0000 mgr.y (mgr.14138) 121 : cluster [DBG] pgmap v89: 1 pgs: 1 undersized+peered; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:21.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:21 smithi100 bash[9834]: audit 2021-01-28T03:53:21.225470+0000 mon.c (mon.1) 10 : audit [INF] from='client.? 172.21.15.100:0/3271476069' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5866a31a-7066-4ae4-a7c9-d155b09460fd"}]: dispatch 2021-01-28T03:53:21.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:21 smithi100 bash[9834]: audit 2021-01-28T03:53:21.225973+0000 mon.a (mon.0) 316 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5866a31a-7066-4ae4-a7c9-d155b09460fd"}]: dispatch 2021-01-28T03:53:21.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:21 smithi100 bash[9834]: audit 2021-01-28T03:53:21.232803+0000 mon.a (mon.0) 317 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5866a31a-7066-4ae4-a7c9-d155b09460fd"}]': finished 2021-01-28T03:53:21.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:21 smithi100 bash[9834]: cluster 2021-01-28T03:53:21.232954+0000 mon.a (mon.0) 318 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2021-01-28T03:53:21.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:21 smithi100 bash[9834]: audit 2021-01-28T03:53:21.233178+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-28T03:53:21.571 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:21 smithi100 bash[13549]: audit 2021-01-28T03:53:21.225470+0000 mon.c (mon.1) 10 : audit [INF] from='client.? 172.21.15.100:0/3271476069' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5866a31a-7066-4ae4-a7c9-d155b09460fd"}]: dispatch 2021-01-28T03:53:21.571 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:21 smithi100 bash[13549]: audit 2021-01-28T03:53:21.225973+0000 mon.a (mon.0) 316 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5866a31a-7066-4ae4-a7c9-d155b09460fd"}]: dispatch 2021-01-28T03:53:21.571 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:21 smithi100 bash[13549]: audit 2021-01-28T03:53:21.232803+0000 mon.a (mon.0) 317 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5866a31a-7066-4ae4-a7c9-d155b09460fd"}]': finished 2021-01-28T03:53:21.571 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:21 smithi100 bash[13549]: cluster 2021-01-28T03:53:21.232954+0000 mon.a (mon.0) 318 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2021-01-28T03:53:21.572 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:21 smithi100 bash[13549]: audit 2021-01-28T03:53:21.233178+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-28T03:53:21.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:21 smithi162 bash[9856]: audit 2021-01-28T03:53:21.225470+0000 mon.c (mon.1) 10 : audit [INF] from='client.? 172.21.15.100:0/3271476069' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5866a31a-7066-4ae4-a7c9-d155b09460fd"}]: dispatch 2021-01-28T03:53:21.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:21 smithi162 bash[9856]: audit 2021-01-28T03:53:21.225973+0000 mon.a (mon.0) 316 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5866a31a-7066-4ae4-a7c9-d155b09460fd"}]: dispatch 2021-01-28T03:53:21.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:21 smithi162 bash[9856]: audit 2021-01-28T03:53:21.232803+0000 mon.a (mon.0) 317 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5866a31a-7066-4ae4-a7c9-d155b09460fd"}]': finished 2021-01-28T03:53:21.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:21 smithi162 bash[9856]: cluster 2021-01-28T03:53:21.232954+0000 mon.a (mon.0) 318 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2021-01-28T03:53:21.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:21 smithi162 bash[9856]: audit 2021-01-28T03:53:21.233178+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-28T03:53:22.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:22 smithi100 bash[9834]: cluster 2021-01-28T03:53:21.313030+0000 mgr.y (mgr.14138) 122 : cluster [DBG] pgmap v91: 1 pgs: 1 undersized+peered; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:22.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:22 smithi100 bash[9834]: audit 2021-01-28T03:53:21.861564+0000 mon.c (mon.1) 11 : audit [DBG] from='client.? 172.21.15.100:0/2678319711' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T03:53:22.570 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:22 smithi100 bash[13549]: cluster 2021-01-28T03:53:21.313030+0000 mgr.y (mgr.14138) 122 : cluster [DBG] pgmap v91: 1 pgs: 1 undersized+peered; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:22.571 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:22 smithi100 bash[13549]: audit 2021-01-28T03:53:21.861564+0000 mon.c (mon.1) 11 : audit [DBG] from='client.? 172.21.15.100:0/2678319711' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T03:53:22.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:22 smithi162 bash[9856]: cluster 2021-01-28T03:53:21.313030+0000 mgr.y (mgr.14138) 122 : cluster [DBG] pgmap v91: 1 pgs: 1 undersized+peered; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:22.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:22 smithi162 bash[9856]: audit 2021-01-28T03:53:21.861564+0000 mon.c (mon.1) 11 : audit [DBG] from='client.? 172.21.15.100:0/2678319711' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T03:53:23.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:23 smithi162 bash[9856]: cluster 2021-01-28T03:53:23.364901+0000 mon.a (mon.0) 320 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2021-01-28T03:53:23.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:23 smithi162 bash[9856]: cluster 2021-01-28T03:53:23.365006+0000 mon.a (mon.0) 321 : cluster [INF] Cluster is now healthy 2021-01-28T03:53:23.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:23 smithi100 bash[9834]: cluster 2021-01-28T03:53:23.364901+0000 mon.a (mon.0) 320 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2021-01-28T03:53:23.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:23 smithi100 bash[9834]: cluster 2021-01-28T03:53:23.365006+0000 mon.a (mon.0) 321 : cluster [INF] Cluster is now healthy 2021-01-28T03:53:23.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:23 smithi100 bash[13549]: cluster 2021-01-28T03:53:23.364901+0000 mon.a (mon.0) 320 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2021-01-28T03:53:23.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:23 smithi100 bash[13549]: cluster 2021-01-28T03:53:23.365006+0000 mon.a (mon.0) 321 : cluster [INF] Cluster is now healthy 2021-01-28T03:53:24.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:24 smithi100 bash[9834]: cluster 2021-01-28T03:53:23.313612+0000 mgr.y (mgr.14138) 123 : cluster [DBG] pgmap v92: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:24.570 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:24 smithi100 bash[13549]: cluster 2021-01-28T03:53:23.313612+0000 mgr.y (mgr.14138) 123 : cluster [DBG] pgmap v92: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:24.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:24 smithi162 bash[9856]: cluster 2021-01-28T03:53:23.313612+0000 mgr.y (mgr.14138) 123 : cluster [DBG] pgmap v92: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:25.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:25 smithi162 bash[9856]: audit 2021-01-28T03:53:25.144006+0000 mon.a (mon.0) 322 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:53:25.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:25 smithi100 bash[13549]: audit 2021-01-28T03:53:25.144006+0000 mon.a (mon.0) 322 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:53:25.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:25 smithi100 bash[9834]: audit 2021-01-28T03:53:25.144006+0000 mon.a (mon.0) 322 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:53:26.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:26 smithi162 bash[9856]: cluster 2021-01-28T03:53:25.314099+0000 mgr.y (mgr.14138) 124 : cluster [DBG] pgmap v93: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:26.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:26 smithi100 bash[9834]: cluster 2021-01-28T03:53:25.314099+0000 mgr.y (mgr.14138) 124 : cluster [DBG] pgmap v93: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:26.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:26 smithi100 bash[13549]: cluster 2021-01-28T03:53:25.314099+0000 mgr.y (mgr.14138) 124 : cluster [DBG] pgmap v93: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:27.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:27 smithi100 bash[9834]: cluster 2021-01-28T03:53:27.314707+0000 mgr.y (mgr.14138) 125 : cluster [DBG] pgmap v94: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:27.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:27 smithi100 bash[13549]: cluster 2021-01-28T03:53:27.314707+0000 mgr.y (mgr.14138) 125 : cluster [DBG] pgmap v94: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:28.007 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:27 smithi162 bash[9856]: cluster 2021-01-28T03:53:27.314707+0000 mgr.y (mgr.14138) 125 : cluster [DBG] pgmap v94: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:30.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:30 smithi162 bash[9856]: cluster 2021-01-28T03:53:29.315363+0000 mgr.y (mgr.14138) 126 : cluster [DBG] pgmap v95: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:30.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:30 smithi162 bash[9856]: audit 2021-01-28T03:53:29.663762+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-01-28T03:53:30.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:30 smithi162 bash[9856]: audit 2021-01-28T03:53:29.665558+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:53:30.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:30 smithi162 bash[9856]: audit 2021-01-28T03:53:29.667439+0000 mon.a (mon.0) 325 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2021-01-28T03:53:30.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:30 smithi100 bash[9834]: cluster 2021-01-28T03:53:29.315363+0000 mgr.y (mgr.14138) 126 : cluster [DBG] pgmap v95: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:30.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:30 smithi100 bash[9834]: audit 2021-01-28T03:53:29.663762+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-01-28T03:53:30.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:30 smithi100 bash[9834]: audit 2021-01-28T03:53:29.665558+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:53:30.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:30 smithi100 bash[9834]: audit 2021-01-28T03:53:29.667439+0000 mon.a (mon.0) 325 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2021-01-28T03:53:30.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:30 smithi100 bash[13549]: cluster 2021-01-28T03:53:29.315363+0000 mgr.y (mgr.14138) 126 : cluster [DBG] pgmap v95: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:30.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:30 smithi100 bash[13549]: audit 2021-01-28T03:53:29.663762+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-01-28T03:53:30.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:30 smithi100 bash[13549]: audit 2021-01-28T03:53:29.665558+0000 mon.a (mon.0) 324 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:53:30.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:30 smithi100 bash[13549]: audit 2021-01-28T03:53:29.667439+0000 mon.a (mon.0) 325 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2021-01-28T03:53:31.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:31 smithi162 bash[9856]: cephadm 2021-01-28T03:53:29.666813+0000 mgr.y (mgr.14138) 127 : cephadm [INF] Deploying daemon osd.2 on smithi100 2021-01-28T03:53:31.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:31 smithi100 bash[9834]: cephadm 2021-01-28T03:53:29.666813+0000 mgr.y (mgr.14138) 127 : cephadm [INF] Deploying daemon osd.2 on smithi100 2021-01-28T03:53:31.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:31 smithi100 bash[13549]: cephadm 2021-01-28T03:53:29.666813+0000 mgr.y (mgr.14138) 127 : cephadm [INF] Deploying daemon osd.2 on smithi100 2021-01-28T03:53:32.498 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:32.502+0000 7faf3ffff700 1 -- 172.21.15.100:0/1168678970 <== mgr.14138 v2:172.21.15.100:6800/928846103 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7faf2c000bc0 con 0x7faf3405bc30 2021-01-28T03:53:32.498 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 2 on host 'smithi100' 2021-01-28T03:53:32.501 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:32.506+0000 7faf4ca1b700 1 -- 172.21.15.100:0/1168678970 >> v2:172.21.15.100:6800/928846103 conn(0x7faf3405bc30 msgr2=0x7faf3405e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:53:32.501 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:32.506+0000 7faf4ca1b700 1 --2- 172.21.15.100:0/1168678970 >> v2:172.21.15.100:6800/928846103 conn(0x7faf3405bc30 0x7faf3405e0f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7faf4806a820 tx=0x7faf3800b040).stop 2021-01-28T03:53:32.502 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:32.506+0000 7faf4ca1b700 1 -- 172.21.15.100:0/1168678970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf480f74c0 msgr2=0x7faf48069560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:53:32.502 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:32.506+0000 7faf4ca1b700 1 --2- 172.21.15.100:0/1168678970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf480f74c0 0x7faf48069560 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7faf400043d0 tx=0x7faf40009b30).stop 2021-01-28T03:53:32.502 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:32.506+0000 7faf4ca1b700 1 -- 172.21.15.100:0/1168678970 shutdown_connections 2021-01-28T03:53:32.502 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:32.506+0000 7faf4ca1b700 1 --2- 172.21.15.100:0/1168678970 >> v2:172.21.15.100:6800/928846103 conn(0x7faf3405bc30 0x7faf3405e0f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:53:32.502 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:32.506+0000 7faf4ca1b700 1 --2- 172.21.15.100:0/1168678970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faf480f74c0 0x7faf48069560 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:53:32.503 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:32.506+0000 7faf4ca1b700 1 --2- 172.21.15.100:0/1168678970 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faf480f58d0 0x7faf4806aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:53:32.503 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:32.506+0000 7faf4ca1b700 1 --2- 172.21.15.100:0/1168678970 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf480f6b70 0x7faf48068f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:53:32.503 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:32.506+0000 7faf4ca1b700 1 -- 172.21.15.100:0/1168678970 >> 172.21.15.100:0/1168678970 conn(0x7faf480f10d0 msgr2=0x7faf480f32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:53:32.504 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:32.510+0000 7faf4ca1b700 1 -- 172.21.15.100:0/1168678970 shutdown_connections 2021-01-28T03:53:32.504 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:32.510+0000 7faf4ca1b700 1 -- 172.21.15.100:0/1168678970 wait complete. 2021-01-28T03:53:32.585 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:32 smithi100 bash[9834]: cluster 2021-01-28T03:53:31.315879+0000 mgr.y (mgr.14138) 128 : cluster [DBG] pgmap v96: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:32.586 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:32 smithi100 bash[13549]: cluster 2021-01-28T03:53:31.315879+0000 mgr.y (mgr.14138) 128 : cluster [DBG] pgmap v96: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:32.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:32 smithi162 bash[9856]: cluster 2021-01-28T03:53:31.315879+0000 mgr.y (mgr.14138) 128 : cluster [DBG] pgmap v96: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:33.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:33 smithi162 bash[9856]: audit 2021-01-28T03:53:32.500776+0000 mon.a (mon.0) 326 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:53:33.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:33 smithi162 bash[9856]: audit 2021-01-28T03:53:32.503991+0000 mon.a (mon.0) 327 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:53:33.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:33 smithi100 bash[9834]: audit 2021-01-28T03:53:32.500776+0000 mon.a (mon.0) 326 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:53:33.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:33 smithi100 bash[9834]: audit 2021-01-28T03:53:32.503991+0000 mon.a (mon.0) 327 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:53:33.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:33 smithi100 bash[13549]: audit 2021-01-28T03:53:32.500776+0000 mon.a (mon.0) 326 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:53:33.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:33 smithi100 bash[13549]: audit 2021-01-28T03:53:32.503991+0000 mon.a (mon.0) 327 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:53:33.881 DEBUG:teuthology.orchestra.run.smithi100:osd.2> sudo journalctl -f -n 0 -u ceph-c217df96-611b-11eb-8f9e-001a4aab830c@osd.2.service 2021-01-28T03:53:33.922 INFO:tasks.cephadm:Deploying osd.3 on smithi100 with /dev/vg_nvme/lv_1... 2021-01-28T03:53:33.923 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2021-01-28T03:53:33.939 INFO:journalctl@ceph.osd.2.smithi100.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T03:53:34.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:34 smithi100 bash[9834]: cluster 2021-01-28T03:53:33.316252+0000 mgr.y (mgr.14138) 129 : cluster [DBG] pgmap v97: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:34.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:34 smithi100 bash[9834]: audit 2021-01-28T03:53:33.501264+0000 mon.a (mon.0) 328 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:53:34.570 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:34 smithi100 bash[9834]: audit 2021-01-28T03:53:33.503391+0000 mon.a (mon.0) 329 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:53:34.571 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:34 smithi100 bash[13549]: cluster 2021-01-28T03:53:33.316252+0000 mgr.y (mgr.14138) 129 : cluster [DBG] pgmap v97: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:34.571 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:34 smithi100 bash[13549]: audit 2021-01-28T03:53:33.501264+0000 mon.a (mon.0) 328 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:53:34.572 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:34 smithi100 bash[13549]: audit 2021-01-28T03:53:33.503391+0000 mon.a (mon.0) 329 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:53:34.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:34 smithi162 bash[9856]: cluster 2021-01-28T03:53:33.316252+0000 mgr.y (mgr.14138) 129 : cluster [DBG] pgmap v97: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:34.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:34 smithi162 bash[9856]: audit 2021-01-28T03:53:33.501264+0000 mon.a (mon.0) 328 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:53:34.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:34 smithi162 bash[9856]: audit 2021-01-28T03:53:33.503391+0000 mon.a (mon.0) 329 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:53:35.569 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:53:35 smithi100 bash[10061]: debug 2021-01-28T03:53:35.290+0000 7f55eb859700 -1 calc_pg_upmaps abort due to max <= 0 2021-01-28T03:53:36.065 INFO:journalctl@ceph.osd.2.smithi100.stdout:Jan 28 03:53:35 smithi100 bash[21382]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-01-28T03:53:36.066 INFO:journalctl@ceph.osd.2.smithi100.stdout:Jan 28 03:53:35 smithi100 bash[21382]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2021-01-28T03:53:36.066 INFO:journalctl@ceph.osd.2.smithi100.stdout:Jan 28 03:53:35 smithi100 bash[21382]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2021-01-28T03:53:36.067 INFO:journalctl@ceph.osd.2.smithi100.stdout:Jan 28 03:53:35 smithi100 bash[21382]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2021-01-28T03:53:36.067 INFO:journalctl@ceph.osd.2.smithi100.stdout:Jan 28 03:53:35 smithi100 bash[21382]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-01-28T03:53:36.068 INFO:journalctl@ceph.osd.2.smithi100.stdout:Jan 28 03:53:35 smithi100 bash[21382]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-01-28T03:53:36.068 INFO:journalctl@ceph.osd.2.smithi100.stdout:Jan 28 03:53:35 smithi100 bash[21382]: --> ceph-volume lvm activate successful for osd ID: 2 2021-01-28T03:53:36.670 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:36 smithi100 bash[9834]: cluster 2021-01-28T03:53:35.316688+0000 mgr.y (mgr.14138) 130 : cluster [DBG] pgmap v98: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:36.670 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:36 smithi100 bash[9834]: audit 2021-01-28T03:53:35.473027+0000 mon.a (mon.0) 330 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T03:53:36.671 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:36 smithi100 bash[9834]: audit 2021-01-28T03:53:35.485022+0000 mon.a (mon.0) 331 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T03:53:36.671 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:36 smithi100 bash[13549]: cluster 2021-01-28T03:53:35.316688+0000 mgr.y (mgr.14138) 130 : cluster [DBG] pgmap v98: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:36.672 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:36 smithi100 bash[13549]: audit 2021-01-28T03:53:35.473027+0000 mon.a (mon.0) 330 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T03:53:36.672 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:36 smithi100 bash[13549]: audit 2021-01-28T03:53:35.485022+0000 mon.a (mon.0) 331 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T03:53:36.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:36 smithi162 bash[9856]: cluster 2021-01-28T03:53:35.316688+0000 mgr.y (mgr.14138) 130 : cluster [DBG] pgmap v98: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:36.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:36 smithi162 bash[9856]: audit 2021-01-28T03:53:35.473027+0000 mon.a (mon.0) 330 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T03:53:36.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:36 smithi162 bash[9856]: audit 2021-01-28T03:53:35.485022+0000 mon.a (mon.0) 331 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T03:53:37.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:37 smithi100 bash[9834]: cluster 2021-01-28T03:53:37.317117+0000 mgr.y (mgr.14138) 131 : cluster [DBG] pgmap v99: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:37.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:37 smithi100 bash[13549]: cluster 2021-01-28T03:53:37.317117+0000 mgr.y (mgr.14138) 131 : cluster [DBG] pgmap v99: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:38.007 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:37 smithi162 bash[9856]: cluster 2021-01-28T03:53:37.317117+0000 mgr.y (mgr.14138) 131 : cluster [DBG] pgmap v99: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:40.319 INFO:journalctl@ceph.osd.2.smithi100.stdout:Jan 28 03:53:40 smithi100 bash[21751]: debug 2021-01-28T03:53:40.090+0000 7f0b171d0700 10 -- 172.21.15.100:0/932574096 dispatch_throttle_release 413 to dispatch throttler 413/104857600 2021-01-28T03:53:40.320 INFO:journalctl@ceph.osd.2.smithi100.stdout:Jan 28 03:53:40 smithi100 bash[21751]: debug 2021-01-28T03:53:40.090+0000 7f0b171d0700 20 -- 172.21.15.100:0/932574096 done calling dispatch on 0x55ea328a4c60 2021-01-28T03:53:40.320 INFO:journalctl@ceph.osd.2.smithi100.stdout:Jan 28 03:53:40 smithi100 bash[21751]: debug 2021-01-28T03:53:40.090+0000 7f0b181d2700 20 -- 172.21.15.100:0/932574096 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55ea3292cc00 msgr2=0x55ea32899400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2021-01-28T03:53:40.320 INFO:journalctl@ceph.osd.2.smithi100.stdout:Jan 28 03:53:40 smithi100 bash[21751]: debug 2021-01-28T03:53:40.090+0000 7f0b181d2700 20 -- 172.21.15.100:0/932574096 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55ea3292cc00 msgr2=0x55ea32899400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=96 2021-01-28T03:53:40.320 INFO:journalctl@ceph.osd.2.smithi100.stdout:Jan 28 03:53:40 smithi100 bash[21751]: debug 2021-01-28T03:53:40.090+0000 7f0b181d2700 20 --2- 172.21.15.100:0/932574096 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55ea3292cc00 0x55ea32899400 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x55ea328a9e60 tx=0x55ea328ded80).handle_read_frame_preamble_main r=0 2021-01-28T03:53:40.321 INFO:journalctl@ceph.osd.2.smithi100.stdout:Jan 28 03:53:40 smithi100 bash[21751]: debug 2021-01-28T03:53:40.090+0000 7f0b181d2700 20 --2- 172.21.15.100:0/932574096 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55ea3292cc00 0x55ea32899400 secure :-1 s=THROTTLE_MESSAGE pgs=19 cs=0 l=1 rev1=1 rx=0x55ea328a9e60 tx=0x55ea328ded80).throttle_message 2021-01-28T03:53:40.321 INFO:journalctl@ceph.osd.2.smithi100.stdout:Jan 28 03:53:40 smithi100 bash[21751]: debug 2021-01-28T03:53:40.090+0000 7f0b181d2700 20 --2- 172.21.15.100:0/932574096 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55ea3292cc00 0x55ea32899400 secure :-1 s=THROTTLE_BYTES pgs=19 cs=0 l=1 rev1=1 rx=0x55ea328a9e60 tx=0x55ea328ded80).throttle_bytes 2021-01-28T03:53:40.321 INFO:journalctl@ceph.osd.2.smithi100.stdout:Jan 28 03:53:40 smithi100 bash[21751]: debug 2021-01-28T03:53:40.090+0000 7f0b181d2700 20 --2- 172.21.15.100:0/932574096 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55ea3292cc00 0x55ea32899400 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=19 cs=0 l=1 rev1=1 rx=0x55ea328a9e60 tx=0x55ea328ded80).throttle_dispatch_queue 2021-01-28T03:53:40.321 INFO:journalctl@ceph.osd.2.smithi100.stdout:Jan 28 03:53:40 smithi100 bash[21751]: debug 2021-01-28T03:53:40.090+0000 7f0b181d2700 20 --2- 172.21.15.100:0/932574096 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55ea3292cc00 0x55ea32899400 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rev1=1 rx=0x55ea328a9e60 tx=0x55ea328ded80).read_frame_segment seg_idx=0 2021-01-28T03:53:40.322 INFO:journalctl@ceph.osd.2.smithi100.stdout:Jan 28 03:53:40 smithi100 bash[21751]: debug 2021-01-28T03:53:40.090+0000 7f0b181d2700 20 --2- 172.21.15.100:0/932574096 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55ea3292cc00 0x55ea32899400 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rev1=1 rx=0x55ea328a9e60 tx=0x55ea328ded80).read_frame_segment seg_idx=1 2021-01-28T03:53:40.322 INFO:journalctl@ceph.osd.2.smithi100.stdout:Jan 28 03:53:40 smithi100 bash[21751]: debug 2021-01-28T03:53:40.090+0000 7f0b181d2700 20 -- 172.21.15.100:0/932574096 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55ea3292cc00 msgr2=0x55ea32899400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2021-01-28T03:53:40.322 INFO:journalctl@ceph.osd.2.smithi100.stdout:Jan 28 03:53:40 smithi100 bash[21751]: debug 2021-01-28T03:53:40.090+0000 7f0b181d2700 20 --2- 172.21.15.100:0/932574096 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55ea3292cc00 0x55ea32899400 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rev1=1 rx=0x55ea328a9e60 tx=0x55ea328ded80).handle_read_frame_segment r=0 2021-01-28T03:53:40.322 INFO:journalctl@ceph.osd.2.smithi100.stdout:Jan 28 03:53:40 smithi100 bash[21751]: debug 2021-01-28T03:53:40.090+0000 7f0b181d2700 20 -- 172.21.15.100:0/932574096 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55ea3292cc00 msgr2=0x55ea32899400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2021-01-28T03:53:40.323 INFO:journalctl@ceph.osd.2.smithi100.stdout:Jan 28 03:53:40 smithi100 bash[21751]: debug 2021-01-28T03:53:40.090+0000 7f0b181d2700 20 --2- 172.21.15.100:0/932574096 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55ea3292cc00 0x55ea32899400 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rev1=1 rx=0x55ea328a9e60 tx=0x55ea328ded80).handle_read_frame_epilogue_main r=0 2021-01-28T03:53:40.323 INFO:journalctl@ceph.osd.2.smithi100.stdout:Jan 28 03:53:40 smithi100 bash[21751]: debug 2021-01-28T03:53:40.090+0000 7f0b181d2700 10 --2- 172.21.15.100:0/932574096 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55ea3292cc00 0x55ea32899400 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rev1=1 rx=0x55ea328a9e60 tx=0x55ea328ded80).handle_read_frame_dispatch tag=17 2021-01-28T03:53:40.323 INFO:journalctl@ceph.osd.2.smithi100.stdout:Jan 28 03:53:40 smithi100 bash[21751]: debug 2021-01-28T03:53:40.090+0000 7f0b181d2700 20 --2- 172.21.15.100:0/932574096 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55ea3292cc00 0x55ea32899400 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rev1=1 rx=0x55ea328a9e60 tx=0x55ea328ded80).handle_message 2021-01-28T03:53:40.323 INFO:journalctl@ceph.osd.2.smithi100.stdout:Jan 28 03:53:40 smithi100 bash[21751]: debug 2021-01-28T03:53:40.090+0000 7f0b181d2700 5 --2- 172.21.15.100:0/932574096 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55ea3292cc00 0x55ea32899400 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rev1=1 rx=0x55ea328a9e60 tx=0x55ea328ded80).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.1 off 0 2021-01-28T03:53:40.324 INFO:journalctl@ceph.osd.2.smithi100.stdout:Jan 28 03:53:40 smithi100 bash[21751]: debug 2021-01-28T03:53:40.090+0000 7f0b181d2700 5 --2- 172.21.15.100:0/932574096 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55ea3292cc00 0x55ea32899400 secure :-1 s=READ_MESSAGE_COMPLETE pgs=19 cs=0 l=1 rev1=1 rx=0x55ea328a9e60 tx=0x55ea328ded80).handle_message received message m=0x55ea328ae4e0 seq=4 from=mon.1 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-28T03:53:40.324 INFO:journalctl@ceph.osd.2.smithi100.stdout:Jan 28 03:53:40 smithi100 bash[21751]: debug 2021-01-28T03:53:40.090+0000 7f0b181d2700 20 -- 172.21.15.100:0/932574096 queue 0x55ea328ae4e0 prio 196 2021-01-28T03:53:40.324 INFO:journalctl@ceph.osd.2.smithi100.stdout:Jan 28 03:53:40 smithi100 bash[21751]: debug 2021-01-28T03:53:40.090+0000 7f0b181d2700 20 --2- 172.21.15.100:0/932574096 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55ea3292cc00 0x55ea32899400 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x55ea328a9e60 tx=0x55ea328ded80).read_frame 2021-01-28T03:53:40.325 INFO:journalctl@ceph.osd.2.smithi100.stdout:Jan 28 03:53:40 smithi100 bash[21751]: debug 2021-01-28T03:53:40.090+0000 7f0b181d2700 20 -- 172.21.15.100:0/932574096 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55ea3292cc00 msgr2=0x55ea32899400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-28T03:53:40.325 INFO:journalctl@ceph.osd.2.smithi100.stdout:Jan 28 03:53:40 smithi100 bash[21751]: debug 2021-01-28T03:53:40.090+0000 7f0b171d0700 1 -- 172.21.15.100:0/932574096 <== mon.1 v2:172.21.15.100:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ea328ae4e0 con 0x55ea3292cc00 2021-01-28T03:53:40.325 INFO:journalctl@ceph.osd.2.smithi100.stdout:Jan 28 03:53:40 smithi100 bash[21751]: debug 2021-01-28T03:53:40.090+0000 7f0b171d0700 10 -- 172.21.15.100:0/932574096 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-28T03:53:40.325 INFO:journalctl@ceph.osd.2.smithi100.stdout:Jan 28 03:53:40 smithi100 bash[21751]: debug 2021-01-28T03:53:40.090+0000 7f0b171d0700 20 -- 172.21.15.100:0/932574096 done calling dispatch on 0x55ea328ae4e0 2021-01-28T03:53:40.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:40 smithi162 bash[9856]: cluster 2021-01-28T03:53:39.317687+0000 mgr.y (mgr.14138) 132 : cluster [DBG] pgmap v100: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:40.819 INFO:journalctl@ceph.osd.2.smithi100.stdout:Jan 28 03:53:40 smithi100 bash[21751]: debug 2021-01-28T03:53:40.386+0000 7f0b1ec5b200 -1 Falling back to public interface 2021-01-28T03:53:40.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:40 smithi100 bash[9834]: cluster 2021-01-28T03:53:39.317687+0000 mgr.y (mgr.14138) 132 : cluster [DBG] pgmap v100: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:40.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:40 smithi100 bash[13549]: cluster 2021-01-28T03:53:39.317687+0000 mgr.y (mgr.14138) 132 : cluster [DBG] pgmap v100: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:41.124 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping: /dev/vg_nvme/lv_1 2021-01-28T03:53:41.124 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2021-01-28T03:53:41.125 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10+0 records in 2021-01-28T03:53:41.125 INFO:teuthology.orchestra.run.smithi100.stderr:10+0 records out 2021-01-28T03:53:41.125 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0183679 s, 571 MB/s 2021-01-28T03:53:41.125 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping successful for: 2021-01-28T03:53:42.158 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph orch daemon add osd smithi100:vg_nvme/lv_1 2021-01-28T03:53:42.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:42 smithi162 bash[9856]: cluster 2021-01-28T03:53:41.318129+0000 mgr.y (mgr.14138) 133 : cluster [DBG] pgmap v101: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:42.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:42 smithi100 bash[9834]: cluster 2021-01-28T03:53:41.318129+0000 mgr.y (mgr.14138) 133 : cluster [DBG] pgmap v101: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:42.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:42 smithi100 bash[13549]: cluster 2021-01-28T03:53:41.318129+0000 mgr.y (mgr.14138) 133 : cluster [DBG] pgmap v101: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:43.722 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:43 smithi100 bash[13549]: audit 2021-01-28T03:53:42.962866+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:53:43.722 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:43 smithi100 bash[13549]: audit 2021-01-28T03:53:43.329361+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:53:43.723 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:43 smithi100 bash[13549]: audit 2021-01-28T03:53:43.336941+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:53:43.723 INFO:journalctl@ceph.osd.2.smithi100.stdout:Jan 28 03:53:43 smithi100 bash[21751]: debug 2021-01-28T03:53:43.422+0000 7f0b1ec5b200 -1 osd.2 0 log_to_monitors {default=true} 2021-01-28T03:53:43.723 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:43 smithi100 bash[9834]: audit 2021-01-28T03:53:42.962866+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:53:43.724 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:43 smithi100 bash[9834]: audit 2021-01-28T03:53:43.329361+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:53:43.724 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:43 smithi100 bash[9834]: audit 2021-01-28T03:53:43.336941+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:53:43.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:43 smithi162 bash[9856]: audit 2021-01-28T03:53:42.962866+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:53:43.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:43 smithi162 bash[9856]: audit 2021-01-28T03:53:43.329361+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:53:43.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:43 smithi162 bash[9856]: audit 2021-01-28T03:53:43.336941+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:53:44.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:44 smithi162 bash[9856]: cluster 2021-01-28T03:53:43.318649+0000 mgr.y (mgr.14138) 134 : cluster [DBG] pgmap v102: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:44.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:44 smithi162 bash[9856]: cephadm 2021-01-28T03:53:43.338062+0000 mgr.y (mgr.14138) 135 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:53:44.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:44 smithi162 bash[9856]: cephadm 2021-01-28T03:53:43.340875+0000 mgr.y (mgr.14138) 136 : cephadm [INF] refreshing smithi162 facts 2021-01-28T03:53:44.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:44 smithi162 bash[9856]: audit 2021-01-28T03:53:43.430167+0000 mon.c (mon.1) 12 : audit [INF] from='osd.2 v2:172.21.15.100:6809/1600283162' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-01-28T03:53:44.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:44 smithi162 bash[9856]: audit 2021-01-28T03:53:43.430793+0000 mon.a (mon.0) 335 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-01-28T03:53:44.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:44 smithi162 bash[9856]: audit 2021-01-28T03:53:43.768244+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:53:44.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:44 smithi100 bash[9834]: cluster 2021-01-28T03:53:43.318649+0000 mgr.y (mgr.14138) 134 : cluster [DBG] pgmap v102: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:44.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:44 smithi100 bash[9834]: cephadm 2021-01-28T03:53:43.338062+0000 mgr.y (mgr.14138) 135 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:53:44.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:44 smithi100 bash[9834]: cephadm 2021-01-28T03:53:43.340875+0000 mgr.y (mgr.14138) 136 : cephadm [INF] refreshing smithi162 facts 2021-01-28T03:53:44.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:44 smithi100 bash[9834]: audit 2021-01-28T03:53:43.430167+0000 mon.c (mon.1) 12 : audit [INF] from='osd.2 v2:172.21.15.100:6809/1600283162' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-01-28T03:53:44.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:44 smithi100 bash[9834]: audit 2021-01-28T03:53:43.430793+0000 mon.a (mon.0) 335 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-01-28T03:53:44.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:44 smithi100 bash[9834]: audit 2021-01-28T03:53:43.768244+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:53:44.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:44 smithi100 bash[13549]: cluster 2021-01-28T03:53:43.318649+0000 mgr.y (mgr.14138) 134 : cluster [DBG] pgmap v102: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:44.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:44 smithi100 bash[13549]: cephadm 2021-01-28T03:53:43.338062+0000 mgr.y (mgr.14138) 135 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:53:44.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:44 smithi100 bash[13549]: cephadm 2021-01-28T03:53:43.340875+0000 mgr.y (mgr.14138) 136 : cephadm [INF] refreshing smithi162 facts 2021-01-28T03:53:44.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:44 smithi100 bash[13549]: audit 2021-01-28T03:53:43.430167+0000 mon.c (mon.1) 12 : audit [INF] from='osd.2 v2:172.21.15.100:6809/1600283162' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-01-28T03:53:44.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:44 smithi100 bash[13549]: audit 2021-01-28T03:53:43.430793+0000 mon.a (mon.0) 335 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-01-28T03:53:44.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:44 smithi100 bash[13549]: audit 2021-01-28T03:53:43.768244+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:53:45.724 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.730+0000 7fef289f5700 1 -- 172.21.15.100:0/2194800769 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef240f6390 msgr2=0x7fef240fcc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:53:45.724 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.730+0000 7fef289f5700 1 --2- 172.21.15.100:0/2194800769 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef240f6390 0x7fef240fcc90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fef1c009dc0 tx=0x7fef1c004d10).stop 2021-01-28T03:53:45.724 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.730+0000 7fef289f5700 1 -- 172.21.15.100:0/2194800769 shutdown_connections 2021-01-28T03:53:45.725 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.730+0000 7fef289f5700 1 --2- 172.21.15.100:0/2194800769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef240f47a0 0x7fef240f4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:53:45.725 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.730+0000 7fef289f5700 1 --2- 172.21.15.100:0/2194800769 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef240f6390 0x7fef240fcc90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:53:45.725 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.730+0000 7fef289f5700 1 --2- 172.21.15.100:0/2194800769 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fef240f5a40 0x7fef240f5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:53:45.725 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.730+0000 7fef289f5700 1 -- 172.21.15.100:0/2194800769 >> 172.21.15.100:0/2194800769 conn(0x7fef240effa0 msgr2=0x7fef240f23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:53:45.725 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.730+0000 7fef289f5700 1 -- 172.21.15.100:0/2194800769 shutdown_connections 2021-01-28T03:53:45.726 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.730+0000 7fef289f5700 1 -- 172.21.15.100:0/2194800769 wait complete. 2021-01-28T03:53:45.727 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.730+0000 7fef289f5700 1 Processor -- start 2021-01-28T03:53:45.728 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.730+0000 7fef289f5700 1 -- start start 2021-01-28T03:53:45.728 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.730+0000 7fef289f5700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef240f47a0 0x7fef241044f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:53:45.728 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.730+0000 7fef289f5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef240f5a40 0x7fef241049e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:53:45.728 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.730+0000 7fef289f5700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fef240f6390 0x7fef241058d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:53:45.729 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.730+0000 7fef289f5700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef24105e00 con 0x7fef240f5a40 2021-01-28T03:53:45.729 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.730+0000 7fef289f5700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef24105f70 con 0x7fef240f47a0 2021-01-28T03:53:45.729 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.730+0000 7fef289f5700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef24106130 con 0x7fef240f6390 2021-01-28T03:53:45.729 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.730+0000 7fef1affd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef240f5a40 0x7fef241049e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:53:45.729 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.730+0000 7fef1affd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef240f5a40 0x7fef241049e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59316/0 (socket says 172.21.15.100:59316) 2021-01-28T03:53:45.730 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.730+0000 7fef1affd700 1 -- 172.21.15.100:0/2238885284 learned_addr learned my addr 172.21.15.100:0/2238885284 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:53:45.730 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.730+0000 7fef237fe700 1 --2- 172.21.15.100:0/2238885284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef240f47a0 0x7fef241044f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:53:45.730 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.730+0000 7fef23fff700 1 --2- 172.21.15.100:0/2238885284 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fef240f6390 0x7fef241058d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:53:45.730 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.730+0000 7fef1affd700 1 -- 172.21.15.100:0/2238885284 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fef240f6390 msgr2=0x7fef241058d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:53:45.731 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.730+0000 7fef1affd700 1 --2- 172.21.15.100:0/2238885284 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fef240f6390 0x7fef241058d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:53:45.731 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.730+0000 7fef1affd700 1 -- 172.21.15.100:0/2238885284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef240f47a0 msgr2=0x7fef241044f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:53:45.731 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.730+0000 7fef1affd700 1 --2- 172.21.15.100:0/2238885284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef240f47a0 0x7fef241044f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:53:45.731 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.730+0000 7fef1affd700 1 -- 172.21.15.100:0/2238885284 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef241062f0 con 0x7fef240f5a40 2021-01-28T03:53:45.731 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.730+0000 7fef237fe700 1 --2- 172.21.15.100:0/2238885284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef240f47a0 0x7fef241044f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-28T03:53:45.732 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.730+0000 7fef23fff700 1 --2- 172.21.15.100:0/2238885284 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fef240f6390 0x7fef241058d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-28T03:53:45.732 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.730+0000 7fef1affd700 1 --2- 172.21.15.100:0/2238885284 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef240f5a40 0x7fef241049e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fef0c00ebc0 tx=0x7fef0c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:53:45.732 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.730+0000 7fef20ff9700 1 -- 172.21.15.100:0/2238885284 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c0092e0 con 0x7fef240f5a40 2021-01-28T03:53:45.732 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.730+0000 7fef20ff9700 1 -- 172.21.15.100:0/2238885284 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fef0c00f040 con 0x7fef240f5a40 2021-01-28T03:53:45.732 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.730+0000 7fef289f5700 1 -- 172.21.15.100:0/2238885284 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef241065a0 con 0x7fef240f5a40 2021-01-28T03:53:45.733 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.730+0000 7fef20ff9700 1 -- 172.21.15.100:0/2238885284 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c007ea0 con 0x7fef240f5a40 2021-01-28T03:53:45.733 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.730+0000 7fef289f5700 1 -- 172.21.15.100:0/2238885284 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef2405edd0 con 0x7fef240f5a40 2021-01-28T03:53:45.734 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.734+0000 7fef289f5700 1 -- 172.21.15.100:0/2238885284 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef240f3b90 con 0x7fef240f5a40 2021-01-28T03:53:45.734 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.734+0000 7fef20ff9700 1 -- 172.21.15.100:0/2238885284 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 14) v1 ==== 71316+0+0 (secure 0 0 0) 0x7fef0c00cb10 con 0x7fef240f5a40 2021-01-28T03:53:45.734 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.734+0000 7fef20ff9700 1 --2- 172.21.15.100:0/2238885284 >> v2:172.21.15.100:6800/928846103 conn(0x7fef1005bc30 0x7fef1005e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:53:45.735 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.734+0000 7fef20ff9700 1 -- 172.21.15.100:0/2238885284 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 2328+0+0 (secure 0 0 0) 0x7fef0c074910 con 0x7fef240f5a40 2021-01-28T03:53:45.735 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.734+0000 7fef237fe700 1 --2- 172.21.15.100:0/2238885284 >> v2:172.21.15.100:6800/928846103 conn(0x7fef1005bc30 0x7fef1005e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:53:45.735 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.738+0000 7fef237fe700 1 --2- 172.21.15.100:0/2238885284 >> v2:172.21.15.100:6800/928846103 conn(0x7fef1005bc30 0x7fef1005e0f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fef240f58a0 tx=0x7fef1400b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:53:45.737 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.742+0000 7fef20ff9700 1 -- 172.21.15.100:0/2238885284 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fef0c0492f0 con 0x7fef240f5a40 2021-01-28T03:53:45.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:45 smithi162 bash[9856]: cephadm 2021-01-28T03:53:43.770569+0000 mgr.y (mgr.14138) 137 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:53:45.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:45 smithi162 bash[9856]: audit 2021-01-28T03:53:44.401000+0000 mon.a (mon.0) 337 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-01-28T03:53:45.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:45 smithi162 bash[9856]: cluster 2021-01-28T03:53:44.401185+0000 mon.a (mon.0) 338 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2021-01-28T03:53:45.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:45 smithi162 bash[9856]: audit 2021-01-28T03:53:44.401396+0000 mon.a (mon.0) 339 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-28T03:53:45.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:45 smithi162 bash[9856]: audit 2021-01-28T03:53:44.402254+0000 mon.c (mon.1) 13 : audit [INF] from='osd.2 v2:172.21.15.100:6809/1600283162' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2021-01-28T03:53:45.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:45 smithi162 bash[9856]: audit 2021-01-28T03:53:44.402654+0000 mon.a (mon.0) 340 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2021-01-28T03:53:45.819 INFO:journalctl@ceph.osd.2.smithi100.stdout:Jan 28 03:53:45 smithi100 bash[21751]: debug 2021-01-28T03:53:45.410+0000 7f0b151cc700 -1 osd.2 0 waiting for initial osdmap 2021-01-28T03:53:45.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:45 smithi100 bash[9834]: cephadm 2021-01-28T03:53:43.770569+0000 mgr.y (mgr.14138) 137 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:53:45.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:45 smithi100 bash[9834]: audit 2021-01-28T03:53:44.401000+0000 mon.a (mon.0) 337 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-01-28T03:53:45.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:45 smithi100 bash[9834]: cluster 2021-01-28T03:53:44.401185+0000 mon.a (mon.0) 338 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2021-01-28T03:53:45.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:45 smithi100 bash[9834]: audit 2021-01-28T03:53:44.401396+0000 mon.a (mon.0) 339 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-28T03:53:45.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:45 smithi100 bash[9834]: audit 2021-01-28T03:53:44.402254+0000 mon.c (mon.1) 13 : audit [INF] from='osd.2 v2:172.21.15.100:6809/1600283162' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2021-01-28T03:53:45.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:45 smithi100 bash[9834]: audit 2021-01-28T03:53:44.402654+0000 mon.a (mon.0) 340 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2021-01-28T03:53:45.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:45 smithi100 bash[13549]: cephadm 2021-01-28T03:53:43.770569+0000 mgr.y (mgr.14138) 137 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:53:45.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:45 smithi100 bash[13549]: audit 2021-01-28T03:53:44.401000+0000 mon.a (mon.0) 337 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-01-28T03:53:45.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:45 smithi100 bash[13549]: cluster 2021-01-28T03:53:44.401185+0000 mon.a (mon.0) 338 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2021-01-28T03:53:45.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:45 smithi100 bash[13549]: audit 2021-01-28T03:53:44.401396+0000 mon.a (mon.0) 339 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-28T03:53:45.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:45 smithi100 bash[13549]: audit 2021-01-28T03:53:44.402254+0000 mon.c (mon.1) 13 : audit [INF] from='osd.2 v2:172.21.15.100:6809/1600283162' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2021-01-28T03:53:45.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:45 smithi100 bash[13549]: audit 2021-01-28T03:53:44.402654+0000 mon.a (mon.0) 340 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2021-01-28T03:53:45.926 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:53:45.930+0000 7fef289f5700 1 -- 172.21.15.100:0/2238885284 --> v2:172.21.15.100:6800/928846103 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fef240ff660 con 0x7fef1005bc30 2021-01-28T03:53:46.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:46 smithi100 bash[9834]: cluster 2021-01-28T03:53:45.319196+0000 mgr.y (mgr.14138) 138 : cluster [DBG] pgmap v104: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:46.607 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:46 smithi100 bash[9834]: audit 2021-01-28T03:53:45.405791+0000 mon.a (mon.0) 341 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2021-01-28T03:53:46.608 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:46 smithi100 bash[9834]: cluster 2021-01-28T03:53:45.406050+0000 mon.a (mon.0) 342 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2021-01-28T03:53:46.608 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:46 smithi100 bash[9834]: audit 2021-01-28T03:53:45.407004+0000 mon.a (mon.0) 343 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-28T03:53:46.608 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:46 smithi100 bash[9834]: audit 2021-01-28T03:53:45.413648+0000 mon.a (mon.0) 344 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-28T03:53:46.608 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:46 smithi100 bash[9834]: audit 2021-01-28T03:53:45.937665+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T03:53:46.609 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:46 smithi100 bash[9834]: audit 2021-01-28T03:53:45.940001+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T03:53:46.609 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:46 smithi100 bash[9834]: audit 2021-01-28T03:53:45.941471+0000 mon.a (mon.0) 347 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:53:46.609 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:46 smithi100 bash[9834]: audit 2021-01-28T03:53:45.943240+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:53:46.609 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:46 smithi100 bash[13549]: cluster 2021-01-28T03:53:45.319196+0000 mgr.y (mgr.14138) 138 : cluster [DBG] pgmap v104: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:46.610 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:46 smithi100 bash[13549]: audit 2021-01-28T03:53:45.405791+0000 mon.a (mon.0) 341 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2021-01-28T03:53:46.610 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:46 smithi100 bash[13549]: cluster 2021-01-28T03:53:45.406050+0000 mon.a (mon.0) 342 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2021-01-28T03:53:46.610 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:46 smithi100 bash[13549]: audit 2021-01-28T03:53:45.407004+0000 mon.a (mon.0) 343 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-28T03:53:46.610 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:46 smithi100 bash[13549]: audit 2021-01-28T03:53:45.413648+0000 mon.a (mon.0) 344 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-28T03:53:46.611 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:46 smithi100 bash[13549]: audit 2021-01-28T03:53:45.937665+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T03:53:46.611 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:46 smithi100 bash[13549]: audit 2021-01-28T03:53:45.940001+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T03:53:46.611 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:46 smithi100 bash[13549]: audit 2021-01-28T03:53:45.941471+0000 mon.a (mon.0) 347 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:53:46.611 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:46 smithi100 bash[13549]: audit 2021-01-28T03:53:45.943240+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:53:46.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:46 smithi162 bash[9856]: cluster 2021-01-28T03:53:45.319196+0000 mgr.y (mgr.14138) 138 : cluster [DBG] pgmap v104: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:46.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:46 smithi162 bash[9856]: audit 2021-01-28T03:53:45.405791+0000 mon.a (mon.0) 341 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2021-01-28T03:53:46.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:46 smithi162 bash[9856]: cluster 2021-01-28T03:53:45.406050+0000 mon.a (mon.0) 342 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2021-01-28T03:53:46.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:46 smithi162 bash[9856]: audit 2021-01-28T03:53:45.407004+0000 mon.a (mon.0) 343 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-28T03:53:46.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:46 smithi162 bash[9856]: audit 2021-01-28T03:53:45.413648+0000 mon.a (mon.0) 344 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-28T03:53:46.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:46 smithi162 bash[9856]: audit 2021-01-28T03:53:45.937665+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T03:53:46.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:46 smithi162 bash[9856]: audit 2021-01-28T03:53:45.940001+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T03:53:46.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:46 smithi162 bash[9856]: audit 2021-01-28T03:53:45.941471+0000 mon.a (mon.0) 347 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:53:46.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:46 smithi162 bash[9856]: audit 2021-01-28T03:53:45.943240+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:53:47.688 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:47 smithi100 bash[9834]: cluster 2021-01-28T03:53:44.401820+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T03:53:47.689 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:47 smithi100 bash[9834]: cluster 2021-01-28T03:53:44.401961+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T03:53:47.689 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:47 smithi100 bash[9834]: audit 2021-01-28T03:53:45.935652+0000 mgr.y (mgr.14138) 139 : audit [DBG] from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:53:47.689 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:47 smithi100 bash[9834]: cephadm 2021-01-28T03:53:45.939529+0000 mgr.y (mgr.14138) 140 : cephadm [INF] Applying drive group None on host smithi100... 2021-01-28T03:53:47.690 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:47 smithi100 bash[9834]: cluster 2021-01-28T03:53:46.416141+0000 mon.a (mon.0) 349 : cluster [INF] osd.2 v2:172.21.15.100:6809/1600283162 boot 2021-01-28T03:53:47.690 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:47 smithi100 bash[9834]: cluster 2021-01-28T03:53:46.416262+0000 mon.a (mon.0) 350 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2021-01-28T03:53:47.691 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:47 smithi100 bash[9834]: audit 2021-01-28T03:53:46.417114+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-28T03:53:47.691 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:47 smithi100 bash[13549]: cluster 2021-01-28T03:53:44.401820+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T03:53:47.692 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:47 smithi100 bash[13549]: cluster 2021-01-28T03:53:44.401961+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T03:53:47.692 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:47 smithi100 bash[13549]: audit 2021-01-28T03:53:45.935652+0000 mgr.y (mgr.14138) 139 : audit [DBG] from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:53:47.692 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:47 smithi100 bash[13549]: cephadm 2021-01-28T03:53:45.939529+0000 mgr.y (mgr.14138) 140 : cephadm [INF] Applying drive group None on host smithi100... 2021-01-28T03:53:47.693 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:47 smithi100 bash[13549]: cluster 2021-01-28T03:53:46.416141+0000 mon.a (mon.0) 349 : cluster [INF] osd.2 v2:172.21.15.100:6809/1600283162 boot 2021-01-28T03:53:47.693 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:47 smithi100 bash[13549]: cluster 2021-01-28T03:53:46.416262+0000 mon.a (mon.0) 350 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2021-01-28T03:53:47.694 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:47 smithi100 bash[13549]: audit 2021-01-28T03:53:46.417114+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-28T03:53:47.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:47 smithi162 bash[9856]: cluster 2021-01-28T03:53:44.401820+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T03:53:47.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:47 smithi162 bash[9856]: cluster 2021-01-28T03:53:44.401961+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T03:53:47.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:47 smithi162 bash[9856]: audit 2021-01-28T03:53:45.935652+0000 mgr.y (mgr.14138) 139 : audit [DBG] from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:53:47.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:47 smithi162 bash[9856]: cephadm 2021-01-28T03:53:45.939529+0000 mgr.y (mgr.14138) 140 : cephadm [INF] Applying drive group None on host smithi100... 2021-01-28T03:53:47.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:47 smithi162 bash[9856]: cluster 2021-01-28T03:53:46.416141+0000 mon.a (mon.0) 349 : cluster [INF] osd.2 v2:172.21.15.100:6809/1600283162 boot 2021-01-28T03:53:47.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:47 smithi162 bash[9856]: cluster 2021-01-28T03:53:46.416262+0000 mon.a (mon.0) 350 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2021-01-28T03:53:47.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:47 smithi162 bash[9856]: audit 2021-01-28T03:53:46.417114+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-28T03:53:48.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:48 smithi162 bash[9856]: cluster 2021-01-28T03:53:47.319810+0000 mgr.y (mgr.14138) 141 : cluster [DBG] pgmap v107: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:48.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:48 smithi162 bash[9856]: cluster 2021-01-28T03:53:47.432654+0000 mon.a (mon.0) 352 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2021-01-28T03:53:48.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:48 smithi100 bash[9834]: cluster 2021-01-28T03:53:47.319810+0000 mgr.y (mgr.14138) 141 : cluster [DBG] pgmap v107: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:48.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:48 smithi100 bash[9834]: cluster 2021-01-28T03:53:47.432654+0000 mon.a (mon.0) 352 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2021-01-28T03:53:48.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:48 smithi100 bash[13549]: cluster 2021-01-28T03:53:47.319810+0000 mgr.y (mgr.14138) 141 : cluster [DBG] pgmap v107: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T03:53:48.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:48 smithi100 bash[13549]: cluster 2021-01-28T03:53:47.432654+0000 mon.a (mon.0) 352 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2021-01-28T03:53:49.568 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:49 smithi100 bash[13549]: cluster 2021-01-28T03:53:49.320344+0000 mgr.y (mgr.14138) 142 : cluster [DBG] pgmap v109: 1 pgs: 1 activating; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:53:49.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:49 smithi100 bash[9834]: cluster 2021-01-28T03:53:49.320344+0000 mgr.y (mgr.14138) 142 : cluster [DBG] pgmap v109: 1 pgs: 1 activating; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:53:49.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:49 smithi162 bash[9856]: cluster 2021-01-28T03:53:49.320344+0000 mgr.y (mgr.14138) 142 : cluster [DBG] pgmap v109: 1 pgs: 1 activating; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:53:50.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:50 smithi162 bash[9856]: audit 2021-01-28T03:53:50.168302+0000 mon.c (mon.1) 14 : audit [INF] from='client.? 172.21.15.100:0/3133676380' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5de112f2-cf7c-4075-9d15-b8566a707947"}]: dispatch 2021-01-28T03:53:50.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:50 smithi162 bash[9856]: audit 2021-01-28T03:53:50.168831+0000 mon.a (mon.0) 353 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5de112f2-cf7c-4075-9d15-b8566a707947"}]: dispatch 2021-01-28T03:53:50.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:50 smithi162 bash[9856]: audit 2021-01-28T03:53:50.173728+0000 mon.a (mon.0) 354 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5de112f2-cf7c-4075-9d15-b8566a707947"}]': finished 2021-01-28T03:53:50.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:50 smithi162 bash[9856]: cluster 2021-01-28T03:53:50.173838+0000 mon.a (mon.0) 355 : cluster [DBG] osdmap e23: 4 total, 3 up, 3 in 2021-01-28T03:53:50.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:50 smithi162 bash[9856]: audit 2021-01-28T03:53:50.173958+0000 mon.a (mon.0) 356 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-28T03:53:50.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:50 smithi100 bash[9834]: audit 2021-01-28T03:53:50.168302+0000 mon.c (mon.1) 14 : audit [INF] from='client.? 172.21.15.100:0/3133676380' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5de112f2-cf7c-4075-9d15-b8566a707947"}]: dispatch 2021-01-28T03:53:50.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:50 smithi100 bash[9834]: audit 2021-01-28T03:53:50.168831+0000 mon.a (mon.0) 353 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5de112f2-cf7c-4075-9d15-b8566a707947"}]: dispatch 2021-01-28T03:53:50.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:50 smithi100 bash[9834]: audit 2021-01-28T03:53:50.173728+0000 mon.a (mon.0) 354 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5de112f2-cf7c-4075-9d15-b8566a707947"}]': finished 2021-01-28T03:53:50.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:50 smithi100 bash[9834]: cluster 2021-01-28T03:53:50.173838+0000 mon.a (mon.0) 355 : cluster [DBG] osdmap e23: 4 total, 3 up, 3 in 2021-01-28T03:53:50.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:50 smithi100 bash[9834]: audit 2021-01-28T03:53:50.173958+0000 mon.a (mon.0) 356 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-28T03:53:50.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:50 smithi100 bash[13549]: audit 2021-01-28T03:53:50.168302+0000 mon.c (mon.1) 14 : audit [INF] from='client.? 172.21.15.100:0/3133676380' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5de112f2-cf7c-4075-9d15-b8566a707947"}]: dispatch 2021-01-28T03:53:50.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:50 smithi100 bash[13549]: audit 2021-01-28T03:53:50.168831+0000 mon.a (mon.0) 353 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5de112f2-cf7c-4075-9d15-b8566a707947"}]: dispatch 2021-01-28T03:53:50.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:50 smithi100 bash[13549]: audit 2021-01-28T03:53:50.173728+0000 mon.a (mon.0) 354 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5de112f2-cf7c-4075-9d15-b8566a707947"}]': finished 2021-01-28T03:53:50.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:50 smithi100 bash[13549]: cluster 2021-01-28T03:53:50.173838+0000 mon.a (mon.0) 355 : cluster [DBG] osdmap e23: 4 total, 3 up, 3 in 2021-01-28T03:53:50.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:50 smithi100 bash[13549]: audit 2021-01-28T03:53:50.173958+0000 mon.a (mon.0) 356 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-28T03:53:51.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:51 smithi162 bash[9856]: audit 2021-01-28T03:53:50.838533+0000 mon.a (mon.0) 357 : audit [DBG] from='client.? 172.21.15.100:0/1742050327' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T03:53:51.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:51 smithi162 bash[9856]: cluster 2021-01-28T03:53:51.320906+0000 mgr.y (mgr.14138) 143 : cluster [DBG] pgmap v111: 1 pgs: 1 activating; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:53:51.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:51 smithi100 bash[13549]: audit 2021-01-28T03:53:50.838533+0000 mon.a (mon.0) 357 : audit [DBG] from='client.? 172.21.15.100:0/1742050327' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T03:53:51.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:51 smithi100 bash[13549]: cluster 2021-01-28T03:53:51.320906+0000 mgr.y (mgr.14138) 143 : cluster [DBG] pgmap v111: 1 pgs: 1 activating; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:53:51.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:51 smithi100 bash[9834]: audit 2021-01-28T03:53:50.838533+0000 mon.a (mon.0) 357 : audit [DBG] from='client.? 172.21.15.100:0/1742050327' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T03:53:51.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:51 smithi100 bash[9834]: cluster 2021-01-28T03:53:51.320906+0000 mgr.y (mgr.14138) 143 : cluster [DBG] pgmap v111: 1 pgs: 1 activating; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:53:54.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:54 smithi162 bash[9856]: cluster 2021-01-28T03:53:53.321480+0000 mgr.y (mgr.14138) 144 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:53:54.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:54 smithi162 bash[9856]: audit 2021-01-28T03:53:54.091584+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:53:54.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:54 smithi100 bash[9834]: cluster 2021-01-28T03:53:53.321480+0000 mgr.y (mgr.14138) 144 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:53:54.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:54 smithi100 bash[9834]: audit 2021-01-28T03:53:54.091584+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:53:54.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:54 smithi100 bash[13549]: cluster 2021-01-28T03:53:53.321480+0000 mgr.y (mgr.14138) 144 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:53:54.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:54 smithi100 bash[13549]: audit 2021-01-28T03:53:54.091584+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:53:56.506 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:56 smithi162 bash[9856]: cluster 2021-01-28T03:53:55.322056+0000 mgr.y (mgr.14138) 145 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:53:56.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:56 smithi100 bash[9834]: cluster 2021-01-28T03:53:55.322056+0000 mgr.y (mgr.14138) 145 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:53:56.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:56 smithi100 bash[13549]: cluster 2021-01-28T03:53:55.322056+0000 mgr.y (mgr.14138) 145 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:53:57.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:57 smithi100 bash[9834]: cluster 2021-01-28T03:53:57.322692+0000 mgr.y (mgr.14138) 146 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:53:57.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:57 smithi100 bash[13549]: cluster 2021-01-28T03:53:57.322692+0000 mgr.y (mgr.14138) 146 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:53:58.006 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:57 smithi162 bash[9856]: cluster 2021-01-28T03:53:57.322692+0000 mgr.y (mgr.14138) 146 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:53:59.185 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:58 smithi100 bash[9834]: audit 2021-01-28T03:53:58.797969+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-01-28T03:53:59.186 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:58 smithi100 bash[9834]: audit 2021-01-28T03:53:58.799611+0000 mon.a (mon.0) 360 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:53:59.186 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:58 smithi100 bash[9834]: audit 2021-01-28T03:53:58.801680+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2021-01-28T03:53:59.187 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:58 smithi100 bash[13549]: audit 2021-01-28T03:53:58.797969+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-01-28T03:53:59.187 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:58 smithi100 bash[13549]: audit 2021-01-28T03:53:58.799611+0000 mon.a (mon.0) 360 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:53:59.188 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:58 smithi100 bash[13549]: audit 2021-01-28T03:53:58.801680+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2021-01-28T03:53:59.256 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:58 smithi162 bash[9856]: audit 2021-01-28T03:53:58.797969+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-01-28T03:53:59.257 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:58 smithi162 bash[9856]: audit 2021-01-28T03:53:58.799611+0000 mon.a (mon.0) 360 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:53:59.257 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:58 smithi162 bash[9856]: audit 2021-01-28T03:53:58.801680+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2021-01-28T03:54:00.180 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:59 smithi100 bash[9834]: cephadm 2021-01-28T03:53:58.801017+0000 mgr.y (mgr.14138) 147 : cephadm [INF] Deploying daemon osd.3 on smithi100 2021-01-28T03:54:00.180 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:53:59 smithi100 bash[9834]: cluster 2021-01-28T03:53:59.323370+0000 mgr.y (mgr.14138) 148 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:54:00.181 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:59 smithi100 bash[13549]: cephadm 2021-01-28T03:53:58.801017+0000 mgr.y (mgr.14138) 147 : cephadm [INF] Deploying daemon osd.3 on smithi100 2021-01-28T03:54:00.181 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:53:59 smithi100 bash[13549]: cluster 2021-01-28T03:53:59.323370+0000 mgr.y (mgr.14138) 148 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:54:00.256 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:59 smithi162 bash[9856]: cephadm 2021-01-28T03:53:58.801017+0000 mgr.y (mgr.14138) 147 : cephadm [INF] Deploying daemon osd.3 on smithi100 2021-01-28T03:54:00.257 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:53:59 smithi162 bash[9856]: cluster 2021-01-28T03:53:59.323370+0000 mgr.y (mgr.14138) 148 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:54:01.583 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:54:01.590+0000 7fef20ff9700 1 -- 172.21.15.100:0/2238885284 <== mgr.14138 v2:172.21.15.100:6800/928846103 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fef240ff660 con 0x7fef1005bc30 2021-01-28T03:54:01.584 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 3 on host 'smithi100' 2021-01-28T03:54:01.585 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:54:01.590+0000 7fef289f5700 1 -- 172.21.15.100:0/2238885284 >> v2:172.21.15.100:6800/928846103 conn(0x7fef1005bc30 msgr2=0x7fef1005e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:54:01.586 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:54:01.590+0000 7fef289f5700 1 --2- 172.21.15.100:0/2238885284 >> v2:172.21.15.100:6800/928846103 conn(0x7fef1005bc30 0x7fef1005e0f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fef240f58a0 tx=0x7fef1400b040).stop 2021-01-28T03:54:01.586 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:54:01.590+0000 7fef289f5700 1 -- 172.21.15.100:0/2238885284 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef240f5a40 msgr2=0x7fef241049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:54:01.586 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:54:01.590+0000 7fef289f5700 1 --2- 172.21.15.100:0/2238885284 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef240f5a40 0x7fef241049e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fef0c00ebc0 tx=0x7fef0c00b040).stop 2021-01-28T03:54:01.586 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:54:01.590+0000 7fef289f5700 1 -- 172.21.15.100:0/2238885284 shutdown_connections 2021-01-28T03:54:01.587 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:54:01.590+0000 7fef289f5700 1 --2- 172.21.15.100:0/2238885284 >> v2:172.21.15.100:6800/928846103 conn(0x7fef1005bc30 0x7fef1005e0f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:54:01.587 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:54:01.590+0000 7fef289f5700 1 --2- 172.21.15.100:0/2238885284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef240f47a0 0x7fef241044f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:54:01.588 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:54:01.590+0000 7fef289f5700 1 --2- 172.21.15.100:0/2238885284 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fef240f6390 0x7fef241058d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:54:01.588 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:54:01.590+0000 7fef289f5700 1 --2- 172.21.15.100:0/2238885284 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef240f5a40 0x7fef241049e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:54:01.589 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:54:01.590+0000 7fef289f5700 1 -- 172.21.15.100:0/2238885284 >> 172.21.15.100:0/2238885284 conn(0x7fef240effa0 msgr2=0x7fef240f2260 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:54:01.589 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:54:01.590+0000 7fef289f5700 1 -- 172.21.15.100:0/2238885284 shutdown_connections 2021-01-28T03:54:01.589 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:54:01.590+0000 7fef289f5700 1 -- 172.21.15.100:0/2238885284 wait complete. 2021-01-28T03:54:02.568 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:02 smithi100 bash[9834]: cluster 2021-01-28T03:54:01.323731+0000 mgr.y (mgr.14138) 149 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:54:02.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:02 smithi100 bash[9834]: audit 2021-01-28T03:54:01.584027+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:54:02.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:02 smithi100 bash[9834]: audit 2021-01-28T03:54:01.588105+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:02.569 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:02 smithi100 bash[13549]: cluster 2021-01-28T03:54:01.323731+0000 mgr.y (mgr.14138) 149 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:54:02.569 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:02 smithi100 bash[13549]: audit 2021-01-28T03:54:01.584027+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:54:02.570 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:02 smithi100 bash[13549]: audit 2021-01-28T03:54:01.588105+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:02.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:02 smithi162 bash[9856]: cluster 2021-01-28T03:54:01.323731+0000 mgr.y (mgr.14138) 149 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:54:02.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:02 smithi162 bash[9856]: audit 2021-01-28T03:54:01.584027+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:54:02.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:02 smithi162 bash[9856]: audit 2021-01-28T03:54:01.588105+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:03.030 DEBUG:teuthology.orchestra.run.smithi100:osd.3> sudo journalctl -f -n 0 -u ceph-c217df96-611b-11eb-8f9e-001a4aab830c@osd.3.service 2021-01-28T03:54:03.041 INFO:tasks.cephadm:Deploying osd.4 on smithi162 with /dev/vg_nvme/lv_4... 2021-01-28T03:54:03.042 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2021-01-28T03:54:03.095 INFO:journalctl@ceph.osd.3.smithi100.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T03:54:04.006 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:03 smithi162 bash[9856]: audit 2021-01-28T03:54:02.722700+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:04.007 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:03 smithi162 bash[9856]: audit 2021-01-28T03:54:02.724880+0000 mon.a (mon.0) 365 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:54:04.007 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:03 smithi162 bash[9856]: cluster 2021-01-28T03:54:03.324247+0000 mgr.y (mgr.14138) 150 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:54:04.018 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:03 smithi100 bash[13549]: audit 2021-01-28T03:54:02.722700+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:04.019 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:03 smithi100 bash[13549]: audit 2021-01-28T03:54:02.724880+0000 mon.a (mon.0) 365 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:54:04.019 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:03 smithi100 bash[13549]: cluster 2021-01-28T03:54:03.324247+0000 mgr.y (mgr.14138) 150 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:54:04.022 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:03 smithi100 bash[9834]: audit 2021-01-28T03:54:02.722700+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:04.022 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:03 smithi100 bash[9834]: audit 2021-01-28T03:54:02.724880+0000 mon.a (mon.0) 365 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:54:04.023 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:03 smithi100 bash[9834]: cluster 2021-01-28T03:54:03.324247+0000 mgr.y (mgr.14138) 150 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:54:04.664 INFO:journalctl@ceph.osd.3.smithi100.stdout:Jan 28 03:54:04 smithi100 bash[23886]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-01-28T03:54:04.664 INFO:journalctl@ceph.osd.3.smithi100.stdout:Jan 28 03:54:04 smithi100 bash[23886]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2021-01-28T03:54:04.665 INFO:journalctl@ceph.osd.3.smithi100.stdout:Jan 28 03:54:04 smithi100 bash[23886]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3/block 2021-01-28T03:54:04.665 INFO:journalctl@ceph.osd.3.smithi100.stdout:Jan 28 03:54:04 smithi100 bash[23886]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2021-01-28T03:54:04.665 INFO:journalctl@ceph.osd.3.smithi100.stdout:Jan 28 03:54:04 smithi100 bash[23886]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2021-01-28T03:54:04.665 INFO:journalctl@ceph.osd.3.smithi100.stdout:Jan 28 03:54:04 smithi100 bash[23886]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-01-28T03:54:04.665 INFO:journalctl@ceph.osd.3.smithi100.stdout:Jan 28 03:54:04 smithi100 bash[23886]: --> ceph-volume lvm activate successful for osd ID: 3 2021-01-28T03:54:06.279 INFO:teuthology.orchestra.run.smithi162.stderr:--> Zapping: /dev/vg_nvme/lv_4 2021-01-28T03:54:06.279 INFO:teuthology.orchestra.run.smithi162.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2021-01-28T03:54:06.279 INFO:teuthology.orchestra.run.smithi162.stderr: stderr: 10+0 records in 2021-01-28T03:54:06.280 INFO:teuthology.orchestra.run.smithi162.stderr:10+0 records out 2021-01-28T03:54:06.280 INFO:teuthology.orchestra.run.smithi162.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0188647 s, 556 MB/s 2021-01-28T03:54:06.280 INFO:teuthology.orchestra.run.smithi162.stderr:--> Zapping successful for: 2021-01-28T03:54:06.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:06 smithi162 bash[9856]: cluster 2021-01-28T03:54:05.324773+0000 mgr.y (mgr.14138) 151 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:54:06.893 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:06 smithi100 bash[9834]: cluster 2021-01-28T03:54:05.324773+0000 mgr.y (mgr.14138) 151 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:54:06.894 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:06 smithi100 bash[13549]: cluster 2021-01-28T03:54:05.324773+0000 mgr.y (mgr.14138) 151 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:54:06.980 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph orch daemon add osd smithi162:vg_nvme/lv_4 2021-01-28T03:54:07.646 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:07 smithi100 bash[9834]: cluster 2021-01-28T03:54:07.325341+0000 mgr.y (mgr.14138) 152 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:54:07.647 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:07 smithi100 bash[13549]: cluster 2021-01-28T03:54:07.325341+0000 mgr.y (mgr.14138) 152 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:54:08.006 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:07 smithi162 bash[9856]: cluster 2021-01-28T03:54:07.325341+0000 mgr.y (mgr.14138) 152 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:54:08.318 INFO:journalctl@ceph.osd.3.smithi100.stdout:Jan 28 03:54:08 smithi100 bash[24240]: debug 2021-01-28T03:54:08.046+0000 7ff135c4a200 -1 Falling back to public interface 2021-01-28T03:54:09.893 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.895+0000 7f2876e39700 1 -- 172.21.15.162:0/46939637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f287005f7f0 msgr2=0x7f28700f8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:54:09.894 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.895+0000 7f2876e39700 1 --2- 172.21.15.162:0/46939637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f287005f7f0 0x7f28700f8480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f2868004e00 tx=0x7f2868009b30).stop 2021-01-28T03:54:09.894 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.895+0000 7f2876e39700 1 -- 172.21.15.162:0/46939637 shutdown_connections 2021-01-28T03:54:09.894 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.895+0000 7f2876e39700 1 --2- 172.21.15.162:0/46939637 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f287005f7f0 0x7f28700f8480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:54:09.894 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.895+0000 7f2876e39700 1 --2- 172.21.15.162:0/46939637 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f28700fb490 0x7f28700fd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:54:09.895 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.895+0000 7f2876e39700 1 --2- 172.21.15.162:0/46939637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28700f8a00 0x7f28700fae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:54:09.895 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.895+0000 7f2876e39700 1 -- 172.21.15.162:0/46939637 >> 172.21.15.162:0/46939637 conn(0x7f28700effa0 msgr2=0x7f28700f23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:54:09.895 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.895+0000 7f2876e39700 1 -- 172.21.15.162:0/46939637 shutdown_connections 2021-01-28T03:54:09.895 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.895+0000 7f2876e39700 1 -- 172.21.15.162:0/46939637 wait complete. 2021-01-28T03:54:09.897 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.899+0000 7f2876e39700 1 Processor -- start 2021-01-28T03:54:09.897 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.899+0000 7f2876e39700 1 -- start start 2021-01-28T03:54:09.897 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.899+0000 7f2876e39700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f287005f7f0 0x7f28701058a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:54:09.897 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.899+0000 7f2876e39700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28700f8a00 0x7f2870105d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:54:09.898 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.899+0000 7f2876e39700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28700fb490 0x7f2870106c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:54:09.898 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.899+0000 7f2876e39700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28701071b0 con 0x7f28700f8a00 2021-01-28T03:54:09.898 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.899+0000 7f2876e39700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2870107320 con 0x7f28700fb490 2021-01-28T03:54:09.898 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.899+0000 7f2876e39700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28701074e0 con 0x7f287005f7f0 2021-01-28T03:54:09.899 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.899+0000 7f2876638700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28700fb490 0x7f2870106c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:54:09.899 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.899+0000 7f2876638700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28700fb490 0x7f2870106c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:44758/0 (socket says 172.21.15.162:44758) 2021-01-28T03:54:09.899 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.899+0000 7f2876638700 1 -- 172.21.15.162:0/1538100191 learned_addr learned my addr 172.21.15.162:0/1538100191 (peer_addr_for_me v2:172.21.15.162:0/0) 2021-01-28T03:54:09.899 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.899+0000 7f2875e37700 1 --2- 172.21.15.162:0/1538100191 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f287005f7f0 0x7f28701058a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:54:09.899 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.899+0000 7f2875636700 1 --2- 172.21.15.162:0/1538100191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28700f8a00 0x7f2870105d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:54:09.900 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.899+0000 7f2876638700 1 -- 172.21.15.162:0/1538100191 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f287005f7f0 msgr2=0x7f28701058a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:54:09.900 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.899+0000 7f2876638700 1 --2- 172.21.15.162:0/1538100191 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f287005f7f0 0x7f28701058a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:54:09.900 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.899+0000 7f2876638700 1 -- 172.21.15.162:0/1538100191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28700f8a00 msgr2=0x7f2870105d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:54:09.900 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.899+0000 7f2876638700 1 --2- 172.21.15.162:0/1538100191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28700f8a00 0x7f2870105d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:54:09.900 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.899+0000 7f2876638700 1 -- 172.21.15.162:0/1538100191 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28701076a0 con 0x7f28700fb490 2021-01-28T03:54:09.901 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.899+0000 7f2876638700 1 --2- 172.21.15.162:0/1538100191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28700fb490 0x7f2870106c80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f286000de20 tx=0x7f2860004f00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:54:09.901 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.899+0000 7f286e7fc700 1 -- 172.21.15.162:0/1538100191 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2860007e00 con 0x7f28700fb490 2021-01-28T03:54:09.901 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.899+0000 7f286e7fc700 1 -- 172.21.15.162:0/1538100191 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f286000f040 con 0x7f28700fb490 2021-01-28T03:54:09.901 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.899+0000 7f2876e39700 1 -- 172.21.15.162:0/1538100191 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2870107950 con 0x7f28700fb490 2021-01-28T03:54:09.902 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.899+0000 7f286e7fc700 1 -- 172.21.15.162:0/1538100191 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2860013b00 con 0x7f28700fb490 2021-01-28T03:54:09.902 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.899+0000 7f2876e39700 1 -- 172.21.15.162:0/1538100191 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287010e090 con 0x7f28700fb490 2021-01-28T03:54:09.903 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.903+0000 7f2876e39700 1 -- 172.21.15.162:0/1538100191 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28700f3b90 con 0x7f28700fb490 2021-01-28T03:54:09.903 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.903+0000 7f286e7fc700 1 -- 172.21.15.162:0/1538100191 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 71316+0+0 (secure 0 0 0) 0x7f286001a030 con 0x7f28700fb490 2021-01-28T03:54:09.903 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.903+0000 7f286e7fc700 1 --2- 172.21.15.162:0/1538100191 >> v2:172.21.15.100:6800/928846103 conn(0x7f285805bc30 0x7f285805e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:54:09.904 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.903+0000 7f286e7fc700 1 -- 172.21.15.162:0/1538100191 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 2583+0+0 (secure 0 0 0) 0x7f2860074940 con 0x7f28700fb490 2021-01-28T03:54:09.904 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.903+0000 7f2875e37700 1 --2- 172.21.15.162:0/1538100191 >> v2:172.21.15.100:6800/928846103 conn(0x7f285805bc30 0x7f285805e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:54:09.904 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.903+0000 7f2875e37700 1 --2- 172.21.15.162:0/1538100191 >> v2:172.21.15.100:6800/928846103 conn(0x7f285805bc30 0x7f285805e0f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f2868009c20 tx=0x7f2868009b30).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:54:09.905 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:09.911+0000 7f286e7fc700 1 -- 172.21.15.162:0/1538100191 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f28600483c0 con 0x7f28700fb490 2021-01-28T03:54:10.097 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:10.099+0000 7f2876e39700 1 -- 172.21.15.162:0/1538100191 --> v2:172.21.15.100:6800/928846103 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f28701005f0 con 0x7f285805bc30 2021-01-28T03:54:10.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:10 smithi162 bash[9856]: cluster 2021-01-28T03:54:09.325920+0000 mgr.y (mgr.14138) 153 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:54:10.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:10 smithi162 bash[9856]: audit 2021-01-28T03:54:09.741925+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:54:10.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:10 smithi162 bash[9856]: audit 2021-01-28T03:54:10.109355+0000 mon.a (mon.0) 367 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:10.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:10 smithi162 bash[9856]: audit 2021-01-28T03:54:10.110050+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T03:54:10.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:10 smithi162 bash[9856]: audit 2021-01-28T03:54:10.112458+0000 mon.a (mon.0) 369 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T03:54:10.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:10 smithi162 bash[9856]: audit 2021-01-28T03:54:10.113349+0000 mon.a (mon.0) 370 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:54:10.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:10 smithi162 bash[9856]: audit 2021-01-28T03:54:10.115884+0000 mon.a (mon.0) 371 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:10.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:10 smithi162 bash[9856]: audit 2021-01-28T03:54:10.118874+0000 mon.a (mon.0) 372 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:54:10.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:10 smithi162 bash[9856]: audit 2021-01-28T03:54:10.124500+0000 mon.a (mon.0) 373 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:10.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:10 smithi100 bash[9834]: cluster 2021-01-28T03:54:09.325920+0000 mgr.y (mgr.14138) 153 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:54:10.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:10 smithi100 bash[9834]: audit 2021-01-28T03:54:09.741925+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:54:10.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:10 smithi100 bash[9834]: audit 2021-01-28T03:54:10.109355+0000 mon.a (mon.0) 367 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:10.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:10 smithi100 bash[9834]: audit 2021-01-28T03:54:10.110050+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T03:54:10.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:10 smithi100 bash[9834]: audit 2021-01-28T03:54:10.112458+0000 mon.a (mon.0) 369 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T03:54:10.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:10 smithi100 bash[9834]: audit 2021-01-28T03:54:10.113349+0000 mon.a (mon.0) 370 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:54:10.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:10 smithi100 bash[9834]: audit 2021-01-28T03:54:10.115884+0000 mon.a (mon.0) 371 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:10.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:10 smithi100 bash[9834]: audit 2021-01-28T03:54:10.118874+0000 mon.a (mon.0) 372 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:54:10.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:10 smithi100 bash[9834]: audit 2021-01-28T03:54:10.124500+0000 mon.a (mon.0) 373 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:10.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:10 smithi100 bash[13549]: cluster 2021-01-28T03:54:09.325920+0000 mgr.y (mgr.14138) 153 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:54:10.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:10 smithi100 bash[13549]: audit 2021-01-28T03:54:09.741925+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:54:10.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:10 smithi100 bash[13549]: audit 2021-01-28T03:54:10.109355+0000 mon.a (mon.0) 367 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:10.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:10 smithi100 bash[13549]: audit 2021-01-28T03:54:10.110050+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T03:54:10.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:10 smithi100 bash[13549]: audit 2021-01-28T03:54:10.112458+0000 mon.a (mon.0) 369 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T03:54:10.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:10 smithi100 bash[13549]: audit 2021-01-28T03:54:10.113349+0000 mon.a (mon.0) 370 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:54:10.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:10 smithi100 bash[13549]: audit 2021-01-28T03:54:10.115884+0000 mon.a (mon.0) 371 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:10.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:10 smithi100 bash[13549]: audit 2021-01-28T03:54:10.118874+0000 mon.a (mon.0) 372 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:54:10.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:10 smithi100 bash[13549]: audit 2021-01-28T03:54:10.124500+0000 mon.a (mon.0) 373 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:11.318 INFO:journalctl@ceph.osd.3.smithi100.stdout:Jan 28 03:54:11 smithi100 bash[24240]: debug 2021-01-28T03:54:11.074+0000 7ff135c4a200 -1 osd.3 0 log_to_monitors {default=true} 2021-01-28T03:54:11.669 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:11 smithi162 bash[9856]: audit 2021-01-28T03:54:10.106181+0000 mgr.y (mgr.14138) 154 : audit [DBG] from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:54:11.670 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:11 smithi162 bash[9856]: cephadm 2021-01-28T03:54:10.112174+0000 mgr.y (mgr.14138) 155 : cephadm [INF] Applying drive group None on host smithi162... 2021-01-28T03:54:11.670 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:11 smithi162 bash[9856]: cephadm 2021-01-28T03:54:10.116602+0000 mgr.y (mgr.14138) 156 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:54:11.670 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:11 smithi162 bash[9856]: cephadm 2021-01-28T03:54:10.126282+0000 mgr.y (mgr.14138) 157 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:54:11.670 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:11 smithi162 bash[9856]: audit 2021-01-28T03:54:11.081185+0000 mon.a (mon.0) 374 : audit [INF] from='osd.3 v2:172.21.15.100:6813/799206422' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-01-28T03:54:11.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:11 smithi100 bash[9834]: audit 2021-01-28T03:54:10.106181+0000 mgr.y (mgr.14138) 154 : audit [DBG] from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:54:11.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:11 smithi100 bash[9834]: cephadm 2021-01-28T03:54:10.112174+0000 mgr.y (mgr.14138) 155 : cephadm [INF] Applying drive group None on host smithi162... 2021-01-28T03:54:11.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:11 smithi100 bash[9834]: cephadm 2021-01-28T03:54:10.116602+0000 mgr.y (mgr.14138) 156 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:54:11.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:11 smithi100 bash[9834]: cephadm 2021-01-28T03:54:10.126282+0000 mgr.y (mgr.14138) 157 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:54:11.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:11 smithi100 bash[9834]: audit 2021-01-28T03:54:11.081185+0000 mon.a (mon.0) 374 : audit [INF] from='osd.3 v2:172.21.15.100:6813/799206422' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-01-28T03:54:11.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:11 smithi100 bash[13549]: audit 2021-01-28T03:54:10.106181+0000 mgr.y (mgr.14138) 154 : audit [DBG] from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:54:11.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:11 smithi100 bash[13549]: cephadm 2021-01-28T03:54:10.112174+0000 mgr.y (mgr.14138) 155 : cephadm [INF] Applying drive group None on host smithi162... 2021-01-28T03:54:11.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:11 smithi100 bash[13549]: cephadm 2021-01-28T03:54:10.116602+0000 mgr.y (mgr.14138) 156 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:54:11.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:11 smithi100 bash[13549]: cephadm 2021-01-28T03:54:10.126282+0000 mgr.y (mgr.14138) 157 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:54:11.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:11 smithi100 bash[13549]: audit 2021-01-28T03:54:11.081185+0000 mon.a (mon.0) 374 : audit [INF] from='osd.3 v2:172.21.15.100:6813/799206422' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-01-28T03:54:12.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:12 smithi162 bash[9856]: cluster 2021-01-28T03:54:11.326490+0000 mgr.y (mgr.14138) 158 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:54:12.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:12 smithi162 bash[9856]: audit 2021-01-28T03:54:11.399414+0000 mon.a (mon.0) 375 : audit [INF] from='osd.3 v2:172.21.15.100:6813/799206422' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-01-28T03:54:12.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:12 smithi162 bash[9856]: cluster 2021-01-28T03:54:11.399516+0000 mon.a (mon.0) 376 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2021-01-28T03:54:12.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:12 smithi162 bash[9856]: audit 2021-01-28T03:54:11.399670+0000 mon.a (mon.0) 377 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-28T03:54:12.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:12 smithi162 bash[9856]: audit 2021-01-28T03:54:11.400275+0000 mon.a (mon.0) 378 : audit [INF] from='osd.3 v2:172.21.15.100:6813/799206422' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2021-01-28T03:54:12.818 INFO:journalctl@ceph.osd.3.smithi100.stdout:Jan 28 03:54:12 smithi100 bash[24240]: debug 2021-01-28T03:54:12.406+0000 7ff12c1bb700 -1 osd.3 0 waiting for initial osdmap 2021-01-28T03:54:12.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:12 smithi100 bash[13549]: cluster 2021-01-28T03:54:11.326490+0000 mgr.y (mgr.14138) 158 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:54:12.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:12 smithi100 bash[13549]: audit 2021-01-28T03:54:11.399414+0000 mon.a (mon.0) 375 : audit [INF] from='osd.3 v2:172.21.15.100:6813/799206422' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-01-28T03:54:12.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:12 smithi100 bash[13549]: cluster 2021-01-28T03:54:11.399516+0000 mon.a (mon.0) 376 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2021-01-28T03:54:12.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:12 smithi100 bash[13549]: audit 2021-01-28T03:54:11.399670+0000 mon.a (mon.0) 377 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-28T03:54:12.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:12 smithi100 bash[13549]: audit 2021-01-28T03:54:11.400275+0000 mon.a (mon.0) 378 : audit [INF] from='osd.3 v2:172.21.15.100:6813/799206422' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2021-01-28T03:54:12.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:12 smithi100 bash[9834]: cluster 2021-01-28T03:54:11.326490+0000 mgr.y (mgr.14138) 158 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:54:12.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:12 smithi100 bash[9834]: audit 2021-01-28T03:54:11.399414+0000 mon.a (mon.0) 375 : audit [INF] from='osd.3 v2:172.21.15.100:6813/799206422' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-01-28T03:54:12.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:12 smithi100 bash[9834]: cluster 2021-01-28T03:54:11.399516+0000 mon.a (mon.0) 376 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2021-01-28T03:54:12.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:12 smithi100 bash[9834]: audit 2021-01-28T03:54:11.399670+0000 mon.a (mon.0) 377 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-28T03:54:12.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:12 smithi100 bash[9834]: audit 2021-01-28T03:54:11.400275+0000 mon.a (mon.0) 378 : audit [INF] from='osd.3 v2:172.21.15.100:6813/799206422' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2021-01-28T03:54:13.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:13 smithi162 bash[9856]: audit 2021-01-28T03:54:12.400128+0000 mon.a (mon.0) 379 : audit [INF] from='osd.3 v2:172.21.15.100:6813/799206422' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2021-01-28T03:54:13.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:13 smithi162 bash[9856]: cluster 2021-01-28T03:54:12.400426+0000 mon.a (mon.0) 380 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2021-01-28T03:54:13.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:13 smithi162 bash[9856]: audit 2021-01-28T03:54:12.401243+0000 mon.a (mon.0) 381 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-28T03:54:13.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:13 smithi162 bash[9856]: audit 2021-01-28T03:54:12.410254+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-28T03:54:13.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:13 smithi100 bash[9834]: audit 2021-01-28T03:54:12.400128+0000 mon.a (mon.0) 379 : audit [INF] from='osd.3 v2:172.21.15.100:6813/799206422' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2021-01-28T03:54:13.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:13 smithi100 bash[9834]: cluster 2021-01-28T03:54:12.400426+0000 mon.a (mon.0) 380 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2021-01-28T03:54:13.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:13 smithi100 bash[9834]: audit 2021-01-28T03:54:12.401243+0000 mon.a (mon.0) 381 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-28T03:54:13.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:13 smithi100 bash[9834]: audit 2021-01-28T03:54:12.410254+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-28T03:54:13.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:13 smithi100 bash[13549]: audit 2021-01-28T03:54:12.400128+0000 mon.a (mon.0) 379 : audit [INF] from='osd.3 v2:172.21.15.100:6813/799206422' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2021-01-28T03:54:13.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:13 smithi100 bash[13549]: cluster 2021-01-28T03:54:12.400426+0000 mon.a (mon.0) 380 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2021-01-28T03:54:13.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:13 smithi100 bash[13549]: audit 2021-01-28T03:54:12.401243+0000 mon.a (mon.0) 381 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-28T03:54:13.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:13 smithi100 bash[13549]: audit 2021-01-28T03:54:12.410254+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-28T03:54:14.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:14 smithi162 bash[9856]: cluster 2021-01-28T03:54:12.075663+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T03:54:14.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:14 smithi162 bash[9856]: cluster 2021-01-28T03:54:12.075875+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T03:54:14.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:14 smithi162 bash[9856]: cluster 2021-01-28T03:54:13.327065+0000 mgr.y (mgr.14138) 159 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:54:14.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:14 smithi162 bash[9856]: cluster 2021-01-28T03:54:13.411885+0000 mon.a (mon.0) 383 : cluster [INF] osd.3 v2:172.21.15.100:6813/799206422 boot 2021-01-28T03:54:14.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:14 smithi162 bash[9856]: cluster 2021-01-28T03:54:13.411964+0000 mon.a (mon.0) 384 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2021-01-28T03:54:14.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:14 smithi162 bash[9856]: audit 2021-01-28T03:54:13.412860+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-28T03:54:14.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:14 smithi162 bash[9856]: audit 2021-01-28T03:54:14.119609+0000 mon.b (mon.2) 5 : audit [INF] from='client.? 172.21.15.162:0/570618739' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fda3d97f-42ca-4449-a4c0-c3256b8c64a5"}]: dispatch 2021-01-28T03:54:14.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:14 smithi162 bash[9856]: audit 2021-01-28T03:54:14.123352+0000 mon.a (mon.0) 386 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fda3d97f-42ca-4449-a4c0-c3256b8c64a5"}]: dispatch 2021-01-28T03:54:14.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:14 smithi162 bash[9856]: audit 2021-01-28T03:54:14.132300+0000 mon.a (mon.0) 387 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fda3d97f-42ca-4449-a4c0-c3256b8c64a5"}]': finished 2021-01-28T03:54:14.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:14 smithi162 bash[9856]: cluster 2021-01-28T03:54:14.132477+0000 mon.a (mon.0) 388 : cluster [DBG] osdmap e27: 5 total, 4 up, 4 in 2021-01-28T03:54:14.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:14 smithi162 bash[9856]: audit 2021-01-28T03:54:14.132763+0000 mon.a (mon.0) 389 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T03:54:14.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:14 smithi100 bash[9834]: cluster 2021-01-28T03:54:12.075663+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T03:54:14.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:14 smithi100 bash[9834]: cluster 2021-01-28T03:54:12.075875+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T03:54:14.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:14 smithi100 bash[9834]: cluster 2021-01-28T03:54:13.327065+0000 mgr.y (mgr.14138) 159 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:54:14.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:14 smithi100 bash[9834]: cluster 2021-01-28T03:54:13.411885+0000 mon.a (mon.0) 383 : cluster [INF] osd.3 v2:172.21.15.100:6813/799206422 boot 2021-01-28T03:54:14.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:14 smithi100 bash[9834]: cluster 2021-01-28T03:54:13.411964+0000 mon.a (mon.0) 384 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2021-01-28T03:54:14.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:14 smithi100 bash[9834]: audit 2021-01-28T03:54:13.412860+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-28T03:54:14.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:14 smithi100 bash[9834]: audit 2021-01-28T03:54:14.119609+0000 mon.b (mon.2) 5 : audit [INF] from='client.? 172.21.15.162:0/570618739' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fda3d97f-42ca-4449-a4c0-c3256b8c64a5"}]: dispatch 2021-01-28T03:54:14.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:14 smithi100 bash[9834]: audit 2021-01-28T03:54:14.123352+0000 mon.a (mon.0) 386 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fda3d97f-42ca-4449-a4c0-c3256b8c64a5"}]: dispatch 2021-01-28T03:54:14.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:14 smithi100 bash[9834]: audit 2021-01-28T03:54:14.132300+0000 mon.a (mon.0) 387 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fda3d97f-42ca-4449-a4c0-c3256b8c64a5"}]': finished 2021-01-28T03:54:14.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:14 smithi100 bash[9834]: cluster 2021-01-28T03:54:14.132477+0000 mon.a (mon.0) 388 : cluster [DBG] osdmap e27: 5 total, 4 up, 4 in 2021-01-28T03:54:14.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:14 smithi100 bash[9834]: audit 2021-01-28T03:54:14.132763+0000 mon.a (mon.0) 389 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T03:54:14.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:14 smithi100 bash[13549]: cluster 2021-01-28T03:54:12.075663+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T03:54:14.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:14 smithi100 bash[13549]: cluster 2021-01-28T03:54:12.075875+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T03:54:14.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:14 smithi100 bash[13549]: cluster 2021-01-28T03:54:13.327065+0000 mgr.y (mgr.14138) 159 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T03:54:14.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:14 smithi100 bash[13549]: cluster 2021-01-28T03:54:13.411885+0000 mon.a (mon.0) 383 : cluster [INF] osd.3 v2:172.21.15.100:6813/799206422 boot 2021-01-28T03:54:14.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:14 smithi100 bash[13549]: cluster 2021-01-28T03:54:13.411964+0000 mon.a (mon.0) 384 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2021-01-28T03:54:14.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:14 smithi100 bash[13549]: audit 2021-01-28T03:54:13.412860+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-28T03:54:14.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:14 smithi100 bash[13549]: audit 2021-01-28T03:54:14.119609+0000 mon.b (mon.2) 5 : audit [INF] from='client.? 172.21.15.162:0/570618739' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fda3d97f-42ca-4449-a4c0-c3256b8c64a5"}]: dispatch 2021-01-28T03:54:14.823 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:14 smithi100 bash[13549]: audit 2021-01-28T03:54:14.123352+0000 mon.a (mon.0) 386 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fda3d97f-42ca-4449-a4c0-c3256b8c64a5"}]: dispatch 2021-01-28T03:54:14.823 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:14 smithi100 bash[13549]: audit 2021-01-28T03:54:14.132300+0000 mon.a (mon.0) 387 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fda3d97f-42ca-4449-a4c0-c3256b8c64a5"}]': finished 2021-01-28T03:54:14.823 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:14 smithi100 bash[13549]: cluster 2021-01-28T03:54:14.132477+0000 mon.a (mon.0) 388 : cluster [DBG] osdmap e27: 5 total, 4 up, 4 in 2021-01-28T03:54:14.824 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:14 smithi100 bash[13549]: audit 2021-01-28T03:54:14.132763+0000 mon.a (mon.0) 389 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T03:54:15.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:15 smithi162 bash[9856]: audit 2021-01-28T03:54:14.741893+0000 mon.b (mon.2) 6 : audit [DBG] from='client.? 172.21.15.162:0/1384162405' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T03:54:15.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:15 smithi162 bash[9856]: cluster 2021-01-28T03:54:15.134197+0000 mon.a (mon.0) 390 : cluster [DBG] osdmap e28: 5 total, 4 up, 4 in 2021-01-28T03:54:15.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:15 smithi162 bash[9856]: audit 2021-01-28T03:54:15.134436+0000 mon.a (mon.0) 391 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T03:54:15.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:15 smithi100 bash[9834]: audit 2021-01-28T03:54:14.741893+0000 mon.b (mon.2) 6 : audit [DBG] from='client.? 172.21.15.162:0/1384162405' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T03:54:15.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:15 smithi100 bash[9834]: cluster 2021-01-28T03:54:15.134197+0000 mon.a (mon.0) 390 : cluster [DBG] osdmap e28: 5 total, 4 up, 4 in 2021-01-28T03:54:15.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:15 smithi100 bash[9834]: audit 2021-01-28T03:54:15.134436+0000 mon.a (mon.0) 391 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T03:54:15.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:15 smithi100 bash[13549]: audit 2021-01-28T03:54:14.741893+0000 mon.b (mon.2) 6 : audit [DBG] from='client.? 172.21.15.162:0/1384162405' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T03:54:15.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:15 smithi100 bash[13549]: cluster 2021-01-28T03:54:15.134197+0000 mon.a (mon.0) 390 : cluster [DBG] osdmap e28: 5 total, 4 up, 4 in 2021-01-28T03:54:15.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:15 smithi100 bash[13549]: audit 2021-01-28T03:54:15.134436+0000 mon.a (mon.0) 391 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T03:54:16.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:16 smithi162 bash[9856]: cluster 2021-01-28T03:54:15.327655+0000 mgr.y (mgr.14138) 160 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T03:54:16.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:16 smithi100 bash[9834]: cluster 2021-01-28T03:54:15.327655+0000 mgr.y (mgr.14138) 160 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T03:54:16.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:16 smithi100 bash[13549]: cluster 2021-01-28T03:54:15.327655+0000 mgr.y (mgr.14138) 160 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T03:54:17.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:17 smithi162 bash[9856]: cluster 2021-01-28T03:54:17.328228+0000 mgr.y (mgr.14138) 161 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T03:54:17.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:17 smithi100 bash[13549]: cluster 2021-01-28T03:54:17.328228+0000 mgr.y (mgr.14138) 161 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T03:54:17.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:17 smithi100 bash[9834]: cluster 2021-01-28T03:54:17.328228+0000 mgr.y (mgr.14138) 161 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T03:54:18.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:18 smithi162 bash[9856]: audit 2021-01-28T03:54:18.024444+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:54:18.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:18 smithi100 bash[13549]: audit 2021-01-28T03:54:18.024444+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:54:18.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:18 smithi100 bash[9834]: audit 2021-01-28T03:54:18.024444+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:54:19.701 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:19 smithi162 bash[9856]: cluster 2021-01-28T03:54:19.328843+0000 mgr.y (mgr.14138) 162 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T03:54:19.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:19 smithi100 bash[13549]: cluster 2021-01-28T03:54:19.328843+0000 mgr.y (mgr.14138) 162 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T03:54:19.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:19 smithi100 bash[9834]: cluster 2021-01-28T03:54:19.328843+0000 mgr.y (mgr.14138) 162 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T03:54:22.676 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:22 smithi162 bash[9856]: cluster 2021-01-28T03:54:21.329399+0000 mgr.y (mgr.14138) 163 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T03:54:22.677 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:22 smithi162 bash[9856]: audit 2021-01-28T03:54:22.269886+0000 mon.a (mon.0) 393 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-01-28T03:54:22.677 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:22 smithi162 bash[9856]: audit 2021-01-28T03:54:22.271688+0000 mon.a (mon.0) 394 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:54:22.677 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:22 smithi162 bash[9856]: audit 2021-01-28T03:54:22.274099+0000 mon.a (mon.0) 395 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2021-01-28T03:54:22.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:22 smithi100 bash[13549]: cluster 2021-01-28T03:54:21.329399+0000 mgr.y (mgr.14138) 163 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T03:54:22.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:22 smithi100 bash[13549]: audit 2021-01-28T03:54:22.269886+0000 mon.a (mon.0) 393 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-01-28T03:54:22.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:22 smithi100 bash[13549]: audit 2021-01-28T03:54:22.271688+0000 mon.a (mon.0) 394 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:54:22.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:22 smithi100 bash[13549]: audit 2021-01-28T03:54:22.274099+0000 mon.a (mon.0) 395 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2021-01-28T03:54:22.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:22 smithi100 bash[9834]: cluster 2021-01-28T03:54:21.329399+0000 mgr.y (mgr.14138) 163 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T03:54:22.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:22 smithi100 bash[9834]: audit 2021-01-28T03:54:22.269886+0000 mon.a (mon.0) 393 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-01-28T03:54:22.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:22 smithi100 bash[9834]: audit 2021-01-28T03:54:22.271688+0000 mon.a (mon.0) 394 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:54:22.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:22 smithi100 bash[9834]: audit 2021-01-28T03:54:22.274099+0000 mon.a (mon.0) 395 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2021-01-28T03:54:23.725 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:23 smithi162 bash[9856]: cephadm 2021-01-28T03:54:22.273202+0000 mgr.y (mgr.14138) 164 : cephadm [INF] Deploying daemon osd.4 on smithi162 2021-01-28T03:54:23.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:23 smithi100 bash[13549]: cephadm 2021-01-28T03:54:22.273202+0000 mgr.y (mgr.14138) 164 : cephadm [INF] Deploying daemon osd.4 on smithi162 2021-01-28T03:54:23.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:23 smithi100 bash[9834]: cephadm 2021-01-28T03:54:22.273202+0000 mgr.y (mgr.14138) 164 : cephadm [INF] Deploying daemon osd.4 on smithi162 2021-01-28T03:54:24.719 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:24 smithi162 bash[9856]: cluster 2021-01-28T03:54:23.329959+0000 mgr.y (mgr.14138) 165 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T03:54:24.817 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:24 smithi100 bash[13549]: cluster 2021-01-28T03:54:23.329959+0000 mgr.y (mgr.14138) 165 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T03:54:24.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:24 smithi100 bash[9834]: cluster 2021-01-28T03:54:23.329959+0000 mgr.y (mgr.14138) 165 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T03:54:24.887 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:24.891+0000 7f286e7fc700 1 -- 172.21.15.162:0/1538100191 <== mgr.14138 v2:172.21.15.100:6800/928846103 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f28701005f0 con 0x7f285805bc30 2021-01-28T03:54:24.887 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 4 on host 'smithi162' 2021-01-28T03:54:24.889 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:24.891+0000 7f2876e39700 1 -- 172.21.15.162:0/1538100191 >> v2:172.21.15.100:6800/928846103 conn(0x7f285805bc30 msgr2=0x7f285805e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:54:24.889 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:24.891+0000 7f2876e39700 1 --2- 172.21.15.162:0/1538100191 >> v2:172.21.15.100:6800/928846103 conn(0x7f285805bc30 0x7f285805e0f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f2868009c20 tx=0x7f2868009b30).stop 2021-01-28T03:54:24.890 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:24.891+0000 7f2876e39700 1 -- 172.21.15.162:0/1538100191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28700fb490 msgr2=0x7f2870106c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:54:24.890 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:24.895+0000 7f2876e39700 1 --2- 172.21.15.162:0/1538100191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28700fb490 0x7f2870106c80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f286000de20 tx=0x7f2860004f00).stop 2021-01-28T03:54:24.890 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:24.895+0000 7f2876e39700 1 -- 172.21.15.162:0/1538100191 shutdown_connections 2021-01-28T03:54:24.890 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:24.895+0000 7f2876e39700 1 --2- 172.21.15.162:0/1538100191 >> v2:172.21.15.100:6800/928846103 conn(0x7f285805bc30 0x7f285805e0f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:54:24.890 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:24.895+0000 7f2876e39700 1 --2- 172.21.15.162:0/1538100191 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28700fb490 0x7f2870106c80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:54:24.891 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:24.895+0000 7f2876e39700 1 --2- 172.21.15.162:0/1538100191 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f287005f7f0 0x7f28701058a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:54:24.891 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:24.895+0000 7f2876e39700 1 --2- 172.21.15.162:0/1538100191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28700f8a00 0x7f2870105d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:54:24.891 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:24.895+0000 7f2876e39700 1 -- 172.21.15.162:0/1538100191 >> 172.21.15.162:0/1538100191 conn(0x7f28700effa0 msgr2=0x7f28700f9660 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:54:24.891 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:24.895+0000 7f2876e39700 1 -- 172.21.15.162:0/1538100191 shutdown_connections 2021-01-28T03:54:24.891 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:24.895+0000 7f2876e39700 1 -- 172.21.15.162:0/1538100191 wait complete. 2021-01-28T03:54:25.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:25 smithi162 bash[9856]: audit 2021-01-28T03:54:24.881888+0000 mon.a (mon.0) 396 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:54:25.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:25 smithi162 bash[9856]: audit 2021-01-28T03:54:24.887668+0000 mon.a (mon.0) 397 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:25.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:25 smithi100 bash[9834]: audit 2021-01-28T03:54:24.881888+0000 mon.a (mon.0) 396 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:54:25.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:25 smithi100 bash[9834]: audit 2021-01-28T03:54:24.887668+0000 mon.a (mon.0) 397 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:25.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:25 smithi100 bash[13549]: audit 2021-01-28T03:54:24.881888+0000 mon.a (mon.0) 396 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:54:25.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:25 smithi100 bash[13549]: audit 2021-01-28T03:54:24.887668+0000 mon.a (mon.0) 397 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:26.377 DEBUG:teuthology.orchestra.run.smithi162:osd.4> sudo journalctl -f -n 0 -u ceph-c217df96-611b-11eb-8f9e-001a4aab830c@osd.4.service 2021-01-28T03:54:26.387 INFO:tasks.cephadm:Deploying osd.5 on smithi162 with /dev/vg_nvme/lv_3... 2021-01-28T03:54:26.388 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2021-01-28T03:54:26.479 INFO:journalctl@ceph.osd.4.smithi162.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T03:54:26.506 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:26 smithi162 bash[9856]: cephadm 2021-01-28T03:54:24.880767+0000 mgr.y (mgr.14138) 166 : cephadm [INF] refreshing smithi100 facts 2021-01-28T03:54:26.506 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:26 smithi162 bash[9856]: cluster 2021-01-28T03:54:25.330482+0000 mgr.y (mgr.14138) 167 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T03:54:26.506 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:26 smithi162 bash[9856]: audit 2021-01-28T03:54:25.863109+0000 mon.a (mon.0) 398 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:26.507 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:26 smithi162 bash[9856]: audit 2021-01-28T03:54:25.865155+0000 mon.a (mon.0) 399 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:54:26.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:26 smithi100 bash[9834]: cephadm 2021-01-28T03:54:24.880767+0000 mgr.y (mgr.14138) 166 : cephadm [INF] refreshing smithi100 facts 2021-01-28T03:54:26.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:26 smithi100 bash[9834]: cluster 2021-01-28T03:54:25.330482+0000 mgr.y (mgr.14138) 167 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T03:54:26.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:26 smithi100 bash[9834]: audit 2021-01-28T03:54:25.863109+0000 mon.a (mon.0) 398 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:26.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:26 smithi100 bash[9834]: audit 2021-01-28T03:54:25.865155+0000 mon.a (mon.0) 399 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:54:26.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:26 smithi100 bash[13549]: cephadm 2021-01-28T03:54:24.880767+0000 mgr.y (mgr.14138) 166 : cephadm [INF] refreshing smithi100 facts 2021-01-28T03:54:26.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:26 smithi100 bash[13549]: cluster 2021-01-28T03:54:25.330482+0000 mgr.y (mgr.14138) 167 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T03:54:26.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:26 smithi100 bash[13549]: audit 2021-01-28T03:54:25.863109+0000 mon.a (mon.0) 398 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:26.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:26 smithi100 bash[13549]: audit 2021-01-28T03:54:25.865155+0000 mon.a (mon.0) 399 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:54:27.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:27 smithi100 bash[9834]: cluster 2021-01-28T03:54:27.331109+0000 mgr.y (mgr.14138) 168 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T03:54:27.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:27 smithi100 bash[13549]: cluster 2021-01-28T03:54:27.331109+0000 mgr.y (mgr.14138) 168 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T03:54:28.006 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:27 smithi162 bash[9856]: cluster 2021-01-28T03:54:27.331109+0000 mgr.y (mgr.14138) 168 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T03:54:28.007 INFO:journalctl@ceph.osd.4.smithi162.stdout:Jan 28 03:54:27 smithi162 bash[12381]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-01-28T03:54:28.007 INFO:journalctl@ceph.osd.4.smithi162.stdout:Jan 28 03:54:27 smithi162 bash[12381]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2021-01-28T03:54:28.007 INFO:journalctl@ceph.osd.4.smithi162.stdout:Jan 28 03:54:27 smithi162 bash[12381]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4/block 2021-01-28T03:54:28.008 INFO:journalctl@ceph.osd.4.smithi162.stdout:Jan 28 03:54:27 smithi162 bash[12381]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2021-01-28T03:54:28.008 INFO:journalctl@ceph.osd.4.smithi162.stdout:Jan 28 03:54:27 smithi162 bash[12381]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2021-01-28T03:54:28.008 INFO:journalctl@ceph.osd.4.smithi162.stdout:Jan 28 03:54:27 smithi162 bash[12381]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-01-28T03:54:28.008 INFO:journalctl@ceph.osd.4.smithi162.stdout:Jan 28 03:54:27 smithi162 bash[12381]: --> ceph-volume lvm activate successful for osd ID: 4 2021-01-28T03:54:30.703 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:30 smithi162 bash[9856]: cluster 2021-01-28T03:54:29.331738+0000 mgr.y (mgr.14138) 169 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T03:54:30.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:30 smithi100 bash[9834]: cluster 2021-01-28T03:54:29.331738+0000 mgr.y (mgr.14138) 169 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T03:54:30.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:30 smithi100 bash[13549]: cluster 2021-01-28T03:54:29.331738+0000 mgr.y (mgr.14138) 169 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T03:54:31.757 INFO:journalctl@ceph.osd.4.smithi162.stdout:Jan 28 03:54:31 smithi162 bash[12687]: debug 2021-01-28T03:54:31.487+0000 7f58a13f2700 20 -- 172.21.15.162:0/908643766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eab406b000 msgr2=0x55eab3fd7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2021-01-28T03:54:31.757 INFO:journalctl@ceph.osd.4.smithi162.stdout:Jan 28 03:54:31 smithi162 bash[12687]: debug 2021-01-28T03:54:31.487+0000 7f58a13f2700 20 -- 172.21.15.162:0/908643766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eab406b000 msgr2=0x55eab3fd7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=96 2021-01-28T03:54:31.758 INFO:journalctl@ceph.osd.4.smithi162.stdout:Jan 28 03:54:31 smithi162 bash[12687]: debug 2021-01-28T03:54:31.487+0000 7f58a13f2700 20 --2- 172.21.15.162:0/908643766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eab406b000 0x55eab3fd7e00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x55eab3fe7e60 tx=0x55eab401cd80).handle_read_frame_preamble_main r=0 2021-01-28T03:54:31.758 INFO:journalctl@ceph.osd.4.smithi162.stdout:Jan 28 03:54:31 smithi162 bash[12687]: debug 2021-01-28T03:54:31.487+0000 7f58a13f2700 20 --2- 172.21.15.162:0/908643766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eab406b000 0x55eab3fd7e00 secure :-1 s=THROTTLE_MESSAGE pgs=16 cs=0 l=1 rev1=1 rx=0x55eab3fe7e60 tx=0x55eab401cd80).throttle_message 2021-01-28T03:54:31.759 INFO:journalctl@ceph.osd.4.smithi162.stdout:Jan 28 03:54:31 smithi162 bash[12687]: debug 2021-01-28T03:54:31.487+0000 7f58a13f2700 20 --2- 172.21.15.162:0/908643766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eab406b000 0x55eab3fd7e00 secure :-1 s=THROTTLE_BYTES pgs=16 cs=0 l=1 rev1=1 rx=0x55eab3fe7e60 tx=0x55eab401cd80).throttle_bytes 2021-01-28T03:54:31.759 INFO:journalctl@ceph.osd.4.smithi162.stdout:Jan 28 03:54:31 smithi162 bash[12687]: debug 2021-01-28T03:54:31.487+0000 7f58a13f2700 20 --2- 172.21.15.162:0/908643766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eab406b000 0x55eab3fd7e00 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=16 cs=0 l=1 rev1=1 rx=0x55eab3fe7e60 tx=0x55eab401cd80).throttle_dispatch_queue 2021-01-28T03:54:31.759 INFO:journalctl@ceph.osd.4.smithi162.stdout:Jan 28 03:54:31 smithi162 bash[12687]: debug 2021-01-28T03:54:31.487+0000 7f58a13f2700 20 --2- 172.21.15.162:0/908643766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eab406b000 0x55eab3fd7e00 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rev1=1 rx=0x55eab3fe7e60 tx=0x55eab401cd80).read_frame_segment seg_idx=0 2021-01-28T03:54:31.760 INFO:journalctl@ceph.osd.4.smithi162.stdout:Jan 28 03:54:31 smithi162 bash[12687]: debug 2021-01-28T03:54:31.487+0000 7f58a13f2700 20 --2- 172.21.15.162:0/908643766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eab406b000 0x55eab3fd7e00 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rev1=1 rx=0x55eab3fe7e60 tx=0x55eab401cd80).read_frame_segment seg_idx=1 2021-01-28T03:54:31.760 INFO:journalctl@ceph.osd.4.smithi162.stdout:Jan 28 03:54:31 smithi162 bash[12687]: debug 2021-01-28T03:54:31.487+0000 7f58a13f2700 20 -- 172.21.15.162:0/908643766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eab406b000 msgr2=0x55eab3fd7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2021-01-28T03:54:31.760 INFO:journalctl@ceph.osd.4.smithi162.stdout:Jan 28 03:54:31 smithi162 bash[12687]: debug 2021-01-28T03:54:31.487+0000 7f58a13f2700 20 --2- 172.21.15.162:0/908643766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eab406b000 0x55eab3fd7e00 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rev1=1 rx=0x55eab3fe7e60 tx=0x55eab401cd80).handle_read_frame_segment r=0 2021-01-28T03:54:31.761 INFO:journalctl@ceph.osd.4.smithi162.stdout:Jan 28 03:54:31 smithi162 bash[12687]: debug 2021-01-28T03:54:31.487+0000 7f58a13f2700 20 -- 172.21.15.162:0/908643766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eab406b000 msgr2=0x55eab3fd7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2021-01-28T03:54:31.761 INFO:journalctl@ceph.osd.4.smithi162.stdout:Jan 28 03:54:31 smithi162 bash[12687]: debug 2021-01-28T03:54:31.487+0000 7f58a13f2700 20 --2- 172.21.15.162:0/908643766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eab406b000 0x55eab3fd7e00 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rev1=1 rx=0x55eab3fe7e60 tx=0x55eab401cd80).handle_read_frame_epilogue_main r=0 2021-01-28T03:54:31.761 INFO:journalctl@ceph.osd.4.smithi162.stdout:Jan 28 03:54:31 smithi162 bash[12687]: debug 2021-01-28T03:54:31.487+0000 7f58a13f2700 10 --2- 172.21.15.162:0/908643766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eab406b000 0x55eab3fd7e00 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rev1=1 rx=0x55eab3fe7e60 tx=0x55eab401cd80).handle_read_frame_dispatch tag=17 2021-01-28T03:54:31.761 INFO:journalctl@ceph.osd.4.smithi162.stdout:Jan 28 03:54:31 smithi162 bash[12687]: debug 2021-01-28T03:54:31.487+0000 7f58a13f2700 20 --2- 172.21.15.162:0/908643766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eab406b000 0x55eab3fd7e00 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rev1=1 rx=0x55eab3fe7e60 tx=0x55eab401cd80).handle_message 2021-01-28T03:54:31.761 INFO:journalctl@ceph.osd.4.smithi162.stdout:Jan 28 03:54:31 smithi162 bash[12687]: debug 2021-01-28T03:54:31.487+0000 7f58a13f2700 5 --2- 172.21.15.162:0/908643766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eab406b000 0x55eab3fd7e00 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rev1=1 rx=0x55eab3fe7e60 tx=0x55eab401cd80).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.2 off 0 2021-01-28T03:54:31.762 INFO:journalctl@ceph.osd.4.smithi162.stdout:Jan 28 03:54:31 smithi162 bash[12687]: debug 2021-01-28T03:54:31.487+0000 7f58a13f2700 5 --2- 172.21.15.162:0/908643766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eab406b000 0x55eab3fd7e00 secure :-1 s=READ_MESSAGE_COMPLETE pgs=16 cs=0 l=1 rev1=1 rx=0x55eab3fe7e60 tx=0x55eab401cd80).handle_message received message m=0x55eab3fec4e0 seq=4 from=mon.2 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-28T03:54:31.762 INFO:journalctl@ceph.osd.4.smithi162.stdout:Jan 28 03:54:31 smithi162 bash[12687]: debug 2021-01-28T03:54:31.487+0000 7f58a13f2700 20 -- 172.21.15.162:0/908643766 queue 0x55eab3fec4e0 prio 196 2021-01-28T03:54:31.762 INFO:journalctl@ceph.osd.4.smithi162.stdout:Jan 28 03:54:31 smithi162 bash[12687]: debug 2021-01-28T03:54:31.487+0000 7f58a13f2700 20 --2- 172.21.15.162:0/908643766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eab406b000 0x55eab3fd7e00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x55eab3fe7e60 tx=0x55eab401cd80).read_frame 2021-01-28T03:54:31.762 INFO:journalctl@ceph.osd.4.smithi162.stdout:Jan 28 03:54:31 smithi162 bash[12687]: debug 2021-01-28T03:54:31.487+0000 7f58a13f2700 20 -- 172.21.15.162:0/908643766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55eab406b000 msgr2=0x55eab3fd7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-28T03:54:31.763 INFO:journalctl@ceph.osd.4.smithi162.stdout:Jan 28 03:54:31 smithi162 bash[12687]: debug 2021-01-28T03:54:31.487+0000 7f58a0bf1700 1 -- 172.21.15.162:0/908643766 <== mon.2 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55eab3fec4e0 con 0x55eab406b000 2021-01-28T03:54:31.763 INFO:journalctl@ceph.osd.4.smithi162.stdout:Jan 28 03:54:31 smithi162 bash[12687]: debug 2021-01-28T03:54:31.487+0000 7f58a0bf1700 10 -- 172.21.15.162:0/908643766 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-28T03:54:31.764 INFO:journalctl@ceph.osd.4.smithi162.stdout:Jan 28 03:54:31 smithi162 bash[12687]: debug 2021-01-28T03:54:31.487+0000 7f58a0bf1700 20 -- 172.21.15.162:0/908643766 done calling dispatch on 0x55eab3fec4e0 2021-01-28T03:54:32.387 INFO:journalctl@ceph.osd.4.smithi162.stdout:Jan 28 03:54:32 smithi162 bash[12687]: debug 2021-01-28T03:54:32.019+0000 7f58a867c200 -1 Falling back to public interface 2021-01-28T03:54:32.657 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:32 smithi162 bash[9856]: cluster 2021-01-28T03:54:31.332292+0000 mgr.y (mgr.14138) 170 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T03:54:32.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:32 smithi100 bash[9834]: cluster 2021-01-28T03:54:31.332292+0000 mgr.y (mgr.14138) 170 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T03:54:32.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:32 smithi100 bash[13549]: cluster 2021-01-28T03:54:31.332292+0000 mgr.y (mgr.14138) 170 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T03:54:33.232 INFO:teuthology.orchestra.run.smithi162.stderr:--> Zapping: /dev/vg_nvme/lv_3 2021-01-28T03:54:33.233 INFO:teuthology.orchestra.run.smithi162.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2021-01-28T03:54:33.233 INFO:teuthology.orchestra.run.smithi162.stderr: stderr: 10+0 records in 2021-01-28T03:54:33.233 INFO:teuthology.orchestra.run.smithi162.stderr:10+0 records out 2021-01-28T03:54:33.233 INFO:teuthology.orchestra.run.smithi162.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0149138 s, 703 MB/s 2021-01-28T03:54:33.234 INFO:teuthology.orchestra.run.smithi162.stderr:--> Zapping successful for: 2021-01-28T03:54:33.973 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph orch daemon add osd smithi162:vg_nvme/lv_3 2021-01-28T03:54:34.505 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:34 smithi162 bash[9856]: cluster 2021-01-28T03:54:33.332868+0000 mgr.y (mgr.14138) 171 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T03:54:34.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:34 smithi100 bash[9834]: cluster 2021-01-28T03:54:33.332868+0000 mgr.y (mgr.14138) 171 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T03:54:34.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:34 smithi100 bash[13549]: cluster 2021-01-28T03:54:33.332868+0000 mgr.y (mgr.14138) 171 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T03:54:35.394 INFO:journalctl@ceph.osd.4.smithi162.stdout:Jan 28 03:54:35 smithi162 bash[12687]: debug 2021-01-28T03:54:35.015+0000 7f58a867c200 -1 osd.4 0 log_to_monitors {default=true} 2021-01-28T03:54:35.650 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:35 smithi162 bash[9856]: audit 2021-01-28T03:54:35.027470+0000 mon.c (mon.1) 15 : audit [INF] from='osd.4 v2:172.21.15.162:6800/4274488621' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-01-28T03:54:35.650 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:35 smithi162 bash[9856]: audit 2021-01-28T03:54:35.028270+0000 mon.a (mon.0) 400 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-01-28T03:54:35.651 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:35 smithi162 bash[9856]: audit 2021-01-28T03:54:35.086286+0000 mon.a (mon.0) 401 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:54:35.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:35 smithi100 bash[9834]: audit 2021-01-28T03:54:35.027470+0000 mon.c (mon.1) 15 : audit [INF] from='osd.4 v2:172.21.15.162:6800/4274488621' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-01-28T03:54:35.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:35 smithi100 bash[9834]: audit 2021-01-28T03:54:35.028270+0000 mon.a (mon.0) 400 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-01-28T03:54:35.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:35 smithi100 bash[9834]: audit 2021-01-28T03:54:35.086286+0000 mon.a (mon.0) 401 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:54:35.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:35 smithi100 bash[13549]: audit 2021-01-28T03:54:35.027470+0000 mon.c (mon.1) 15 : audit [INF] from='osd.4 v2:172.21.15.162:6800/4274488621' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-01-28T03:54:35.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:35 smithi100 bash[13549]: audit 2021-01-28T03:54:35.028270+0000 mon.a (mon.0) 400 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-01-28T03:54:35.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:35 smithi100 bash[13549]: audit 2021-01-28T03:54:35.086286+0000 mon.a (mon.0) 401 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:54:36.756 INFO:journalctl@ceph.osd.4.smithi162.stdout:Jan 28 03:54:36 smithi162 bash[12687]: debug 2021-01-28T03:54:36.423+0000 7f589ebed700 -1 osd.4 0 waiting for initial osdmap 2021-01-28T03:54:36.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:36 smithi162 bash[9856]: cluster 2021-01-28T03:54:35.333436+0000 mgr.y (mgr.14138) 172 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T03:54:36.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:36 smithi162 bash[9856]: audit 2021-01-28T03:54:35.414025+0000 mon.a (mon.0) 402 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-01-28T03:54:36.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:36 smithi162 bash[9856]: cluster 2021-01-28T03:54:35.414166+0000 mon.a (mon.0) 403 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2021-01-28T03:54:36.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:36 smithi162 bash[9856]: audit 2021-01-28T03:54:35.414437+0000 mon.a (mon.0) 404 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T03:54:36.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:36 smithi162 bash[9856]: audit 2021-01-28T03:54:35.415764+0000 mon.c (mon.1) 16 : audit [INF] from='osd.4 v2:172.21.15.162:6800/4274488621' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2021-01-28T03:54:36.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:36 smithi162 bash[9856]: audit 2021-01-28T03:54:35.416348+0000 mon.a (mon.0) 405 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2021-01-28T03:54:36.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:36 smithi162 bash[9856]: audit 2021-01-28T03:54:35.452062+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:36.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:36 smithi162 bash[9856]: audit 2021-01-28T03:54:35.458812+0000 mon.a (mon.0) 407 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:36.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:36 smithi162 bash[9856]: audit 2021-01-28T03:54:35.471812+0000 mon.a (mon.0) 408 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:36.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:36 smithi162 bash[9856]: audit 2021-01-28T03:54:35.475546+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T03:54:36.761 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:36 smithi162 bash[9856]: audit 2021-01-28T03:54:35.487214+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T03:54:36.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:36 smithi100 bash[9834]: cluster 2021-01-28T03:54:35.333436+0000 mgr.y (mgr.14138) 172 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T03:54:36.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:36 smithi100 bash[9834]: audit 2021-01-28T03:54:35.414025+0000 mon.a (mon.0) 402 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-01-28T03:54:36.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:36 smithi100 bash[9834]: cluster 2021-01-28T03:54:35.414166+0000 mon.a (mon.0) 403 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2021-01-28T03:54:36.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:36 smithi100 bash[9834]: audit 2021-01-28T03:54:35.414437+0000 mon.a (mon.0) 404 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T03:54:36.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:36 smithi100 bash[9834]: audit 2021-01-28T03:54:35.415764+0000 mon.c (mon.1) 16 : audit [INF] from='osd.4 v2:172.21.15.162:6800/4274488621' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2021-01-28T03:54:36.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:36 smithi100 bash[9834]: audit 2021-01-28T03:54:35.416348+0000 mon.a (mon.0) 405 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2021-01-28T03:54:36.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:36 smithi100 bash[9834]: audit 2021-01-28T03:54:35.452062+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:36.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:36 smithi100 bash[9834]: audit 2021-01-28T03:54:35.458812+0000 mon.a (mon.0) 407 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:36.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:36 smithi100 bash[9834]: audit 2021-01-28T03:54:35.471812+0000 mon.a (mon.0) 408 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:36.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:36 smithi100 bash[9834]: audit 2021-01-28T03:54:35.475546+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T03:54:36.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:36 smithi100 bash[9834]: audit 2021-01-28T03:54:35.487214+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T03:54:36.823 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:36 smithi100 bash[13549]: cluster 2021-01-28T03:54:35.333436+0000 mgr.y (mgr.14138) 172 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T03:54:36.823 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:36 smithi100 bash[13549]: audit 2021-01-28T03:54:35.414025+0000 mon.a (mon.0) 402 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-01-28T03:54:36.824 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:36 smithi100 bash[13549]: cluster 2021-01-28T03:54:35.414166+0000 mon.a (mon.0) 403 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2021-01-28T03:54:36.824 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:36 smithi100 bash[13549]: audit 2021-01-28T03:54:35.414437+0000 mon.a (mon.0) 404 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T03:54:36.824 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:36 smithi100 bash[13549]: audit 2021-01-28T03:54:35.415764+0000 mon.c (mon.1) 16 : audit [INF] from='osd.4 v2:172.21.15.162:6800/4274488621' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2021-01-28T03:54:36.825 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:36 smithi100 bash[13549]: audit 2021-01-28T03:54:35.416348+0000 mon.a (mon.0) 405 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2021-01-28T03:54:36.825 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:36 smithi100 bash[13549]: audit 2021-01-28T03:54:35.452062+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:36.826 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:36 smithi100 bash[13549]: audit 2021-01-28T03:54:35.458812+0000 mon.a (mon.0) 407 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:36.826 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:36 smithi100 bash[13549]: audit 2021-01-28T03:54:35.471812+0000 mon.a (mon.0) 408 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:36.826 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:36 smithi100 bash[13549]: audit 2021-01-28T03:54:35.475546+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T03:54:36.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:36 smithi100 bash[13549]: audit 2021-01-28T03:54:35.487214+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T03:54:37.482 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.483+0000 7fd0f17e9700 1 -- 172.21.15.162:0/501569225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0ec0f5d80 msgr2=0x7fd0ec0f61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:54:37.482 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.483+0000 7fd0f17e9700 1 --2- 172.21.15.162:0/501569225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0ec0f5d80 0x7fd0ec0f61a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fd0dc009dc0 tx=0x7fd0dc004d10).stop 2021-01-28T03:54:37.483 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.483+0000 7fd0f17e9700 1 -- 172.21.15.162:0/501569225 shutdown_connections 2021-01-28T03:54:37.483 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.483+0000 7fd0f17e9700 1 --2- 172.21.15.162:0/501569225 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0ec0f5d80 0x7fd0ec0f61a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:54:37.483 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.483+0000 7fd0f17e9700 1 --2- 172.21.15.162:0/501569225 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd0ec0f3f80 0x7fd0ec0f43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:54:37.483 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.483+0000 7fd0f17e9700 1 --2- 172.21.15.162:0/501569225 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0ec0f6720 0x7fd0ec0f39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:54:37.483 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.483+0000 7fd0f17e9700 1 -- 172.21.15.162:0/501569225 >> 172.21.15.162:0/501569225 conn(0x7fd0ec0ef730 msgr2=0x7fd0ec0f1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:54:37.484 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.483+0000 7fd0f17e9700 1 -- 172.21.15.162:0/501569225 shutdown_connections 2021-01-28T03:54:37.484 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.483+0000 7fd0f17e9700 1 -- 172.21.15.162:0/501569225 wait complete. 2021-01-28T03:54:37.484 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.483+0000 7fd0f17e9700 1 Processor -- start 2021-01-28T03:54:37.484 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.483+0000 7fd0f17e9700 1 -- start start 2021-01-28T03:54:37.484 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.483+0000 7fd0f17e9700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0ec0f3f80 0x7fd0ec107d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:54:37.485 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.483+0000 7fd0f17e9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0ec0f5d80 0x7fd0ec108240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:54:37.485 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.483+0000 7fd0f17e9700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd0ec0f6720 0x7fd0ec108ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:54:37.485 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.483+0000 7fd0f17e9700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec1095c0 con 0x7fd0ec0f5d80 2021-01-28T03:54:37.485 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.483+0000 7fd0f17e9700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec109730 con 0x7fd0ec0f3f80 2021-01-28T03:54:37.486 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.483+0000 7fd0f17e9700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ec1098f0 con 0x7fd0ec0f6720 2021-01-28T03:54:37.486 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.483+0000 7fd0ebfff700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0ec0f3f80 0x7fd0ec107d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:54:37.486 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.483+0000 7fd0ebfff700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0ec0f3f80 0x7fd0ec107d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:44834/0 (socket says 172.21.15.162:44834) 2021-01-28T03:54:37.486 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.483+0000 7fd0ebfff700 1 -- 172.21.15.162:0/2273734679 learned_addr learned my addr 172.21.15.162:0/2273734679 (peer_addr_for_me v2:172.21.15.162:0/0) 2021-01-28T03:54:37.486 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.483+0000 7fd0eb7fe700 1 --2- 172.21.15.162:0/2273734679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0ec0f5d80 0x7fd0ec108240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:54:37.487 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.483+0000 7fd0f0fe8700 1 --2- 172.21.15.162:0/2273734679 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd0ec0f6720 0x7fd0ec108ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:54:37.487 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.483+0000 7fd0ebfff700 1 -- 172.21.15.162:0/2273734679 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd0ec0f6720 msgr2=0x7fd0ec108ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:54:37.487 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.483+0000 7fd0ebfff700 1 --2- 172.21.15.162:0/2273734679 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd0ec0f6720 0x7fd0ec108ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:54:37.487 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.483+0000 7fd0ebfff700 1 -- 172.21.15.162:0/2273734679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0ec0f5d80 msgr2=0x7fd0ec108240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:54:37.487 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.483+0000 7fd0ebfff700 1 --2- 172.21.15.162:0/2273734679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0ec0f5d80 0x7fd0ec108240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:54:37.488 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.483+0000 7fd0ebfff700 1 -- 172.21.15.162:0/2273734679 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ec109ab0 con 0x7fd0ec0f3f80 2021-01-28T03:54:37.488 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.483+0000 7fd0f0fe8700 1 --2- 172.21.15.162:0/2273734679 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd0ec0f6720 0x7fd0ec108ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-28T03:54:37.488 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.483+0000 7fd0ebfff700 1 --2- 172.21.15.162:0/2273734679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0ec0f3f80 0x7fd0ec107d50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fd0dc004750 tx=0x7fd0dc004d10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:54:37.488 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.483+0000 7fd0e8ff9700 1 -- 172.21.15.162:0/2273734679 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc00e070 con 0x7fd0ec0f3f80 2021-01-28T03:54:37.488 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.483+0000 7fd0f17e9700 1 -- 172.21.15.162:0/2273734679 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0ec109d00 con 0x7fd0ec0f3f80 2021-01-28T03:54:37.489 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.483+0000 7fd0f17e9700 1 -- 172.21.15.162:0/2273734679 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0ec110400 con 0x7fd0ec0f3f80 2021-01-28T03:54:37.489 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.483+0000 7fd0e8ff9700 1 -- 172.21.15.162:0/2273734679 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fd0dc004520 con 0x7fd0ec0f3f80 2021-01-28T03:54:37.489 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.483+0000 7fd0e8ff9700 1 -- 172.21.15.162:0/2273734679 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0dc018070 con 0x7fd0ec0f3f80 2021-01-28T03:54:37.490 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.487+0000 7fd0f17e9700 1 -- 172.21.15.162:0/2273734679 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0d0004da0 con 0x7fd0ec0f3f80 2021-01-28T03:54:37.490 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.487+0000 7fd0e8ff9700 1 -- 172.21.15.162:0/2273734679 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 71316+0+0 (secure 0 0 0) 0x7fd0dc024060 con 0x7fd0ec0f3f80 2021-01-28T03:54:37.490 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.487+0000 7fd0e8ff9700 1 --2- 172.21.15.162:0/2273734679 >> v2:172.21.15.100:6800/928846103 conn(0x7fd0d805bc30 0x7fd0d805e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:54:37.491 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.487+0000 7fd0e8ff9700 1 -- 172.21.15.162:0/2273734679 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 3162+0+0 (secure 0 0 0) 0x7fd0dc0768c0 con 0x7fd0ec0f3f80 2021-01-28T03:54:37.491 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.487+0000 7fd0eb7fe700 1 --2- 172.21.15.162:0/2273734679 >> v2:172.21.15.100:6800/928846103 conn(0x7fd0d805bc30 0x7fd0d805e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:54:37.491 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.491+0000 7fd0eb7fe700 1 --2- 172.21.15.162:0/2273734679 >> v2:172.21.15.100:6800/928846103 conn(0x7fd0d805bc30 0x7fd0d805e0f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fd0d4009740 tx=0x7fd0d4009c60).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:54:37.492 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.495+0000 7fd0e8ff9700 1 -- 172.21.15.162:0/2273734679 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fd0dc04a080 con 0x7fd0ec0f3f80 2021-01-28T03:54:37.683 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:37.687+0000 7fd0f17e9700 1 -- 172.21.15.162:0/2273734679 --> v2:172.21.15.100:6800/928846103 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0d0000bc0 con 0x7fd0d805bc30 2021-01-28T03:54:37.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:37 smithi162 bash[9856]: cephadm 2021-01-28T03:54:35.460305+0000 mgr.y (mgr.14138) 173 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:54:37.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:37 smithi162 bash[9856]: cephadm 2021-01-28T03:54:35.473229+0000 mgr.y (mgr.14138) 174 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:54:37.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:37 smithi162 bash[9856]: audit 2021-01-28T03:54:36.419625+0000 mon.a (mon.0) 411 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2021-01-28T03:54:37.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:37 smithi162 bash[9856]: cluster 2021-01-28T03:54:36.419870+0000 mon.a (mon.0) 412 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2021-01-28T03:54:37.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:37 smithi162 bash[9856]: audit 2021-01-28T03:54:36.420960+0000 mon.a (mon.0) 413 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T03:54:37.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:37 smithi162 bash[9856]: audit 2021-01-28T03:54:36.427775+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T03:54:37.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:37 smithi162 bash[9856]: cluster 2021-01-28T03:54:37.421219+0000 mon.a (mon.0) 415 : cluster [INF] osd.4 v2:172.21.15.162:6800/4274488621 boot 2021-01-28T03:54:37.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:37 smithi100 bash[9834]: cephadm 2021-01-28T03:54:35.460305+0000 mgr.y (mgr.14138) 173 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:54:37.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:37 smithi100 bash[9834]: cephadm 2021-01-28T03:54:35.473229+0000 mgr.y (mgr.14138) 174 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:54:37.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:37 smithi100 bash[9834]: audit 2021-01-28T03:54:36.419625+0000 mon.a (mon.0) 411 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2021-01-28T03:54:37.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:37 smithi100 bash[9834]: cluster 2021-01-28T03:54:36.419870+0000 mon.a (mon.0) 412 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2021-01-28T03:54:37.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:37 smithi100 bash[9834]: audit 2021-01-28T03:54:36.420960+0000 mon.a (mon.0) 413 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T03:54:37.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:37 smithi100 bash[9834]: audit 2021-01-28T03:54:36.427775+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T03:54:37.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:37 smithi100 bash[9834]: cluster 2021-01-28T03:54:37.421219+0000 mon.a (mon.0) 415 : cluster [INF] osd.4 v2:172.21.15.162:6800/4274488621 boot 2021-01-28T03:54:37.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:37 smithi100 bash[13549]: cephadm 2021-01-28T03:54:35.460305+0000 mgr.y (mgr.14138) 173 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:54:37.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:37 smithi100 bash[13549]: cephadm 2021-01-28T03:54:35.473229+0000 mgr.y (mgr.14138) 174 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:54:37.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:37 smithi100 bash[13549]: audit 2021-01-28T03:54:36.419625+0000 mon.a (mon.0) 411 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2021-01-28T03:54:37.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:37 smithi100 bash[13549]: cluster 2021-01-28T03:54:36.419870+0000 mon.a (mon.0) 412 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2021-01-28T03:54:37.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:37 smithi100 bash[13549]: audit 2021-01-28T03:54:36.420960+0000 mon.a (mon.0) 413 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T03:54:37.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:37 smithi100 bash[13549]: audit 2021-01-28T03:54:36.427775+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T03:54:37.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:37 smithi100 bash[13549]: cluster 2021-01-28T03:54:37.421219+0000 mon.a (mon.0) 415 : cluster [INF] osd.4 v2:172.21.15.162:6800/4274488621 boot 2021-01-28T03:54:38.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:38 smithi162 bash[9856]: cluster 2021-01-28T03:54:36.048713+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T03:54:38.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:38 smithi162 bash[9856]: cluster 2021-01-28T03:54:36.048927+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T03:54:38.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:38 smithi162 bash[9856]: cluster 2021-01-28T03:54:37.333990+0000 mgr.y (mgr.14138) 175 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T03:54:38.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:38 smithi162 bash[9856]: cluster 2021-01-28T03:54:37.421356+0000 mon.a (mon.0) 416 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2021-01-28T03:54:38.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:38 smithi162 bash[9856]: audit 2021-01-28T03:54:37.422578+0000 mon.a (mon.0) 417 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T03:54:38.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:38 smithi162 bash[9856]: audit 2021-01-28T03:54:37.696299+0000 mon.a (mon.0) 418 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T03:54:38.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:38 smithi162 bash[9856]: audit 2021-01-28T03:54:37.699746+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T03:54:38.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:38 smithi162 bash[9856]: audit 2021-01-28T03:54:37.701457+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:54:38.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:38 smithi162 bash[9856]: audit 2021-01-28T03:54:37.703579+0000 mon.a (mon.0) 421 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:54:38.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:38 smithi162 bash[9856]: cluster 2021-01-28T03:54:38.424553+0000 mon.a (mon.0) 422 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2021-01-28T03:54:38.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:38 smithi100 bash[9834]: cluster 2021-01-28T03:54:36.048713+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T03:54:38.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:38 smithi100 bash[9834]: cluster 2021-01-28T03:54:36.048927+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T03:54:38.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:38 smithi100 bash[9834]: cluster 2021-01-28T03:54:37.333990+0000 mgr.y (mgr.14138) 175 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T03:54:38.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:38 smithi100 bash[9834]: cluster 2021-01-28T03:54:37.421356+0000 mon.a (mon.0) 416 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2021-01-28T03:54:38.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:38 smithi100 bash[9834]: audit 2021-01-28T03:54:37.422578+0000 mon.a (mon.0) 417 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T03:54:38.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:38 smithi100 bash[9834]: audit 2021-01-28T03:54:37.696299+0000 mon.a (mon.0) 418 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T03:54:38.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:38 smithi100 bash[9834]: audit 2021-01-28T03:54:37.699746+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T03:54:38.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:38 smithi100 bash[9834]: audit 2021-01-28T03:54:37.701457+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:54:38.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:38 smithi100 bash[9834]: audit 2021-01-28T03:54:37.703579+0000 mon.a (mon.0) 421 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:54:38.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:38 smithi100 bash[9834]: cluster 2021-01-28T03:54:38.424553+0000 mon.a (mon.0) 422 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2021-01-28T03:54:38.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:38 smithi100 bash[13549]: cluster 2021-01-28T03:54:36.048713+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T03:54:38.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:38 smithi100 bash[13549]: cluster 2021-01-28T03:54:36.048927+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T03:54:38.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:38 smithi100 bash[13549]: cluster 2021-01-28T03:54:37.333990+0000 mgr.y (mgr.14138) 175 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T03:54:38.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:38 smithi100 bash[13549]: cluster 2021-01-28T03:54:37.421356+0000 mon.a (mon.0) 416 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2021-01-28T03:54:38.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:38 smithi100 bash[13549]: audit 2021-01-28T03:54:37.422578+0000 mon.a (mon.0) 417 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T03:54:38.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:38 smithi100 bash[13549]: audit 2021-01-28T03:54:37.696299+0000 mon.a (mon.0) 418 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T03:54:38.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:38 smithi100 bash[13549]: audit 2021-01-28T03:54:37.699746+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T03:54:38.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:38 smithi100 bash[13549]: audit 2021-01-28T03:54:37.701457+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:54:38.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:38 smithi100 bash[13549]: audit 2021-01-28T03:54:37.703579+0000 mon.a (mon.0) 421 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:54:38.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:38 smithi100 bash[13549]: cluster 2021-01-28T03:54:38.424553+0000 mon.a (mon.0) 422 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2021-01-28T03:54:39.755 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:39 smithi162 bash[9856]: audit 2021-01-28T03:54:37.694192+0000 mgr.y (mgr.14138) 176 : audit [DBG] from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:54:39.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:39 smithi162 bash[9856]: cephadm 2021-01-28T03:54:37.699164+0000 mgr.y (mgr.14138) 177 : cephadm [INF] Applying drive group None on host smithi162... 2021-01-28T03:54:39.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:39 smithi100 bash[9834]: audit 2021-01-28T03:54:37.694192+0000 mgr.y (mgr.14138) 176 : audit [DBG] from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:54:39.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:39 smithi100 bash[9834]: cephadm 2021-01-28T03:54:37.699164+0000 mgr.y (mgr.14138) 177 : cephadm [INF] Applying drive group None on host smithi162... 2021-01-28T03:54:39.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:39 smithi100 bash[13549]: audit 2021-01-28T03:54:37.694192+0000 mgr.y (mgr.14138) 176 : audit [DBG] from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:54:39.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:39 smithi100 bash[13549]: cephadm 2021-01-28T03:54:37.699164+0000 mgr.y (mgr.14138) 177 : cephadm [INF] Applying drive group None on host smithi162... 2021-01-28T03:54:40.755 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:40 smithi162 bash[9856]: cluster 2021-01-28T03:54:39.334556+0000 mgr.y (mgr.14138) 178 : cluster [DBG] pgmap v144: 1 pgs: 1 peering; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:54:40.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:40 smithi100 bash[9834]: cluster 2021-01-28T03:54:39.334556+0000 mgr.y (mgr.14138) 178 : cluster [DBG] pgmap v144: 1 pgs: 1 peering; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:54:40.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:40 smithi100 bash[13549]: cluster 2021-01-28T03:54:39.334556+0000 mgr.y (mgr.14138) 178 : cluster [DBG] pgmap v144: 1 pgs: 1 peering; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:54:42.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:42 smithi162 bash[9856]: cluster 2021-01-28T03:54:41.335112+0000 mgr.y (mgr.14138) 179 : cluster [DBG] pgmap v145: 1 pgs: 1 peering; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:54:42.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:42 smithi162 bash[9856]: audit 2021-01-28T03:54:41.773585+0000 mon.b (mon.2) 7 : audit [INF] from='client.? 172.21.15.162:0/2098036895' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69c742c7-276f-4c30-a60f-18362a187b5a"}]: dispatch 2021-01-28T03:54:42.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:42 smithi162 bash[9856]: audit 2021-01-28T03:54:41.777251+0000 mon.a (mon.0) 423 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69c742c7-276f-4c30-a60f-18362a187b5a"}]: dispatch 2021-01-28T03:54:42.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:42 smithi162 bash[9856]: audit 2021-01-28T03:54:41.788219+0000 mon.a (mon.0) 424 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "69c742c7-276f-4c30-a60f-18362a187b5a"}]': finished 2021-01-28T03:54:42.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:42 smithi162 bash[9856]: cluster 2021-01-28T03:54:41.788414+0000 mon.a (mon.0) 425 : cluster [DBG] osdmap e33: 6 total, 5 up, 5 in 2021-01-28T03:54:42.757 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:42 smithi162 bash[9856]: audit 2021-01-28T03:54:41.788630+0000 mon.a (mon.0) 426 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-28T03:54:42.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:42 smithi100 bash[9834]: cluster 2021-01-28T03:54:41.335112+0000 mgr.y (mgr.14138) 179 : cluster [DBG] pgmap v145: 1 pgs: 1 peering; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:54:42.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:42 smithi100 bash[9834]: audit 2021-01-28T03:54:41.773585+0000 mon.b (mon.2) 7 : audit [INF] from='client.? 172.21.15.162:0/2098036895' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69c742c7-276f-4c30-a60f-18362a187b5a"}]: dispatch 2021-01-28T03:54:42.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:42 smithi100 bash[9834]: audit 2021-01-28T03:54:41.777251+0000 mon.a (mon.0) 423 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69c742c7-276f-4c30-a60f-18362a187b5a"}]: dispatch 2021-01-28T03:54:42.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:42 smithi100 bash[9834]: audit 2021-01-28T03:54:41.788219+0000 mon.a (mon.0) 424 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "69c742c7-276f-4c30-a60f-18362a187b5a"}]': finished 2021-01-28T03:54:42.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:42 smithi100 bash[9834]: cluster 2021-01-28T03:54:41.788414+0000 mon.a (mon.0) 425 : cluster [DBG] osdmap e33: 6 total, 5 up, 5 in 2021-01-28T03:54:42.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:42 smithi100 bash[9834]: audit 2021-01-28T03:54:41.788630+0000 mon.a (mon.0) 426 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-28T03:54:42.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:42 smithi100 bash[13549]: cluster 2021-01-28T03:54:41.335112+0000 mgr.y (mgr.14138) 179 : cluster [DBG] pgmap v145: 1 pgs: 1 peering; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:54:42.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:42 smithi100 bash[13549]: audit 2021-01-28T03:54:41.773585+0000 mon.b (mon.2) 7 : audit [INF] from='client.? 172.21.15.162:0/2098036895' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69c742c7-276f-4c30-a60f-18362a187b5a"}]: dispatch 2021-01-28T03:54:42.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:42 smithi100 bash[13549]: audit 2021-01-28T03:54:41.777251+0000 mon.a (mon.0) 423 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69c742c7-276f-4c30-a60f-18362a187b5a"}]: dispatch 2021-01-28T03:54:42.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:42 smithi100 bash[13549]: audit 2021-01-28T03:54:41.788219+0000 mon.a (mon.0) 424 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "69c742c7-276f-4c30-a60f-18362a187b5a"}]': finished 2021-01-28T03:54:42.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:42 smithi100 bash[13549]: cluster 2021-01-28T03:54:41.788414+0000 mon.a (mon.0) 425 : cluster [DBG] osdmap e33: 6 total, 5 up, 5 in 2021-01-28T03:54:42.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:42 smithi100 bash[13549]: audit 2021-01-28T03:54:41.788630+0000 mon.a (mon.0) 426 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-28T03:54:43.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:43 smithi162 bash[9856]: audit 2021-01-28T03:54:42.458384+0000 mon.b (mon.2) 8 : audit [DBG] from='client.? 172.21.15.162:0/1037707060' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T03:54:43.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:43 smithi162 bash[9856]: cluster 2021-01-28T03:54:43.335713+0000 mgr.y (mgr.14138) 180 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:54:43.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:43 smithi100 bash[9834]: audit 2021-01-28T03:54:42.458384+0000 mon.b (mon.2) 8 : audit [DBG] from='client.? 172.21.15.162:0/1037707060' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T03:54:43.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:43 smithi100 bash[9834]: cluster 2021-01-28T03:54:43.335713+0000 mgr.y (mgr.14138) 180 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:54:43.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:43 smithi100 bash[13549]: audit 2021-01-28T03:54:42.458384+0000 mon.b (mon.2) 8 : audit [DBG] from='client.? 172.21.15.162:0/1037707060' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T03:54:43.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:43 smithi100 bash[13549]: cluster 2021-01-28T03:54:43.335713+0000 mgr.y (mgr.14138) 180 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:54:46.755 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:46 smithi162 bash[9856]: cluster 2021-01-28T03:54:45.336277+0000 mgr.y (mgr.14138) 181 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:54:46.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:46 smithi162 bash[9856]: audit 2021-01-28T03:54:45.623194+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:54:46.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:46 smithi100 bash[9834]: cluster 2021-01-28T03:54:45.336277+0000 mgr.y (mgr.14138) 181 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:54:46.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:46 smithi100 bash[9834]: audit 2021-01-28T03:54:45.623194+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:54:46.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:46 smithi100 bash[13549]: cluster 2021-01-28T03:54:45.336277+0000 mgr.y (mgr.14138) 181 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:54:46.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:46 smithi100 bash[13549]: audit 2021-01-28T03:54:45.623194+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:54:47.808 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:47 smithi162 bash[9856]: cluster 2021-01-28T03:54:47.336834+0000 mgr.y (mgr.14138) 182 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:54:47.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:47 smithi100 bash[9834]: cluster 2021-01-28T03:54:47.336834+0000 mgr.y (mgr.14138) 182 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:54:47.817 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:47 smithi100 bash[13549]: cluster 2021-01-28T03:54:47.336834+0000 mgr.y (mgr.14138) 182 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:54:50.755 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:50 smithi162 bash[9856]: cluster 2021-01-28T03:54:49.337439+0000 mgr.y (mgr.14138) 183 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:54:50.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:50 smithi162 bash[9856]: audit 2021-01-28T03:54:49.880378+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-01-28T03:54:50.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:50 smithi162 bash[9856]: audit 2021-01-28T03:54:49.882152+0000 mon.a (mon.0) 429 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:54:50.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:50 smithi162 bash[9856]: audit 2021-01-28T03:54:49.884519+0000 mon.a (mon.0) 430 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2021-01-28T03:54:50.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:50 smithi100 bash[9834]: cluster 2021-01-28T03:54:49.337439+0000 mgr.y (mgr.14138) 183 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:54:50.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:50 smithi100 bash[9834]: audit 2021-01-28T03:54:49.880378+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-01-28T03:54:50.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:50 smithi100 bash[9834]: audit 2021-01-28T03:54:49.882152+0000 mon.a (mon.0) 429 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:54:50.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:50 smithi100 bash[9834]: audit 2021-01-28T03:54:49.884519+0000 mon.a (mon.0) 430 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2021-01-28T03:54:50.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:50 smithi100 bash[13549]: cluster 2021-01-28T03:54:49.337439+0000 mgr.y (mgr.14138) 183 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:54:50.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:50 smithi100 bash[13549]: audit 2021-01-28T03:54:49.880378+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-01-28T03:54:50.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:50 smithi100 bash[13549]: audit 2021-01-28T03:54:49.882152+0000 mon.a (mon.0) 429 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:54:50.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:50 smithi100 bash[13549]: audit 2021-01-28T03:54:49.884519+0000 mon.a (mon.0) 430 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2021-01-28T03:54:51.460 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:51 smithi162 bash[9856]: cephadm 2021-01-28T03:54:49.883671+0000 mgr.y (mgr.14138) 184 : cephadm [INF] Deploying daemon osd.5 on smithi162 2021-01-28T03:54:51.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:51 smithi100 bash[9834]: cephadm 2021-01-28T03:54:49.883671+0000 mgr.y (mgr.14138) 184 : cephadm [INF] Deploying daemon osd.5 on smithi162 2021-01-28T03:54:51.817 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:51 smithi100 bash[13549]: cephadm 2021-01-28T03:54:49.883671+0000 mgr.y (mgr.14138) 184 : cephadm [INF] Deploying daemon osd.5 on smithi162 2021-01-28T03:54:52.422 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:52.427+0000 7fd0e8ff9700 1 -- 172.21.15.162:0/2273734679 <== mgr.14138 v2:172.21.15.100:6800/928846103 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd0d0000bc0 con 0x7fd0d805bc30 2021-01-28T03:54:52.422 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 5 on host 'smithi162' 2021-01-28T03:54:52.425 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:52.431+0000 7fd0f17e9700 1 -- 172.21.15.162:0/2273734679 >> v2:172.21.15.100:6800/928846103 conn(0x7fd0d805bc30 msgr2=0x7fd0d805e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:54:52.425 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:52.431+0000 7fd0f17e9700 1 --2- 172.21.15.162:0/2273734679 >> v2:172.21.15.100:6800/928846103 conn(0x7fd0d805bc30 0x7fd0d805e0f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fd0d4009740 tx=0x7fd0d4009c60).stop 2021-01-28T03:54:52.425 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:52.431+0000 7fd0f17e9700 1 -- 172.21.15.162:0/2273734679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0ec0f3f80 msgr2=0x7fd0ec107d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:54:52.425 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:52.431+0000 7fd0f17e9700 1 --2- 172.21.15.162:0/2273734679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0ec0f3f80 0x7fd0ec107d50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fd0dc004750 tx=0x7fd0dc004d10).stop 2021-01-28T03:54:52.426 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:52.431+0000 7fd0f17e9700 1 -- 172.21.15.162:0/2273734679 shutdown_connections 2021-01-28T03:54:52.426 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:52.431+0000 7fd0f17e9700 1 --2- 172.21.15.162:0/2273734679 >> v2:172.21.15.100:6800/928846103 conn(0x7fd0d805bc30 0x7fd0d805e0f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:54:52.426 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:52.431+0000 7fd0f17e9700 1 --2- 172.21.15.162:0/2273734679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd0ec0f3f80 0x7fd0ec107d50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:54:52.426 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:52.431+0000 7fd0f17e9700 1 --2- 172.21.15.162:0/2273734679 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fd0ec0f6720 0x7fd0ec108ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:54:52.426 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:52.431+0000 7fd0f17e9700 1 --2- 172.21.15.162:0/2273734679 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd0ec0f5d80 0x7fd0ec108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:54:52.427 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:52.431+0000 7fd0f17e9700 1 -- 172.21.15.162:0/2273734679 >> 172.21.15.162:0/2273734679 conn(0x7fd0ec0ef730 msgr2=0x7fd0ec0f1910 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:54:52.427 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:52.431+0000 7fd0f17e9700 1 -- 172.21.15.162:0/2273734679 shutdown_connections 2021-01-28T03:54:52.427 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:54:52.431+0000 7fd0f17e9700 1 -- 172.21.15.162:0/2273734679 wait complete. 2021-01-28T03:54:52.478 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:52 smithi162 bash[9856]: cluster 2021-01-28T03:54:51.338001+0000 mgr.y (mgr.14138) 185 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:54:52.817 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:52 smithi100 bash[13549]: cluster 2021-01-28T03:54:51.338001+0000 mgr.y (mgr.14138) 185 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:54:52.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:52 smithi100 bash[9834]: cluster 2021-01-28T03:54:51.338001+0000 mgr.y (mgr.14138) 185 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:54:53.743 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:53 smithi162 bash[9856]: audit 2021-01-28T03:54:52.422443+0000 mon.a (mon.0) 431 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:54:53.743 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:53 smithi162 bash[9856]: audit 2021-01-28T03:54:52.429667+0000 mon.a (mon.0) 432 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:53.746 DEBUG:teuthology.orchestra.run.smithi162:osd.5> sudo journalctl -f -n 0 -u ceph-c217df96-611b-11eb-8f9e-001a4aab830c@osd.5.service 2021-01-28T03:54:53.755 INFO:tasks.cephadm:Deploying osd.6 on smithi162 with /dev/vg_nvme/lv_2... 2021-01-28T03:54:53.756 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2021-01-28T03:54:53.817 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:53 smithi100 bash[13549]: audit 2021-01-28T03:54:52.422443+0000 mon.a (mon.0) 431 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:54:53.817 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:53 smithi100 bash[13549]: audit 2021-01-28T03:54:52.429667+0000 mon.a (mon.0) 432 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:53.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:53 smithi100 bash[9834]: audit 2021-01-28T03:54:52.422443+0000 mon.a (mon.0) 431 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:54:53.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:53 smithi100 bash[9834]: audit 2021-01-28T03:54:52.429667+0000 mon.a (mon.0) 432 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:53.818 INFO:journalctl@ceph.osd.5.smithi162.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T03:54:54.755 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:54 smithi162 bash[9856]: cluster 2021-01-28T03:54:53.338673+0000 mgr.y (mgr.14138) 186 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:54:54.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:54 smithi162 bash[9856]: audit 2021-01-28T03:54:53.462725+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:54.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:54 smithi162 bash[9856]: audit 2021-01-28T03:54:53.464643+0000 mon.a (mon.0) 434 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:54:54.817 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:54 smithi100 bash[13549]: cluster 2021-01-28T03:54:53.338673+0000 mgr.y (mgr.14138) 186 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:54:54.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:54 smithi100 bash[13549]: audit 2021-01-28T03:54:53.462725+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:54.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:54 smithi100 bash[13549]: audit 2021-01-28T03:54:53.464643+0000 mon.a (mon.0) 434 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:54:54.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:54 smithi100 bash[9834]: cluster 2021-01-28T03:54:53.338673+0000 mgr.y (mgr.14138) 186 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:54:54.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:54 smithi100 bash[9834]: audit 2021-01-28T03:54:53.462725+0000 mon.a (mon.0) 433 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:54.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:54 smithi100 bash[9834]: audit 2021-01-28T03:54:53.464643+0000 mon.a (mon.0) 434 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:54:55.857 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jan 28 03:54:55 smithi162 bash[14820]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-01-28T03:54:55.858 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jan 28 03:54:55 smithi162 bash[14820]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2021-01-28T03:54:55.858 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jan 28 03:54:55 smithi162 bash[14820]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5/block 2021-01-28T03:54:55.858 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jan 28 03:54:55 smithi162 bash[14820]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2021-01-28T03:54:55.858 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jan 28 03:54:55 smithi162 bash[14820]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-01-28T03:54:55.859 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jan 28 03:54:55 smithi162 bash[14820]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-01-28T03:54:55.859 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jan 28 03:54:55 smithi162 bash[14820]: --> ceph-volume lvm activate successful for osd ID: 5 2021-01-28T03:54:56.605 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:56 smithi162 bash[9856]: cluster 2021-01-28T03:54:55.339253+0000 mgr.y (mgr.14138) 187 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:54:56.606 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:56 smithi162 bash[9856]: audit 2021-01-28T03:54:55.469308+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:56.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:56 smithi100 bash[9834]: cluster 2021-01-28T03:54:55.339253+0000 mgr.y (mgr.14138) 187 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:54:56.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:56 smithi100 bash[9834]: audit 2021-01-28T03:54:55.469308+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:56.817 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:56 smithi100 bash[13549]: cluster 2021-01-28T03:54:55.339253+0000 mgr.y (mgr.14138) 187 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:54:56.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:56 smithi100 bash[13549]: audit 2021-01-28T03:54:55.469308+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:54:57.673 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:54:57 smithi162 bash[9856]: cluster 2021-01-28T03:54:57.339814+0000 mgr.y (mgr.14138) 188 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:54:57.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:54:57 smithi100 bash[9834]: cluster 2021-01-28T03:54:57.339814+0000 mgr.y (mgr.14138) 188 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:54:57.826 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:54:57 smithi100 bash[13549]: cluster 2021-01-28T03:54:57.339814+0000 mgr.y (mgr.14138) 188 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:54:59.755 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jan 28 03:54:59 smithi162 bash[15177]: debug 2021-01-28T03:54:59.611+0000 7f0f66c84700 10 -- 172.21.15.162:0/1575426697 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-28T03:54:59.755 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jan 28 03:54:59 smithi162 bash[15177]: debug 2021-01-28T03:54:59.611+0000 7f0f66c84700 20 -- 172.21.15.162:0/1575426697 done calling dispatch on 0x5643522f84e0 2021-01-28T03:55:00.505 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:00 smithi162 bash[9856]: cluster 2021-01-28T03:54:59.340377+0000 mgr.y (mgr.14138) 189 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:55:00.505 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jan 28 03:55:00 smithi162 bash[15177]: debug 2021-01-28T03:55:00.187+0000 7f0f6e70f200 -1 Falling back to public interface 2021-01-28T03:55:00.671 INFO:teuthology.orchestra.run.smithi162.stderr:--> Zapping: /dev/vg_nvme/lv_2 2021-01-28T03:55:00.671 INFO:teuthology.orchestra.run.smithi162.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2021-01-28T03:55:00.671 INFO:teuthology.orchestra.run.smithi162.stderr: stderr: 10+0 records in 2021-01-28T03:55:00.671 INFO:teuthology.orchestra.run.smithi162.stderr:10+0 records out 2021-01-28T03:55:00.672 INFO:teuthology.orchestra.run.smithi162.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0214917 s, 488 MB/s 2021-01-28T03:55:00.672 INFO:teuthology.orchestra.run.smithi162.stderr:--> Zapping successful for: 2021-01-28T03:55:00.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:00 smithi100 bash[9834]: cluster 2021-01-28T03:54:59.340377+0000 mgr.y (mgr.14138) 189 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:55:00.817 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:00 smithi100 bash[13549]: cluster 2021-01-28T03:54:59.340377+0000 mgr.y (mgr.14138) 189 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:55:01.363 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph orch daemon add osd smithi162:vg_nvme/lv_2 2021-01-28T03:55:02.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:02 smithi162 bash[9856]: cluster 2021-01-28T03:55:01.340928+0000 mgr.y (mgr.14138) 190 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:55:02.683 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:02 smithi162 bash[9856]: audit 2021-01-28T03:55:02.118128+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:55:02.817 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:02 smithi100 bash[13549]: cluster 2021-01-28T03:55:01.340928+0000 mgr.y (mgr.14138) 190 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:55:02.817 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:02 smithi100 bash[13549]: audit 2021-01-28T03:55:02.118128+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:55:02.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:02 smithi100 bash[9834]: cluster 2021-01-28T03:55:01.340928+0000 mgr.y (mgr.14138) 190 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:55:02.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:02 smithi100 bash[9834]: audit 2021-01-28T03:55:02.118128+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:55:03.506 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jan 28 03:55:03 smithi162 bash[15177]: debug 2021-01-28T03:55:03.259+0000 7f0f6e70f200 -1 osd.5 0 log_to_monitors {default=true} 2021-01-28T03:55:03.507 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:03 smithi162 bash[9856]: audit 2021-01-28T03:55:02.491595+0000 mon.a (mon.0) 437 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:03.507 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:03 smithi162 bash[9856]: cephadm 2021-01-28T03:55:02.492697+0000 mgr.y (mgr.14138) 191 : cephadm [INF] refreshing smithi162 facts 2021-01-28T03:55:03.507 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:03 smithi162 bash[9856]: audit 2021-01-28T03:55:02.927588+0000 mon.a (mon.0) 438 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:03.508 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:03 smithi162 bash[9856]: cephadm 2021-01-28T03:55:02.929054+0000 mgr.y (mgr.14138) 192 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:55:03.508 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:03 smithi162 bash[9856]: audit 2021-01-28T03:55:02.938718+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:03.508 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:03 smithi162 bash[9856]: cephadm 2021-01-28T03:55:02.940365+0000 mgr.y (mgr.14138) 193 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:55:03.508 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:03 smithi162 bash[9856]: audit 2021-01-28T03:55:03.268378+0000 mon.b (mon.2) 9 : audit [INF] from='osd.5 v2:172.21.15.162:6804/1953061558' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-01-28T03:55:03.508 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:03 smithi162 bash[9856]: audit 2021-01-28T03:55:03.271926+0000 mon.a (mon.0) 440 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-01-28T03:55:03.509 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:03 smithi162 bash[9856]: cluster 2021-01-28T03:55:03.341525+0000 mgr.y (mgr.14138) 194 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:55:03.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:03 smithi100 bash[9834]: audit 2021-01-28T03:55:02.491595+0000 mon.a (mon.0) 437 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:03.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:03 smithi100 bash[9834]: cephadm 2021-01-28T03:55:02.492697+0000 mgr.y (mgr.14138) 191 : cephadm [INF] refreshing smithi162 facts 2021-01-28T03:55:03.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:03 smithi100 bash[9834]: audit 2021-01-28T03:55:02.927588+0000 mon.a (mon.0) 438 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:03.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:03 smithi100 bash[9834]: cephadm 2021-01-28T03:55:02.929054+0000 mgr.y (mgr.14138) 192 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:55:03.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:03 smithi100 bash[9834]: audit 2021-01-28T03:55:02.938718+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:03.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:03 smithi100 bash[9834]: cephadm 2021-01-28T03:55:02.940365+0000 mgr.y (mgr.14138) 193 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:55:03.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:03 smithi100 bash[9834]: audit 2021-01-28T03:55:03.268378+0000 mon.b (mon.2) 9 : audit [INF] from='osd.5 v2:172.21.15.162:6804/1953061558' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-01-28T03:55:03.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:03 smithi100 bash[9834]: audit 2021-01-28T03:55:03.271926+0000 mon.a (mon.0) 440 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-01-28T03:55:03.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:03 smithi100 bash[9834]: cluster 2021-01-28T03:55:03.341525+0000 mgr.y (mgr.14138) 194 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:55:03.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:03 smithi100 bash[13549]: audit 2021-01-28T03:55:02.491595+0000 mon.a (mon.0) 437 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:03.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:03 smithi100 bash[13549]: cephadm 2021-01-28T03:55:02.492697+0000 mgr.y (mgr.14138) 191 : cephadm [INF] refreshing smithi162 facts 2021-01-28T03:55:03.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:03 smithi100 bash[13549]: audit 2021-01-28T03:55:02.927588+0000 mon.a (mon.0) 438 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:03.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:03 smithi100 bash[13549]: cephadm 2021-01-28T03:55:02.929054+0000 mgr.y (mgr.14138) 192 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:55:03.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:03 smithi100 bash[13549]: audit 2021-01-28T03:55:02.938718+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:03.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:03 smithi100 bash[13549]: cephadm 2021-01-28T03:55:02.940365+0000 mgr.y (mgr.14138) 193 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:55:03.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:03 smithi100 bash[13549]: audit 2021-01-28T03:55:03.268378+0000 mon.b (mon.2) 9 : audit [INF] from='osd.5 v2:172.21.15.162:6804/1953061558' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-01-28T03:55:03.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:03 smithi100 bash[13549]: audit 2021-01-28T03:55:03.271926+0000 mon.a (mon.0) 440 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-01-28T03:55:03.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:03 smithi100 bash[13549]: cluster 2021-01-28T03:55:03.341525+0000 mgr.y (mgr.14138) 194 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:55:04.565 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.571+0000 7ffa1cf85700 1 -- 172.21.15.162:0/1604149514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa180694a0 msgr2=0x7ffa18069920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:55:04.565 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.571+0000 7ffa1cf85700 1 --2- 172.21.15.162:0/1604149514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa180694a0 0x7ffa18069920 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7ffa00004e00 tx=0x7ffa00009b30).stop 2021-01-28T03:55:04.565 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.571+0000 7ffa1cf85700 1 -- 172.21.15.162:0/1604149514 shutdown_connections 2021-01-28T03:55:04.566 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.571+0000 7ffa1cf85700 1 --2- 172.21.15.162:0/1604149514 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffa180f93c0 0x7ffa18103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:55:04.566 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.571+0000 7ffa1cf85700 1 --2- 172.21.15.162:0/1604149514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa1806aab0 0x7ffa18068fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:55:04.566 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.571+0000 7ffa1cf85700 1 --2- 172.21.15.162:0/1604149514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa180694a0 0x7ffa18069920 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:55:04.566 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.571+0000 7ffa1cf85700 1 -- 172.21.15.162:0/1604149514 >> 172.21.15.162:0/1604149514 conn(0x7ffa180f10a0 msgr2=0x7ffa180f34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:55:04.566 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.571+0000 7ffa1cf85700 1 -- 172.21.15.162:0/1604149514 shutdown_connections 2021-01-28T03:55:04.567 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.571+0000 7ffa1cf85700 1 -- 172.21.15.162:0/1604149514 wait complete. 2021-01-28T03:55:04.568 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.571+0000 7ffa1cf85700 1 Processor -- start 2021-01-28T03:55:04.568 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.571+0000 7ffa1cf85700 1 -- start start 2021-01-28T03:55:04.568 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.571+0000 7ffa1cf85700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa1806aab0 0x7ffa1810c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:55:04.569 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.571+0000 7ffa1cf85700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa1810c510 0x7ffa1810d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:55:04.569 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.571+0000 7ffa1cf85700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffa1810d8f0 0x7ffa1810dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:55:04.569 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.571+0000 7ffa1cf85700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1810ca30 con 0x7ffa1810c510 2021-01-28T03:55:04.569 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.571+0000 7ffa1cf85700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1810cba0 con 0x7ffa1806aab0 2021-01-28T03:55:04.569 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.571+0000 7ffa1cf85700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa18114680 con 0x7ffa1810d8f0 2021-01-28T03:55:04.570 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.571+0000 7ffa177fe700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa1806aab0 0x7ffa1810c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:55:04.570 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.571+0000 7ffa177fe700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa1806aab0 0x7ffa1810c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:44898/0 (socket says 172.21.15.162:44898) 2021-01-28T03:55:04.570 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.571+0000 7ffa177fe700 1 -- 172.21.15.162:0/3810921279 learned_addr learned my addr 172.21.15.162:0/3810921279 (peer_addr_for_me v2:172.21.15.162:0/0) 2021-01-28T03:55:04.570 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.571+0000 7ffa16ffd700 1 --2- 172.21.15.162:0/3810921279 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa1810c510 0x7ffa1810d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:55:04.571 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.571+0000 7ffa17fff700 1 --2- 172.21.15.162:0/3810921279 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffa1810d8f0 0x7ffa1810dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:55:04.571 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.571+0000 7ffa177fe700 1 -- 172.21.15.162:0/3810921279 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffa1810d8f0 msgr2=0x7ffa1810dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:55:04.571 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.571+0000 7ffa177fe700 1 --2- 172.21.15.162:0/3810921279 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffa1810d8f0 0x7ffa1810dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:55:04.571 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.571+0000 7ffa177fe700 1 -- 172.21.15.162:0/3810921279 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa1810c510 msgr2=0x7ffa1810d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:55:04.571 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.571+0000 7ffa177fe700 1 --2- 172.21.15.162:0/3810921279 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa1810c510 0x7ffa1810d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:55:04.572 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.571+0000 7ffa177fe700 1 -- 172.21.15.162:0/3810921279 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa18114840 con 0x7ffa1806aab0 2021-01-28T03:55:04.572 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.571+0000 7ffa177fe700 1 --2- 172.21.15.162:0/3810921279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa1806aab0 0x7ffa1810c020 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7ffa10002a50 tx=0x7ffa10009e00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:55:04.572 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.571+0000 7ffa0ffff700 1 -- 172.21.15.162:0/3810921279 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa10009320 con 0x7ffa1806aab0 2021-01-28T03:55:04.572 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.571+0000 7ffa0ffff700 1 -- 172.21.15.162:0/3810921279 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7ffa1000f040 con 0x7ffa1806aab0 2021-01-28T03:55:04.572 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.571+0000 7ffa1cf85700 1 -- 172.21.15.162:0/3810921279 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa18114af0 con 0x7ffa1806aab0 2021-01-28T03:55:04.573 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.571+0000 7ffa0ffff700 1 -- 172.21.15.162:0/3810921279 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1000d830 con 0x7ffa1806aab0 2021-01-28T03:55:04.573 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.571+0000 7ffa1cf85700 1 -- 172.21.15.162:0/3810921279 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa18114fe0 con 0x7ffa1806aab0 2021-01-28T03:55:04.574 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.575+0000 7ffa0ffff700 1 -- 172.21.15.162:0/3810921279 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 71316+0+0 (secure 0 0 0) 0x7ffa1000dc20 con 0x7ffa1806aab0 2021-01-28T03:55:04.574 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.575+0000 7ffa1cf85700 1 -- 172.21.15.162:0/3810921279 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa180f4c90 con 0x7ffa1806aab0 2021-01-28T03:55:04.574 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.575+0000 7ffa0ffff700 1 --2- 172.21.15.162:0/3810921279 >> v2:172.21.15.100:6800/928846103 conn(0x7ffa0405bc30 0x7ffa0405e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:55:04.574 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.575+0000 7ffa0ffff700 1 -- 172.21.15.162:0/3810921279 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 3298+0+0 (secure 0 0 0) 0x7ffa100751a0 con 0x7ffa1806aab0 2021-01-28T03:55:04.575 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.575+0000 7ffa16ffd700 1 --2- 172.21.15.162:0/3810921279 >> v2:172.21.15.100:6800/928846103 conn(0x7ffa0405bc30 0x7ffa0405e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:55:04.575 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.575+0000 7ffa16ffd700 1 --2- 172.21.15.162:0/3810921279 >> v2:172.21.15.100:6800/928846103 conn(0x7ffa0405bc30 0x7ffa0405e0f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7ffa00004dd0 tx=0x7ffa00009b30).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:55:04.578 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.583+0000 7ffa0ffff700 1 -- 172.21.15.162:0/3810921279 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7ffa100488d0 con 0x7ffa1806aab0 2021-01-28T03:55:04.770 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:04.775+0000 7ffa1cf85700 1 -- 172.21.15.162:0/3810921279 --> v2:172.21.15.100:6800/928846103 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa180f93c0 con 0x7ffa0405bc30 2021-01-28T03:55:05.255 INFO:journalctl@ceph.osd.5.smithi162.stdout:Jan 28 03:55:04 smithi162 bash[15177]: debug 2021-01-28T03:55:04.955+0000 7f0f64c80700 -1 osd.5 0 waiting for initial osdmap 2021-01-28T03:55:05.255 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:04 smithi162 bash[9856]: audit 2021-01-28T03:55:03.948850+0000 mon.b (mon.2) 10 : audit [INF] from='osd.5 v2:172.21.15.162:6804/1953061558' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2021-01-28T03:55:05.256 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:04 smithi162 bash[9856]: audit 2021-01-28T03:55:03.949625+0000 mon.a (mon.0) 441 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-01-28T03:55:05.256 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:04 smithi162 bash[9856]: cluster 2021-01-28T03:55:03.949765+0000 mon.a (mon.0) 442 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2021-01-28T03:55:05.256 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:04 smithi162 bash[9856]: audit 2021-01-28T03:55:03.950062+0000 mon.a (mon.0) 443 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-28T03:55:05.256 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:04 smithi162 bash[9856]: audit 2021-01-28T03:55:03.952467+0000 mon.a (mon.0) 444 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2021-01-28T03:55:05.257 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:04 smithi162 bash[9856]: audit 2021-01-28T03:55:04.783771+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T03:55:05.257 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:04 smithi162 bash[9856]: audit 2021-01-28T03:55:04.787070+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T03:55:05.257 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:04 smithi162 bash[9856]: audit 2021-01-28T03:55:04.788854+0000 mon.a (mon.0) 447 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:55:05.257 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:04 smithi162 bash[9856]: audit 2021-01-28T03:55:04.790931+0000 mon.a (mon.0) 448 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:55:05.317 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:04 smithi100 bash[9834]: audit 2021-01-28T03:55:03.948850+0000 mon.b (mon.2) 10 : audit [INF] from='osd.5 v2:172.21.15.162:6804/1953061558' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2021-01-28T03:55:05.317 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:04 smithi100 bash[9834]: audit 2021-01-28T03:55:03.949625+0000 mon.a (mon.0) 441 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-01-28T03:55:05.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:04 smithi100 bash[9834]: cluster 2021-01-28T03:55:03.949765+0000 mon.a (mon.0) 442 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2021-01-28T03:55:05.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:04 smithi100 bash[9834]: audit 2021-01-28T03:55:03.950062+0000 mon.a (mon.0) 443 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-28T03:55:05.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:04 smithi100 bash[9834]: audit 2021-01-28T03:55:03.952467+0000 mon.a (mon.0) 444 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2021-01-28T03:55:05.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:04 smithi100 bash[9834]: audit 2021-01-28T03:55:04.783771+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T03:55:05.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:04 smithi100 bash[9834]: audit 2021-01-28T03:55:04.787070+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T03:55:05.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:04 smithi100 bash[9834]: audit 2021-01-28T03:55:04.788854+0000 mon.a (mon.0) 447 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:55:05.319 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:04 smithi100 bash[9834]: audit 2021-01-28T03:55:04.790931+0000 mon.a (mon.0) 448 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:55:05.320 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:04 smithi100 bash[13549]: audit 2021-01-28T03:55:03.948850+0000 mon.b (mon.2) 10 : audit [INF] from='osd.5 v2:172.21.15.162:6804/1953061558' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2021-01-28T03:55:05.320 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:04 smithi100 bash[13549]: audit 2021-01-28T03:55:03.949625+0000 mon.a (mon.0) 441 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-01-28T03:55:05.320 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:04 smithi100 bash[13549]: cluster 2021-01-28T03:55:03.949765+0000 mon.a (mon.0) 442 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2021-01-28T03:55:05.320 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:04 smithi100 bash[13549]: audit 2021-01-28T03:55:03.950062+0000 mon.a (mon.0) 443 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-28T03:55:05.320 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:04 smithi100 bash[13549]: audit 2021-01-28T03:55:03.952467+0000 mon.a (mon.0) 444 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2021-01-28T03:55:05.321 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:04 smithi100 bash[13549]: audit 2021-01-28T03:55:04.783771+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T03:55:05.321 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:04 smithi100 bash[13549]: audit 2021-01-28T03:55:04.787070+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T03:55:05.321 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:04 smithi100 bash[13549]: audit 2021-01-28T03:55:04.788854+0000 mon.a (mon.0) 447 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:55:05.321 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:04 smithi100 bash[13549]: audit 2021-01-28T03:55:04.790931+0000 mon.a (mon.0) 448 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:55:06.247 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:05 smithi162 bash[9856]: audit 2021-01-28T03:55:04.781645+0000 mgr.y (mgr.14138) 195 : audit [DBG] from='client.34271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:55:06.248 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:05 smithi162 bash[9856]: cephadm 2021-01-28T03:55:04.786520+0000 mgr.y (mgr.14138) 196 : cephadm [INF] Applying drive group None on host smithi162... 2021-01-28T03:55:06.248 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:05 smithi162 bash[9856]: audit 2021-01-28T03:55:04.951986+0000 mon.a (mon.0) 449 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2021-01-28T03:55:06.248 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:05 smithi162 bash[9856]: cluster 2021-01-28T03:55:04.952316+0000 mon.a (mon.0) 450 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2021-01-28T03:55:06.248 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:05 smithi162 bash[9856]: audit 2021-01-28T03:55:04.953170+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-28T03:55:06.249 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:05 smithi162 bash[9856]: audit 2021-01-28T03:55:04.960821+0000 mon.a (mon.0) 452 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-28T03:55:06.249 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:05 smithi162 bash[9856]: cluster 2021-01-28T03:55:05.342072+0000 mgr.y (mgr.14138) 197 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:55:06.317 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:05 smithi100 bash[9834]: audit 2021-01-28T03:55:04.781645+0000 mgr.y (mgr.14138) 195 : audit [DBG] from='client.34271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:55:06.317 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:05 smithi100 bash[9834]: cephadm 2021-01-28T03:55:04.786520+0000 mgr.y (mgr.14138) 196 : cephadm [INF] Applying drive group None on host smithi162... 2021-01-28T03:55:06.317 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:05 smithi100 bash[9834]: audit 2021-01-28T03:55:04.951986+0000 mon.a (mon.0) 449 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2021-01-28T03:55:06.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:05 smithi100 bash[9834]: cluster 2021-01-28T03:55:04.952316+0000 mon.a (mon.0) 450 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2021-01-28T03:55:06.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:05 smithi100 bash[9834]: audit 2021-01-28T03:55:04.953170+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-28T03:55:06.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:05 smithi100 bash[9834]: audit 2021-01-28T03:55:04.960821+0000 mon.a (mon.0) 452 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-28T03:55:06.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:05 smithi100 bash[9834]: cluster 2021-01-28T03:55:05.342072+0000 mgr.y (mgr.14138) 197 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:55:06.319 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:05 smithi100 bash[13549]: audit 2021-01-28T03:55:04.781645+0000 mgr.y (mgr.14138) 195 : audit [DBG] from='client.34271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:55:06.319 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:05 smithi100 bash[13549]: cephadm 2021-01-28T03:55:04.786520+0000 mgr.y (mgr.14138) 196 : cephadm [INF] Applying drive group None on host smithi162... 2021-01-28T03:55:06.319 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:05 smithi100 bash[13549]: audit 2021-01-28T03:55:04.951986+0000 mon.a (mon.0) 449 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2021-01-28T03:55:06.319 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:05 smithi100 bash[13549]: cluster 2021-01-28T03:55:04.952316+0000 mon.a (mon.0) 450 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2021-01-28T03:55:06.319 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:05 smithi100 bash[13549]: audit 2021-01-28T03:55:04.953170+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-28T03:55:06.320 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:05 smithi100 bash[13549]: audit 2021-01-28T03:55:04.960821+0000 mon.a (mon.0) 452 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-28T03:55:06.320 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:05 smithi100 bash[13549]: cluster 2021-01-28T03:55:05.342072+0000 mgr.y (mgr.14138) 197 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T03:55:07.255 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:06 smithi162 bash[9856]: cluster 2021-01-28T03:55:04.310771+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T03:55:07.255 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:06 smithi162 bash[9856]: cluster 2021-01-28T03:55:04.310968+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T03:55:07.256 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:06 smithi162 bash[9856]: audit 2021-01-28T03:55:05.963844+0000 mon.a (mon.0) 453 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-28T03:55:07.256 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:06 smithi162 bash[9856]: cluster 2021-01-28T03:55:05.975774+0000 mon.a (mon.0) 454 : cluster [INF] osd.5 v2:172.21.15.162:6804/1953061558 boot 2021-01-28T03:55:07.256 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:06 smithi162 bash[9856]: cluster 2021-01-28T03:55:05.975877+0000 mon.a (mon.0) 455 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2021-01-28T03:55:07.256 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:06 smithi162 bash[9856]: audit 2021-01-28T03:55:05.976112+0000 mon.a (mon.0) 456 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-28T03:55:07.317 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:06 smithi100 bash[9834]: cluster 2021-01-28T03:55:04.310771+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T03:55:07.317 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:06 smithi100 bash[9834]: cluster 2021-01-28T03:55:04.310968+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T03:55:07.317 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:06 smithi100 bash[9834]: audit 2021-01-28T03:55:05.963844+0000 mon.a (mon.0) 453 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-28T03:55:07.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:06 smithi100 bash[9834]: cluster 2021-01-28T03:55:05.975774+0000 mon.a (mon.0) 454 : cluster [INF] osd.5 v2:172.21.15.162:6804/1953061558 boot 2021-01-28T03:55:07.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:06 smithi100 bash[9834]: cluster 2021-01-28T03:55:05.975877+0000 mon.a (mon.0) 455 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2021-01-28T03:55:07.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:06 smithi100 bash[9834]: audit 2021-01-28T03:55:05.976112+0000 mon.a (mon.0) 456 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-28T03:55:07.318 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:06 smithi100 bash[13549]: cluster 2021-01-28T03:55:04.310771+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T03:55:07.319 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:06 smithi100 bash[13549]: cluster 2021-01-28T03:55:04.310968+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T03:55:07.319 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:06 smithi100 bash[13549]: audit 2021-01-28T03:55:05.963844+0000 mon.a (mon.0) 453 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-28T03:55:07.319 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:06 smithi100 bash[13549]: cluster 2021-01-28T03:55:05.975774+0000 mon.a (mon.0) 454 : cluster [INF] osd.5 v2:172.21.15.162:6804/1953061558 boot 2021-01-28T03:55:07.319 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:06 smithi100 bash[13549]: cluster 2021-01-28T03:55:05.975877+0000 mon.a (mon.0) 455 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2021-01-28T03:55:07.320 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:06 smithi100 bash[13549]: audit 2021-01-28T03:55:05.976112+0000 mon.a (mon.0) 456 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-28T03:55:08.255 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:07 smithi162 bash[9856]: cluster 2021-01-28T03:55:06.984153+0000 mon.a (mon.0) 457 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2021-01-28T03:55:08.255 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:07 smithi162 bash[9856]: cluster 2021-01-28T03:55:07.342758+0000 mgr.y (mgr.14138) 198 : cluster [DBG] pgmap v163: 1 pgs: 1 peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T03:55:08.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:07 smithi100 bash[9834]: cluster 2021-01-28T03:55:06.984153+0000 mon.a (mon.0) 457 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2021-01-28T03:55:08.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:07 smithi100 bash[9834]: cluster 2021-01-28T03:55:07.342758+0000 mgr.y (mgr.14138) 198 : cluster [DBG] pgmap v163: 1 pgs: 1 peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T03:55:08.318 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:07 smithi100 bash[13549]: cluster 2021-01-28T03:55:06.984153+0000 mon.a (mon.0) 457 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2021-01-28T03:55:08.319 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:07 smithi100 bash[13549]: cluster 2021-01-28T03:55:07.342758+0000 mgr.y (mgr.14138) 198 : cluster [DBG] pgmap v163: 1 pgs: 1 peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T03:55:09.255 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:08 smithi162 bash[9856]: audit 2021-01-28T03:55:08.728202+0000 mon.b (mon.2) 11 : audit [INF] from='client.? 172.21.15.162:0/2147207308' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "95a3b8cf-fdc9-43b4-8cd6-f7c92161409a"}]: dispatch 2021-01-28T03:55:09.255 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:08 smithi162 bash[9856]: audit 2021-01-28T03:55:08.731896+0000 mon.a (mon.0) 458 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "95a3b8cf-fdc9-43b4-8cd6-f7c92161409a"}]: dispatch 2021-01-28T03:55:09.255 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:08 smithi162 bash[9856]: audit 2021-01-28T03:55:08.742703+0000 mon.a (mon.0) 459 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "95a3b8cf-fdc9-43b4-8cd6-f7c92161409a"}]': finished 2021-01-28T03:55:09.256 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:08 smithi162 bash[9856]: cluster 2021-01-28T03:55:08.742893+0000 mon.a (mon.0) 460 : cluster [DBG] osdmap e38: 7 total, 6 up, 6 in 2021-01-28T03:55:09.256 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:08 smithi162 bash[9856]: audit 2021-01-28T03:55:08.743166+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-28T03:55:09.317 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:08 smithi100 bash[9834]: audit 2021-01-28T03:55:08.728202+0000 mon.b (mon.2) 11 : audit [INF] from='client.? 172.21.15.162:0/2147207308' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "95a3b8cf-fdc9-43b4-8cd6-f7c92161409a"}]: dispatch 2021-01-28T03:55:09.317 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:08 smithi100 bash[9834]: audit 2021-01-28T03:55:08.731896+0000 mon.a (mon.0) 458 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "95a3b8cf-fdc9-43b4-8cd6-f7c92161409a"}]: dispatch 2021-01-28T03:55:09.317 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:08 smithi100 bash[9834]: audit 2021-01-28T03:55:08.742703+0000 mon.a (mon.0) 459 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "95a3b8cf-fdc9-43b4-8cd6-f7c92161409a"}]': finished 2021-01-28T03:55:09.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:08 smithi100 bash[9834]: cluster 2021-01-28T03:55:08.742893+0000 mon.a (mon.0) 460 : cluster [DBG] osdmap e38: 7 total, 6 up, 6 in 2021-01-28T03:55:09.318 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:08 smithi100 bash[9834]: audit 2021-01-28T03:55:08.743166+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-28T03:55:09.318 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:08 smithi100 bash[13549]: audit 2021-01-28T03:55:08.728202+0000 mon.b (mon.2) 11 : audit [INF] from='client.? 172.21.15.162:0/2147207308' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "95a3b8cf-fdc9-43b4-8cd6-f7c92161409a"}]: dispatch 2021-01-28T03:55:09.318 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:08 smithi100 bash[13549]: audit 2021-01-28T03:55:08.731896+0000 mon.a (mon.0) 458 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "95a3b8cf-fdc9-43b4-8cd6-f7c92161409a"}]: dispatch 2021-01-28T03:55:09.319 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:08 smithi100 bash[13549]: audit 2021-01-28T03:55:08.742703+0000 mon.a (mon.0) 459 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "95a3b8cf-fdc9-43b4-8cd6-f7c92161409a"}]': finished 2021-01-28T03:55:09.319 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:08 smithi100 bash[13549]: cluster 2021-01-28T03:55:08.742893+0000 mon.a (mon.0) 460 : cluster [DBG] osdmap e38: 7 total, 6 up, 6 in 2021-01-28T03:55:09.319 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:08 smithi100 bash[13549]: audit 2021-01-28T03:55:08.743166+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-28T03:55:10.255 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:09 smithi162 bash[9856]: cluster 2021-01-28T03:55:09.343478+0000 mgr.y (mgr.14138) 199 : cluster [DBG] pgmap v165: 1 pgs: 1 peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T03:55:10.255 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:09 smithi162 bash[9856]: audit 2021-01-28T03:55:09.398015+0000 mon.b (mon.2) 12 : audit [DBG] from='client.? 172.21.15.162:0/2555722354' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T03:55:10.316 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:09 smithi100 bash[9834]: cluster 2021-01-28T03:55:09.343478+0000 mgr.y (mgr.14138) 199 : cluster [DBG] pgmap v165: 1 pgs: 1 peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T03:55:10.317 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:09 smithi100 bash[9834]: audit 2021-01-28T03:55:09.398015+0000 mon.b (mon.2) 12 : audit [DBG] from='client.? 172.21.15.162:0/2555722354' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T03:55:10.317 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:10 smithi100 bash[13549]: cluster 2021-01-28T03:55:09.343478+0000 mgr.y (mgr.14138) 199 : cluster [DBG] pgmap v165: 1 pgs: 1 peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T03:55:10.317 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:10 smithi100 bash[13549]: audit 2021-01-28T03:55:09.398015+0000 mon.b (mon.2) 12 : audit [DBG] from='client.? 172.21.15.162:0/2555722354' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T03:55:12.755 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:12 smithi162 bash[9856]: cluster 2021-01-28T03:55:11.344094+0000 mgr.y (mgr.14138) 200 : cluster [DBG] pgmap v166: 1 pgs: 1 peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T03:55:12.816 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:12 smithi100 bash[9834]: cluster 2021-01-28T03:55:11.344094+0000 mgr.y (mgr.14138) 200 : cluster [DBG] pgmap v166: 1 pgs: 1 peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T03:55:12.817 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:12 smithi100 bash[13549]: cluster 2021-01-28T03:55:11.344094+0000 mgr.y (mgr.14138) 200 : cluster [DBG] pgmap v166: 1 pgs: 1 peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T03:55:13.755 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:13 smithi162 bash[9856]: audit 2021-01-28T03:55:12.539931+0000 mon.a (mon.0) 462 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:55:13.816 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:13 smithi100 bash[9834]: audit 2021-01-28T03:55:12.539931+0000 mon.a (mon.0) 462 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:55:13.817 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:13 smithi100 bash[13549]: audit 2021-01-28T03:55:12.539931+0000 mon.a (mon.0) 462 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:55:14.755 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:14 smithi162 bash[9856]: cluster 2021-01-28T03:55:13.344712+0000 mgr.y (mgr.14138) 201 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T03:55:14.816 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:14 smithi100 bash[9834]: cluster 2021-01-28T03:55:13.344712+0000 mgr.y (mgr.14138) 201 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T03:55:14.817 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:14 smithi100 bash[13549]: cluster 2021-01-28T03:55:13.344712+0000 mgr.y (mgr.14138) 201 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T03:55:16.505 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:16 smithi162 bash[9856]: cluster 2021-01-28T03:55:15.345254+0000 mgr.y (mgr.14138) 202 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T03:55:16.816 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:16 smithi100 bash[9834]: cluster 2021-01-28T03:55:15.345254+0000 mgr.y (mgr.14138) 202 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T03:55:16.817 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:16 smithi100 bash[13549]: cluster 2021-01-28T03:55:15.345254+0000 mgr.y (mgr.14138) 202 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T03:55:17.816 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:17 smithi100 bash[9834]: audit 2021-01-28T03:55:16.710158+0000 mon.a (mon.0) 463 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-01-28T03:55:17.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:17 smithi100 bash[9834]: audit 2021-01-28T03:55:16.712158+0000 mon.a (mon.0) 464 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:55:17.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:17 smithi100 bash[9834]: cephadm 2021-01-28T03:55:16.713785+0000 mgr.y (mgr.14138) 203 : cephadm [INF] Deploying daemon osd.6 on smithi162 2021-01-28T03:55:17.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:17 smithi100 bash[9834]: audit 2021-01-28T03:55:16.714654+0000 mon.a (mon.0) 465 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2021-01-28T03:55:17.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:17 smithi100 bash[9834]: cluster 2021-01-28T03:55:17.345859+0000 mgr.y (mgr.14138) 204 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T03:55:17.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:17 smithi100 bash[13549]: audit 2021-01-28T03:55:16.710158+0000 mon.a (mon.0) 463 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-01-28T03:55:17.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:17 smithi100 bash[13549]: audit 2021-01-28T03:55:16.712158+0000 mon.a (mon.0) 464 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:55:17.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:17 smithi100 bash[13549]: cephadm 2021-01-28T03:55:16.713785+0000 mgr.y (mgr.14138) 203 : cephadm [INF] Deploying daemon osd.6 on smithi162 2021-01-28T03:55:17.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:17 smithi100 bash[13549]: audit 2021-01-28T03:55:16.714654+0000 mon.a (mon.0) 465 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2021-01-28T03:55:17.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:17 smithi100 bash[13549]: cluster 2021-01-28T03:55:17.345859+0000 mgr.y (mgr.14138) 204 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T03:55:18.005 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:17 smithi162 bash[9856]: audit 2021-01-28T03:55:16.710158+0000 mon.a (mon.0) 463 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-01-28T03:55:18.005 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:17 smithi162 bash[9856]: audit 2021-01-28T03:55:16.712158+0000 mon.a (mon.0) 464 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:55:18.005 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:17 smithi162 bash[9856]: cephadm 2021-01-28T03:55:16.713785+0000 mgr.y (mgr.14138) 203 : cephadm [INF] Deploying daemon osd.6 on smithi162 2021-01-28T03:55:18.006 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:17 smithi162 bash[9856]: audit 2021-01-28T03:55:16.714654+0000 mon.a (mon.0) 465 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2021-01-28T03:55:18.006 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:17 smithi162 bash[9856]: cluster 2021-01-28T03:55:17.345859+0000 mgr.y (mgr.14138) 204 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T03:55:19.391 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:19.395+0000 7ffa0ffff700 1 -- 172.21.15.162:0/3810921279 <== mgr.14138 v2:172.21.15.100:6800/928846103 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ffa180f93c0 con 0x7ffa0405bc30 2021-01-28T03:55:19.391 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 6 on host 'smithi162' 2021-01-28T03:55:19.395 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:19.399+0000 7ffa1cf85700 1 -- 172.21.15.162:0/3810921279 >> v2:172.21.15.100:6800/928846103 conn(0x7ffa0405bc30 msgr2=0x7ffa0405e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:55:19.395 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:19.399+0000 7ffa1cf85700 1 --2- 172.21.15.162:0/3810921279 >> v2:172.21.15.100:6800/928846103 conn(0x7ffa0405bc30 0x7ffa0405e0f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7ffa00004dd0 tx=0x7ffa00009b30).stop 2021-01-28T03:55:19.395 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:19.399+0000 7ffa1cf85700 1 -- 172.21.15.162:0/3810921279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa1806aab0 msgr2=0x7ffa1810c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:55:19.395 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:19.399+0000 7ffa1cf85700 1 --2- 172.21.15.162:0/3810921279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa1806aab0 0x7ffa1810c020 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7ffa10002a50 tx=0x7ffa10009e00).stop 2021-01-28T03:55:19.395 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:19.399+0000 7ffa1cf85700 1 -- 172.21.15.162:0/3810921279 shutdown_connections 2021-01-28T03:55:19.396 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:19.399+0000 7ffa1cf85700 1 --2- 172.21.15.162:0/3810921279 >> v2:172.21.15.100:6800/928846103 conn(0x7ffa0405bc30 0x7ffa0405e0f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:55:19.396 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:19.399+0000 7ffa1cf85700 1 --2- 172.21.15.162:0/3810921279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffa1806aab0 0x7ffa1810c020 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:55:19.396 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:19.399+0000 7ffa1cf85700 1 --2- 172.21.15.162:0/3810921279 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7ffa1810d8f0 0x7ffa1810dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:55:19.396 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:19.399+0000 7ffa1cf85700 1 --2- 172.21.15.162:0/3810921279 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffa1810c510 0x7ffa1810d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:55:19.396 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:19.399+0000 7ffa1cf85700 1 -- 172.21.15.162:0/3810921279 >> 172.21.15.162:0/3810921279 conn(0x7ffa180f10a0 msgr2=0x7ffa180f1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:55:19.397 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:19.399+0000 7ffa1cf85700 1 -- 172.21.15.162:0/3810921279 shutdown_connections 2021-01-28T03:55:19.397 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:19.399+0000 7ffa1cf85700 1 -- 172.21.15.162:0/3810921279 wait complete. 2021-01-28T03:55:19.755 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:19 smithi162 bash[9856]: audit 2021-01-28T03:55:19.390807+0000 mon.a (mon.0) 466 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:55:19.755 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:19 smithi162 bash[9856]: audit 2021-01-28T03:55:19.396046+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:19.816 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:19 smithi100 bash[9834]: audit 2021-01-28T03:55:19.390807+0000 mon.a (mon.0) 466 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:55:19.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:19 smithi100 bash[9834]: audit 2021-01-28T03:55:19.396046+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:19.817 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:19 smithi100 bash[13549]: audit 2021-01-28T03:55:19.390807+0000 mon.a (mon.0) 466 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:55:19.817 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:19 smithi100 bash[13549]: audit 2021-01-28T03:55:19.396046+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:20.609 DEBUG:teuthology.orchestra.run.smithi162:osd.6> sudo journalctl -f -n 0 -u ceph-c217df96-611b-11eb-8f9e-001a4aab830c@osd.6.service 2021-01-28T03:55:20.617 INFO:tasks.cephadm:Deploying osd.7 on smithi162 with /dev/vg_nvme/lv_1... 2021-01-28T03:55:20.618 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2021-01-28T03:55:20.673 INFO:journalctl@ceph.osd.6.smithi162.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T03:55:20.698 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:20 smithi162 bash[9856]: cluster 2021-01-28T03:55:19.346403+0000 mgr.y (mgr.14138) 205 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T03:55:20.698 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:20 smithi162 bash[9856]: audit 2021-01-28T03:55:20.327759+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:20.699 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:20 smithi162 bash[9856]: audit 2021-01-28T03:55:20.329838+0000 mon.a (mon.0) 469 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:55:20.816 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:20 smithi100 bash[9834]: cluster 2021-01-28T03:55:19.346403+0000 mgr.y (mgr.14138) 205 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T03:55:20.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:20 smithi100 bash[9834]: audit 2021-01-28T03:55:20.327759+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:20.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:20 smithi100 bash[9834]: audit 2021-01-28T03:55:20.329838+0000 mon.a (mon.0) 469 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:55:20.817 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:20 smithi100 bash[13549]: cluster 2021-01-28T03:55:19.346403+0000 mgr.y (mgr.14138) 205 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T03:55:20.817 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:20 smithi100 bash[13549]: audit 2021-01-28T03:55:20.327759+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:20.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:20 smithi100 bash[13549]: audit 2021-01-28T03:55:20.329838+0000 mon.a (mon.0) 469 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:55:21.755 INFO:journalctl@ceph.osd.6.smithi162.stdout:Jan 28 03:55:21 smithi162 bash[17293]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-01-28T03:55:21.755 INFO:journalctl@ceph.osd.6.smithi162.stdout:Jan 28 03:55:21 smithi162 bash[17293]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-6 --no-mon-config 2021-01-28T03:55:21.755 INFO:journalctl@ceph.osd.6.smithi162.stdout:Jan 28 03:55:21 smithi162 bash[17293]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6/block 2021-01-28T03:55:21.756 INFO:journalctl@ceph.osd.6.smithi162.stdout:Jan 28 03:55:21 smithi162 bash[17293]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-6/block 2021-01-28T03:55:21.756 INFO:journalctl@ceph.osd.6.smithi162.stdout:Jan 28 03:55:21 smithi162 bash[17293]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-01-28T03:55:21.756 INFO:journalctl@ceph.osd.6.smithi162.stdout:Jan 28 03:55:21 smithi162 bash[17293]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-01-28T03:55:21.756 INFO:journalctl@ceph.osd.6.smithi162.stdout:Jan 28 03:55:21 smithi162 bash[17293]: --> ceph-volume lvm activate successful for osd ID: 6 2021-01-28T03:55:22.755 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:22 smithi162 bash[9856]: cluster 2021-01-28T03:55:21.346952+0000 mgr.y (mgr.14138) 206 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T03:55:22.816 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:22 smithi100 bash[13549]: cluster 2021-01-28T03:55:21.346952+0000 mgr.y (mgr.14138) 206 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T03:55:22.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:22 smithi100 bash[9834]: cluster 2021-01-28T03:55:21.346952+0000 mgr.y (mgr.14138) 206 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T03:55:24.755 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:24 smithi162 bash[9856]: cluster 2021-01-28T03:55:23.347557+0000 mgr.y (mgr.14138) 207 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T03:55:24.755 INFO:journalctl@ceph.osd.6.smithi162.stdout:Jan 28 03:55:24 smithi162 bash[17572]: debug 2021-01-28T03:55:24.355+0000 7f4064151700 20 -- 172.21.15.162:0/94452918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56159ea44c00 msgr2=0x56159e9b1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2021-01-28T03:55:24.756 INFO:journalctl@ceph.osd.6.smithi162.stdout:Jan 28 03:55:24 smithi162 bash[17572]: debug 2021-01-28T03:55:24.355+0000 7f4064151700 20 -- 172.21.15.162:0/94452918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56159ea44c00 msgr2=0x56159e9b1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=96 2021-01-28T03:55:24.756 INFO:journalctl@ceph.osd.6.smithi162.stdout:Jan 28 03:55:24 smithi162 bash[17572]: debug 2021-01-28T03:55:24.355+0000 7f4064151700 20 --2- 172.21.15.162:0/94452918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56159ea44c00 0x56159e9b1400 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x56159e9c1e60 tx=0x56159e9f6d80).handle_read_frame_preamble_main r=0 2021-01-28T03:55:24.756 INFO:journalctl@ceph.osd.6.smithi162.stdout:Jan 28 03:55:24 smithi162 bash[17572]: debug 2021-01-28T03:55:24.355+0000 7f4064151700 20 --2- 172.21.15.162:0/94452918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56159ea44c00 0x56159e9b1400 secure :-1 s=THROTTLE_MESSAGE pgs=33 cs=0 l=1 rev1=1 rx=0x56159e9c1e60 tx=0x56159e9f6d80).throttle_message 2021-01-28T03:55:24.756 INFO:journalctl@ceph.osd.6.smithi162.stdout:Jan 28 03:55:24 smithi162 bash[17572]: debug 2021-01-28T03:55:24.355+0000 7f4064151700 20 --2- 172.21.15.162:0/94452918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56159ea44c00 0x56159e9b1400 secure :-1 s=THROTTLE_BYTES pgs=33 cs=0 l=1 rev1=1 rx=0x56159e9c1e60 tx=0x56159e9f6d80).throttle_bytes 2021-01-28T03:55:24.757 INFO:journalctl@ceph.osd.6.smithi162.stdout:Jan 28 03:55:24 smithi162 bash[17572]: debug 2021-01-28T03:55:24.355+0000 7f4064151700 20 --2- 172.21.15.162:0/94452918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56159ea44c00 0x56159e9b1400 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=33 cs=0 l=1 rev1=1 rx=0x56159e9c1e60 tx=0x56159e9f6d80).throttle_dispatch_queue 2021-01-28T03:55:24.757 INFO:journalctl@ceph.osd.6.smithi162.stdout:Jan 28 03:55:24 smithi162 bash[17572]: debug 2021-01-28T03:55:24.355+0000 7f4064151700 20 --2- 172.21.15.162:0/94452918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56159ea44c00 0x56159e9b1400 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rev1=1 rx=0x56159e9c1e60 tx=0x56159e9f6d80).read_frame_segment seg_idx=0 2021-01-28T03:55:24.757 INFO:journalctl@ceph.osd.6.smithi162.stdout:Jan 28 03:55:24 smithi162 bash[17572]: debug 2021-01-28T03:55:24.355+0000 7f4064151700 20 --2- 172.21.15.162:0/94452918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56159ea44c00 0x56159e9b1400 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rev1=1 rx=0x56159e9c1e60 tx=0x56159e9f6d80).read_frame_segment seg_idx=1 2021-01-28T03:55:24.757 INFO:journalctl@ceph.osd.6.smithi162.stdout:Jan 28 03:55:24 smithi162 bash[17572]: debug 2021-01-28T03:55:24.355+0000 7f4064151700 20 -- 172.21.15.162:0/94452918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56159ea44c00 msgr2=0x56159e9b1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2021-01-28T03:55:24.758 INFO:journalctl@ceph.osd.6.smithi162.stdout:Jan 28 03:55:24 smithi162 bash[17572]: debug 2021-01-28T03:55:24.355+0000 7f4064151700 20 --2- 172.21.15.162:0/94452918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56159ea44c00 0x56159e9b1400 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rev1=1 rx=0x56159e9c1e60 tx=0x56159e9f6d80).handle_read_frame_segment r=0 2021-01-28T03:55:24.758 INFO:journalctl@ceph.osd.6.smithi162.stdout:Jan 28 03:55:24 smithi162 bash[17572]: debug 2021-01-28T03:55:24.355+0000 7f4064151700 20 -- 172.21.15.162:0/94452918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56159ea44c00 msgr2=0x56159e9b1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2021-01-28T03:55:24.758 INFO:journalctl@ceph.osd.6.smithi162.stdout:Jan 28 03:55:24 smithi162 bash[17572]: debug 2021-01-28T03:55:24.355+0000 7f4064151700 20 --2- 172.21.15.162:0/94452918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56159ea44c00 0x56159e9b1400 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rev1=1 rx=0x56159e9c1e60 tx=0x56159e9f6d80).handle_read_frame_epilogue_main r=0 2021-01-28T03:55:24.758 INFO:journalctl@ceph.osd.6.smithi162.stdout:Jan 28 03:55:24 smithi162 bash[17572]: debug 2021-01-28T03:55:24.355+0000 7f4064151700 10 --2- 172.21.15.162:0/94452918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56159ea44c00 0x56159e9b1400 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rev1=1 rx=0x56159e9c1e60 tx=0x56159e9f6d80).handle_read_frame_dispatch tag=17 2021-01-28T03:55:24.759 INFO:journalctl@ceph.osd.6.smithi162.stdout:Jan 28 03:55:24 smithi162 bash[17572]: debug 2021-01-28T03:55:24.355+0000 7f4064151700 20 --2- 172.21.15.162:0/94452918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56159ea44c00 0x56159e9b1400 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rev1=1 rx=0x56159e9c1e60 tx=0x56159e9f6d80).handle_message 2021-01-28T03:55:24.759 INFO:journalctl@ceph.osd.6.smithi162.stdout:Jan 28 03:55:24 smithi162 bash[17572]: debug 2021-01-28T03:55:24.355+0000 7f4064151700 5 --2- 172.21.15.162:0/94452918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56159ea44c00 0x56159e9b1400 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rev1=1 rx=0x56159e9c1e60 tx=0x56159e9f6d80).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.2 off 0 2021-01-28T03:55:24.759 INFO:journalctl@ceph.osd.6.smithi162.stdout:Jan 28 03:55:24 smithi162 bash[17572]: debug 2021-01-28T03:55:24.355+0000 7f4064151700 5 --2- 172.21.15.162:0/94452918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56159ea44c00 0x56159e9b1400 secure :-1 s=READ_MESSAGE_COMPLETE pgs=33 cs=0 l=1 rev1=1 rx=0x56159e9c1e60 tx=0x56159e9f6d80).handle_message received message m=0x56159e9c64e0 seq=4 from=mon.2 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-28T03:55:24.759 INFO:journalctl@ceph.osd.6.smithi162.stdout:Jan 28 03:55:24 smithi162 bash[17572]: debug 2021-01-28T03:55:24.355+0000 7f4064151700 20 -- 172.21.15.162:0/94452918 queue 0x56159e9c64e0 prio 196 2021-01-28T03:55:24.759 INFO:journalctl@ceph.osd.6.smithi162.stdout:Jan 28 03:55:24 smithi162 bash[17572]: debug 2021-01-28T03:55:24.355+0000 7f4064151700 20 --2- 172.21.15.162:0/94452918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56159ea44c00 0x56159e9b1400 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x56159e9c1e60 tx=0x56159e9f6d80).read_frame 2021-01-28T03:55:24.760 INFO:journalctl@ceph.osd.6.smithi162.stdout:Jan 28 03:55:24 smithi162 bash[17572]: debug 2021-01-28T03:55:24.355+0000 7f4064151700 20 -- 172.21.15.162:0/94452918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56159ea44c00 msgr2=0x56159e9b1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-28T03:55:24.760 INFO:journalctl@ceph.osd.6.smithi162.stdout:Jan 28 03:55:24 smithi162 bash[17572]: debug 2021-01-28T03:55:24.355+0000 7f406314f700 1 -- 172.21.15.162:0/94452918 <== mon.2 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56159e9c64e0 con 0x56159ea44c00 2021-01-28T03:55:24.760 INFO:journalctl@ceph.osd.6.smithi162.stdout:Jan 28 03:55:24 smithi162 bash[17572]: debug 2021-01-28T03:55:24.355+0000 7f406314f700 10 -- 172.21.15.162:0/94452918 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-28T03:55:24.760 INFO:journalctl@ceph.osd.6.smithi162.stdout:Jan 28 03:55:24 smithi162 bash[17572]: debug 2021-01-28T03:55:24.355+0000 7f406314f700 20 -- 172.21.15.162:0/94452918 done calling dispatch on 0x56159e9c64e0 2021-01-28T03:55:24.816 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:24 smithi100 bash[9834]: cluster 2021-01-28T03:55:23.347557+0000 mgr.y (mgr.14138) 207 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T03:55:24.816 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:24 smithi100 bash[13549]: cluster 2021-01-28T03:55:23.347557+0000 mgr.y (mgr.14138) 207 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T03:55:25.255 INFO:journalctl@ceph.osd.6.smithi162.stdout:Jan 28 03:55:25 smithi162 bash[17572]: debug 2021-01-28T03:55:24.907+0000 7f406abda200 -1 Falling back to public interface 2021-01-28T03:55:25.755 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:25 smithi162 bash[9856]: cluster 2021-01-28T03:55:25.348123+0000 mgr.y (mgr.14138) 208 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T03:55:25.816 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:25 smithi100 bash[9834]: cluster 2021-01-28T03:55:25.348123+0000 mgr.y (mgr.14138) 208 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T03:55:25.816 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:25 smithi100 bash[13549]: cluster 2021-01-28T03:55:25.348123+0000 mgr.y (mgr.14138) 208 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T03:55:27.097 INFO:teuthology.orchestra.run.smithi162.stderr:--> Zapping: /dev/vg_nvme/lv_1 2021-01-28T03:55:27.097 INFO:teuthology.orchestra.run.smithi162.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2021-01-28T03:55:27.097 INFO:teuthology.orchestra.run.smithi162.stderr: stderr: 10+0 records in 2021-01-28T03:55:27.097 INFO:teuthology.orchestra.run.smithi162.stderr:10+0 records out 2021-01-28T03:55:27.098 INFO:teuthology.orchestra.run.smithi162.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0135408 s, 774 MB/s 2021-01-28T03:55:27.098 INFO:teuthology.orchestra.run.smithi162.stderr:--> Zapping successful for: 2021-01-28T03:55:27.754 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph orch daemon add osd smithi162:vg_nvme/lv_1 2021-01-28T03:55:27.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:27 smithi100 bash[9834]: cluster 2021-01-28T03:55:27.348716+0000 mgr.y (mgr.14138) 209 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T03:55:27.817 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:27 smithi100 bash[13549]: cluster 2021-01-28T03:55:27.348716+0000 mgr.y (mgr.14138) 209 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T03:55:27.948 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:27 smithi162 bash[9856]: cluster 2021-01-28T03:55:27.348716+0000 mgr.y (mgr.14138) 209 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T03:55:27.949 INFO:journalctl@ceph.osd.6.smithi162.stdout:Jan 28 03:55:27 smithi162 bash[17572]: debug 2021-01-28T03:55:27.951+0000 7f406abda200 -1 osd.6 0 log_to_monitors {default=true} 2021-01-28T03:55:28.755 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:28 smithi162 bash[9856]: audit 2021-01-28T03:55:27.960486+0000 mon.b (mon.2) 13 : audit [INF] from='osd.6 v2:172.21.15.162:6808/3682466023' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-01-28T03:55:28.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:28 smithi162 bash[9856]: audit 2021-01-28T03:55:27.964157+0000 mon.a (mon.0) 470 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-01-28T03:55:28.816 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:28 smithi100 bash[9834]: audit 2021-01-28T03:55:27.960486+0000 mon.b (mon.2) 13 : audit [INF] from='osd.6 v2:172.21.15.162:6808/3682466023' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-01-28T03:55:28.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:28 smithi100 bash[9834]: audit 2021-01-28T03:55:27.964157+0000 mon.a (mon.0) 470 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-01-28T03:55:28.817 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:28 smithi100 bash[13549]: audit 2021-01-28T03:55:27.960486+0000 mon.b (mon.2) 13 : audit [INF] from='osd.6 v2:172.21.15.162:6808/3682466023' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-01-28T03:55:28.817 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:28 smithi100 bash[13549]: audit 2021-01-28T03:55:27.964157+0000 mon.a (mon.0) 470 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-01-28T03:55:29.718 INFO:journalctl@ceph.osd.6.smithi162.stdout:Jan 28 03:55:29 smithi162 bash[17572]: debug 2021-01-28T03:55:29.591+0000 7f406114b700 -1 osd.6 0 waiting for initial osdmap 2021-01-28T03:55:29.719 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:29 smithi162 bash[9856]: audit 2021-01-28T03:55:28.574232+0000 mon.b (mon.2) 14 : audit [INF] from='osd.6 v2:172.21.15.162:6808/3682466023' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2021-01-28T03:55:29.719 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:29 smithi162 bash[9856]: audit 2021-01-28T03:55:28.575549+0000 mon.a (mon.0) 471 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-01-28T03:55:29.719 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:29 smithi162 bash[9856]: cluster 2021-01-28T03:55:28.575713+0000 mon.a (mon.0) 472 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2021-01-28T03:55:29.719 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:29 smithi162 bash[9856]: audit 2021-01-28T03:55:28.575934+0000 mon.a (mon.0) 473 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-28T03:55:29.720 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:29 smithi162 bash[9856]: audit 2021-01-28T03:55:28.577939+0000 mon.a (mon.0) 474 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2021-01-28T03:55:29.720 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:29 smithi162 bash[9856]: audit 2021-01-28T03:55:29.234257+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:55:29.720 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:29 smithi162 bash[9856]: cluster 2021-01-28T03:55:29.349285+0000 mgr.y (mgr.14138) 210 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T03:55:30.066 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:29 smithi100 bash[13549]: audit 2021-01-28T03:55:28.574232+0000 mon.b (mon.2) 14 : audit [INF] from='osd.6 v2:172.21.15.162:6808/3682466023' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2021-01-28T03:55:30.067 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:29 smithi100 bash[13549]: audit 2021-01-28T03:55:28.575549+0000 mon.a (mon.0) 471 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-01-28T03:55:30.067 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:29 smithi100 bash[13549]: cluster 2021-01-28T03:55:28.575713+0000 mon.a (mon.0) 472 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2021-01-28T03:55:30.067 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:29 smithi100 bash[13549]: audit 2021-01-28T03:55:28.575934+0000 mon.a (mon.0) 473 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-28T03:55:30.067 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:29 smithi100 bash[13549]: audit 2021-01-28T03:55:28.577939+0000 mon.a (mon.0) 474 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2021-01-28T03:55:30.067 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:29 smithi100 bash[13549]: audit 2021-01-28T03:55:29.234257+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:55:30.068 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:29 smithi100 bash[13549]: cluster 2021-01-28T03:55:29.349285+0000 mgr.y (mgr.14138) 210 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T03:55:30.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:29 smithi100 bash[9834]: audit 2021-01-28T03:55:28.574232+0000 mon.b (mon.2) 14 : audit [INF] from='osd.6 v2:172.21.15.162:6808/3682466023' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2021-01-28T03:55:30.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:29 smithi100 bash[9834]: audit 2021-01-28T03:55:28.575549+0000 mon.a (mon.0) 471 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-01-28T03:55:30.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:29 smithi100 bash[9834]: cluster 2021-01-28T03:55:28.575713+0000 mon.a (mon.0) 472 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2021-01-28T03:55:30.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:29 smithi100 bash[9834]: audit 2021-01-28T03:55:28.575934+0000 mon.a (mon.0) 473 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-28T03:55:30.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:29 smithi100 bash[9834]: audit 2021-01-28T03:55:28.577939+0000 mon.a (mon.0) 474 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2021-01-28T03:55:30.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:29 smithi100 bash[9834]: audit 2021-01-28T03:55:29.234257+0000 mon.a (mon.0) 475 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:55:30.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:29 smithi100 bash[9834]: cluster 2021-01-28T03:55:29.349285+0000 mgr.y (mgr.14138) 210 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T03:55:31.005 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:30 smithi162 bash[9856]: audit 2021-01-28T03:55:29.589709+0000 mon.a (mon.0) 476 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2021-01-28T03:55:31.005 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:30 smithi162 bash[9856]: cluster 2021-01-28T03:55:29.589887+0000 mon.a (mon.0) 477 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2021-01-28T03:55:31.005 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:30 smithi162 bash[9856]: audit 2021-01-28T03:55:29.590509+0000 mon.a (mon.0) 478 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-28T03:55:31.005 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:30 smithi162 bash[9856]: audit 2021-01-28T03:55:29.596979+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-28T03:55:31.006 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:30 smithi162 bash[9856]: audit 2021-01-28T03:55:29.624791+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:31.006 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:30 smithi162 bash[9856]: audit 2021-01-28T03:55:29.632564+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:31.006 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:30 smithi162 bash[9856]: cephadm 2021-01-28T03:55:29.633826+0000 mgr.y (mgr.14138) 211 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:55:31.006 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:30 smithi162 bash[9856]: cephadm 2021-01-28T03:55:29.636014+0000 mgr.y (mgr.14138) 212 : cephadm [INF] refreshing smithi100 facts 2021-01-28T03:55:31.007 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:30 smithi162 bash[9856]: audit 2021-01-28T03:55:30.051829+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:31.007 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:30 smithi162 bash[9856]: cephadm 2021-01-28T03:55:30.053184+0000 mgr.y (mgr.14138) 213 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:55:31.066 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:30 smithi100 bash[9834]: audit 2021-01-28T03:55:29.589709+0000 mon.a (mon.0) 476 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2021-01-28T03:55:31.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:30 smithi100 bash[9834]: cluster 2021-01-28T03:55:29.589887+0000 mon.a (mon.0) 477 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2021-01-28T03:55:31.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:30 smithi100 bash[9834]: audit 2021-01-28T03:55:29.590509+0000 mon.a (mon.0) 478 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-28T03:55:31.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:30 smithi100 bash[9834]: audit 2021-01-28T03:55:29.596979+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-28T03:55:31.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:30 smithi100 bash[9834]: audit 2021-01-28T03:55:29.624791+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:31.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:30 smithi100 bash[9834]: audit 2021-01-28T03:55:29.632564+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:31.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:30 smithi100 bash[9834]: cephadm 2021-01-28T03:55:29.633826+0000 mgr.y (mgr.14138) 211 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:55:31.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:30 smithi100 bash[9834]: cephadm 2021-01-28T03:55:29.636014+0000 mgr.y (mgr.14138) 212 : cephadm [INF] refreshing smithi100 facts 2021-01-28T03:55:31.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:30 smithi100 bash[9834]: audit 2021-01-28T03:55:30.051829+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:31.069 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:30 smithi100 bash[9834]: cephadm 2021-01-28T03:55:30.053184+0000 mgr.y (mgr.14138) 213 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:55:31.069 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:30 smithi100 bash[13549]: audit 2021-01-28T03:55:29.589709+0000 mon.a (mon.0) 476 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2021-01-28T03:55:31.069 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:30 smithi100 bash[13549]: cluster 2021-01-28T03:55:29.589887+0000 mon.a (mon.0) 477 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2021-01-28T03:55:31.069 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:30 smithi100 bash[13549]: audit 2021-01-28T03:55:29.590509+0000 mon.a (mon.0) 478 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-28T03:55:31.070 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:30 smithi100 bash[13549]: audit 2021-01-28T03:55:29.596979+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-28T03:55:31.070 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:30 smithi100 bash[13549]: audit 2021-01-28T03:55:29.624791+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:31.070 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:30 smithi100 bash[13549]: audit 2021-01-28T03:55:29.632564+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:31.070 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:30 smithi100 bash[13549]: cephadm 2021-01-28T03:55:29.633826+0000 mgr.y (mgr.14138) 211 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:55:31.071 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:30 smithi100 bash[13549]: cephadm 2021-01-28T03:55:29.636014+0000 mgr.y (mgr.14138) 212 : cephadm [INF] refreshing smithi100 facts 2021-01-28T03:55:31.071 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:30 smithi100 bash[13549]: audit 2021-01-28T03:55:30.051829+0000 mon.a (mon.0) 482 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:31.071 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:30 smithi100 bash[13549]: cephadm 2021-01-28T03:55:30.053184+0000 mgr.y (mgr.14138) 213 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:55:31.461 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.467+0000 7f936e09d700 1 -- 172.21.15.162:0/3871011836 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93680f6730 msgr2=0x7f93680f4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:55:31.461 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.467+0000 7f936e09d700 1 --2- 172.21.15.162:0/3871011836 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93680f6730 0x7f93680f4b80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f9364009dc0 tx=0x7f9364004d10).stop 2021-01-28T03:55:31.461 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.467+0000 7f936e09d700 1 -- 172.21.15.162:0/3871011836 shutdown_connections 2021-01-28T03:55:31.461 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.467+0000 7f936e09d700 1 --2- 172.21.15.162:0/3871011836 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93680f51a0 0x7f93680f5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:55:31.462 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.467+0000 7f936e09d700 1 --2- 172.21.15.162:0/3871011836 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f93680f5d90 0x7f93680f61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:55:31.462 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.467+0000 7f936e09d700 1 --2- 172.21.15.162:0/3871011836 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93680f6730 0x7f93680f4b80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:55:31.462 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.467+0000 7f936e09d700 1 -- 172.21.15.162:0/3871011836 >> 172.21.15.162:0/3871011836 conn(0x7f93680ef730 msgr2=0x7f93680f1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:55:31.462 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.467+0000 7f936e09d700 1 -- 172.21.15.162:0/3871011836 shutdown_connections 2021-01-28T03:55:31.463 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.467+0000 7f936e09d700 1 -- 172.21.15.162:0/3871011836 wait complete. 2021-01-28T03:55:31.464 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.467+0000 7f936e09d700 1 Processor -- start 2021-01-28T03:55:31.464 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.467+0000 7f936e09d700 1 -- start start 2021-01-28T03:55:31.464 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.467+0000 7f936e09d700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93680f51a0 0x7f9368107b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:55:31.465 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.467+0000 7f936e09d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93680f5d90 0x7f9368108050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:55:31.465 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.467+0000 7f936e09d700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f93680f6730 0x7f9368108f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:55:31.465 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.467+0000 7f936e09d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9368109470 con 0x7f93680f5d90 2021-01-28T03:55:31.465 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.467+0000 7f936e09d700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93681095e0 con 0x7f93680f51a0 2021-01-28T03:55:31.466 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.467+0000 7f936e09d700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93681097a0 con 0x7f93680f6730 2021-01-28T03:55:31.466 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.467+0000 7f936d09b700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93680f51a0 0x7f9368107b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:55:31.466 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.467+0000 7f936d09b700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93680f51a0 0x7f9368107b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:45042/0 (socket says 172.21.15.162:45042) 2021-01-28T03:55:31.466 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.467+0000 7f936d09b700 1 -- 172.21.15.162:0/1157806871 learned_addr learned my addr 172.21.15.162:0/1157806871 (peer_addr_for_me v2:172.21.15.162:0/0) 2021-01-28T03:55:31.466 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.467+0000 7f936c89a700 1 --2- 172.21.15.162:0/1157806871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93680f5d90 0x7f9368108050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:55:31.467 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.467+0000 7f936d89c700 1 --2- 172.21.15.162:0/1157806871 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f93680f6730 0x7f9368108f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:55:31.467 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.467+0000 7f936d09b700 1 -- 172.21.15.162:0/1157806871 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f93680f6730 msgr2=0x7f9368108f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:55:31.467 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.467+0000 7f936d09b700 1 --2- 172.21.15.162:0/1157806871 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f93680f6730 0x7f9368108f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:55:31.467 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.467+0000 7f936d09b700 1 -- 172.21.15.162:0/1157806871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93680f5d90 msgr2=0x7f9368108050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:55:31.467 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.467+0000 7f936d09b700 1 --2- 172.21.15.162:0/1157806871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93680f5d90 0x7f9368108050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:55:31.468 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.467+0000 7f936d09b700 1 -- 172.21.15.162:0/1157806871 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9368109960 con 0x7f93680f51a0 2021-01-28T03:55:31.468 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.467+0000 7f936c89a700 1 --2- 172.21.15.162:0/1157806871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93680f5d90 0x7f9368108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-28T03:55:31.468 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.467+0000 7f936d09b700 1 --2- 172.21.15.162:0/1157806871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93680f51a0 0x7f9368107b60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f935800eb90 tx=0x7f935800b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:55:31.468 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.467+0000 7f935dffb700 1 -- 172.21.15.162:0/1157806871 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93580092e0 con 0x7f93680f51a0 2021-01-28T03:55:31.468 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.467+0000 7f936e09d700 1 -- 172.21.15.162:0/1157806871 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9368109c10 con 0x7f93680f51a0 2021-01-28T03:55:31.469 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.467+0000 7f936e09d700 1 -- 172.21.15.162:0/1157806871 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93681103a0 con 0x7f93680f51a0 2021-01-28T03:55:31.469 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.471+0000 7f935dffb700 1 -- 172.21.15.162:0/1157806871 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f935800f040 con 0x7f93680f51a0 2021-01-28T03:55:31.469 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.471+0000 7f935dffb700 1 -- 172.21.15.162:0/1157806871 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935800c840 con 0x7f93680f51a0 2021-01-28T03:55:31.470 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.471+0000 7f936e09d700 1 -- 172.21.15.162:0/1157806871 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9348004da0 con 0x7f93680f51a0 2021-01-28T03:55:31.470 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.471+0000 7f935dffb700 1 -- 172.21.15.162:0/1157806871 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 71316+0+0 (secure 0 0 0) 0x7f935801b030 con 0x7f93680f51a0 2021-01-28T03:55:31.471 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.471+0000 7f935dffb700 1 --2- 172.21.15.162:0/1157806871 >> v2:172.21.15.100:6800/928846103 conn(0x7f935405bc30 0x7f935405e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:55:31.471 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.471+0000 7f935dffb700 1 -- 172.21.15.162:0/1157806871 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 3746+0+0 (secure 0 0 0) 0x7f9358074c20 con 0x7f93680f51a0 2021-01-28T03:55:31.471 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.471+0000 7f936c89a700 1 --2- 172.21.15.162:0/1157806871 >> v2:172.21.15.100:6800/928846103 conn(0x7f935405bc30 0x7f935405e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:55:31.471 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.471+0000 7f936c89a700 1 --2- 172.21.15.162:0/1157806871 >> v2:172.21.15.100:6800/928846103 conn(0x7f935405bc30 0x7f935405e0f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f9364007690 tx=0x7f9364004d10).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:55:31.474 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.479+0000 7f935dffb700 1 -- 172.21.15.162:0/1157806871 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f93580481e0 con 0x7f93680f51a0 2021-01-28T03:55:31.666 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:31.671+0000 7f936e09d700 1 -- 172.21.15.162:0/1157806871 --> v2:172.21.15.100:6800/928846103 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f9348000bc0 con 0x7f935405bc30 2021-01-28T03:55:32.007 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:31 smithi162 bash[9856]: cluster 2021-01-28T03:55:28.994199+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T03:55:32.007 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:31 smithi162 bash[9856]: cluster 2021-01-28T03:55:28.994407+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T03:55:32.008 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:31 smithi162 bash[9856]: cluster 2021-01-28T03:55:30.590897+0000 mon.a (mon.0) 483 : cluster [INF] osd.6 v2:172.21.15.162:6808/3682466023 boot 2021-01-28T03:55:32.008 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:31 smithi162 bash[9856]: cluster 2021-01-28T03:55:30.591086+0000 mon.a (mon.0) 484 : cluster [DBG] osdmap e41: 7 total, 7 up, 7 in 2021-01-28T03:55:32.009 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:31 smithi162 bash[9856]: audit 2021-01-28T03:55:30.592038+0000 mon.a (mon.0) 485 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-28T03:55:32.009 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:31 smithi162 bash[9856]: cluster 2021-01-28T03:55:31.349924+0000 mgr.y (mgr.14138) 214 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 35 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:32.066 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:31 smithi100 bash[9834]: cluster 2021-01-28T03:55:28.994199+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T03:55:32.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:31 smithi100 bash[9834]: cluster 2021-01-28T03:55:28.994407+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T03:55:32.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:31 smithi100 bash[9834]: cluster 2021-01-28T03:55:30.590897+0000 mon.a (mon.0) 483 : cluster [INF] osd.6 v2:172.21.15.162:6808/3682466023 boot 2021-01-28T03:55:32.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:31 smithi100 bash[9834]: cluster 2021-01-28T03:55:30.591086+0000 mon.a (mon.0) 484 : cluster [DBG] osdmap e41: 7 total, 7 up, 7 in 2021-01-28T03:55:32.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:31 smithi100 bash[9834]: audit 2021-01-28T03:55:30.592038+0000 mon.a (mon.0) 485 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-28T03:55:32.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:31 smithi100 bash[9834]: cluster 2021-01-28T03:55:31.349924+0000 mgr.y (mgr.14138) 214 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 35 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:32.068 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:31 smithi100 bash[13549]: cluster 2021-01-28T03:55:28.994199+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T03:55:32.068 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:31 smithi100 bash[13549]: cluster 2021-01-28T03:55:28.994407+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T03:55:32.068 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:31 smithi100 bash[13549]: cluster 2021-01-28T03:55:30.590897+0000 mon.a (mon.0) 483 : cluster [INF] osd.6 v2:172.21.15.162:6808/3682466023 boot 2021-01-28T03:55:32.069 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:31 smithi100 bash[13549]: cluster 2021-01-28T03:55:30.591086+0000 mon.a (mon.0) 484 : cluster [DBG] osdmap e41: 7 total, 7 up, 7 in 2021-01-28T03:55:32.069 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:31 smithi100 bash[13549]: audit 2021-01-28T03:55:30.592038+0000 mon.a (mon.0) 485 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-28T03:55:32.069 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:31 smithi100 bash[13549]: cluster 2021-01-28T03:55:31.349924+0000 mgr.y (mgr.14138) 214 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 35 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:32.971 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:32 smithi162 bash[9856]: cluster 2021-01-28T03:55:31.606837+0000 mon.a (mon.0) 486 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2021-01-28T03:55:32.972 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:32 smithi162 bash[9856]: audit 2021-01-28T03:55:31.678148+0000 mgr.y (mgr.14138) 215 : audit [DBG] from='client.34298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:55:32.972 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:32 smithi162 bash[9856]: audit 2021-01-28T03:55:31.680162+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T03:55:32.972 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:32 smithi162 bash[9856]: cephadm 2021-01-28T03:55:31.682619+0000 mgr.y (mgr.14138) 216 : cephadm [INF] Applying drive group None on host smithi162... 2021-01-28T03:55:32.972 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:32 smithi162 bash[9856]: audit 2021-01-28T03:55:31.683130+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T03:55:32.973 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:32 smithi162 bash[9856]: audit 2021-01-28T03:55:31.684741+0000 mon.a (mon.0) 489 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:55:32.973 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:32 smithi162 bash[9856]: audit 2021-01-28T03:55:31.686829+0000 mon.a (mon.0) 490 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:55:33.066 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:32 smithi100 bash[9834]: cluster 2021-01-28T03:55:31.606837+0000 mon.a (mon.0) 486 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2021-01-28T03:55:33.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:32 smithi100 bash[9834]: audit 2021-01-28T03:55:31.678148+0000 mgr.y (mgr.14138) 215 : audit [DBG] from='client.34298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:55:33.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:32 smithi100 bash[9834]: audit 2021-01-28T03:55:31.680162+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T03:55:33.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:32 smithi100 bash[9834]: cephadm 2021-01-28T03:55:31.682619+0000 mgr.y (mgr.14138) 216 : cephadm [INF] Applying drive group None on host smithi162... 2021-01-28T03:55:33.067 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:32 smithi100 bash[9834]: audit 2021-01-28T03:55:31.683130+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T03:55:33.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:32 smithi100 bash[9834]: audit 2021-01-28T03:55:31.684741+0000 mon.a (mon.0) 489 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:55:33.068 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:32 smithi100 bash[9834]: audit 2021-01-28T03:55:31.686829+0000 mon.a (mon.0) 490 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:55:33.068 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:32 smithi100 bash[13549]: cluster 2021-01-28T03:55:31.606837+0000 mon.a (mon.0) 486 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2021-01-28T03:55:33.068 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:32 smithi100 bash[13549]: audit 2021-01-28T03:55:31.678148+0000 mgr.y (mgr.14138) 215 : audit [DBG] from='client.34298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi162:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:55:33.068 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:32 smithi100 bash[13549]: audit 2021-01-28T03:55:31.680162+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T03:55:33.069 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:32 smithi100 bash[13549]: cephadm 2021-01-28T03:55:31.682619+0000 mgr.y (mgr.14138) 216 : cephadm [INF] Applying drive group None on host smithi162... 2021-01-28T03:55:33.069 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:32 smithi100 bash[13549]: audit 2021-01-28T03:55:31.683130+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T03:55:33.070 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:32 smithi100 bash[13549]: audit 2021-01-28T03:55:31.684741+0000 mon.a (mon.0) 489 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:55:33.070 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:32 smithi100 bash[13549]: audit 2021-01-28T03:55:31.686829+0000 mon.a (mon.0) 490 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:55:34.004 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:33 smithi162 bash[9856]: cluster 2021-01-28T03:55:33.350530+0000 mgr.y (mgr.14138) 217 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:34.066 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:33 smithi100 bash[9834]: cluster 2021-01-28T03:55:33.350530+0000 mgr.y (mgr.14138) 217 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:34.066 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:33 smithi100 bash[13549]: cluster 2021-01-28T03:55:33.350530+0000 mgr.y (mgr.14138) 217 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:36.754 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:36 smithi162 bash[9856]: cluster 2021-01-28T03:55:35.351095+0000 mgr.y (mgr.14138) 218 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:36.755 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:36 smithi162 bash[9856]: audit 2021-01-28T03:55:35.477654+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T03:55:36.755 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:36 smithi162 bash[9856]: audit 2021-01-28T03:55:35.489703+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T03:55:36.755 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:36 smithi162 bash[9856]: audit 2021-01-28T03:55:35.565932+0000 mon.b (mon.2) 15 : audit [INF] from='client.? 172.21.15.162:0/866620081' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ac18dc9-7208-4f26-b6a6-f9d11c3257be"}]: dispatch 2021-01-28T03:55:36.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:36 smithi162 bash[9856]: audit 2021-01-28T03:55:35.569937+0000 mon.a (mon.0) 493 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ac18dc9-7208-4f26-b6a6-f9d11c3257be"}]: dispatch 2021-01-28T03:55:36.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:36 smithi162 bash[9856]: audit 2021-01-28T03:55:35.578605+0000 mon.a (mon.0) 494 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ac18dc9-7208-4f26-b6a6-f9d11c3257be"}]': finished 2021-01-28T03:55:36.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:36 smithi162 bash[9856]: cluster 2021-01-28T03:55:35.578791+0000 mon.a (mon.0) 495 : cluster [DBG] osdmap e43: 8 total, 7 up, 7 in 2021-01-28T03:55:36.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:36 smithi162 bash[9856]: audit 2021-01-28T03:55:35.579055+0000 mon.a (mon.0) 496 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T03:55:36.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:36 smithi162 bash[9856]: audit 2021-01-28T03:55:36.228151+0000 mon.b (mon.2) 16 : audit [DBG] from='client.? 172.21.15.162:0/2451048995' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T03:55:36.816 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:36 smithi100 bash[9834]: cluster 2021-01-28T03:55:35.351095+0000 mgr.y (mgr.14138) 218 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:36.816 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:36 smithi100 bash[9834]: audit 2021-01-28T03:55:35.477654+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T03:55:36.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:36 smithi100 bash[9834]: audit 2021-01-28T03:55:35.489703+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T03:55:36.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:36 smithi100 bash[9834]: audit 2021-01-28T03:55:35.565932+0000 mon.b (mon.2) 15 : audit [INF] from='client.? 172.21.15.162:0/866620081' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ac18dc9-7208-4f26-b6a6-f9d11c3257be"}]: dispatch 2021-01-28T03:55:36.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:36 smithi100 bash[9834]: audit 2021-01-28T03:55:35.569937+0000 mon.a (mon.0) 493 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ac18dc9-7208-4f26-b6a6-f9d11c3257be"}]: dispatch 2021-01-28T03:55:36.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:36 smithi100 bash[9834]: audit 2021-01-28T03:55:35.578605+0000 mon.a (mon.0) 494 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ac18dc9-7208-4f26-b6a6-f9d11c3257be"}]': finished 2021-01-28T03:55:36.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:36 smithi100 bash[9834]: cluster 2021-01-28T03:55:35.578791+0000 mon.a (mon.0) 495 : cluster [DBG] osdmap e43: 8 total, 7 up, 7 in 2021-01-28T03:55:36.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:36 smithi100 bash[9834]: audit 2021-01-28T03:55:35.579055+0000 mon.a (mon.0) 496 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T03:55:36.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:36 smithi100 bash[9834]: audit 2021-01-28T03:55:36.228151+0000 mon.b (mon.2) 16 : audit [DBG] from='client.? 172.21.15.162:0/2451048995' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T03:55:36.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:36 smithi100 bash[13549]: cluster 2021-01-28T03:55:35.351095+0000 mgr.y (mgr.14138) 218 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:36.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:36 smithi100 bash[13549]: audit 2021-01-28T03:55:35.477654+0000 mon.a (mon.0) 491 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T03:55:36.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:36 smithi100 bash[13549]: audit 2021-01-28T03:55:35.489703+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T03:55:36.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:36 smithi100 bash[13549]: audit 2021-01-28T03:55:35.565932+0000 mon.b (mon.2) 15 : audit [INF] from='client.? 172.21.15.162:0/866620081' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ac18dc9-7208-4f26-b6a6-f9d11c3257be"}]: dispatch 2021-01-28T03:55:36.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:36 smithi100 bash[13549]: audit 2021-01-28T03:55:35.569937+0000 mon.a (mon.0) 493 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ac18dc9-7208-4f26-b6a6-f9d11c3257be"}]: dispatch 2021-01-28T03:55:36.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:36 smithi100 bash[13549]: audit 2021-01-28T03:55:35.578605+0000 mon.a (mon.0) 494 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ac18dc9-7208-4f26-b6a6-f9d11c3257be"}]': finished 2021-01-28T03:55:36.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:36 smithi100 bash[13549]: cluster 2021-01-28T03:55:35.578791+0000 mon.a (mon.0) 495 : cluster [DBG] osdmap e43: 8 total, 7 up, 7 in 2021-01-28T03:55:36.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:36 smithi100 bash[13549]: audit 2021-01-28T03:55:35.579055+0000 mon.a (mon.0) 496 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T03:55:36.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:36 smithi100 bash[13549]: audit 2021-01-28T03:55:36.228151+0000 mon.b (mon.2) 16 : audit [DBG] from='client.? 172.21.15.162:0/2451048995' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T03:55:37.811 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:37 smithi100 bash[9834]: cluster 2021-01-28T03:55:37.351708+0000 mgr.y (mgr.14138) 219 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:37.811 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:37 smithi100 bash[13549]: cluster 2021-01-28T03:55:37.351708+0000 mgr.y (mgr.14138) 219 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:38.004 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:37 smithi162 bash[9856]: cluster 2021-01-28T03:55:37.351708+0000 mgr.y (mgr.14138) 219 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:39.718 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:39 smithi162 bash[9856]: audit 2021-01-28T03:55:39.351943+0000 mon.a (mon.0) 497 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:55:39.816 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:39 smithi100 bash[9834]: audit 2021-01-28T03:55:39.351943+0000 mon.a (mon.0) 497 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:55:39.816 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:39 smithi100 bash[13549]: audit 2021-01-28T03:55:39.351943+0000 mon.a (mon.0) 497 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:55:40.663 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:40 smithi162 bash[9856]: cluster 2021-01-28T03:55:39.352383+0000 mgr.y (mgr.14138) 220 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:40.816 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:40 smithi100 bash[9834]: cluster 2021-01-28T03:55:39.352383+0000 mgr.y (mgr.14138) 220 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:40.817 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:40 smithi100 bash[13549]: cluster 2021-01-28T03:55:39.352383+0000 mgr.y (mgr.14138) 220 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:42.754 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:42 smithi162 bash[9856]: cluster 2021-01-28T03:55:41.352988+0000 mgr.y (mgr.14138) 221 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:42.817 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:42 smithi100 bash[13549]: cluster 2021-01-28T03:55:41.352988+0000 mgr.y (mgr.14138) 221 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:42.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:42 smithi100 bash[9834]: cluster 2021-01-28T03:55:41.352988+0000 mgr.y (mgr.14138) 221 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:44.754 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:44 smithi162 bash[9856]: cluster 2021-01-28T03:55:43.353604+0000 mgr.y (mgr.14138) 222 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:44.755 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:44 smithi162 bash[9856]: audit 2021-01-28T03:55:43.633289+0000 mon.a (mon.0) 498 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-01-28T03:55:44.755 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:44 smithi162 bash[9856]: audit 2021-01-28T03:55:43.635105+0000 mon.a (mon.0) 499 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:55:44.755 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:44 smithi162 bash[9856]: audit 2021-01-28T03:55:43.637192+0000 mon.a (mon.0) 500 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2021-01-28T03:55:44.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:44 smithi100 bash[9834]: cluster 2021-01-28T03:55:43.353604+0000 mgr.y (mgr.14138) 222 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:44.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:44 smithi100 bash[9834]: audit 2021-01-28T03:55:43.633289+0000 mon.a (mon.0) 498 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-01-28T03:55:44.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:44 smithi100 bash[9834]: audit 2021-01-28T03:55:43.635105+0000 mon.a (mon.0) 499 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:55:44.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:44 smithi100 bash[9834]: audit 2021-01-28T03:55:43.637192+0000 mon.a (mon.0) 500 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2021-01-28T03:55:44.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:44 smithi100 bash[13549]: cluster 2021-01-28T03:55:43.353604+0000 mgr.y (mgr.14138) 222 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:44.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:44 smithi100 bash[13549]: audit 2021-01-28T03:55:43.633289+0000 mon.a (mon.0) 498 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-01-28T03:55:44.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:44 smithi100 bash[13549]: audit 2021-01-28T03:55:43.635105+0000 mon.a (mon.0) 499 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:55:44.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:44 smithi100 bash[13549]: audit 2021-01-28T03:55:43.637192+0000 mon.a (mon.0) 500 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2021-01-28T03:55:45.730 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:45 smithi162 bash[9856]: cephadm 2021-01-28T03:55:43.636384+0000 mgr.y (mgr.14138) 223 : cephadm [INF] Deploying daemon osd.7 on smithi162 2021-01-28T03:55:45.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:45 smithi100 bash[9834]: cephadm 2021-01-28T03:55:43.636384+0000 mgr.y (mgr.14138) 223 : cephadm [INF] Deploying daemon osd.7 on smithi162 2021-01-28T03:55:45.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:45 smithi100 bash[13549]: cephadm 2021-01-28T03:55:43.636384+0000 mgr.y (mgr.14138) 223 : cephadm [INF] Deploying daemon osd.7 on smithi162 2021-01-28T03:55:46.281 INFO:teuthology.orchestra.run.smithi162.stdout:Created osd(s) 7 on host 'smithi162' 2021-01-28T03:55:46.281 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:46.286+0000 7f935dffb700 1 -- 172.21.15.162:0/1157806871 <== mgr.14138 v2:172.21.15.100:6800/928846103 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9348000bc0 con 0x7f935405bc30 2021-01-28T03:55:46.283 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:46.286+0000 7f936e09d700 1 -- 172.21.15.162:0/1157806871 >> v2:172.21.15.100:6800/928846103 conn(0x7f935405bc30 msgr2=0x7f935405e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:55:46.283 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:46.286+0000 7f936e09d700 1 --2- 172.21.15.162:0/1157806871 >> v2:172.21.15.100:6800/928846103 conn(0x7f935405bc30 0x7f935405e0f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f9364007690 tx=0x7f9364004d10).stop 2021-01-28T03:55:46.283 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:46.286+0000 7f936e09d700 1 -- 172.21.15.162:0/1157806871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93680f51a0 msgr2=0x7f9368107b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:55:46.283 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:46.286+0000 7f936e09d700 1 --2- 172.21.15.162:0/1157806871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93680f51a0 0x7f9368107b60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f935800eb90 tx=0x7f935800b040).stop 2021-01-28T03:55:46.284 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:46.286+0000 7f936e09d700 1 -- 172.21.15.162:0/1157806871 shutdown_connections 2021-01-28T03:55:46.284 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:46.286+0000 7f936e09d700 1 --2- 172.21.15.162:0/1157806871 >> v2:172.21.15.100:6800/928846103 conn(0x7f935405bc30 0x7f935405e0f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:55:46.284 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:46.286+0000 7f936e09d700 1 --2- 172.21.15.162:0/1157806871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f93680f51a0 0x7f9368107b60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:55:46.284 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:46.286+0000 7f936e09d700 1 --2- 172.21.15.162:0/1157806871 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f93680f6730 0x7f9368108f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:55:46.284 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:46.286+0000 7f936e09d700 1 --2- 172.21.15.162:0/1157806871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93680f5d90 0x7f9368108050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:55:46.285 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:46.286+0000 7f936e09d700 1 -- 172.21.15.162:0/1157806871 >> 172.21.15.162:0/1157806871 conn(0x7f93680ef730 msgr2=0x7f93680f1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:55:46.285 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:46.286+0000 7f936e09d700 1 -- 172.21.15.162:0/1157806871 shutdown_connections 2021-01-28T03:55:46.285 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:55:46.286+0000 7f936e09d700 1 -- 172.21.15.162:0/1157806871 wait complete. 2021-01-28T03:55:46.755 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:46 smithi162 bash[9856]: cluster 2021-01-28T03:55:45.354177+0000 mgr.y (mgr.14138) 224 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:46.804 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:46 smithi162 bash[9856]: audit 2021-01-28T03:55:46.279191+0000 mon.a (mon.0) 501 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:55:46.805 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:46 smithi162 bash[9856]: audit 2021-01-28T03:55:46.286347+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:46.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:46 smithi100 bash[9834]: cluster 2021-01-28T03:55:45.354177+0000 mgr.y (mgr.14138) 224 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:46.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:46 smithi100 bash[9834]: audit 2021-01-28T03:55:46.279191+0000 mon.a (mon.0) 501 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:55:46.819 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:46 smithi100 bash[9834]: audit 2021-01-28T03:55:46.286347+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:46.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:46 smithi100 bash[13549]: cluster 2021-01-28T03:55:45.354177+0000 mgr.y (mgr.14138) 224 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:46.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:46 smithi100 bash[13549]: audit 2021-01-28T03:55:46.279191+0000 mon.a (mon.0) 501 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:55:46.820 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:46 smithi100 bash[13549]: audit 2021-01-28T03:55:46.286347+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:47.621 DEBUG:teuthology.orchestra.run.smithi162:osd.7> sudo journalctl -f -n 0 -u ceph-c217df96-611b-11eb-8f9e-001a4aab830c@osd.7.service 2021-01-28T03:55:47.631 INFO:tasks.cephadm:Adding ceph.rgw.realm.zone.a on smithi100 2021-01-28T03:55:47.631 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- radosgw-admin realm create --rgw-realm realm --default 2021-01-28T03:55:47.667 INFO:journalctl@ceph.osd.7.smithi162.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T03:55:48.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:48 smithi100 bash[9834]: audit 2021-01-28T03:55:47.287011+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:48.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:48 smithi100 bash[9834]: audit 2021-01-28T03:55:47.288802+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:55:48.569 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:48 smithi100 bash[9834]: cluster 2021-01-28T03:55:47.354769+0000 mgr.y (mgr.14138) 225 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:48.570 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:48 smithi100 bash[13549]: audit 2021-01-28T03:55:47.287011+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:48.570 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:48 smithi100 bash[13549]: audit 2021-01-28T03:55:47.288802+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:55:48.570 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:48 smithi100 bash[13549]: cluster 2021-01-28T03:55:47.354769+0000 mgr.y (mgr.14138) 225 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:48.755 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:48 smithi162 bash[9856]: audit 2021-01-28T03:55:47.287011+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:48.755 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:48 smithi162 bash[9856]: audit 2021-01-28T03:55:47.288802+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T03:55:48.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:48 smithi162 bash[9856]: cluster 2021-01-28T03:55:47.354769+0000 mgr.y (mgr.14138) 225 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:49.255 INFO:journalctl@ceph.osd.7.smithi162.stdout:Jan 28 03:55:48 smithi162 bash[19805]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-01-28T03:55:49.256 INFO:journalctl@ceph.osd.7.smithi162.stdout:Jan 28 03:55:48 smithi162 bash[19805]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-7 --no-mon-config 2021-01-28T03:55:49.256 INFO:journalctl@ceph.osd.7.smithi162.stdout:Jan 28 03:55:48 smithi162 bash[19805]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7/block 2021-01-28T03:55:49.256 INFO:journalctl@ceph.osd.7.smithi162.stdout:Jan 28 03:55:48 smithi162 bash[19805]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-7/block 2021-01-28T03:55:49.256 INFO:journalctl@ceph.osd.7.smithi162.stdout:Jan 28 03:55:48 smithi162 bash[19805]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2021-01-28T03:55:49.257 INFO:journalctl@ceph.osd.7.smithi162.stdout:Jan 28 03:55:48 smithi162 bash[19805]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-01-28T03:55:49.257 INFO:journalctl@ceph.osd.7.smithi162.stdout:Jan 28 03:55:48 smithi162 bash[19805]: --> ceph-volume lvm activate successful for osd ID: 7 2021-01-28T03:55:50.505 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:50 smithi162 bash[9856]: cluster 2021-01-28T03:55:49.355396+0000 mgr.y (mgr.14138) 226 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:50.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:50 smithi100 bash[9834]: cluster 2021-01-28T03:55:49.355396+0000 mgr.y (mgr.14138) 226 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:50.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:50 smithi100 bash[13549]: cluster 2021-01-28T03:55:49.355396+0000 mgr.y (mgr.14138) 226 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:51.738 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:51 smithi162 bash[9856]: audit 2021-01-28T03:55:50.480445+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:51.739 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:51 smithi162 bash[9856]: cluster 2021-01-28T03:55:51.356011+0000 mgr.y (mgr.14138) 227 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:51.739 INFO:journalctl@ceph.osd.7.smithi162.stdout:Jan 28 03:55:51 smithi162 bash[20113]: debug 2021-01-28T03:55:51.721+0000 7f0f18818700 20 -- 172.21.15.162:0/964353272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622aa3a9000 msgr2=0x5622aa315e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2021-01-28T03:55:51.739 INFO:journalctl@ceph.osd.7.smithi162.stdout:Jan 28 03:55:51 smithi162 bash[20113]: debug 2021-01-28T03:55:51.721+0000 7f0f18818700 20 -- 172.21.15.162:0/964353272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622aa3a9000 msgr2=0x5622aa315e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=96 2021-01-28T03:55:51.740 INFO:journalctl@ceph.osd.7.smithi162.stdout:Jan 28 03:55:51 smithi162 bash[20113]: debug 2021-01-28T03:55:51.721+0000 7f0f18818700 20 --2- 172.21.15.162:0/964353272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622aa3a9000 0x5622aa315e00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x5622aa325e60 tx=0x5622aa35ad80).handle_read_frame_preamble_main r=0 2021-01-28T03:55:51.740 INFO:journalctl@ceph.osd.7.smithi162.stdout:Jan 28 03:55:51 smithi162 bash[20113]: debug 2021-01-28T03:55:51.721+0000 7f0f18818700 20 --2- 172.21.15.162:0/964353272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622aa3a9000 0x5622aa315e00 secure :-1 s=THROTTLE_MESSAGE pgs=42 cs=0 l=1 rev1=1 rx=0x5622aa325e60 tx=0x5622aa35ad80).throttle_message 2021-01-28T03:55:51.740 INFO:journalctl@ceph.osd.7.smithi162.stdout:Jan 28 03:55:51 smithi162 bash[20113]: debug 2021-01-28T03:55:51.721+0000 7f0f18818700 20 --2- 172.21.15.162:0/964353272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622aa3a9000 0x5622aa315e00 secure :-1 s=THROTTLE_BYTES pgs=42 cs=0 l=1 rev1=1 rx=0x5622aa325e60 tx=0x5622aa35ad80).throttle_bytes 2021-01-28T03:55:51.740 INFO:journalctl@ceph.osd.7.smithi162.stdout:Jan 28 03:55:51 smithi162 bash[20113]: debug 2021-01-28T03:55:51.721+0000 7f0f18818700 20 --2- 172.21.15.162:0/964353272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622aa3a9000 0x5622aa315e00 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=42 cs=0 l=1 rev1=1 rx=0x5622aa325e60 tx=0x5622aa35ad80).throttle_dispatch_queue 2021-01-28T03:55:51.741 INFO:journalctl@ceph.osd.7.smithi162.stdout:Jan 28 03:55:51 smithi162 bash[20113]: debug 2021-01-28T03:55:51.721+0000 7f0f18818700 20 --2- 172.21.15.162:0/964353272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622aa3a9000 0x5622aa315e00 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rev1=1 rx=0x5622aa325e60 tx=0x5622aa35ad80).read_frame_segment seg_idx=0 2021-01-28T03:55:51.741 INFO:journalctl@ceph.osd.7.smithi162.stdout:Jan 28 03:55:51 smithi162 bash[20113]: debug 2021-01-28T03:55:51.721+0000 7f0f18818700 20 --2- 172.21.15.162:0/964353272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622aa3a9000 0x5622aa315e00 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rev1=1 rx=0x5622aa325e60 tx=0x5622aa35ad80).read_frame_segment seg_idx=1 2021-01-28T03:55:51.741 INFO:journalctl@ceph.osd.7.smithi162.stdout:Jan 28 03:55:51 smithi162 bash[20113]: debug 2021-01-28T03:55:51.721+0000 7f0f18818700 20 -- 172.21.15.162:0/964353272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622aa3a9000 msgr2=0x5622aa315e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2021-01-28T03:55:51.741 INFO:journalctl@ceph.osd.7.smithi162.stdout:Jan 28 03:55:51 smithi162 bash[20113]: debug 2021-01-28T03:55:51.721+0000 7f0f18818700 20 --2- 172.21.15.162:0/964353272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622aa3a9000 0x5622aa315e00 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rev1=1 rx=0x5622aa325e60 tx=0x5622aa35ad80).handle_read_frame_segment r=0 2021-01-28T03:55:51.741 INFO:journalctl@ceph.osd.7.smithi162.stdout:Jan 28 03:55:51 smithi162 bash[20113]: debug 2021-01-28T03:55:51.721+0000 7f0f18818700 20 -- 172.21.15.162:0/964353272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622aa3a9000 msgr2=0x5622aa315e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2021-01-28T03:55:51.742 INFO:journalctl@ceph.osd.7.smithi162.stdout:Jan 28 03:55:51 smithi162 bash[20113]: debug 2021-01-28T03:55:51.721+0000 7f0f18818700 20 --2- 172.21.15.162:0/964353272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622aa3a9000 0x5622aa315e00 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rev1=1 rx=0x5622aa325e60 tx=0x5622aa35ad80).handle_read_frame_epilogue_main r=0 2021-01-28T03:55:51.742 INFO:journalctl@ceph.osd.7.smithi162.stdout:Jan 28 03:55:51 smithi162 bash[20113]: debug 2021-01-28T03:55:51.721+0000 7f0f18818700 10 --2- 172.21.15.162:0/964353272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622aa3a9000 0x5622aa315e00 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rev1=1 rx=0x5622aa325e60 tx=0x5622aa35ad80).handle_read_frame_dispatch tag=17 2021-01-28T03:55:51.742 INFO:journalctl@ceph.osd.7.smithi162.stdout:Jan 28 03:55:51 smithi162 bash[20113]: debug 2021-01-28T03:55:51.721+0000 7f0f18818700 20 --2- 172.21.15.162:0/964353272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622aa3a9000 0x5622aa315e00 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rev1=1 rx=0x5622aa325e60 tx=0x5622aa35ad80).handle_message 2021-01-28T03:55:51.742 INFO:journalctl@ceph.osd.7.smithi162.stdout:Jan 28 03:55:51 smithi162 bash[20113]: debug 2021-01-28T03:55:51.721+0000 7f0f18818700 5 --2- 172.21.15.162:0/964353272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622aa3a9000 0x5622aa315e00 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rev1=1 rx=0x5622aa325e60 tx=0x5622aa35ad80).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.2 off 0 2021-01-28T03:55:51.743 INFO:journalctl@ceph.osd.7.smithi162.stdout:Jan 28 03:55:51 smithi162 bash[20113]: debug 2021-01-28T03:55:51.721+0000 7f0f18818700 5 --2- 172.21.15.162:0/964353272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622aa3a9000 0x5622aa315e00 secure :-1 s=READ_MESSAGE_COMPLETE pgs=42 cs=0 l=1 rev1=1 rx=0x5622aa325e60 tx=0x5622aa35ad80).handle_message received message m=0x5622aa32a4e0 seq=4 from=mon.2 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-28T03:55:51.743 INFO:journalctl@ceph.osd.7.smithi162.stdout:Jan 28 03:55:51 smithi162 bash[20113]: debug 2021-01-28T03:55:51.721+0000 7f0f18818700 20 -- 172.21.15.162:0/964353272 queue 0x5622aa32a4e0 prio 196 2021-01-28T03:55:51.743 INFO:journalctl@ceph.osd.7.smithi162.stdout:Jan 28 03:55:51 smithi162 bash[20113]: debug 2021-01-28T03:55:51.721+0000 7f0f18818700 20 --2- 172.21.15.162:0/964353272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622aa3a9000 0x5622aa315e00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x5622aa325e60 tx=0x5622aa35ad80).read_frame 2021-01-28T03:55:51.743 INFO:journalctl@ceph.osd.7.smithi162.stdout:Jan 28 03:55:51 smithi162 bash[20113]: debug 2021-01-28T03:55:51.721+0000 7f0f18818700 20 -- 172.21.15.162:0/964353272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5622aa3a9000 msgr2=0x5622aa315e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-28T03:55:51.744 INFO:journalctl@ceph.osd.7.smithi162.stdout:Jan 28 03:55:51 smithi162 bash[20113]: debug 2021-01-28T03:55:51.721+0000 7f0f18017700 1 -- 172.21.15.162:0/964353272 <== mon.2 v2:172.21.15.162:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5622aa32a4e0 con 0x5622aa3a9000 2021-01-28T03:55:51.744 INFO:journalctl@ceph.osd.7.smithi162.stdout:Jan 28 03:55:51 smithi162 bash[20113]: debug 2021-01-28T03:55:51.721+0000 7f0f18017700 10 -- 172.21.15.162:0/964353272 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-28T03:55:51.744 INFO:journalctl@ceph.osd.7.smithi162.stdout:Jan 28 03:55:51 smithi162 bash[20113]: debug 2021-01-28T03:55:51.721+0000 7f0f18017700 20 -- 172.21.15.162:0/964353272 done calling dispatch on 0x5622aa32a4e0 2021-01-28T03:55:51.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:51 smithi100 bash[9834]: audit 2021-01-28T03:55:50.480445+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:51.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:51 smithi100 bash[9834]: cluster 2021-01-28T03:55:51.356011+0000 mgr.y (mgr.14138) 227 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:51.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:51 smithi100 bash[13549]: audit 2021-01-28T03:55:50.480445+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:51.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:51 smithi100 bash[13549]: cluster 2021-01-28T03:55:51.356011+0000 mgr.y (mgr.14138) 227 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:52.707 INFO:journalctl@ceph.osd.7.smithi162.stdout:Jan 28 03:55:52 smithi162 bash[20113]: debug 2021-01-28T03:55:52.265+0000 7f0f1faa2200 -1 Falling back to public interface 2021-01-28T03:55:54.756 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:54 smithi162 bash[9856]: cluster 2021-01-28T03:55:53.356591+0000 mgr.y (mgr.14138) 228 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:54.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:54 smithi100 bash[9834]: cluster 2021-01-28T03:55:53.356591+0000 mgr.y (mgr.14138) 228 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:54.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:54 smithi100 bash[13549]: cluster 2021-01-28T03:55:53.356591+0000 mgr.y (mgr.14138) 228 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:55.554 INFO:journalctl@ceph.osd.7.smithi162.stdout:Jan 28 03:55:55 smithi162 bash[20113]: debug 2021-01-28T03:55:55.289+0000 7f0f1faa2200 -1 osd.7 0 log_to_monitors {default=true} 2021-01-28T03:55:55.555 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:55 smithi162 bash[9856]: cluster 2021-01-28T03:55:54.522063+0000 mon.a (mon.0) 506 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2021-01-28T03:55:55.555 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:55 smithi162 bash[9856]: audit 2021-01-28T03:55:54.522955+0000 mon.a (mon.0) 507 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T03:55:55.579 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2021-01-28T03:55:55.579 INFO:teuthology.orchestra.run.smithi162.stdout: "id": "4bc7a76b-1253-4744-a404-e07a1623017d", 2021-01-28T03:55:55.580 INFO:teuthology.orchestra.run.smithi162.stdout: "name": "realm", 2021-01-28T03:55:55.580 INFO:teuthology.orchestra.run.smithi162.stdout: "current_period": "bd796b50-0f37-453c-b93d-01563f86a979", 2021-01-28T03:55:55.580 INFO:teuthology.orchestra.run.smithi162.stdout: "epoch": 1 2021-01-28T03:55:55.580 INFO:teuthology.orchestra.run.smithi162.stdout:} 2021-01-28T03:55:55.820 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:55 smithi100 bash[9834]: cluster 2021-01-28T03:55:54.522063+0000 mon.a (mon.0) 506 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2021-01-28T03:55:55.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:55 smithi100 bash[9834]: audit 2021-01-28T03:55:54.522955+0000 mon.a (mon.0) 507 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T03:55:55.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:55 smithi100 bash[9834]: audit 2021-01-28T03:55:54.524785+0000 mon.b (mon.2) 17 : audit [INF] from='client.? 172.21.15.162:0/3811994067' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-01-28T03:55:55.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:55 smithi100 bash[9834]: audit 2021-01-28T03:55:54.529936+0000 mon.a (mon.0) 508 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-01-28T03:55:55.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:55 smithi100 bash[9834]: audit 2021-01-28T03:55:55.301595+0000 mon.b (mon.2) 18 : audit [INF] from='osd.7 v2:172.21.15.162:6812/2319408968' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-01-28T03:55:55.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:55 smithi100 bash[9834]: audit 2021-01-28T03:55:55.303090+0000 mon.a (mon.0) 509 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-01-28T03:55:55.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:55 smithi100 bash[9834]: cluster 2021-01-28T03:55:55.357238+0000 mgr.y (mgr.14138) 229 : cluster [DBG] pgmap v194: 33 pgs: 32 unknown, 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:55.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:55 smithi100 bash[13549]: cluster 2021-01-28T03:55:54.522063+0000 mon.a (mon.0) 506 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2021-01-28T03:55:55.823 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:55 smithi100 bash[13549]: audit 2021-01-28T03:55:54.522955+0000 mon.a (mon.0) 507 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T03:55:55.823 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:55 smithi100 bash[13549]: audit 2021-01-28T03:55:54.524785+0000 mon.b (mon.2) 17 : audit [INF] from='client.? 172.21.15.162:0/3811994067' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-01-28T03:55:55.823 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:55 smithi100 bash[13549]: audit 2021-01-28T03:55:54.529936+0000 mon.a (mon.0) 508 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-01-28T03:55:55.823 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:55 smithi100 bash[13549]: audit 2021-01-28T03:55:55.301595+0000 mon.b (mon.2) 18 : audit [INF] from='osd.7 v2:172.21.15.162:6812/2319408968' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-01-28T03:55:55.824 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:55 smithi100 bash[13549]: audit 2021-01-28T03:55:55.303090+0000 mon.a (mon.0) 509 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-01-28T03:55:55.824 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:55 smithi100 bash[13549]: cluster 2021-01-28T03:55:55.357238+0000 mgr.y (mgr.14138) 229 : cluster [DBG] pgmap v194: 33 pgs: 32 unknown, 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:56.006 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:55 smithi162 bash[9856]: audit 2021-01-28T03:55:54.524785+0000 mon.b (mon.2) 17 : audit [INF] from='client.? 172.21.15.162:0/3811994067' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-01-28T03:55:56.007 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:55 smithi162 bash[9856]: audit 2021-01-28T03:55:54.529936+0000 mon.a (mon.0) 508 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-01-28T03:55:56.007 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:55 smithi162 bash[9856]: audit 2021-01-28T03:55:55.301595+0000 mon.b (mon.2) 18 : audit [INF] from='osd.7 v2:172.21.15.162:6812/2319408968' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-01-28T03:55:56.007 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:55 smithi162 bash[9856]: audit 2021-01-28T03:55:55.303090+0000 mon.a (mon.0) 509 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-01-28T03:55:56.007 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:55 smithi162 bash[9856]: cluster 2021-01-28T03:55:55.357238+0000 mgr.y (mgr.14138) 229 : cluster [DBG] pgmap v194: 33 pgs: 32 unknown, 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T03:55:56.742 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- radosgw-admin zonegroup create --rgw-zonegroup=default --master --default 2021-01-28T03:55:56.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:56 smithi100 bash[13549]: audit 2021-01-28T03:55:55.531033+0000 mon.a (mon.0) 510 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-01-28T03:55:56.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:56 smithi100 bash[13549]: audit 2021-01-28T03:55:55.531271+0000 mon.a (mon.0) 511 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-01-28T03:55:56.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:56 smithi100 bash[13549]: cluster 2021-01-28T03:55:55.531388+0000 mon.a (mon.0) 512 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2021-01-28T03:55:56.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:56 smithi100 bash[13549]: audit 2021-01-28T03:55:55.535196+0000 mon.b (mon.2) 19 : audit [INF] from='osd.7 v2:172.21.15.162:6812/2319408968' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2021-01-28T03:55:56.823 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:56 smithi100 bash[13549]: audit 2021-01-28T03:55:55.536806+0000 mon.a (mon.0) 513 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T03:55:56.823 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:56 smithi100 bash[13549]: audit 2021-01-28T03:55:55.539659+0000 mon.a (mon.0) 514 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2021-01-28T03:55:56.824 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:56 smithi100 bash[9834]: audit 2021-01-28T03:55:55.531033+0000 mon.a (mon.0) 510 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-01-28T03:55:56.824 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:56 smithi100 bash[9834]: audit 2021-01-28T03:55:55.531271+0000 mon.a (mon.0) 511 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-01-28T03:55:56.824 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:56 smithi100 bash[9834]: cluster 2021-01-28T03:55:55.531388+0000 mon.a (mon.0) 512 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2021-01-28T03:55:56.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:56 smithi100 bash[9834]: audit 2021-01-28T03:55:55.535196+0000 mon.b (mon.2) 19 : audit [INF] from='osd.7 v2:172.21.15.162:6812/2319408968' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2021-01-28T03:55:56.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:56 smithi100 bash[9834]: audit 2021-01-28T03:55:55.536806+0000 mon.a (mon.0) 513 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T03:55:56.826 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:56 smithi100 bash[9834]: audit 2021-01-28T03:55:55.539659+0000 mon.a (mon.0) 514 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2021-01-28T03:55:56.934 INFO:journalctl@ceph.osd.7.smithi162.stdout:Jan 28 03:55:56 smithi162 bash[20113]: debug 2021-01-28T03:55:56.540+0000 7f0f16013700 -1 osd.7 0 waiting for initial osdmap 2021-01-28T03:55:56.934 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:56 smithi162 bash[9856]: audit 2021-01-28T03:55:55.531033+0000 mon.a (mon.0) 510 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-01-28T03:55:56.935 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:56 smithi162 bash[9856]: audit 2021-01-28T03:55:55.531271+0000 mon.a (mon.0) 511 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-01-28T03:55:56.935 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:56 smithi162 bash[9856]: cluster 2021-01-28T03:55:55.531388+0000 mon.a (mon.0) 512 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2021-01-28T03:55:56.935 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:56 smithi162 bash[9856]: audit 2021-01-28T03:55:55.535196+0000 mon.b (mon.2) 19 : audit [INF] from='osd.7 v2:172.21.15.162:6812/2319408968' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2021-01-28T03:55:56.935 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:56 smithi162 bash[9856]: audit 2021-01-28T03:55:55.536806+0000 mon.a (mon.0) 513 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T03:55:56.935 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:56 smithi162 bash[9856]: audit 2021-01-28T03:55:55.539659+0000 mon.a (mon.0) 514 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]: dispatch 2021-01-28T03:55:57.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:57 smithi100 bash[9834]: audit 2021-01-28T03:55:56.535870+0000 mon.a (mon.0) 515 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2021-01-28T03:55:57.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:57 smithi100 bash[9834]: cluster 2021-01-28T03:55:56.536238+0000 mon.a (mon.0) 516 : cluster [DBG] osdmap e46: 8 total, 7 up, 7 in 2021-01-28T03:55:57.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:57 smithi100 bash[9834]: audit 2021-01-28T03:55:56.537762+0000 mon.a (mon.0) 517 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T03:55:57.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:57 smithi100 bash[9834]: audit 2021-01-28T03:55:56.547887+0000 mon.a (mon.0) 518 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T03:55:57.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:57 smithi100 bash[9834]: audit 2021-01-28T03:55:56.697543+0000 mon.a (mon.0) 519 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:55:57.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:57 smithi100 bash[9834]: audit 2021-01-28T03:55:57.069975+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:57.824 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:57 smithi100 bash[9834]: audit 2021-01-28T03:55:57.077550+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:57.824 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:57 smithi100 bash[9834]: cephadm 2021-01-28T03:55:57.079157+0000 mgr.y (mgr.14138) 230 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:55:57.824 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:57 smithi100 bash[9834]: audit 2021-01-28T03:55:57.090490+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:57.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:57 smithi100 bash[9834]: cephadm 2021-01-28T03:55:57.092204+0000 mgr.y (mgr.14138) 231 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:55:57.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:57 smithi100 bash[9834]: cluster 2021-01-28T03:55:57.357925+0000 mgr.y (mgr.14138) 232 : cluster [DBG] pgmap v197: 33 pgs: 3 peering, 20 unknown, 10 active+clean; 293 B data, 36 MiB used, 626 GiB / 626 GiB avail; 3.6 KiB/s wr, 4 op/s 2021-01-28T03:55:57.826 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:57 smithi100 bash[13549]: audit 2021-01-28T03:55:56.535870+0000 mon.a (mon.0) 515 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2021-01-28T03:55:57.826 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:57 smithi100 bash[13549]: cluster 2021-01-28T03:55:56.536238+0000 mon.a (mon.0) 516 : cluster [DBG] osdmap e46: 8 total, 7 up, 7 in 2021-01-28T03:55:57.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:57 smithi100 bash[13549]: audit 2021-01-28T03:55:56.537762+0000 mon.a (mon.0) 517 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T03:55:57.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:57 smithi100 bash[13549]: audit 2021-01-28T03:55:56.547887+0000 mon.a (mon.0) 518 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T03:55:57.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:57 smithi100 bash[13549]: audit 2021-01-28T03:55:56.697543+0000 mon.a (mon.0) 519 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:55:57.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:57 smithi100 bash[13549]: audit 2021-01-28T03:55:57.069975+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:57.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:57 smithi100 bash[13549]: audit 2021-01-28T03:55:57.077550+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:57.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:57 smithi100 bash[13549]: cephadm 2021-01-28T03:55:57.079157+0000 mgr.y (mgr.14138) 230 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:55:57.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:57 smithi100 bash[13549]: audit 2021-01-28T03:55:57.090490+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:57.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:57 smithi100 bash[13549]: cephadm 2021-01-28T03:55:57.092204+0000 mgr.y (mgr.14138) 231 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:55:57.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:57 smithi100 bash[13549]: cluster 2021-01-28T03:55:57.357925+0000 mgr.y (mgr.14138) 232 : cluster [DBG] pgmap v197: 33 pgs: 3 peering, 20 unknown, 10 active+clean; 293 B data, 36 MiB used, 626 GiB / 626 GiB avail; 3.6 KiB/s wr, 4 op/s 2021-01-28T03:55:57.941 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:57 smithi162 bash[9856]: audit 2021-01-28T03:55:56.535870+0000 mon.a (mon.0) 515 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi162", "root=default"]}]': finished 2021-01-28T03:55:57.941 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:57 smithi162 bash[9856]: cluster 2021-01-28T03:55:56.536238+0000 mon.a (mon.0) 516 : cluster [DBG] osdmap e46: 8 total, 7 up, 7 in 2021-01-28T03:55:57.942 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:57 smithi162 bash[9856]: audit 2021-01-28T03:55:56.537762+0000 mon.a (mon.0) 517 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T03:55:57.942 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:57 smithi162 bash[9856]: audit 2021-01-28T03:55:56.547887+0000 mon.a (mon.0) 518 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T03:55:57.942 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:57 smithi162 bash[9856]: audit 2021-01-28T03:55:56.697543+0000 mon.a (mon.0) 519 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:55:57.942 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:57 smithi162 bash[9856]: audit 2021-01-28T03:55:57.069975+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:57.943 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:57 smithi162 bash[9856]: audit 2021-01-28T03:55:57.077550+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:57.943 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:57 smithi162 bash[9856]: cephadm 2021-01-28T03:55:57.079157+0000 mgr.y (mgr.14138) 230 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:55:57.943 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:57 smithi162 bash[9856]: audit 2021-01-28T03:55:57.090490+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:55:57.943 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:57 smithi162 bash[9856]: cephadm 2021-01-28T03:55:57.092204+0000 mgr.y (mgr.14138) 231 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:55:57.944 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:57 smithi162 bash[9856]: cluster 2021-01-28T03:55:57.357925+0000 mgr.y (mgr.14138) 232 : cluster [DBG] pgmap v197: 33 pgs: 3 peering, 20 unknown, 10 active+clean; 293 B data, 36 MiB used, 626 GiB / 626 GiB avail; 3.6 KiB/s wr, 4 op/s 2021-01-28T03:55:58.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:58 smithi100 bash[9834]: cluster 2021-01-28T03:55:56.253307+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T03:55:58.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:58 smithi100 bash[9834]: cluster 2021-01-28T03:55:56.253529+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T03:55:58.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:58 smithi100 bash[9834]: cluster 2021-01-28T03:55:57.551070+0000 mon.a (mon.0) 523 : cluster [INF] osd.7 v2:172.21.15.162:6812/2319408968 boot 2021-01-28T03:55:58.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:58 smithi100 bash[9834]: cluster 2021-01-28T03:55:57.551701+0000 mon.a (mon.0) 524 : cluster [DBG] osdmap e47: 8 total, 8 up, 8 in 2021-01-28T03:55:58.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:58 smithi100 bash[9834]: audit 2021-01-28T03:55:57.552974+0000 mon.a (mon.0) 525 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T03:55:58.823 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:58 smithi100 bash[9834]: cluster 2021-01-28T03:55:58.555016+0000 mon.a (mon.0) 526 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2021-01-28T03:55:58.823 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:58 smithi100 bash[13549]: cluster 2021-01-28T03:55:56.253307+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T03:55:58.824 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:58 smithi100 bash[13549]: cluster 2021-01-28T03:55:56.253529+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T03:55:58.824 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:58 smithi100 bash[13549]: cluster 2021-01-28T03:55:57.551070+0000 mon.a (mon.0) 523 : cluster [INF] osd.7 v2:172.21.15.162:6812/2319408968 boot 2021-01-28T03:55:58.824 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:58 smithi100 bash[13549]: cluster 2021-01-28T03:55:57.551701+0000 mon.a (mon.0) 524 : cluster [DBG] osdmap e47: 8 total, 8 up, 8 in 2021-01-28T03:55:58.825 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:58 smithi100 bash[13549]: audit 2021-01-28T03:55:57.552974+0000 mon.a (mon.0) 525 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T03:55:58.825 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:58 smithi100 bash[13549]: cluster 2021-01-28T03:55:58.555016+0000 mon.a (mon.0) 526 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2021-01-28T03:55:59.007 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:58 smithi162 bash[9856]: cluster 2021-01-28T03:55:56.253307+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T03:55:59.007 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:58 smithi162 bash[9856]: cluster 2021-01-28T03:55:56.253529+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T03:55:59.007 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:58 smithi162 bash[9856]: cluster 2021-01-28T03:55:57.551070+0000 mon.a (mon.0) 523 : cluster [INF] osd.7 v2:172.21.15.162:6812/2319408968 boot 2021-01-28T03:55:59.008 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:58 smithi162 bash[9856]: cluster 2021-01-28T03:55:57.551701+0000 mon.a (mon.0) 524 : cluster [DBG] osdmap e47: 8 total, 8 up, 8 in 2021-01-28T03:55:59.008 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:58 smithi162 bash[9856]: audit 2021-01-28T03:55:57.552974+0000 mon.a (mon.0) 525 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T03:55:59.008 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:58 smithi162 bash[9856]: cluster 2021-01-28T03:55:58.555016+0000 mon.a (mon.0) 526 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2021-01-28T03:55:59.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:55:59 smithi100 bash[9834]: cluster 2021-01-28T03:55:59.358554+0000 mgr.y (mgr.14138) 233 : cluster [DBG] pgmap v200: 33 pgs: 13 peering, 3 unknown, 17 active+clean; 398 B data, 42 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s wr, 2 op/s 2021-01-28T03:55:59.821 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:55:59 smithi100 bash[13549]: cluster 2021-01-28T03:55:59.358554+0000 mgr.y (mgr.14138) 233 : cluster [DBG] pgmap v200: 33 pgs: 13 peering, 3 unknown, 17 active+clean; 398 B data, 42 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s wr, 2 op/s 2021-01-28T03:55:59.822 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:55:59 smithi162 bash[9856]: cluster 2021-01-28T03:55:59.358554+0000 mgr.y (mgr.14138) 233 : cluster [DBG] pgmap v200: 33 pgs: 13 peering, 3 unknown, 17 active+clean; 398 B data, 42 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s wr, 2 op/s 2021-01-28T03:55:59.967 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2021-01-28T03:55:59.968 INFO:teuthology.orchestra.run.smithi162.stdout: "id": "29ff9088-b567-4547-a48e-10ad7af437c6", 2021-01-28T03:55:59.968 INFO:teuthology.orchestra.run.smithi162.stdout: "name": "default", 2021-01-28T03:55:59.968 INFO:teuthology.orchestra.run.smithi162.stdout: "api_name": "default", 2021-01-28T03:55:59.968 INFO:teuthology.orchestra.run.smithi162.stdout: "is_master": "true", 2021-01-28T03:55:59.969 INFO:teuthology.orchestra.run.smithi162.stdout: "endpoints": [], 2021-01-28T03:55:59.969 INFO:teuthology.orchestra.run.smithi162.stdout: "hostnames": [], 2021-01-28T03:55:59.969 INFO:teuthology.orchestra.run.smithi162.stdout: "hostnames_s3website": [], 2021-01-28T03:55:59.969 INFO:teuthology.orchestra.run.smithi162.stdout: "master_zone": "", 2021-01-28T03:55:59.969 INFO:teuthology.orchestra.run.smithi162.stdout: "zones": [], 2021-01-28T03:55:59.970 INFO:teuthology.orchestra.run.smithi162.stdout: "placement_targets": [], 2021-01-28T03:55:59.970 INFO:teuthology.orchestra.run.smithi162.stdout: "default_placement": "", 2021-01-28T03:55:59.970 INFO:teuthology.orchestra.run.smithi162.stdout: "realm_id": "4bc7a76b-1253-4744-a404-e07a1623017d", 2021-01-28T03:55:59.970 INFO:teuthology.orchestra.run.smithi162.stdout: "sync_policy": { 2021-01-28T03:55:59.971 INFO:teuthology.orchestra.run.smithi162.stdout: "groups": [] 2021-01-28T03:55:59.971 INFO:teuthology.orchestra.run.smithi162.stdout: } 2021-01-28T03:55:59.971 INFO:teuthology.orchestra.run.smithi162.stdout:} 2021-01-28T03:56:00.720 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- radosgw-admin zone create --rgw-zonegroup=default --rgw-zone zone --master --default 2021-01-28T03:56:02.507 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:02 smithi162 bash[9856]: cluster 2021-01-28T03:56:01.359240+0000 mgr.y (mgr.14138) 234 : cluster [DBG] pgmap v201: 33 pgs: 13 peering, 20 active+clean; 454 B data, 42 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s wr, 1 op/s; 11 B/s, 0 objects/s recovering 2021-01-28T03:56:02.821 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:02 smithi100 bash[9834]: cluster 2021-01-28T03:56:01.359240+0000 mgr.y (mgr.14138) 234 : cluster [DBG] pgmap v201: 33 pgs: 13 peering, 20 active+clean; 454 B data, 42 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s wr, 1 op/s; 11 B/s, 0 objects/s recovering 2021-01-28T03:56:02.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:02 smithi100 bash[13549]: cluster 2021-01-28T03:56:01.359240+0000 mgr.y (mgr.14138) 234 : cluster [DBG] pgmap v201: 33 pgs: 13 peering, 20 active+clean; 454 B data, 42 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s wr, 1 op/s; 11 B/s, 0 objects/s recovering 2021-01-28T03:56:03.800 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2021-01-28T03:56:03.800 INFO:teuthology.orchestra.run.smithi162.stdout: "id": "e53076dc-85a9-4192-87da-143df67788de", 2021-01-28T03:56:03.801 INFO:teuthology.orchestra.run.smithi162.stdout: "name": "zone", 2021-01-28T03:56:03.801 INFO:teuthology.orchestra.run.smithi162.stdout: "domain_root": "zone.rgw.meta:root", 2021-01-28T03:56:03.801 INFO:teuthology.orchestra.run.smithi162.stdout: "control_pool": "zone.rgw.control", 2021-01-28T03:56:03.801 INFO:teuthology.orchestra.run.smithi162.stdout: "gc_pool": "zone.rgw.log:gc", 2021-01-28T03:56:03.801 INFO:teuthology.orchestra.run.smithi162.stdout: "lc_pool": "zone.rgw.log:lc", 2021-01-28T03:56:03.802 INFO:teuthology.orchestra.run.smithi162.stdout: "log_pool": "zone.rgw.log", 2021-01-28T03:56:03.802 INFO:teuthology.orchestra.run.smithi162.stdout: "intent_log_pool": "zone.rgw.log:intent", 2021-01-28T03:56:03.802 INFO:teuthology.orchestra.run.smithi162.stdout: "usage_log_pool": "zone.rgw.log:usage", 2021-01-28T03:56:03.802 INFO:teuthology.orchestra.run.smithi162.stdout: "roles_pool": "zone.rgw.meta:roles", 2021-01-28T03:56:03.803 INFO:teuthology.orchestra.run.smithi162.stdout: "reshard_pool": "zone.rgw.log:reshard", 2021-01-28T03:56:03.803 INFO:teuthology.orchestra.run.smithi162.stdout: "user_keys_pool": "zone.rgw.meta:users.keys", 2021-01-28T03:56:03.803 INFO:teuthology.orchestra.run.smithi162.stdout: "user_email_pool": "zone.rgw.meta:users.email", 2021-01-28T03:56:03.803 INFO:teuthology.orchestra.run.smithi162.stdout: "user_swift_pool": "zone.rgw.meta:users.swift", 2021-01-28T03:56:03.803 INFO:teuthology.orchestra.run.smithi162.stdout: "user_uid_pool": "zone.rgw.meta:users.uid", 2021-01-28T03:56:03.804 INFO:teuthology.orchestra.run.smithi162.stdout: "otp_pool": "zone.rgw.otp", 2021-01-28T03:56:03.804 INFO:teuthology.orchestra.run.smithi162.stdout: "system_key": { 2021-01-28T03:56:03.804 INFO:teuthology.orchestra.run.smithi162.stdout: "access_key": "", 2021-01-28T03:56:03.804 INFO:teuthology.orchestra.run.smithi162.stdout: "secret_key": "" 2021-01-28T03:56:03.804 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2021-01-28T03:56:03.805 INFO:teuthology.orchestra.run.smithi162.stdout: "placement_pools": [ 2021-01-28T03:56:03.805 INFO:teuthology.orchestra.run.smithi162.stdout: { 2021-01-28T03:56:03.805 INFO:teuthology.orchestra.run.smithi162.stdout: "key": "default-placement", 2021-01-28T03:56:03.805 INFO:teuthology.orchestra.run.smithi162.stdout: "val": { 2021-01-28T03:56:03.806 INFO:teuthology.orchestra.run.smithi162.stdout: "index_pool": "zone.rgw.buckets.index", 2021-01-28T03:56:03.806 INFO:teuthology.orchestra.run.smithi162.stdout: "storage_classes": { 2021-01-28T03:56:03.806 INFO:teuthology.orchestra.run.smithi162.stdout: "STANDARD": { 2021-01-28T03:56:03.806 INFO:teuthology.orchestra.run.smithi162.stdout: "data_pool": "zone.rgw.buckets.data" 2021-01-28T03:56:03.806 INFO:teuthology.orchestra.run.smithi162.stdout: } 2021-01-28T03:56:03.807 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2021-01-28T03:56:03.807 INFO:teuthology.orchestra.run.smithi162.stdout: "data_extra_pool": "zone.rgw.buckets.non-ec", 2021-01-28T03:56:03.807 INFO:teuthology.orchestra.run.smithi162.stdout: "index_type": 0 2021-01-28T03:56:03.807 INFO:teuthology.orchestra.run.smithi162.stdout: } 2021-01-28T03:56:03.807 INFO:teuthology.orchestra.run.smithi162.stdout: } 2021-01-28T03:56:03.808 INFO:teuthology.orchestra.run.smithi162.stdout: ], 2021-01-28T03:56:03.808 INFO:teuthology.orchestra.run.smithi162.stdout: "realm_id": "4bc7a76b-1253-4744-a404-e07a1623017d", 2021-01-28T03:56:03.808 INFO:teuthology.orchestra.run.smithi162.stdout: "notif_pool": "zone.rgw.log:notif" 2021-01-28T03:56:03.808 INFO:teuthology.orchestra.run.smithi162.stdout:} 2021-01-28T03:56:04.503 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph orch apply rgw realm zone --placement '1;smithi100=realm.zone.a' 2021-01-28T03:56:04.706 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:04 smithi162 bash[9856]: cluster 2021-01-28T03:56:03.359988+0000 mgr.y (mgr.14138) 235 : cluster [DBG] pgmap v202: 33 pgs: 8 peering, 25 active+clean; 546 B data, 42 MiB used, 715 GiB / 715 GiB avail; 149 B/s rd, 1.3 KiB/s wr, 1 op/s; 51 B/s, 0 objects/s recovering 2021-01-28T03:56:04.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:04 smithi100 bash[9834]: cluster 2021-01-28T03:56:03.359988+0000 mgr.y (mgr.14138) 235 : cluster [DBG] pgmap v202: 33 pgs: 8 peering, 25 active+clean; 546 B data, 42 MiB used, 715 GiB / 715 GiB avail; 149 B/s rd, 1.3 KiB/s wr, 1 op/s; 51 B/s, 0 objects/s recovering 2021-01-28T03:56:04.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:04 smithi100 bash[13549]: cluster 2021-01-28T03:56:03.359988+0000 mgr.y (mgr.14138) 235 : cluster [DBG] pgmap v202: 33 pgs: 8 peering, 25 active+clean; 546 B data, 42 MiB used, 715 GiB / 715 GiB avail; 149 B/s rd, 1.3 KiB/s wr, 1 op/s; 51 B/s, 0 objects/s recovering 2021-01-28T03:56:06.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:06 smithi162 bash[9856]: cluster 2021-01-28T03:56:05.360700+0000 mgr.y (mgr.14138) 236 : cluster [DBG] pgmap v203: 33 pgs: 33 active+clean; 780 B data, 43 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 1023 B/s wr, 1 op/s; 52 B/s, 0 objects/s recovering 2021-01-28T03:56:06.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:06 smithi100 bash[9834]: cluster 2021-01-28T03:56:05.360700+0000 mgr.y (mgr.14138) 236 : cluster [DBG] pgmap v203: 33 pgs: 33 active+clean; 780 B data, 43 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 1023 B/s wr, 1 op/s; 52 B/s, 0 objects/s recovering 2021-01-28T03:56:06.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:06 smithi100 bash[13549]: cluster 2021-01-28T03:56:05.360700+0000 mgr.y (mgr.14138) 236 : cluster [DBG] pgmap v203: 33 pgs: 33 active+clean; 780 B data, 43 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 1023 B/s wr, 1 op/s; 52 B/s, 0 objects/s recovering 2021-01-28T03:56:07.698 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.699+0000 7fde2bfff700 1 -- 172.21.15.162:0/1658924334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde2c0f8a00 msgr2=0x7fde2c0fae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:07.698 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.699+0000 7fde2bfff700 1 --2- 172.21.15.162:0/1658924334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde2c0f8a00 0x7fde2c0fae50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fde14004e00 tx=0x7fde14009b30).stop 2021-01-28T03:56:07.699 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.699+0000 7fde2bfff700 1 -- 172.21.15.162:0/1658924334 shutdown_connections 2021-01-28T03:56:07.699 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.699+0000 7fde2bfff700 1 --2- 172.21.15.162:0/1658924334 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde2c0fb490 0x7fde2c0fd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:07.699 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.699+0000 7fde2bfff700 1 --2- 172.21.15.162:0/1658924334 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fde2c05f7f0 0x7fde2c0f8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:07.699 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.699+0000 7fde2bfff700 1 --2- 172.21.15.162:0/1658924334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde2c0f8a00 0x7fde2c0fae50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:07.700 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.699+0000 7fde2bfff700 1 -- 172.21.15.162:0/1658924334 >> 172.21.15.162:0/1658924334 conn(0x7fde2c0effa0 msgr2=0x7fde2c0f23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:56:07.700 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.699+0000 7fde2bfff700 1 -- 172.21.15.162:0/1658924334 shutdown_connections 2021-01-28T03:56:07.700 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.699+0000 7fde2bfff700 1 -- 172.21.15.162:0/1658924334 wait complete. 2021-01-28T03:56:07.701 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.703+0000 7fde2bfff700 1 Processor -- start 2021-01-28T03:56:07.702 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.703+0000 7fde2bfff700 1 -- start start 2021-01-28T03:56:07.702 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.703+0000 7fde2bfff700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fde2c05f7f0 0x7fde2c105a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:56:07.702 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.703+0000 7fde2bfff700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde2c0f8a00 0x7fde2c105f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:56:07.702 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.703+0000 7fde2bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde2c0fb490 0x7fde2c106df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:56:07.703 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.703+0000 7fde2bfff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde2c107320 con 0x7fde2c0fb490 2021-01-28T03:56:07.703 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.703+0000 7fde2bfff700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde2c107490 con 0x7fde2c0f8a00 2021-01-28T03:56:07.703 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.703+0000 7fde2bfff700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde2c107650 con 0x7fde2c05f7f0 2021-01-28T03:56:07.703 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.703+0000 7fde2a7fc700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde2c0f8a00 0x7fde2c105f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:56:07.704 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.703+0000 7fde2a7fc700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde2c0f8a00 0x7fde2c105f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:45298/0 (socket says 172.21.15.162:45298) 2021-01-28T03:56:07.704 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.703+0000 7fde2affd700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fde2c05f7f0 0x7fde2c105a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:56:07.704 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.703+0000 7fde2a7fc700 1 -- 172.21.15.162:0/2519707719 learned_addr learned my addr 172.21.15.162:0/2519707719 (peer_addr_for_me v2:172.21.15.162:0/0) 2021-01-28T03:56:07.705 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.703+0000 7fde2b7fe700 1 --2- 172.21.15.162:0/2519707719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde2c0fb490 0x7fde2c106df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:56:07.705 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.703+0000 7fde2a7fc700 1 -- 172.21.15.162:0/2519707719 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fde2c05f7f0 msgr2=0x7fde2c105a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:07.705 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.703+0000 7fde2a7fc700 1 --2- 172.21.15.162:0/2519707719 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fde2c05f7f0 0x7fde2c105a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:07.705 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.703+0000 7fde2a7fc700 1 -- 172.21.15.162:0/2519707719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde2c0fb490 msgr2=0x7fde2c106df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:07.706 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.703+0000 7fde2a7fc700 1 --2- 172.21.15.162:0/2519707719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde2c0fb490 0x7fde2c106df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:07.706 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.703+0000 7fde2a7fc700 1 -- 172.21.15.162:0/2519707719 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde2c107810 con 0x7fde2c0f8a00 2021-01-28T03:56:07.706 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.703+0000 7fde2a7fc700 1 --2- 172.21.15.162:0/2519707719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde2c0f8a00 0x7fde2c105f00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fde14000e50 tx=0x7fde14009b30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:56:07.706 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.703+0000 7fde237fe700 1 -- 172.21.15.162:0/2519707719 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1400e030 con 0x7fde2c0f8a00 2021-01-28T03:56:07.706 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.703+0000 7fde237fe700 1 -- 172.21.15.162:0/2519707719 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fde14004160 con 0x7fde2c0f8a00 2021-01-28T03:56:07.707 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.703+0000 7fde2bfff700 1 -- 172.21.15.162:0/2519707719 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde2c107a60 con 0x7fde2c0f8a00 2021-01-28T03:56:07.707 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.703+0000 7fde237fe700 1 -- 172.21.15.162:0/2519707719 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde14018070 con 0x7fde2c0f8a00 2021-01-28T03:56:07.707 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.703+0000 7fde2bfff700 1 -- 172.21.15.162:0/2519707719 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde2c10e200 con 0x7fde2c0f8a00 2021-01-28T03:56:07.708 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.707+0000 7fde2bfff700 1 -- 172.21.15.162:0/2519707719 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde2c0f3b90 con 0x7fde2c0f8a00 2021-01-28T03:56:07.708 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.707+0000 7fde237fe700 1 -- 172.21.15.162:0/2519707719 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 71316+0+0 (secure 0 0 0) 0x7fde1401d420 con 0x7fde2c0f8a00 2021-01-28T03:56:07.708 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.707+0000 7fde237fe700 1 --2- 172.21.15.162:0/2519707719 >> v2:172.21.15.100:6800/928846103 conn(0x7fde1805bc30 0x7fde1805e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:56:07.709 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.707+0000 7fde237fe700 1 -- 172.21.15.162:0/2519707719 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4397+0+0 (secure 0 0 0) 0x7fde14076e00 con 0x7fde2c0f8a00 2021-01-28T03:56:07.709 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.707+0000 7fde2affd700 1 --2- 172.21.15.162:0/2519707719 >> v2:172.21.15.100:6800/928846103 conn(0x7fde1805bc30 0x7fde1805e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:56:07.709 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.707+0000 7fde2affd700 1 --2- 172.21.15.162:0/2519707719 >> v2:172.21.15.100:6800/928846103 conn(0x7fde1805bc30 0x7fde1805e0f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fde1c007db0 tx=0x7fde1c009040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:56:07.710 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.711+0000 7fde237fe700 1 -- 172.21.15.162:0/2519707719 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fde1404a220 con 0x7fde2c0f8a00 2021-01-28T03:56:07.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:07 smithi162 bash[9856]: cluster 2021-01-28T03:56:07.361570+0000 mgr.y (mgr.14138) 237 : cluster [DBG] pgmap v204: 33 pgs: 33 active+clean; 1.6 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 312 B/s rd, 1.0 KiB/s wr, 1 op/s; 42 B/s, 0 objects/s recovering 2021-01-28T03:56:07.822 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:07 smithi100 bash[9834]: cluster 2021-01-28T03:56:07.361570+0000 mgr.y (mgr.14138) 237 : cluster [DBG] pgmap v204: 33 pgs: 33 active+clean; 1.6 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 312 B/s rd, 1.0 KiB/s wr, 1 op/s; 42 B/s, 0 objects/s recovering 2021-01-28T03:56:07.822 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:07 smithi100 bash[13549]: cluster 2021-01-28T03:56:07.361570+0000 mgr.y (mgr.14138) 237 : cluster [DBG] pgmap v204: 33 pgs: 33 active+clean; 1.6 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 312 B/s rd, 1.0 KiB/s wr, 1 op/s; 42 B/s, 0 objects/s recovering 2021-01-28T03:56:07.899 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.903+0000 7fde2bfff700 1 -- 172.21.15.162:0/2519707719 --> v2:172.21.15.100:6800/928846103 -- mgr_command(tid 0: {"prefix": "orch apply rgw", "realm_name": "realm", "zone_name": "zone", "placement": "1;smithi100=realm.zone.a", "target": ["mon-mgr", ""]}) v1 -- 0x7fde2c1005f0 con 0x7fde1805bc30 2021-01-28T03:56:07.911 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.915+0000 7fde237fe700 1 -- 172.21.15.162:0/2519707719 <== mgr.14138 v2:172.21.15.100:6800/928846103 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+35 (secure 0 0 0) 0x7fde2c1005f0 con 0x7fde1805bc30 2021-01-28T03:56:07.912 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled rgw.realm.zone update... 2021-01-28T03:56:07.913 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.915+0000 7fde2bfff700 1 -- 172.21.15.162:0/2519707719 >> v2:172.21.15.100:6800/928846103 conn(0x7fde1805bc30 msgr2=0x7fde1805e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:07.913 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.915+0000 7fde2bfff700 1 --2- 172.21.15.162:0/2519707719 >> v2:172.21.15.100:6800/928846103 conn(0x7fde1805bc30 0x7fde1805e0f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fde1c007db0 tx=0x7fde1c009040).stop 2021-01-28T03:56:07.914 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.915+0000 7fde2bfff700 1 -- 172.21.15.162:0/2519707719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde2c0f8a00 msgr2=0x7fde2c105f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:07.914 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.915+0000 7fde2bfff700 1 --2- 172.21.15.162:0/2519707719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde2c0f8a00 0x7fde2c105f00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fde14000e50 tx=0x7fde14009b30).stop 2021-01-28T03:56:07.914 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.915+0000 7fde2bfff700 1 -- 172.21.15.162:0/2519707719 shutdown_connections 2021-01-28T03:56:07.915 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.915+0000 7fde2bfff700 1 --2- 172.21.15.162:0/2519707719 >> v2:172.21.15.100:6800/928846103 conn(0x7fde1805bc30 0x7fde1805e0f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:07.915 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.915+0000 7fde2bfff700 1 --2- 172.21.15.162:0/2519707719 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde2c0fb490 0x7fde2c106df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:07.915 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.915+0000 7fde2bfff700 1 --2- 172.21.15.162:0/2519707719 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fde2c05f7f0 0x7fde2c105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:07.915 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.915+0000 7fde2bfff700 1 --2- 172.21.15.162:0/2519707719 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde2c0f8a00 0x7fde2c105f00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:07.915 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.915+0000 7fde2bfff700 1 -- 172.21.15.162:0/2519707719 >> 172.21.15.162:0/2519707719 conn(0x7fde2c0effa0 msgr2=0x7fde2c0fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:56:07.916 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.915+0000 7fde2bfff700 1 -- 172.21.15.162:0/2519707719 shutdown_connections 2021-01-28T03:56:07.916 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:07.915+0000 7fde2bfff700 1 -- 172.21.15.162:0/2519707719 wait complete. 2021-01-28T03:56:08.618 DEBUG:teuthology.orchestra.run.smithi100:rgw.realm.zone.a> sudo journalctl -f -n 0 -u ceph-c217df96-611b-11eb-8f9e-001a4aab830c@rgw.realm.zone.a.service 2021-01-28T03:56:08.622 INFO:tasks.cephadm:Adding ceph.iscsi.iscsi.a on smithi162 2021-01-28T03:56:08.623 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph osd pool create iscsi 3 3 replicated 2021-01-28T03:56:08.660 INFO:journalctl@ceph.rgw.realm.zone.a.smithi100.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T03:56:09.258 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:08 smithi162 bash[9856]: audit 2021-01-28T03:56:07.905660+0000 mgr.y (mgr.14138) 238 : audit [DBG] from='client.34370 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "realm", "zone_name": "zone", "placement": "1;smithi100=realm.zone.a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:56:09.259 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:08 smithi162 bash[9856]: cephadm 2021-01-28T03:56:07.907554+0000 mgr.y (mgr.14138) 239 : cephadm [INF] Saving service rgw.realm.zone spec with placement smithi100=realm.zone.a;count:1 2021-01-28T03:56:09.259 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:08 smithi162 bash[9856]: audit 2021-01-28T03:56:07.914103+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:09.259 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:08 smithi162 bash[9856]: cephadm 2021-01-28T03:56:07.916749+0000 mgr.y (mgr.14138) 240 : cephadm [INF] refreshing smithi162 facts 2021-01-28T03:56:09.259 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:08 smithi162 bash[9856]: audit 2021-01-28T03:56:08.332178+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:09.260 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:08 smithi162 bash[9856]: cephadm 2021-01-28T03:56:08.333795+0000 mgr.y (mgr.14138) 241 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:56:09.260 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:08 smithi162 bash[9856]: cephadm 2021-01-28T03:56:08.335241+0000 mgr.y (mgr.14138) 242 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi100', network='', name='realm.zone.a')] 2021-01-28T03:56:09.260 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:08 smithi162 bash[9856]: audit 2021-01-28T03:56:08.336656+0000 mon.a (mon.0) 529 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-01-28T03:56:09.260 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:08 smithi162 bash[9856]: audit 2021-01-28T03:56:08.338305+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-01-28T03:56:09.261 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:08 smithi162 bash[9856]: audit 2021-01-28T03:56:08.343425+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2021-01-28T03:56:09.261 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:08 smithi162 bash[9856]: audit 2021-01-28T03:56:08.600532+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:09.261 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:08 smithi162 bash[9856]: audit 2021-01-28T03:56:08.608799+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:09.261 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:08 smithi162 bash[9856]: audit 2021-01-28T03:56:08.616423+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:09.261 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:08 smithi162 bash[9856]: audit 2021-01-28T03:56:08.622930+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:09.262 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:08 smithi162 bash[9856]: audit 2021-01-28T03:56:08.624296+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-01-28T03:56:09.262 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:08 smithi162 bash[9856]: audit 2021-01-28T03:56:08.625852+0000 mon.a (mon.0) 537 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:56:09.262 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:08 smithi162 bash[9856]: audit 2021-01-28T03:56:08.627603+0000 mon.a (mon.0) 538 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.realm.zone.a", "key": "container_image"}]: dispatch 2021-01-28T03:56:09.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:08 smithi100 bash[9834]: audit 2021-01-28T03:56:07.905660+0000 mgr.y (mgr.14138) 238 : audit [DBG] from='client.34370 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "realm", "zone_name": "zone", "placement": "1;smithi100=realm.zone.a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:56:09.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:08 smithi100 bash[9834]: cephadm 2021-01-28T03:56:07.907554+0000 mgr.y (mgr.14138) 239 : cephadm [INF] Saving service rgw.realm.zone spec with placement smithi100=realm.zone.a;count:1 2021-01-28T03:56:09.323 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:08 smithi100 bash[9834]: audit 2021-01-28T03:56:07.914103+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:09.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:08 smithi100 bash[9834]: cephadm 2021-01-28T03:56:07.916749+0000 mgr.y (mgr.14138) 240 : cephadm [INF] refreshing smithi162 facts 2021-01-28T03:56:09.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:08 smithi100 bash[9834]: audit 2021-01-28T03:56:08.332178+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:09.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:08 smithi100 bash[9834]: cephadm 2021-01-28T03:56:08.333795+0000 mgr.y (mgr.14138) 241 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:56:09.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:08 smithi100 bash[9834]: cephadm 2021-01-28T03:56:08.335241+0000 mgr.y (mgr.14138) 242 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi100', network='', name='realm.zone.a')] 2021-01-28T03:56:09.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:08 smithi100 bash[9834]: audit 2021-01-28T03:56:08.336656+0000 mon.a (mon.0) 529 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-01-28T03:56:09.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:08 smithi100 bash[9834]: audit 2021-01-28T03:56:08.338305+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-01-28T03:56:09.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:08 smithi100 bash[9834]: audit 2021-01-28T03:56:08.343425+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2021-01-28T03:56:09.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:08 smithi100 bash[9834]: audit 2021-01-28T03:56:08.600532+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:09.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:08 smithi100 bash[9834]: audit 2021-01-28T03:56:08.608799+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:09.326 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:08 smithi100 bash[9834]: audit 2021-01-28T03:56:08.616423+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:09.326 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:08 smithi100 bash[9834]: audit 2021-01-28T03:56:08.622930+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:09.326 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:08 smithi100 bash[9834]: audit 2021-01-28T03:56:08.624296+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-01-28T03:56:09.326 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:08 smithi100 bash[9834]: audit 2021-01-28T03:56:08.625852+0000 mon.a (mon.0) 537 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:56:09.326 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:08 smithi100 bash[9834]: audit 2021-01-28T03:56:08.627603+0000 mon.a (mon.0) 538 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.realm.zone.a", "key": "container_image"}]: dispatch 2021-01-28T03:56:09.327 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:08 smithi100 bash[13549]: audit 2021-01-28T03:56:07.905660+0000 mgr.y (mgr.14138) 238 : audit [DBG] from='client.34370 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "realm", "zone_name": "zone", "placement": "1;smithi100=realm.zone.a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:56:09.327 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:08 smithi100 bash[13549]: cephadm 2021-01-28T03:56:07.907554+0000 mgr.y (mgr.14138) 239 : cephadm [INF] Saving service rgw.realm.zone spec with placement smithi100=realm.zone.a;count:1 2021-01-28T03:56:09.327 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:08 smithi100 bash[13549]: audit 2021-01-28T03:56:07.914103+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:09.327 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:08 smithi100 bash[13549]: cephadm 2021-01-28T03:56:07.916749+0000 mgr.y (mgr.14138) 240 : cephadm [INF] refreshing smithi162 facts 2021-01-28T03:56:09.328 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:08 smithi100 bash[13549]: audit 2021-01-28T03:56:08.332178+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:09.328 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:08 smithi100 bash[13549]: cephadm 2021-01-28T03:56:08.333795+0000 mgr.y (mgr.14138) 241 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:56:09.328 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:08 smithi100 bash[13549]: cephadm 2021-01-28T03:56:08.335241+0000 mgr.y (mgr.14138) 242 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi100', network='', name='realm.zone.a')] 2021-01-28T03:56:09.328 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:08 smithi100 bash[13549]: audit 2021-01-28T03:56:08.336656+0000 mon.a (mon.0) 529 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-01-28T03:56:09.328 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:08 smithi100 bash[13549]: audit 2021-01-28T03:56:08.338305+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-01-28T03:56:09.329 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:08 smithi100 bash[13549]: audit 2021-01-28T03:56:08.343425+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2021-01-28T03:56:09.329 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:08 smithi100 bash[13549]: audit 2021-01-28T03:56:08.600532+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:09.329 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:08 smithi100 bash[13549]: audit 2021-01-28T03:56:08.608799+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:09.329 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:08 smithi100 bash[13549]: audit 2021-01-28T03:56:08.616423+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:09.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:08 smithi100 bash[13549]: audit 2021-01-28T03:56:08.622930+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:09.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:08 smithi100 bash[13549]: audit 2021-01-28T03:56:08.624296+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-01-28T03:56:09.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:08 smithi100 bash[13549]: audit 2021-01-28T03:56:08.625852+0000 mon.a (mon.0) 537 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:56:09.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:08 smithi100 bash[13549]: audit 2021-01-28T03:56:08.627603+0000 mon.a (mon.0) 538 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.realm.zone.a", "key": "container_image"}]: dispatch 2021-01-28T03:56:10.093 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:09 smithi162 bash[9856]: cephadm 2021-01-28T03:56:08.617673+0000 mgr.y (mgr.14138) 243 : cephadm [INF] Saving service rgw.realm.zone spec with placement smithi100=realm.zone.a;count:1 2021-01-28T03:56:10.094 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:09 smithi162 bash[9856]: cephadm 2021-01-28T03:56:08.626937+0000 mgr.y (mgr.14138) 244 : cephadm [INF] Deploying daemon rgw.realm.zone.a on smithi100 2021-01-28T03:56:10.094 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:09 smithi162 bash[9856]: cluster 2021-01-28T03:56:09.362510+0000 mgr.y (mgr.14138) 245 : cluster [DBG] pgmap v205: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 473 B/s rd, 1.0 KiB/s wr, 1 op/s; 38 B/s, 0 objects/s recovering 2021-01-28T03:56:10.251 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:09 smithi100 bash[9834]: cephadm 2021-01-28T03:56:08.617673+0000 mgr.y (mgr.14138) 243 : cephadm [INF] Saving service rgw.realm.zone spec with placement smithi100=realm.zone.a;count:1 2021-01-28T03:56:10.251 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:09 smithi100 bash[9834]: cephadm 2021-01-28T03:56:08.626937+0000 mgr.y (mgr.14138) 244 : cephadm [INF] Deploying daemon rgw.realm.zone.a on smithi100 2021-01-28T03:56:10.251 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:09 smithi100 bash[9834]: cluster 2021-01-28T03:56:09.362510+0000 mgr.y (mgr.14138) 245 : cluster [DBG] pgmap v205: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 473 B/s rd, 1.0 KiB/s wr, 1 op/s; 38 B/s, 0 objects/s recovering 2021-01-28T03:56:10.252 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:09 smithi100 bash[13549]: cephadm 2021-01-28T03:56:08.617673+0000 mgr.y (mgr.14138) 243 : cephadm [INF] Saving service rgw.realm.zone spec with placement smithi100=realm.zone.a;count:1 2021-01-28T03:56:10.252 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:09 smithi100 bash[13549]: cephadm 2021-01-28T03:56:08.626937+0000 mgr.y (mgr.14138) 244 : cephadm [INF] Deploying daemon rgw.realm.zone.a on smithi100 2021-01-28T03:56:10.252 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:09 smithi100 bash[13549]: cluster 2021-01-28T03:56:09.362510+0000 mgr.y (mgr.14138) 245 : cluster [DBG] pgmap v205: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 473 B/s rd, 1.0 KiB/s wr, 1 op/s; 38 B/s, 0 objects/s recovering 2021-01-28T03:56:11.681 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.682+0000 7feddbfff700 1 -- 172.21.15.162:0/191697600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feddc05f770 msgr2=0x7feddc0fa900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:11.682 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.682+0000 7feddbfff700 1 --2- 172.21.15.162:0/191697600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feddc05f770 0x7feddc0fa900 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fedcc009dc0 tx=0x7fedcc004d10).stop 2021-01-28T03:56:11.682 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.682+0000 7feddbfff700 1 -- 172.21.15.162:0/191697600 shutdown_connections 2021-01-28T03:56:11.682 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.682+0000 7feddbfff700 1 --2- 172.21.15.162:0/191697600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feddc05f770 0x7feddc0fa900 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:11.682 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.682+0000 7feddbfff700 1 --2- 172.21.15.162:0/191697600 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feddc0fd6d0 0x7feddc0ffb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:11.683 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.682+0000 7feddbfff700 1 --2- 172.21.15.162:0/191697600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feddc0fadf0 0x7feddc0fd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:11.683 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.682+0000 7feddbfff700 1 -- 172.21.15.162:0/191697600 >> 172.21.15.162:0/191697600 conn(0x7feddc0effe0 msgr2=0x7feddc0f2400 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:56:11.683 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.682+0000 7feddbfff700 1 -- 172.21.15.162:0/191697600 shutdown_connections 2021-01-28T03:56:11.683 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.682+0000 7feddbfff700 1 -- 172.21.15.162:0/191697600 wait complete. 2021-01-28T03:56:11.685 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.682+0000 7feddbfff700 1 Processor -- start 2021-01-28T03:56:11.685 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.682+0000 7feddbfff700 1 -- start start 2021-01-28T03:56:11.686 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.682+0000 7feddbfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feddc05f770 0x7feddc107d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:56:11.686 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.682+0000 7feddbfff700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feddc0fadf0 0x7feddc108270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:56:11.686 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.686+0000 7feddbfff700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feddc0fd6d0 0x7feddc1090b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:56:11.686 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.686+0000 7feddbfff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feddc109670 con 0x7feddc05f770 2021-01-28T03:56:11.686 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.686+0000 7feddbfff700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feddc1097e0 con 0x7feddc0fadf0 2021-01-28T03:56:11.687 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.686+0000 7feddbfff700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feddc1099a0 con 0x7feddc0fd6d0 2021-01-28T03:56:11.687 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.686+0000 7fedda7fc700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feddc0fadf0 0x7feddc108270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:56:11.687 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.686+0000 7feddaffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feddc05f770 0x7feddc107d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:56:11.687 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.686+0000 7feddaffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feddc05f770 0x7feddc107d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.162:50706/0 (socket says 172.21.15.162:50706) 2021-01-28T03:56:11.688 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.686+0000 7fedda7fc700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feddc0fadf0 0x7feddc108270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:45312/0 (socket says 172.21.15.162:45312) 2021-01-28T03:56:11.688 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.686+0000 7feddaffd700 1 -- 172.21.15.162:0/72988659 learned_addr learned my addr 172.21.15.162:0/72988659 (peer_addr_for_me v2:172.21.15.162:0/0) 2021-01-28T03:56:11.688 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.686+0000 7feddb7fe700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feddc0fd6d0 0x7feddc1090b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:56:11.688 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.686+0000 7feddaffd700 1 -- 172.21.15.162:0/72988659 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feddc0fd6d0 msgr2=0x7feddc1090b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:11.688 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.686+0000 7feddaffd700 1 --2- 172.21.15.162:0/72988659 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feddc0fd6d0 0x7feddc1090b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:11.689 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.686+0000 7feddaffd700 1 -- 172.21.15.162:0/72988659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feddc0fadf0 msgr2=0x7feddc108270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:11.689 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.686+0000 7feddaffd700 1 --2- 172.21.15.162:0/72988659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feddc0fadf0 0x7feddc108270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:11.689 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.686+0000 7feddaffd700 1 -- 172.21.15.162:0/72988659 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feddc109b60 con 0x7feddc05f770 2021-01-28T03:56:11.689 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.686+0000 7feddb7fe700 1 --2- 172.21.15.162:0/72988659 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feddc0fd6d0 0x7feddc1090b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-28T03:56:11.689 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.686+0000 7fedda7fc700 1 --2- 172.21.15.162:0/72988659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feddc0fadf0 0x7feddc108270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-28T03:56:11.690 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.686+0000 7feddaffd700 1 --2- 172.21.15.162:0/72988659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feddc05f770 0x7feddc107d80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fedcc004b70 tx=0x7fedcc004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:56:11.690 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.686+0000 7fedd37fe700 1 -- 172.21.15.162:0/72988659 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc00e030 con 0x7feddc05f770 2021-01-28T03:56:11.690 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.686+0000 7fedd37fe700 1 -- 172.21.15.162:0/72988659 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fedcc0044e0 con 0x7feddc05f770 2021-01-28T03:56:11.690 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.686+0000 7fedd37fe700 1 -- 172.21.15.162:0/72988659 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc018070 con 0x7feddc05f770 2021-01-28T03:56:11.691 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.686+0000 7feddbfff700 1 -- 172.21.15.162:0/72988659 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feddc109db0 con 0x7feddc05f770 2021-01-28T03:56:11.691 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.686+0000 7feddbfff700 1 -- 172.21.15.162:0/72988659 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feddc1104c0 con 0x7feddc05f770 2021-01-28T03:56:11.692 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.686+0000 7feddbfff700 1 -- 172.21.15.162:0/72988659 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feddc05d580 con 0x7feddc05f770 2021-01-28T03:56:11.692 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.690+0000 7fedd37fe700 1 -- 172.21.15.162:0/72988659 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 14) v1 ==== 71316+0+0 (secure 0 0 0) 0x7fedcc013630 con 0x7feddc05f770 2021-01-28T03:56:11.692 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.690+0000 7fedd37fe700 1 --2- 172.21.15.162:0/72988659 >> v2:172.21.15.100:6800/928846103 conn(0x7fedc805bc30 0x7fedc805e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:56:11.692 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.690+0000 7fedd37fe700 1 -- 172.21.15.162:0/72988659 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4397+0+0 (secure 0 0 0) 0x7fedcc077340 con 0x7feddc05f770 2021-01-28T03:56:11.693 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.690+0000 7fedda7fc700 1 --2- 172.21.15.162:0/72988659 >> v2:172.21.15.100:6800/928846103 conn(0x7fedc805bc30 0x7fedc805e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:56:11.693 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.690+0000 7fedda7fc700 1 --2- 172.21.15.162:0/72988659 >> v2:172.21.15.100:6800/928846103 conn(0x7fedc805bc30 0x7fedc805e0f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7feddc107b10 tx=0x7fedc400b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:56:11.693 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.694+0000 7fedd37fe700 1 -- 172.21.15.162:0/72988659 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7feddc05d580 con 0x7feddc05f770 2021-01-28T03:56:11.758 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:11 smithi162 bash[9856]: audit 2021-01-28T03:56:10.491112+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:11.759 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:11 smithi162 bash[9856]: cluster 2021-01-28T03:56:11.363202+0000 mgr.y (mgr.14138) 246 : cluster [DBG] pgmap v206: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 938 B/s wr, 1 op/s; 34 B/s, 0 objects/s recovering 2021-01-28T03:56:11.766 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:11 smithi100 bash[9834]: audit 2021-01-28T03:56:10.491112+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:11.767 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:11 smithi100 bash[9834]: cluster 2021-01-28T03:56:11.363202+0000 mgr.y (mgr.14138) 246 : cluster [DBG] pgmap v206: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 938 B/s wr, 1 op/s; 34 B/s, 0 objects/s recovering 2021-01-28T03:56:11.767 INFO:journalctl@ceph.rgw.realm.zone.a.smithi100.stdout:Jan 28 03:56:11 smithi100 systemd[1]: Started Ceph rgw.realm.zone.a for c217df96-611b-11eb-8f9e-001a4aab830c. 2021-01-28T03:56:11.767 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:11 smithi100 bash[13549]: audit 2021-01-28T03:56:10.491112+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:11.767 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:11 smithi100 bash[13549]: cluster 2021-01-28T03:56:11.363202+0000 mgr.y (mgr.14138) 246 : cluster [DBG] pgmap v206: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 938 B/s wr, 1 op/s; 34 B/s, 0 objects/s recovering 2021-01-28T03:56:11.856 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:11.858+0000 7feddbfff700 1 -- 172.21.15.162:0/72988659 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} v 0) v1 -- 0x7feddc05d580 con 0x7feddc05f770 2021-01-28T03:56:12.718 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:12.718+0000 7fedd37fe700 1 -- 172.21.15.162:0/72988659 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]=0 pool 'iscsi' created v49) v1 ==== 154+0+0 (secure 0 0 0) 0x7feddc05d580 con 0x7feddc05f770 2021-01-28T03:56:12.722 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:12.722+0000 7feddbfff700 1 -- 172.21.15.162:0/72988659 >> v2:172.21.15.100:6800/928846103 conn(0x7fedc805bc30 msgr2=0x7fedc805e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:12.723 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:12.722+0000 7feddbfff700 1 --2- 172.21.15.162:0/72988659 >> v2:172.21.15.100:6800/928846103 conn(0x7fedc805bc30 0x7fedc805e0f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7feddc107b10 tx=0x7fedc400b040).stop 2021-01-28T03:56:12.723 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:12.722+0000 7feddbfff700 1 -- 172.21.15.162:0/72988659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feddc05f770 msgr2=0x7feddc107d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:12.723 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:12.722+0000 7feddbfff700 1 --2- 172.21.15.162:0/72988659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feddc05f770 0x7feddc107d80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fedcc004b70 tx=0x7fedcc004d10).stop 2021-01-28T03:56:12.724 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:12.722+0000 7feddbfff700 1 -- 172.21.15.162:0/72988659 shutdown_connections 2021-01-28T03:56:12.724 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:12.722+0000 7feddbfff700 1 --2- 172.21.15.162:0/72988659 >> v2:172.21.15.100:6800/928846103 conn(0x7fedc805bc30 0x7fedc805e0f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:12.725 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:12.722+0000 7feddbfff700 1 --2- 172.21.15.162:0/72988659 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7feddc0fd6d0 0x7feddc1090b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:12.725 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:12.722+0000 7feddbfff700 1 --2- 172.21.15.162:0/72988659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feddc05f770 0x7feddc107d80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:12.725 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:12.722+0000 7feddbfff700 1 --2- 172.21.15.162:0/72988659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feddc0fadf0 0x7feddc108270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:12.725 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:12.722+0000 7feddbfff700 1 -- 172.21.15.162:0/72988659 >> 172.21.15.162:0/72988659 conn(0x7feddc0effe0 msgr2=0x7feddc0fcab0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:56:12.726 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:12.722+0000 7feddbfff700 1 -- 172.21.15.162:0/72988659 shutdown_connections 2021-01-28T03:56:12.726 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:12.726+0000 7feddbfff700 1 -- 172.21.15.162:0/72988659 wait complete. 2021-01-28T03:56:12.726 INFO:teuthology.orchestra.run.smithi162.stderr:pool 'iscsi' created 2021-01-28T03:56:13.008 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:12 smithi162 bash[9856]: audit 2021-01-28T03:56:11.705761+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:13.009 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:12 smithi162 bash[9856]: audit 2021-01-28T03:56:11.708983+0000 mon.a (mon.0) 541 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:56:13.009 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:12 smithi162 bash[9856]: audit 2021-01-28T03:56:11.860681+0000 mon.a (mon.0) 542 : audit [INF] from='client.? 172.21.15.162:0/72988659' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-01-28T03:56:13.017 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:12 smithi100 bash[13549]: audit 2021-01-28T03:56:11.705761+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:13.017 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:12 smithi100 bash[13549]: audit 2021-01-28T03:56:11.708983+0000 mon.a (mon.0) 541 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:56:13.018 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:12 smithi100 bash[13549]: audit 2021-01-28T03:56:11.860681+0000 mon.a (mon.0) 542 : audit [INF] from='client.? 172.21.15.162:0/72988659' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-01-28T03:56:13.018 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:12 smithi100 bash[9834]: audit 2021-01-28T03:56:11.705761+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:13.018 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:12 smithi100 bash[9834]: audit 2021-01-28T03:56:11.708983+0000 mon.a (mon.0) 541 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:56:13.019 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:12 smithi100 bash[9834]: audit 2021-01-28T03:56:11.860681+0000 mon.a (mon.0) 542 : audit [INF] from='client.? 172.21.15.162:0/72988659' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-01-28T03:56:13.437 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph osd pool application enable iscsi rbd 2021-01-28T03:56:14.009 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:13 smithi162 bash[9856]: audit 2021-01-28T03:56:12.721176+0000 mon.a (mon.0) 543 : audit [INF] from='client.? 172.21.15.162:0/72988659' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2021-01-28T03:56:14.009 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:13 smithi162 bash[9856]: cluster 2021-01-28T03:56:12.721281+0000 mon.a (mon.0) 544 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2021-01-28T03:56:14.009 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:13 smithi162 bash[9856]: cluster 2021-01-28T03:56:13.363850+0000 mgr.y (mgr.14138) 247 : cluster [DBG] pgmap v208: 36 pgs: 3 unknown, 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 716 B/s rd, 716 B/s wr, 1 op/s; 6 B/s, 0 objects/s recovering 2021-01-28T03:56:14.009 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:13 smithi162 bash[9856]: audit 2021-01-28T03:56:13.694876+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:14.010 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:13 smithi162 bash[9856]: audit 2021-01-28T03:56:13.701637+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:14.010 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:13 smithi162 bash[9856]: audit 2021-01-28T03:56:13.710295+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:14.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:13 smithi100 bash[9834]: audit 2021-01-28T03:56:12.721176+0000 mon.a (mon.0) 543 : audit [INF] from='client.? 172.21.15.162:0/72988659' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2021-01-28T03:56:14.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:13 smithi100 bash[9834]: cluster 2021-01-28T03:56:12.721281+0000 mon.a (mon.0) 544 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2021-01-28T03:56:14.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:13 smithi100 bash[9834]: cluster 2021-01-28T03:56:13.363850+0000 mgr.y (mgr.14138) 247 : cluster [DBG] pgmap v208: 36 pgs: 3 unknown, 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 716 B/s rd, 716 B/s wr, 1 op/s; 6 B/s, 0 objects/s recovering 2021-01-28T03:56:14.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:13 smithi100 bash[9834]: audit 2021-01-28T03:56:13.694876+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:14.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:13 smithi100 bash[9834]: audit 2021-01-28T03:56:13.701637+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:14.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:13 smithi100 bash[9834]: audit 2021-01-28T03:56:13.710295+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:14.074 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:13 smithi100 bash[13549]: audit 2021-01-28T03:56:12.721176+0000 mon.a (mon.0) 543 : audit [INF] from='client.? 172.21.15.162:0/72988659' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2021-01-28T03:56:14.075 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:13 smithi100 bash[13549]: cluster 2021-01-28T03:56:12.721281+0000 mon.a (mon.0) 544 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2021-01-28T03:56:14.075 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:13 smithi100 bash[13549]: cluster 2021-01-28T03:56:13.363850+0000 mgr.y (mgr.14138) 247 : cluster [DBG] pgmap v208: 36 pgs: 3 unknown, 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 716 B/s rd, 716 B/s wr, 1 op/s; 6 B/s, 0 objects/s recovering 2021-01-28T03:56:14.075 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:13 smithi100 bash[13549]: audit 2021-01-28T03:56:13.694876+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:14.075 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:13 smithi100 bash[13549]: audit 2021-01-28T03:56:13.701637+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:14.076 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:13 smithi100 bash[13549]: audit 2021-01-28T03:56:13.710295+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:15.001 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:14 smithi162 bash[9856]: cephadm 2021-01-28T03:56:13.702849+0000 mgr.y (mgr.14138) 248 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:56:15.001 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:14 smithi162 bash[9856]: cephadm 2021-01-28T03:56:13.703525+0000 mgr.y (mgr.14138) 249 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T03:56:15.001 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:14 smithi162 bash[9856]: cephadm 2021-01-28T03:56:13.711288+0000 mgr.y (mgr.14138) 250 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:56:15.001 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:14 smithi162 bash[9856]: cephadm 2021-01-28T03:56:13.712023+0000 mgr.y (mgr.14138) 251 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T03:56:15.002 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:14 smithi162 bash[9856]: cluster 2021-01-28T03:56:13.730099+0000 mon.a (mon.0) 548 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2021-01-28T03:56:15.002 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:14 smithi162 bash[9856]: audit 2021-01-28T03:56:13.736229+0000 mon.c (mon.1) 17 : audit [INF] from='client.? 172.21.15.100:0/1460911681' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]: dispatch 2021-01-28T03:56:15.002 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:14 smithi162 bash[9856]: audit 2021-01-28T03:56:13.736881+0000 mon.a (mon.0) 549 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]: dispatch 2021-01-28T03:56:15.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:14 smithi100 bash[9834]: cephadm 2021-01-28T03:56:13.702849+0000 mgr.y (mgr.14138) 248 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:56:15.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:14 smithi100 bash[9834]: cephadm 2021-01-28T03:56:13.703525+0000 mgr.y (mgr.14138) 249 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T03:56:15.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:14 smithi100 bash[9834]: cephadm 2021-01-28T03:56:13.711288+0000 mgr.y (mgr.14138) 250 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:56:15.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:14 smithi100 bash[9834]: cephadm 2021-01-28T03:56:13.712023+0000 mgr.y (mgr.14138) 251 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T03:56:15.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:14 smithi100 bash[9834]: cluster 2021-01-28T03:56:13.730099+0000 mon.a (mon.0) 548 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2021-01-28T03:56:15.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:14 smithi100 bash[9834]: audit 2021-01-28T03:56:13.736229+0000 mon.c (mon.1) 17 : audit [INF] from='client.? 172.21.15.100:0/1460911681' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]: dispatch 2021-01-28T03:56:15.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:14 smithi100 bash[9834]: audit 2021-01-28T03:56:13.736881+0000 mon.a (mon.0) 549 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]: dispatch 2021-01-28T03:56:15.075 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:14 smithi100 bash[13549]: cephadm 2021-01-28T03:56:13.702849+0000 mgr.y (mgr.14138) 248 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:56:15.075 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:14 smithi100 bash[13549]: cephadm 2021-01-28T03:56:13.703525+0000 mgr.y (mgr.14138) 249 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T03:56:15.075 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:14 smithi100 bash[13549]: cephadm 2021-01-28T03:56:13.711288+0000 mgr.y (mgr.14138) 250 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:56:15.076 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:14 smithi100 bash[13549]: cephadm 2021-01-28T03:56:13.712023+0000 mgr.y (mgr.14138) 251 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T03:56:15.076 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:14 smithi100 bash[13549]: cluster 2021-01-28T03:56:13.730099+0000 mon.a (mon.0) 548 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2021-01-28T03:56:15.076 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:14 smithi100 bash[13549]: audit 2021-01-28T03:56:13.736229+0000 mon.c (mon.1) 17 : audit [INF] from='client.? 172.21.15.100:0/1460911681' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]: dispatch 2021-01-28T03:56:15.076 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:14 smithi100 bash[13549]: audit 2021-01-28T03:56:13.736881+0000 mon.a (mon.0) 549 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]: dispatch 2021-01-28T03:56:16.008 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:15 smithi162 bash[9856]: audit 2021-01-28T03:56:14.736182+0000 mon.a (mon.0) 550 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]': finished 2021-01-28T03:56:16.009 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:15 smithi162 bash[9856]: cluster 2021-01-28T03:56:14.736526+0000 mon.a (mon.0) 551 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2021-01-28T03:56:16.009 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:15 smithi162 bash[9856]: cluster 2021-01-28T03:56:15.364504+0000 mgr.y (mgr.14138) 252 : cluster [DBG] pgmap v211: 68 pgs: 6 creating+peering, 28 unknown, 34 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1 op/s 2021-01-28T03:56:16.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:15 smithi100 bash[9834]: audit 2021-01-28T03:56:14.736182+0000 mon.a (mon.0) 550 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]': finished 2021-01-28T03:56:16.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:15 smithi100 bash[9834]: cluster 2021-01-28T03:56:14.736526+0000 mon.a (mon.0) 551 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2021-01-28T03:56:16.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:15 smithi100 bash[9834]: cluster 2021-01-28T03:56:15.364504+0000 mgr.y (mgr.14138) 252 : cluster [DBG] pgmap v211: 68 pgs: 6 creating+peering, 28 unknown, 34 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1 op/s 2021-01-28T03:56:16.074 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:15 smithi100 bash[13549]: audit 2021-01-28T03:56:14.736182+0000 mon.a (mon.0) 550 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]': finished 2021-01-28T03:56:16.074 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:15 smithi100 bash[13549]: cluster 2021-01-28T03:56:14.736526+0000 mon.a (mon.0) 551 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2021-01-28T03:56:16.074 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:15 smithi100 bash[13549]: cluster 2021-01-28T03:56:15.364504+0000 mgr.y (mgr.14138) 252 : cluster [DBG] pgmap v211: 68 pgs: 6 creating+peering, 28 unknown, 34 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1 op/s 2021-01-28T03:56:16.764 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.762+0000 7f7f36aed700 1 -- 172.21.15.162:0/2009253924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f30100150 msgr2=0x7f7f30102540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:16.764 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.762+0000 7f7f36aed700 1 --2- 172.21.15.162:0/2009253924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f30100150 0x7f7f30102540 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f7f20004e00 tx=0x7f7f20009b30).stop 2021-01-28T03:56:16.765 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.766+0000 7f7f36aed700 1 -- 172.21.15.162:0/2009253924 shutdown_connections 2021-01-28T03:56:16.765 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.766+0000 7f7f36aed700 1 --2- 172.21.15.162:0/2009253924 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7f30102b60 0x7f7f30105020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:16.765 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.766+0000 7f7f36aed700 1 --2- 172.21.15.162:0/2009253924 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f30067350 0x7f7f300ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-28T03:56:16.765 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.766+0000 7f7f36aed700 1 --2- 172.21.15.162:0/2009253924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f30100150 0x7f7f30102540 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:16.765 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.766+0000 7f7f36aed700 1 -- 172.21.15.162:0/2009253924 >> 172.21.15.162:0/2009253924 conn(0x7f7f300628f0 msgr2=0x7f7f30064d10 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:56:16.766 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.766+0000 7f7f36aed700 1 -- 172.21.15.162:0/2009253924 shutdown_connections 2021-01-28T03:56:16.766 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.766+0000 7f7f36aed700 1 -- 172.21.15.162:0/2009253924 wait complete. 2021-01-28T03:56:16.767 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.766+0000 7f7f36aed700 1 Processor -- start 2021-01-28T03:56:16.768 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.766+0000 7f7f36aed700 1 -- start start 2021-01-28T03:56:16.768 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.766+0000 7f7f36aed700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f30067350 0x7f7f3010e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:56:16.768 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.766+0000 7f7f36aed700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7f30100150 0x7f7f3010e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:56:16.768 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.766+0000 7f7f36aed700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f30102b60 0x7f7f3010f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:56:16.768 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.766+0000 7f7f36aed700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3010fc90 con 0x7f7f30067350 2021-01-28T03:56:16.769 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.766+0000 7f7f36aed700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3010fe00 con 0x7f7f30102b60 2021-01-28T03:56:16.769 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.766+0000 7f7f36aed700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3010ffc0 con 0x7f7f30100150 2021-01-28T03:56:16.769 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.766+0000 7f7f362ec700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f30102b60 0x7f7f3010f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:56:16.769 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.766+0000 7f7f362ec700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f30102b60 0x7f7f3010f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:45324/0 (socket says 172.21.15.162:45324) 2021-01-28T03:56:16.770 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.766+0000 7f7f362ec700 1 -- 172.21.15.162:0/327356369 learned_addr learned my addr 172.21.15.162:0/327356369 (peer_addr_for_me v2:172.21.15.162:0/0) 2021-01-28T03:56:16.770 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.766+0000 7f7f352ea700 1 --2- 172.21.15.162:0/327356369 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7f30100150 0x7f7f3010e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:56:16.770 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.766+0000 7f7f35aeb700 1 --2- 172.21.15.162:0/327356369 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f30067350 0x7f7f3010e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:56:16.770 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.766+0000 7f7f362ec700 1 -- 172.21.15.162:0/327356369 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7f30100150 msgr2=0x7f7f3010e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:16.770 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.766+0000 7f7f362ec700 1 --2- 172.21.15.162:0/327356369 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7f30100150 0x7f7f3010e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:16.771 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.766+0000 7f7f362ec700 1 -- 172.21.15.162:0/327356369 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f30067350 msgr2=0x7f7f3010e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:16.771 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.766+0000 7f7f362ec700 1 --2- 172.21.15.162:0/327356369 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f30067350 0x7f7f3010e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:16.771 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.766+0000 7f7f362ec700 1 -- 172.21.15.162:0/327356369 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f30110180 con 0x7f7f30102b60 2021-01-28T03:56:16.771 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.766+0000 7f7f362ec700 1 --2- 172.21.15.162:0/327356369 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f30102b60 0x7f7f3010f6d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f7f2800db70 tx=0x7f7f28004e60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:56:16.772 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.766+0000 7f7f352ea700 1 --2- 172.21.15.162:0/327356369 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7f30100150 0x7f7f3010e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-28T03:56:16.775 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.774+0000 7f7f267fc700 1 -- 172.21.15.162:0/327356369 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f28004020 con 0x7f7f30102b60 2021-01-28T03:56:16.776 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.774+0000 7f7f36aed700 1 -- 172.21.15.162:0/327356369 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f30110430 con 0x7f7f30102b60 2021-01-28T03:56:16.776 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.774+0000 7f7f36aed700 1 -- 172.21.15.162:0/327356369 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f301007a0 con 0x7f7f30102b60 2021-01-28T03:56:16.776 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.774+0000 7f7f267fc700 1 -- 172.21.15.162:0/327356369 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f7f28004180 con 0x7f7f30102b60 2021-01-28T03:56:16.776 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.774+0000 7f7f267fc700 1 -- 172.21.15.162:0/327356369 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2800b870 con 0x7f7f30102b60 2021-01-28T03:56:16.777 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.778+0000 7f7f36aed700 1 -- 172.21.15.162:0/327356369 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f18004da0 con 0x7f7f30102b60 2021-01-28T03:56:16.778 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.778+0000 7f7f267fc700 1 -- 172.21.15.162:0/327356369 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 71316+0+0 (secure 0 0 0) 0x7f7f28022070 con 0x7f7f30102b60 2021-01-28T03:56:16.779 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.778+0000 7f7f267fc700 1 --2- 172.21.15.162:0/327356369 >> v2:172.21.15.100:6800/928846103 conn(0x7f7f1c05bc30 0x7f7f1c05e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:56:16.779 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.778+0000 7f7f267fc700 1 -- 172.21.15.162:0/327356369 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5469+0+0 (secure 0 0 0) 0x7f7f28079eb0 con 0x7f7f30102b60 2021-01-28T03:56:16.780 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.782+0000 7f7f35aeb700 1 --2- 172.21.15.162:0/327356369 >> v2:172.21.15.100:6800/928846103 conn(0x7f7f1c05bc30 0x7f7f1c05e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:56:16.782 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.782+0000 7f7f35aeb700 1 --2- 172.21.15.162:0/327356369 >> v2:172.21.15.100:6800/928846103 conn(0x7f7f1c05bc30 0x7f7f1c05e0f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f7f30066e10 tx=0x7f7f2c008040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:56:16.787 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.786+0000 7f7f267fc700 1 -- 172.21.15.162:0/327356369 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f7f2804cd50 con 0x7f7f30102b60 2021-01-28T03:56:16.962 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:16.962+0000 7f7f36aed700 1 -- 172.21.15.162:0/327356369 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"} v 0) v1 -- 0x7f7f18005740 con 0x7f7f30102b60 2021-01-28T03:56:17.008 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:16 smithi162 bash[9856]: cluster 2021-01-28T03:56:15.758693+0000 mon.a (mon.0) 552 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2021-01-28T03:56:17.009 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:16 smithi162 bash[9856]: audit 2021-01-28T03:56:15.765331+0000 mon.c (mon.1) 18 : audit [INF] from='client.? 172.21.15.100:0/1460911681' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]: dispatch 2021-01-28T03:56:17.009 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:16 smithi162 bash[9856]: audit 2021-01-28T03:56:15.769019+0000 mon.a (mon.0) 553 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]: dispatch 2021-01-28T03:56:17.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:16 smithi100 bash[9834]: cluster 2021-01-28T03:56:15.758693+0000 mon.a (mon.0) 552 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2021-01-28T03:56:17.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:16 smithi100 bash[9834]: audit 2021-01-28T03:56:15.765331+0000 mon.c (mon.1) 18 : audit [INF] from='client.? 172.21.15.100:0/1460911681' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]: dispatch 2021-01-28T03:56:17.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:16 smithi100 bash[9834]: audit 2021-01-28T03:56:15.769019+0000 mon.a (mon.0) 553 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]: dispatch 2021-01-28T03:56:17.074 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:16 smithi100 bash[13549]: cluster 2021-01-28T03:56:15.758693+0000 mon.a (mon.0) 552 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2021-01-28T03:56:17.075 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:16 smithi100 bash[13549]: audit 2021-01-28T03:56:15.765331+0000 mon.c (mon.1) 18 : audit [INF] from='client.? 172.21.15.100:0/1460911681' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]: dispatch 2021-01-28T03:56:17.075 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:16 smithi100 bash[13549]: audit 2021-01-28T03:56:15.769019+0000 mon.a (mon.0) 553 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]: dispatch 2021-01-28T03:56:17.782 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:17.782+0000 7f7f267fc700 1 -- 172.21.15.162:0/327356369 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]=0 enabled application 'rbd' on pool 'iscsi' v54) v1 ==== 147+0+0 (secure 0 0 0) 0x7f7f28020030 con 0x7f7f30102b60 2021-01-28T03:56:17.786 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:17.786+0000 7f7f36aed700 1 -- 172.21.15.162:0/327356369 >> v2:172.21.15.100:6800/928846103 conn(0x7f7f1c05bc30 msgr2=0x7f7f1c05e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:17.786 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:17.786+0000 7f7f36aed700 1 --2- 172.21.15.162:0/327356369 >> v2:172.21.15.100:6800/928846103 conn(0x7f7f1c05bc30 0x7f7f1c05e0f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f7f30066e10 tx=0x7f7f2c008040).stop 2021-01-28T03:56:17.786 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:17.786+0000 7f7f36aed700 1 -- 172.21.15.162:0/327356369 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f30102b60 msgr2=0x7f7f3010f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:17.786 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:17.786+0000 7f7f36aed700 1 --2- 172.21.15.162:0/327356369 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f30102b60 0x7f7f3010f6d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f7f2800db70 tx=0x7f7f28004e60).stop 2021-01-28T03:56:17.787 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:17.786+0000 7f7f36aed700 1 -- 172.21.15.162:0/327356369 shutdown_connections 2021-01-28T03:56:17.787 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:17.786+0000 7f7f36aed700 1 --2- 172.21.15.162:0/327356369 >> v2:172.21.15.100:6800/928846103 conn(0x7f7f1c05bc30 0x7f7f1c05e0f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:17.787 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:17.786+0000 7f7f36aed700 1 --2- 172.21.15.162:0/327356369 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f30102b60 0x7f7f3010f6d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:17.787 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:17.786+0000 7f7f36aed700 1 --2- 172.21.15.162:0/327356369 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f30067350 0x7f7f3010e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:17.788 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:17.786+0000 7f7f36aed700 1 --2- 172.21.15.162:0/327356369 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f7f30100150 0x7f7f3010e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:17.788 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:17.786+0000 7f7f36aed700 1 -- 172.21.15.162:0/327356369 >> 172.21.15.162:0/327356369 conn(0x7f7f300628f0 msgr2=0x7f7f301046e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:56:17.788 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:17.786+0000 7f7f36aed700 1 -- 172.21.15.162:0/327356369 shutdown_connections 2021-01-28T03:56:17.789 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:17.786+0000 7f7f36aed700 1 -- 172.21.15.162:0/327356369 wait complete. 2021-01-28T03:56:17.789 INFO:teuthology.orchestra.run.smithi162.stderr:enabled application 'rbd' on pool 'iscsi' 2021-01-28T03:56:18.073 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:17 smithi100 bash[9834]: audit 2021-01-28T03:56:16.764620+0000 mon.a (mon.0) 554 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]': finished 2021-01-28T03:56:18.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:17 smithi100 bash[9834]: cluster 2021-01-28T03:56:16.765029+0000 mon.a (mon.0) 555 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2021-01-28T03:56:18.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:17 smithi100 bash[9834]: audit 2021-01-28T03:56:16.966399+0000 mon.b (mon.2) 20 : audit [INF] from='client.? 172.21.15.162:0/327356369' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-01-28T03:56:18.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:17 smithi100 bash[9834]: audit 2021-01-28T03:56:16.967193+0000 mon.a (mon.0) 556 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-01-28T03:56:18.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:17 smithi100 bash[9834]: cluster 2021-01-28T03:56:17.365341+0000 mgr.y (mgr.14138) 253 : cluster [DBG] pgmap v214: 100 pgs: 6 creating+peering, 50 unknown, 44 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 3 op/s 2021-01-28T03:56:18.075 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:17 smithi100 bash[13549]: audit 2021-01-28T03:56:16.764620+0000 mon.a (mon.0) 554 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]': finished 2021-01-28T03:56:18.075 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:17 smithi100 bash[13549]: cluster 2021-01-28T03:56:16.765029+0000 mon.a (mon.0) 555 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2021-01-28T03:56:18.075 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:17 smithi100 bash[13549]: audit 2021-01-28T03:56:16.966399+0000 mon.b (mon.2) 20 : audit [INF] from='client.? 172.21.15.162:0/327356369' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-01-28T03:56:18.075 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:17 smithi100 bash[13549]: audit 2021-01-28T03:56:16.967193+0000 mon.a (mon.0) 556 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-01-28T03:56:18.076 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:17 smithi100 bash[13549]: cluster 2021-01-28T03:56:17.365341+0000 mgr.y (mgr.14138) 253 : cluster [DBG] pgmap v214: 100 pgs: 6 creating+peering, 50 unknown, 44 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 3 op/s 2021-01-28T03:56:18.259 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:17 smithi162 bash[9856]: audit 2021-01-28T03:56:16.764620+0000 mon.a (mon.0) 554 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]': finished 2021-01-28T03:56:18.259 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:17 smithi162 bash[9856]: cluster 2021-01-28T03:56:16.765029+0000 mon.a (mon.0) 555 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2021-01-28T03:56:18.260 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:17 smithi162 bash[9856]: audit 2021-01-28T03:56:16.966399+0000 mon.b (mon.2) 20 : audit [INF] from='client.? 172.21.15.162:0/327356369' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-01-28T03:56:18.260 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:17 smithi162 bash[9856]: audit 2021-01-28T03:56:16.967193+0000 mon.a (mon.0) 556 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-01-28T03:56:18.261 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:17 smithi162 bash[9856]: cluster 2021-01-28T03:56:17.365341+0000 mgr.y (mgr.14138) 253 : cluster [DBG] pgmap v214: 100 pgs: 6 creating+peering, 50 unknown, 44 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 3.5 KiB/s rd, 3 op/s 2021-01-28T03:56:18.694 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph orch apply iscsi iscsi user password --placement '1;smithi162=iscsi.a' 2021-01-28T03:56:19.009 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:18 smithi162 bash[9856]: audit 2021-01-28T03:56:17.783449+0000 mon.a (mon.0) 557 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]': finished 2021-01-28T03:56:19.009 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:18 smithi162 bash[9856]: cluster 2021-01-28T03:56:17.783555+0000 mon.a (mon.0) 558 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2021-01-28T03:56:19.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:18 smithi100 bash[9834]: audit 2021-01-28T03:56:17.783449+0000 mon.a (mon.0) 557 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]': finished 2021-01-28T03:56:19.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:18 smithi100 bash[9834]: cluster 2021-01-28T03:56:17.783555+0000 mon.a (mon.0) 558 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2021-01-28T03:56:19.074 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:18 smithi100 bash[13549]: audit 2021-01-28T03:56:17.783449+0000 mon.a (mon.0) 557 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]': finished 2021-01-28T03:56:19.075 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:18 smithi100 bash[13549]: cluster 2021-01-28T03:56:17.783555+0000 mon.a (mon.0) 558 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2021-01-28T03:56:20.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:19 smithi100 bash[9834]: cluster 2021-01-28T03:56:18.797378+0000 mon.a (mon.0) 559 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2021-01-28T03:56:20.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:19 smithi100 bash[9834]: audit 2021-01-28T03:56:18.802408+0000 mon.a (mon.0) 560 : audit [INF] from='client.? 172.21.15.100:0/2550306189' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]: dispatch 2021-01-28T03:56:20.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:19 smithi100 bash[9834]: cluster 2021-01-28T03:56:19.366200+0000 mgr.y (mgr.14138) 254 : cluster [DBG] pgmap v217: 132 pgs: 5 creating+peering, 38 unknown, 89 active+clean; 12 KiB data, 45 MiB used, 715 GiB / 715 GiB avail; 19 KiB/s rd, 17 KiB/s wr, 68 op/s 2021-01-28T03:56:20.075 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:19 smithi100 bash[13549]: cluster 2021-01-28T03:56:18.797378+0000 mon.a (mon.0) 559 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2021-01-28T03:56:20.075 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:19 smithi100 bash[13549]: audit 2021-01-28T03:56:18.802408+0000 mon.a (mon.0) 560 : audit [INF] from='client.? 172.21.15.100:0/2550306189' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]: dispatch 2021-01-28T03:56:20.075 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:19 smithi100 bash[13549]: cluster 2021-01-28T03:56:19.366200+0000 mgr.y (mgr.14138) 254 : cluster [DBG] pgmap v217: 132 pgs: 5 creating+peering, 38 unknown, 89 active+clean; 12 KiB data, 45 MiB used, 715 GiB / 715 GiB avail; 19 KiB/s rd, 17 KiB/s wr, 68 op/s 2021-01-28T03:56:20.076 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:19 smithi162 bash[9856]: cluster 2021-01-28T03:56:18.797378+0000 mon.a (mon.0) 559 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2021-01-28T03:56:20.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:19 smithi162 bash[9856]: audit 2021-01-28T03:56:18.802408+0000 mon.a (mon.0) 560 : audit [INF] from='client.? 172.21.15.100:0/2550306189' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]: dispatch 2021-01-28T03:56:20.077 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:19 smithi162 bash[9856]: cluster 2021-01-28T03:56:19.366200+0000 mgr.y (mgr.14138) 254 : cluster [DBG] pgmap v217: 132 pgs: 5 creating+peering, 38 unknown, 89 active+clean; 12 KiB data, 45 MiB used, 715 GiB / 715 GiB avail; 19 KiB/s rd, 17 KiB/s wr, 68 op/s 2021-01-28T03:56:21.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:20 smithi100 bash[9834]: audit 2021-01-28T03:56:19.807749+0000 mon.a (mon.0) 561 : audit [INF] from='client.? 172.21.15.100:0/2550306189' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]': finished 2021-01-28T03:56:21.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:20 smithi100 bash[9834]: cluster 2021-01-28T03:56:19.808067+0000 mon.a (mon.0) 562 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2021-01-28T03:56:21.074 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:20 smithi100 bash[9834]: audit 2021-01-28T03:56:19.813512+0000 mon.a (mon.0) 563 : audit [INF] from='client.? 172.21.15.100:0/2550306189' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-01-28T03:56:21.075 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:20 smithi100 bash[13549]: audit 2021-01-28T03:56:19.807749+0000 mon.a (mon.0) 561 : audit [INF] from='client.? 172.21.15.100:0/2550306189' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]': finished 2021-01-28T03:56:21.075 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:20 smithi100 bash[13549]: cluster 2021-01-28T03:56:19.808067+0000 mon.a (mon.0) 562 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2021-01-28T03:56:21.075 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:20 smithi100 bash[13549]: audit 2021-01-28T03:56:19.813512+0000 mon.a (mon.0) 563 : audit [INF] from='client.? 172.21.15.100:0/2550306189' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-01-28T03:56:21.259 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:20 smithi162 bash[9856]: audit 2021-01-28T03:56:19.807749+0000 mon.a (mon.0) 561 : audit [INF] from='client.? 172.21.15.100:0/2550306189' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]': finished 2021-01-28T03:56:21.259 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:20 smithi162 bash[9856]: cluster 2021-01-28T03:56:19.808067+0000 mon.a (mon.0) 562 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2021-01-28T03:56:21.259 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:20 smithi162 bash[9856]: audit 2021-01-28T03:56:19.813512+0000 mon.a (mon.0) 563 : audit [INF] from='client.? 172.21.15.100:0/2550306189' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-01-28T03:56:21.918 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.917+0000 7f4e168f0700 1 -- 172.21.15.162:0/201743457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e100f7ad0 msgr2=0x7f4e100f7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:21.918 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.917+0000 7f4e168f0700 1 --2- 172.21.15.162:0/201743457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e100f7ad0 0x7f4e100f7ef0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f4e08009df0 tx=0x7f4e08004d10).stop 2021-01-28T03:56:21.919 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.917+0000 7f4e168f0700 1 -- 172.21.15.162:0/201743457 shutdown_connections 2021-01-28T03:56:21.919 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.917+0000 7f4e168f0700 1 --2- 172.21.15.162:0/201743457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e100f7ad0 0x7f4e100f7ef0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:21.919 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.917+0000 7f4e168f0700 1 --2- 172.21.15.162:0/201743457 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e100f96c0 0x7f4e100fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:21.919 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.917+0000 7f4e168f0700 1 --2- 172.21.15.162:0/201743457 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4e100f8d70 0x7f4e100f91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:21.919 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.917+0000 7f4e168f0700 1 -- 172.21.15.162:0/201743457 >> 172.21.15.162:0/201743457 conn(0x7f4e100f3390 msgr2=0x7f4e100f5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:56:21.920 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.917+0000 7f4e168f0700 1 -- 172.21.15.162:0/201743457 shutdown_connections 2021-01-28T03:56:21.920 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.917+0000 7f4e168f0700 1 -- 172.21.15.162:0/201743457 wait complete. 2021-01-28T03:56:21.922 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.917+0000 7f4e168f0700 1 Processor -- start 2021-01-28T03:56:21.922 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.917+0000 7f4e168f0700 1 -- start start 2021-01-28T03:56:21.922 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.917+0000 7f4e168f0700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e100f7ad0 0x7f4e10107a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:56:21.922 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.917+0000 7f4e168f0700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4e100f8d70 0x7f4e10107f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:56:21.923 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.917+0000 7f4e168f0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e100f96c0 0x7f4e10108e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:56:21.923 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.917+0000 7f4e168f0700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e10109360 con 0x7f4e100f96c0 2021-01-28T03:56:21.923 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.917+0000 7f4e168f0700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e101094d0 con 0x7f4e100f7ad0 2021-01-28T03:56:21.923 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.917+0000 7f4e168f0700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e10109690 con 0x7f4e100f8d70 2021-01-28T03:56:21.924 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.917+0000 7f4e158ee700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e100f7ad0 0x7f4e10107a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:56:21.924 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.917+0000 7f4e158ee700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e100f7ad0 0x7f4e10107a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:45338/0 (socket says 172.21.15.162:45338) 2021-01-28T03:56:21.924 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.917+0000 7f4e158ee700 1 -- 172.21.15.162:0/9353681 learned_addr learned my addr 172.21.15.162:0/9353681 (peer_addr_for_me v2:172.21.15.162:0/0) 2021-01-28T03:56:21.924 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.917+0000 7f4e160ef700 1 --2- 172.21.15.162:0/9353681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e100f96c0 0x7f4e10108e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:56:21.924 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.917+0000 7f4e150ed700 1 --2- 172.21.15.162:0/9353681 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4e100f8d70 0x7f4e10107f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:56:21.925 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.917+0000 7f4e158ee700 1 -- 172.21.15.162:0/9353681 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4e100f8d70 msgr2=0x7f4e10107f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:21.925 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.917+0000 7f4e158ee700 1 --2- 172.21.15.162:0/9353681 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4e100f8d70 0x7f4e10107f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:21.925 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.917+0000 7f4e158ee700 1 -- 172.21.15.162:0/9353681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e100f96c0 msgr2=0x7f4e10108e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:21.925 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.917+0000 7f4e158ee700 1 --2- 172.21.15.162:0/9353681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e100f96c0 0x7f4e10108e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:21.926 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.917+0000 7f4e158ee700 1 -- 172.21.15.162:0/9353681 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e10109850 con 0x7f4e100f7ad0 2021-01-28T03:56:21.926 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.917+0000 7f4e150ed700 1 --2- 172.21.15.162:0/9353681 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4e100f8d70 0x7f4e10107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-28T03:56:21.926 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.921+0000 7f4e158ee700 1 --2- 172.21.15.162:0/9353681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e100f7ad0 0x7f4e10107a50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f4e08003380 tx=0x7f4e08004d10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:56:21.926 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.921+0000 7f4e0e7fc700 1 -- 172.21.15.162:0/9353681 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0800e070 con 0x7f4e100f7ad0 2021-01-28T03:56:21.927 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.921+0000 7f4e0e7fc700 1 -- 172.21.15.162:0/9353681 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f4e08004480 con 0x7f4e100f7ad0 2021-01-28T03:56:21.927 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.921+0000 7f4e0e7fc700 1 -- 172.21.15.162:0/9353681 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e08018070 con 0x7f4e100f7ad0 2021-01-28T03:56:21.927 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.921+0000 7f4e168f0700 1 -- 172.21.15.162:0/9353681 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e10109aa0 con 0x7f4e100f7ad0 2021-01-28T03:56:21.927 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.921+0000 7f4e168f0700 1 -- 172.21.15.162:0/9353681 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e10110240 con 0x7f4e100f7ad0 2021-01-28T03:56:21.928 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.921+0000 7f4e168f0700 1 -- 172.21.15.162:0/9353681 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e100f6ec0 con 0x7f4e100f7ad0 2021-01-28T03:56:21.928 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.921+0000 7f4e0e7fc700 1 -- 172.21.15.162:0/9353681 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 14) v1 ==== 71316+0+0 (secure 0 0 0) 0x7f4e08024060 con 0x7f4e100f7ad0 2021-01-28T03:56:21.929 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.925+0000 7f4e0e7fc700 1 --2- 172.21.15.162:0/9353681 >> v2:172.21.15.100:6800/928846103 conn(0x7f4df805bc30 0x7f4df805e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:56:21.929 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.925+0000 7f4e0e7fc700 1 -- 172.21.15.162:0/9353681 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5875+0+0 (secure 0 0 0) 0x7f4e08077490 con 0x7f4e100f7ad0 2021-01-28T03:56:21.929 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.925+0000 7f4e150ed700 1 --2- 172.21.15.162:0/9353681 >> v2:172.21.15.100:6800/928846103 conn(0x7f4df805bc30 0x7f4df805e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:56:21.929 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.925+0000 7f4e150ed700 1 --2- 172.21.15.162:0/9353681 >> v2:172.21.15.100:6800/928846103 conn(0x7f4df805bc30 0x7f4df805e0f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f4e04009740 tx=0x7f4e04009be0).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:56:21.931 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:21.929+0000 7f4e0e7fc700 1 -- 172.21.15.162:0/9353681 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f4e0804a190 con 0x7f4e100f7ad0 2021-01-28T03:56:22.009 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:21 smithi162 bash[9856]: audit 2021-01-28T03:56:20.812494+0000 mon.a (mon.0) 564 : audit [INF] from='client.? 172.21.15.100:0/2550306189' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-01-28T03:56:22.009 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:21 smithi162 bash[9856]: cluster 2021-01-28T03:56:20.812739+0000 mon.a (mon.0) 565 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2021-01-28T03:56:22.009 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:21 smithi162 bash[9856]: audit 2021-01-28T03:56:20.814253+0000 mon.a (mon.0) 566 : audit [INF] from='client.? 172.21.15.100:0/2550306189' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-01-28T03:56:22.010 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:21 smithi162 bash[9856]: cluster 2021-01-28T03:56:21.366979+0000 mgr.y (mgr.14138) 255 : cluster [DBG] pgmap v220: 132 pgs: 5 creating+peering, 27 unknown, 100 active+clean; 18 KiB data, 46 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 26 KiB/s wr, 104 op/s 2021-01-28T03:56:22.010 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:21 smithi162 bash[9856]: audit 2021-01-28T03:56:21.814704+0000 mon.a (mon.0) 567 : audit [INF] from='client.? 172.21.15.100:0/2550306189' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-01-28T03:56:22.010 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:21 smithi162 bash[9856]: cluster 2021-01-28T03:56:21.814832+0000 mon.a (mon.0) 568 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2021-01-28T03:56:22.197 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:22.197+0000 7f4e168f0700 1 -- 172.21.15.162:0/9353681 --> v2:172.21.15.100:6800/928846103 -- mgr_command(tid 0: {"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi162=iscsi.a", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e101026a0 con 0x7f4df805bc30 2021-01-28T03:56:22.206 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:22.205+0000 7f4e0e7fc700 1 -- 172.21.15.162:0/9353681 <== mgr.14138 v2:172.21.15.100:6800/928846103 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f4e04018030 con 0x7f4df805bc30 2021-01-28T03:56:22.207 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled iscsi.iscsi update... 2021-01-28T03:56:22.210 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:22.209+0000 7f4e168f0700 1 -- 172.21.15.162:0/9353681 >> v2:172.21.15.100:6800/928846103 conn(0x7f4df805bc30 msgr2=0x7f4df805e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:22.210 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:22.209+0000 7f4e168f0700 1 --2- 172.21.15.162:0/9353681 >> v2:172.21.15.100:6800/928846103 conn(0x7f4df805bc30 0x7f4df805e0f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f4e04009740 tx=0x7f4e04009be0).stop 2021-01-28T03:56:22.210 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:22.209+0000 7f4e168f0700 1 -- 172.21.15.162:0/9353681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e100f7ad0 msgr2=0x7f4e10107a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:22.210 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:22.209+0000 7f4e168f0700 1 --2- 172.21.15.162:0/9353681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e100f7ad0 0x7f4e10107a50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f4e08003380 tx=0x7f4e08004d10).stop 2021-01-28T03:56:22.211 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:22.209+0000 7f4e168f0700 1 -- 172.21.15.162:0/9353681 shutdown_connections 2021-01-28T03:56:22.211 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:22.209+0000 7f4e168f0700 1 --2- 172.21.15.162:0/9353681 >> v2:172.21.15.100:6800/928846103 conn(0x7f4df805bc30 0x7f4df805e0f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:22.211 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:22.209+0000 7f4e168f0700 1 --2- 172.21.15.162:0/9353681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e100f7ad0 0x7f4e10107a50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:22.211 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:22.209+0000 7f4e168f0700 1 --2- 172.21.15.162:0/9353681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e100f96c0 0x7f4e10108e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:22.212 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:22.209+0000 7f4e168f0700 1 --2- 172.21.15.162:0/9353681 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4e100f8d70 0x7f4e10107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:22.212 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:22.209+0000 7f4e168f0700 1 -- 172.21.15.162:0/9353681 >> 172.21.15.162:0/9353681 conn(0x7f4e100f3390 msgr2=0x7f4e100fbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:56:22.212 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:22.209+0000 7f4e168f0700 1 -- 172.21.15.162:0/9353681 shutdown_connections 2021-01-28T03:56:22.212 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:22.209+0000 7f4e168f0700 1 -- 172.21.15.162:0/9353681 wait complete. 2021-01-28T03:56:22.324 INFO:journalctl@ceph.rgw.realm.zone.a.smithi100.stdout:Jan 28 03:56:21 smithi100 bash[25197]: debug 2021-01-28T03:56:21.969+0000 7fc18db312c0 -1 rgw period pusher: The new period does not contain my zonegroup! 2021-01-28T03:56:22.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:21 smithi100 bash[9834]: audit 2021-01-28T03:56:20.812494+0000 mon.a (mon.0) 564 : audit [INF] from='client.? 172.21.15.100:0/2550306189' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-01-28T03:56:22.324 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:21 smithi100 bash[9834]: cluster 2021-01-28T03:56:20.812739+0000 mon.a (mon.0) 565 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2021-01-28T03:56:22.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:21 smithi100 bash[9834]: audit 2021-01-28T03:56:20.814253+0000 mon.a (mon.0) 566 : audit [INF] from='client.? 172.21.15.100:0/2550306189' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-01-28T03:56:22.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:21 smithi100 bash[9834]: cluster 2021-01-28T03:56:21.366979+0000 mgr.y (mgr.14138) 255 : cluster [DBG] pgmap v220: 132 pgs: 5 creating+peering, 27 unknown, 100 active+clean; 18 KiB data, 46 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 26 KiB/s wr, 104 op/s 2021-01-28T03:56:22.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:21 smithi100 bash[9834]: audit 2021-01-28T03:56:21.814704+0000 mon.a (mon.0) 567 : audit [INF] from='client.? 172.21.15.100:0/2550306189' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-01-28T03:56:22.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:21 smithi100 bash[9834]: cluster 2021-01-28T03:56:21.814832+0000 mon.a (mon.0) 568 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2021-01-28T03:56:22.326 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:21 smithi100 bash[13549]: audit 2021-01-28T03:56:20.812494+0000 mon.a (mon.0) 564 : audit [INF] from='client.? 172.21.15.100:0/2550306189' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-01-28T03:56:22.326 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:21 smithi100 bash[13549]: cluster 2021-01-28T03:56:20.812739+0000 mon.a (mon.0) 565 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2021-01-28T03:56:22.326 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:21 smithi100 bash[13549]: audit 2021-01-28T03:56:20.814253+0000 mon.a (mon.0) 566 : audit [INF] from='client.? 172.21.15.100:0/2550306189' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-01-28T03:56:22.327 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:21 smithi100 bash[13549]: cluster 2021-01-28T03:56:21.366979+0000 mgr.y (mgr.14138) 255 : cluster [DBG] pgmap v220: 132 pgs: 5 creating+peering, 27 unknown, 100 active+clean; 18 KiB data, 46 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 26 KiB/s wr, 104 op/s 2021-01-28T03:56:22.327 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:21 smithi100 bash[13549]: audit 2021-01-28T03:56:21.814704+0000 mon.a (mon.0) 567 : audit [INF] from='client.? 172.21.15.100:0/2550306189' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-01-28T03:56:22.328 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:21 smithi100 bash[13549]: cluster 2021-01-28T03:56:21.814832+0000 mon.a (mon.0) 568 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2021-01-28T03:56:23.501 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:23 smithi162 bash[9856]: audit 2021-01-28T03:56:22.201142+0000 mgr.y (mgr.14138) 256 : audit [DBG] from='client.34433 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi162=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:56:23.501 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:23 smithi162 bash[9856]: cephadm 2021-01-28T03:56:22.203067+0000 mgr.y (mgr.14138) 257 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi162=iscsi.a;count:1 2021-01-28T03:56:23.501 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:23 smithi162 bash[9856]: audit 2021-01-28T03:56:22.207942+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:23.502 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:23 smithi162 bash[9856]: audit 2021-01-28T03:56:22.214647+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:23.502 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:23 smithi162 bash[9856]: cephadm 2021-01-28T03:56:22.215757+0000 mgr.y (mgr.14138) 258 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:56:23.502 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:23 smithi162 bash[9856]: cephadm 2021-01-28T03:56:22.216311+0000 mgr.y (mgr.14138) 259 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T03:56:23.502 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:23 smithi162 bash[9856]: cephadm 2021-01-28T03:56:22.216879+0000 mgr.y (mgr.14138) 260 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi162', network='', name='iscsi.a')] 2021-01-28T03:56:23.503 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:23 smithi162 bash[9856]: cephadm 2021-01-28T03:56:22.217090+0000 mgr.y (mgr.14138) 261 : cephadm [INF] Checking pool "iscsi" exists for service iscsi.iscsi 2021-01-28T03:56:23.503 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:23 smithi162 bash[9856]: cephadm 2021-01-28T03:56:22.224643+0000 mgr.y (mgr.14138) 262 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi162=iscsi.a;count:1 2021-01-28T03:56:23.503 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:23 smithi162 bash[9856]: audit 2021-01-28T03:56:22.228716+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:23.503 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:23 smithi162 bash[9856]: audit 2021-01-28T03:56:22.229639+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "osd", "allow rwx"]}]: dispatch 2021-01-28T03:56:23.503 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:23 smithi162 bash[9856]: audit 2021-01-28T03:56:22.233673+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "osd", "allow rwx"]}]': finished 2021-01-28T03:56:23.504 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:23 smithi162 bash[9856]: audit 2021-01-28T03:56:22.245174+0000 mon.a (mon.0) 574 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:56:23.504 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:23 smithi162 bash[9856]: cephadm 2021-01-28T03:56:22.246093+0000 mgr.y (mgr.14138) 263 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi162 2021-01-28T03:56:23.504 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:23 smithi162 bash[9856]: audit 2021-01-28T03:56:22.246619+0000 mon.a (mon.0) 575 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.iscsi.iscsi.a", "key": "container_image"}]: dispatch 2021-01-28T03:56:23.505 DEBUG:teuthology.orchestra.run.smithi162:iscsi.iscsi.a> sudo journalctl -f -n 0 -u ceph-c217df96-611b-11eb-8f9e-001a4aab830c@iscsi.iscsi.a.service 2021-01-28T03:56:23.507 INFO:tasks.cephadm:Adding prometheus.a on smithi162 2021-01-28T03:56:23.508 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph orch apply prometheus '1;smithi162=a' 2021-01-28T03:56:23.524 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T03:56:23.574 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:23 smithi100 bash[13549]: audit 2021-01-28T03:56:22.201142+0000 mgr.y (mgr.14138) 256 : audit [DBG] from='client.34433 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi162=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:56:23.575 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:23 smithi100 bash[13549]: cephadm 2021-01-28T03:56:22.203067+0000 mgr.y (mgr.14138) 257 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi162=iscsi.a;count:1 2021-01-28T03:56:23.576 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:23 smithi100 bash[13549]: audit 2021-01-28T03:56:22.207942+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:23.576 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:23 smithi100 bash[13549]: audit 2021-01-28T03:56:22.214647+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:23.576 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:23 smithi100 bash[13549]: cephadm 2021-01-28T03:56:22.215757+0000 mgr.y (mgr.14138) 258 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:56:23.577 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:23 smithi100 bash[13549]: cephadm 2021-01-28T03:56:22.216311+0000 mgr.y (mgr.14138) 259 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T03:56:23.577 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:23 smithi100 bash[13549]: cephadm 2021-01-28T03:56:22.216879+0000 mgr.y (mgr.14138) 260 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi162', network='', name='iscsi.a')] 2021-01-28T03:56:23.578 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:23 smithi100 bash[13549]: cephadm 2021-01-28T03:56:22.217090+0000 mgr.y (mgr.14138) 261 : cephadm [INF] Checking pool "iscsi" exists for service iscsi.iscsi 2021-01-28T03:56:23.578 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:23 smithi100 bash[13549]: cephadm 2021-01-28T03:56:22.224643+0000 mgr.y (mgr.14138) 262 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi162=iscsi.a;count:1 2021-01-28T03:56:23.578 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:23 smithi100 bash[13549]: audit 2021-01-28T03:56:22.228716+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:23.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:23 smithi100 bash[13549]: audit 2021-01-28T03:56:22.229639+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "osd", "allow rwx"]}]: dispatch 2021-01-28T03:56:23.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:23 smithi100 bash[13549]: audit 2021-01-28T03:56:22.233673+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "osd", "allow rwx"]}]': finished 2021-01-28T03:56:23.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:23 smithi100 bash[13549]: audit 2021-01-28T03:56:22.245174+0000 mon.a (mon.0) 574 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:56:23.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:23 smithi100 bash[13549]: cephadm 2021-01-28T03:56:22.246093+0000 mgr.y (mgr.14138) 263 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi162 2021-01-28T03:56:23.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:23 smithi100 bash[13549]: audit 2021-01-28T03:56:22.246619+0000 mon.a (mon.0) 575 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.iscsi.iscsi.a", "key": "container_image"}]: dispatch 2021-01-28T03:56:23.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:23 smithi100 bash[9834]: audit 2021-01-28T03:56:22.201142+0000 mgr.y (mgr.14138) 256 : audit [DBG] from='client.34433 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi162=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:56:23.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:23 smithi100 bash[9834]: cephadm 2021-01-28T03:56:22.203067+0000 mgr.y (mgr.14138) 257 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi162=iscsi.a;count:1 2021-01-28T03:56:23.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:23 smithi100 bash[9834]: audit 2021-01-28T03:56:22.207942+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:23.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:23 smithi100 bash[9834]: audit 2021-01-28T03:56:22.214647+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:23.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:23 smithi100 bash[9834]: cephadm 2021-01-28T03:56:22.215757+0000 mgr.y (mgr.14138) 258 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:56:23.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:23 smithi100 bash[9834]: cephadm 2021-01-28T03:56:22.216311+0000 mgr.y (mgr.14138) 259 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T03:56:23.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:23 smithi100 bash[9834]: cephadm 2021-01-28T03:56:22.216879+0000 mgr.y (mgr.14138) 260 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi162', network='', name='iscsi.a')] 2021-01-28T03:56:23.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:23 smithi100 bash[9834]: cephadm 2021-01-28T03:56:22.217090+0000 mgr.y (mgr.14138) 261 : cephadm [INF] Checking pool "iscsi" exists for service iscsi.iscsi 2021-01-28T03:56:23.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:23 smithi100 bash[9834]: cephadm 2021-01-28T03:56:22.224643+0000 mgr.y (mgr.14138) 262 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi162=iscsi.a;count:1 2021-01-28T03:56:23.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:23 smithi100 bash[9834]: audit 2021-01-28T03:56:22.228716+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:23.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:23 smithi100 bash[9834]: audit 2021-01-28T03:56:22.229639+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "osd", "allow rwx"]}]: dispatch 2021-01-28T03:56:23.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:23 smithi100 bash[9834]: audit 2021-01-28T03:56:22.233673+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "osd", "allow rwx"]}]': finished 2021-01-28T03:56:23.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:23 smithi100 bash[9834]: audit 2021-01-28T03:56:22.245174+0000 mon.a (mon.0) 574 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T03:56:23.584 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:23 smithi100 bash[9834]: cephadm 2021-01-28T03:56:22.246093+0000 mgr.y (mgr.14138) 263 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi162 2021-01-28T03:56:23.584 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:23 smithi100 bash[9834]: audit 2021-01-28T03:56:22.246619+0000 mon.a (mon.0) 575 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.iscsi.iscsi.a", "key": "container_image"}]: dispatch 2021-01-28T03:56:24.509 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:24 smithi162 bash[9856]: cluster 2021-01-28T03:56:23.368171+0000 mgr.y (mgr.14138) 264 : cluster [DBG] pgmap v222: 132 pgs: 5 creating+peering, 13 unknown, 114 active+clean; 23 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 17 KiB/s wr, 196 op/s 2021-01-28T03:56:24.574 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:24 smithi100 bash[13549]: cluster 2021-01-28T03:56:23.368171+0000 mgr.y (mgr.14138) 264 : cluster [DBG] pgmap v222: 132 pgs: 5 creating+peering, 13 unknown, 114 active+clean; 23 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 17 KiB/s wr, 196 op/s 2021-01-28T03:56:24.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:24 smithi100 bash[9834]: cluster 2021-01-28T03:56:23.368171+0000 mgr.y (mgr.14138) 264 : cluster [DBG] pgmap v222: 132 pgs: 5 creating+peering, 13 unknown, 114 active+clean; 23 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s rd, 17 KiB/s wr, 196 op/s 2021-01-28T03:56:25.471 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:25 smithi162 bash[9856]: cluster 2021-01-28T03:56:24.228756+0000 mon.a (mon.0) 576 : cluster [DBG] mgrmap e15: y(active, since 5m), standbys: x 2021-01-28T03:56:25.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:25 smithi100 bash[9834]: cluster 2021-01-28T03:56:24.228756+0000 mon.a (mon.0) 576 : cluster [DBG] mgrmap e15: y(active, since 5m), standbys: x 2021-01-28T03:56:25.574 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:25 smithi100 bash[13549]: cluster 2021-01-28T03:56:24.228756+0000 mon.a (mon.0) 576 : cluster [DBG] mgrmap e15: y(active, since 5m), standbys: x 2021-01-28T03:56:26.259 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:26 smithi162 bash[9856]: cluster 2021-01-28T03:56:25.369335+0000 mgr.y (mgr.14138) 265 : cluster [DBG] pgmap v223: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 113 KiB/s rd, 15 KiB/s wr, 258 op/s 2021-01-28T03:56:26.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:26 smithi100 bash[9834]: cluster 2021-01-28T03:56:25.369335+0000 mgr.y (mgr.14138) 265 : cluster [DBG] pgmap v223: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 113 KiB/s rd, 15 KiB/s wr, 258 op/s 2021-01-28T03:56:26.574 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:26 smithi100 bash[13549]: cluster 2021-01-28T03:56:25.369335+0000 mgr.y (mgr.14138) 265 : cluster [DBG] pgmap v223: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 113 KiB/s rd, 15 KiB/s wr, 258 op/s 2021-01-28T03:56:27.824 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:27 smithi100 bash[9834]: audit 2021-01-28T03:56:26.534219+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:27.824 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:27 smithi100 bash[9834]: audit 2021-01-28T03:56:26.536566+0000 mon.a (mon.0) 578 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:56:27.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:27 smithi100 bash[9834]: cluster 2021-01-28T03:56:27.370305+0000 mgr.y (mgr.14138) 266 : cluster [DBG] pgmap v224: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s rd, 9.1 KiB/s wr, 225 op/s 2021-01-28T03:56:27.825 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:27 smithi100 bash[13549]: audit 2021-01-28T03:56:26.534219+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:27.825 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:27 smithi100 bash[13549]: audit 2021-01-28T03:56:26.536566+0000 mon.a (mon.0) 578 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:56:27.826 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:27 smithi100 bash[13549]: cluster 2021-01-28T03:56:27.370305+0000 mgr.y (mgr.14138) 266 : cluster [DBG] pgmap v224: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s rd, 9.1 KiB/s wr, 225 op/s 2021-01-28T03:56:28.009 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:27 smithi162 bash[9856]: audit 2021-01-28T03:56:26.534219+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:28.010 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:27 smithi162 bash[9856]: audit 2021-01-28T03:56:26.536566+0000 mon.a (mon.0) 578 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:56:28.010 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:27 smithi162 bash[9856]: cluster 2021-01-28T03:56:27.370305+0000 mgr.y (mgr.14138) 266 : cluster [DBG] pgmap v224: 132 pgs: 132 active+clean; 25 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 103 KiB/s rd, 9.1 KiB/s wr, 225 op/s 2021-01-28T03:56:28.711 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.709+0000 7f2377fff700 1 -- 172.21.15.162:0/2221378388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23780fb4a0 msgr2=0x7f23780fd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:28.711 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.709+0000 7f2377fff700 1 --2- 172.21.15.162:0/2221378388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23780fb4a0 0x7f23780fd930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f2370009dc0 tx=0x7f2370004d10).stop 2021-01-28T03:56:28.712 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.709+0000 7f2377fff700 1 -- 172.21.15.162:0/2221378388 shutdown_connections 2021-01-28T03:56:28.712 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.709+0000 7f2377fff700 1 --2- 172.21.15.162:0/2221378388 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23780fb4a0 0x7f23780fd930 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:28.712 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.709+0000 7f2377fff700 1 --2- 172.21.15.162:0/2221378388 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f237805f610 0x7f23780f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:28.712 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.709+0000 7f2377fff700 1 --2- 172.21.15.162:0/2221378388 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f23780f8a30 0x7f23780fae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:28.713 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.709+0000 7f2377fff700 1 -- 172.21.15.162:0/2221378388 >> 172.21.15.162:0/2221378388 conn(0x7f23780effa0 msgr2=0x7f23780f23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:56:28.713 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.709+0000 7f2377fff700 1 -- 172.21.15.162:0/2221378388 shutdown_connections 2021-01-28T03:56:28.713 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.709+0000 7f2377fff700 1 -- 172.21.15.162:0/2221378388 wait complete. 2021-01-28T03:56:28.715 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.709+0000 7f2377fff700 1 Processor -- start 2021-01-28T03:56:28.715 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.709+0000 7f2377fff700 1 -- start start 2021-01-28T03:56:28.715 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.709+0000 7f2377fff700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f237805f610 0x7f23780f5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:56:28.715 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.709+0000 7f2377fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23780f8a30 0x7f23780f4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:56:28.716 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.709+0000 7f2377fff700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f23780fb4a0 0x7f23780f4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:56:28.716 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.709+0000 7f2377fff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23780f4e20 con 0x7f23780f8a30 2021-01-28T03:56:28.716 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.709+0000 7f2377fff700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23780f4f90 con 0x7f237805f610 2021-01-28T03:56:28.716 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.709+0000 7f2377fff700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23780f5150 con 0x7f23780fb4a0 2021-01-28T03:56:28.716 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.709+0000 7f2376ffd700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f237805f610 0x7f23780f5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:56:28.717 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.709+0000 7f2376ffd700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f237805f610 0x7f23780f5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:45352/0 (socket says 172.21.15.162:45352) 2021-01-28T03:56:28.717 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.709+0000 7f2376ffd700 1 -- 172.21.15.162:0/151640031 learned_addr learned my addr 172.21.15.162:0/151640031 (peer_addr_for_me v2:172.21.15.162:0/0) 2021-01-28T03:56:28.717 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.709+0000 7f23777fe700 1 --2- 172.21.15.162:0/151640031 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f23780fb4a0 0x7f23780f4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:56:28.717 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.709+0000 7f23767fc700 1 --2- 172.21.15.162:0/151640031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23780f8a30 0x7f23780f4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:56:28.717 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.713+0000 7f2376ffd700 1 -- 172.21.15.162:0/151640031 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f23780fb4a0 msgr2=0x7f23780f4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:28.718 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.713+0000 7f2376ffd700 1 --2- 172.21.15.162:0/151640031 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f23780fb4a0 0x7f23780f4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:28.718 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.713+0000 7f2376ffd700 1 -- 172.21.15.162:0/151640031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23780f8a30 msgr2=0x7f23780f4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:28.718 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.713+0000 7f2376ffd700 1 --2- 172.21.15.162:0/151640031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23780f8a30 0x7f23780f4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:28.718 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.713+0000 7f2376ffd700 1 -- 172.21.15.162:0/151640031 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2378113ec0 con 0x7f237805f610 2021-01-28T03:56:28.719 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.713+0000 7f23767fc700 1 --2- 172.21.15.162:0/151640031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23780f8a30 0x7f23780f4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-28T03:56:28.719 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.713+0000 7f2376ffd700 1 --2- 172.21.15.162:0/151640031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f237805f610 0x7f23780f5fc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f2368002a20 tx=0x7f2368009de0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:56:28.719 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.713+0000 7f235f7fe700 1 -- 172.21.15.162:0/151640031 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2368009320 con 0x7f237805f610 2021-01-28T03:56:28.719 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.713+0000 7f235f7fe700 1 -- 172.21.15.162:0/151640031 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f236800f040 con 0x7f237805f610 2021-01-28T03:56:28.719 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.713+0000 7f235f7fe700 1 -- 172.21.15.162:0/151640031 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236800d850 con 0x7f237805f610 2021-01-28T03:56:28.720 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.713+0000 7f2377fff700 1 -- 172.21.15.162:0/151640031 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2378114050 con 0x7f237805f610 2021-01-28T03:56:28.720 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.713+0000 7f2377fff700 1 -- 172.21.15.162:0/151640031 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2378114530 con 0x7f237805f610 2021-01-28T03:56:28.720 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.713+0000 7f2377fff700 1 -- 172.21.15.162:0/151640031 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f237805d6c0 con 0x7f237805f610 2021-01-28T03:56:28.720 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.713+0000 7f235f7fe700 1 -- 172.21.15.162:0/151640031 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f236800dc80 con 0x7f237805f610 2021-01-28T03:56:28.721 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.713+0000 7f235f7fe700 1 --2- 172.21.15.162:0/151640031 >> v2:172.21.15.100:6800/928846103 conn(0x7f236005bc70 0x7f236005e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:56:28.721 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.713+0000 7f235f7fe700 1 -- 172.21.15.162:0/151640031 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5875+0+0 (secure 0 0 0) 0x7f2368075df0 con 0x7f237805f610 2021-01-28T03:56:28.722 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.713+0000 7f23767fc700 1 --2- 172.21.15.162:0/151640031 >> v2:172.21.15.100:6800/928846103 conn(0x7f236005bc70 0x7f236005e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:56:28.722 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.713+0000 7f23767fc700 1 --2- 172.21.15.162:0/151640031 >> v2:172.21.15.100:6800/928846103 conn(0x7f236005bc70 0x7f236005e130 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f237805f3e0 tx=0x7f236c009c80).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:56:28.722 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.721+0000 7f235f7fe700 1 -- 172.21.15.162:0/151640031 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f237805d6c0 con 0x7f237805f610 2021-01-28T03:56:28.935 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.933+0000 7f2377fff700 1 -- 172.21.15.162:0/151640031 --> v2:172.21.15.100:6800/928846103 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi162=a", "target": ["mon-mgr", ""]}) v1 -- 0x7f237805d6c0 con 0x7f236005bc70 2021-01-28T03:56:28.946 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.945+0000 7f235f7fe700 1 -- 172.21.15.162:0/151640031 <== mgr.14138 v2:172.21.15.100:6800/928846103 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f237805d6c0 con 0x7f236005bc70 2021-01-28T03:56:28.947 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled prometheus update... 2021-01-28T03:56:28.948 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.949+0000 7f2377fff700 1 -- 172.21.15.162:0/151640031 >> v2:172.21.15.100:6800/928846103 conn(0x7f236005bc70 msgr2=0x7f236005e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:28.949 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.949+0000 7f2377fff700 1 --2- 172.21.15.162:0/151640031 >> v2:172.21.15.100:6800/928846103 conn(0x7f236005bc70 0x7f236005e130 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f237805f3e0 tx=0x7f236c009c80).stop 2021-01-28T03:56:28.949 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.949+0000 7f2377fff700 1 -- 172.21.15.162:0/151640031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f237805f610 msgr2=0x7f23780f5fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:28.949 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.949+0000 7f2377fff700 1 --2- 172.21.15.162:0/151640031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f237805f610 0x7f23780f5fc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f2368002a20 tx=0x7f2368009de0).stop 2021-01-28T03:56:28.949 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.949+0000 7f2377fff700 1 -- 172.21.15.162:0/151640031 shutdown_connections 2021-01-28T03:56:28.950 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.949+0000 7f2377fff700 1 --2- 172.21.15.162:0/151640031 >> v2:172.21.15.100:6800/928846103 conn(0x7f236005bc70 0x7f236005e130 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:28.950 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.949+0000 7f2377fff700 1 --2- 172.21.15.162:0/151640031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f237805f610 0x7f23780f5fc0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:28.950 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.949+0000 7f2377fff700 1 --2- 172.21.15.162:0/151640031 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f23780fb4a0 0x7f23780f4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:28.950 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.949+0000 7f2377fff700 1 --2- 172.21.15.162:0/151640031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23780f8a30 0x7f23780f4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:28.951 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.949+0000 7f2377fff700 1 -- 172.21.15.162:0/151640031 >> 172.21.15.162:0/151640031 conn(0x7f23780effa0 msgr2=0x7f23780f9670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:56:28.951 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.949+0000 7f2377fff700 1 -- 172.21.15.162:0/151640031 shutdown_connections 2021-01-28T03:56:28.952 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:28.949+0000 7f2377fff700 1 -- 172.21.15.162:0/151640031 wait complete. 2021-01-28T03:56:29.113 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 03:56:28 smithi162 bash[22154]: log file path now is '/var/log/tcmu-runner.log' 2021-01-28T03:56:29.113 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:28 smithi162 bash[9856]: audit 2021-01-28T03:56:27.859884+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:29.114 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:28 smithi162 bash[9856]: audit 2021-01-28T03:56:27.868448+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:29.114 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:28 smithi162 bash[9856]: cephadm 2021-01-28T03:56:27.870460+0000 mgr.y (mgr.14138) 267 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:56:29.114 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:28 smithi162 bash[9856]: cephadm 2021-01-28T03:56:27.871818+0000 mgr.y (mgr.14138) 268 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T03:56:29.114 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:28 smithi162 bash[9856]: cephadm 2021-01-28T03:56:27.872911+0000 mgr.y (mgr.14138) 269 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='iscsi.a')] + new hosts [] 2021-01-28T03:56:29.114 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:28 smithi162 bash[9856]: audit 2021-01-28T03:56:27.879491+0000 mon.a (mon.0) 581 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2021-01-28T03:56:29.115 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:28 smithi162 bash[9856]: audit 2021-01-28T03:56:27.880873+0000 mgr.y (mgr.14138) 270 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2021-01-28T03:56:29.115 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:28 smithi162 bash[9856]: cephadm 2021-01-28T03:56:27.884445+0000 mgr.y (mgr.14138) 271 : cephadm [INF] Adding iSCSI gateway http://:@172.21.15.162:5000 to Dashboard 2021-01-28T03:56:29.115 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:28 smithi162 bash[9856]: audit 2021-01-28T03:56:27.884846+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2021-01-28T03:56:29.115 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:28 smithi162 bash[9856]: audit 2021-01-28T03:56:27.885739+0000 mgr.y (mgr.14138) 272 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2021-01-28T03:56:29.116 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:28 smithi162 bash[9856]: audit 2021-01-28T03:56:27.896260+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:29.116 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:28 smithi162 bash[9856]: audit 2021-01-28T03:56:27.901854+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi162"}]: dispatch 2021-01-28T03:56:29.116 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:28 smithi162 bash[9856]: audit 2021-01-28T03:56:27.903277+0000 mgr.y (mgr.14138) 273 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi162"}]: dispatch 2021-01-28T03:56:29.116 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:28 smithi162 bash[9856]: audit 2021-01-28T03:56:27.917982+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:29.116 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:28 smithi162 bash[9856]: audit 2021-01-28T03:56:27.928752+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:29.117 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:28 smithi162 bash[9856]: cephadm 2021-01-28T03:56:27.930105+0000 mgr.y (mgr.14138) 274 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:56:29.118 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:28 smithi162 bash[9856]: cephadm 2021-01-28T03:56:27.931182+0000 mgr.y (mgr.14138) 275 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T03:56:29.118 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:28 smithi162 bash[9856]: cephadm 2021-01-28T03:56:27.932155+0000 mgr.y (mgr.14138) 276 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='iscsi.a')] + new hosts [] 2021-01-28T03:56:29.325 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:28 smithi100 bash[13549]: audit 2021-01-28T03:56:27.859884+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:29.325 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:28 smithi100 bash[13549]: audit 2021-01-28T03:56:27.868448+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:29.325 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:28 smithi100 bash[13549]: cephadm 2021-01-28T03:56:27.870460+0000 mgr.y (mgr.14138) 267 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:56:29.325 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:28 smithi100 bash[13549]: cephadm 2021-01-28T03:56:27.871818+0000 mgr.y (mgr.14138) 268 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T03:56:29.326 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:28 smithi100 bash[13549]: cephadm 2021-01-28T03:56:27.872911+0000 mgr.y (mgr.14138) 269 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='iscsi.a')] + new hosts [] 2021-01-28T03:56:29.326 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:28 smithi100 bash[13549]: audit 2021-01-28T03:56:27.879491+0000 mon.a (mon.0) 581 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2021-01-28T03:56:29.326 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:28 smithi100 bash[13549]: audit 2021-01-28T03:56:27.880873+0000 mgr.y (mgr.14138) 270 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2021-01-28T03:56:29.326 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:28 smithi100 bash[13549]: cephadm 2021-01-28T03:56:27.884445+0000 mgr.y (mgr.14138) 271 : cephadm [INF] Adding iSCSI gateway http://:@172.21.15.162:5000 to Dashboard 2021-01-28T03:56:29.327 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:28 smithi100 bash[13549]: audit 2021-01-28T03:56:27.884846+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2021-01-28T03:56:29.327 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:28 smithi100 bash[13549]: audit 2021-01-28T03:56:27.885739+0000 mgr.y (mgr.14138) 272 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2021-01-28T03:56:29.327 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:28 smithi100 bash[13549]: audit 2021-01-28T03:56:27.896260+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:29.327 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:28 smithi100 bash[13549]: audit 2021-01-28T03:56:27.901854+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi162"}]: dispatch 2021-01-28T03:56:29.327 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:28 smithi100 bash[13549]: audit 2021-01-28T03:56:27.903277+0000 mgr.y (mgr.14138) 273 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi162"}]: dispatch 2021-01-28T03:56:29.328 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:28 smithi100 bash[13549]: audit 2021-01-28T03:56:27.917982+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:29.328 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:28 smithi100 bash[13549]: audit 2021-01-28T03:56:27.928752+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:29.328 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:28 smithi100 bash[13549]: cephadm 2021-01-28T03:56:27.930105+0000 mgr.y (mgr.14138) 274 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:56:29.328 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:28 smithi100 bash[13549]: cephadm 2021-01-28T03:56:27.931182+0000 mgr.y (mgr.14138) 275 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T03:56:29.329 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:28 smithi100 bash[13549]: cephadm 2021-01-28T03:56:27.932155+0000 mgr.y (mgr.14138) 276 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='iscsi.a')] + new hosts [] 2021-01-28T03:56:29.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:28 smithi100 bash[9834]: audit 2021-01-28T03:56:27.859884+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:29.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:28 smithi100 bash[9834]: audit 2021-01-28T03:56:27.868448+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:29.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:28 smithi100 bash[9834]: cephadm 2021-01-28T03:56:27.870460+0000 mgr.y (mgr.14138) 267 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:56:29.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:28 smithi100 bash[9834]: cephadm 2021-01-28T03:56:27.871818+0000 mgr.y (mgr.14138) 268 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T03:56:29.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:28 smithi100 bash[9834]: cephadm 2021-01-28T03:56:27.872911+0000 mgr.y (mgr.14138) 269 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='iscsi.a')] + new hosts [] 2021-01-28T03:56:29.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:28 smithi100 bash[9834]: audit 2021-01-28T03:56:27.879491+0000 mon.a (mon.0) 581 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2021-01-28T03:56:29.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:28 smithi100 bash[9834]: audit 2021-01-28T03:56:27.880873+0000 mgr.y (mgr.14138) 270 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2021-01-28T03:56:29.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:28 smithi100 bash[9834]: cephadm 2021-01-28T03:56:27.884445+0000 mgr.y (mgr.14138) 271 : cephadm [INF] Adding iSCSI gateway http://:@172.21.15.162:5000 to Dashboard 2021-01-28T03:56:29.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:28 smithi100 bash[9834]: audit 2021-01-28T03:56:27.884846+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2021-01-28T03:56:29.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:28 smithi100 bash[9834]: audit 2021-01-28T03:56:27.885739+0000 mgr.y (mgr.14138) 272 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2021-01-28T03:56:29.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:28 smithi100 bash[9834]: audit 2021-01-28T03:56:27.896260+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:29.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:28 smithi100 bash[9834]: audit 2021-01-28T03:56:27.901854+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi162"}]: dispatch 2021-01-28T03:56:29.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:28 smithi100 bash[9834]: audit 2021-01-28T03:56:27.903277+0000 mgr.y (mgr.14138) 273 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi162"}]: dispatch 2021-01-28T03:56:29.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:28 smithi100 bash[9834]: audit 2021-01-28T03:56:27.917982+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:29.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:28 smithi100 bash[9834]: audit 2021-01-28T03:56:27.928752+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:29.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:28 smithi100 bash[9834]: cephadm 2021-01-28T03:56:27.930105+0000 mgr.y (mgr.14138) 274 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:56:29.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:28 smithi100 bash[9834]: cephadm 2021-01-28T03:56:27.931182+0000 mgr.y (mgr.14138) 275 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T03:56:29.333 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:28 smithi100 bash[9834]: cephadm 2021-01-28T03:56:27.932155+0000 mgr.y (mgr.14138) 276 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='iscsi.a')] + new hosts [] 2021-01-28T03:56:29.759 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 03:56:29 smithi162 bash[22192]: debug Started the configuration object watcher 2021-01-28T03:56:29.760 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 03:56:29 smithi162 bash[22192]: debug Checking for config object changes every 1s 2021-01-28T03:56:29.760 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 03:56:29 smithi162 bash[22192]: debug Processing osd blocklist entries for this node 2021-01-28T03:56:29.778 DEBUG:teuthology.orchestra.run.smithi162:prometheus.a> sudo journalctl -f -n 0 -u ceph-c217df96-611b-11eb-8f9e-001a4aab830c@prometheus.a.service 2021-01-28T03:56:29.781 INFO:tasks.cephadm:Adding node-exporter.a on smithi100 2021-01-28T03:56:29.781 INFO:tasks.cephadm:Adding node-exporter.b on smithi162 2021-01-28T03:56:29.781 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph orch apply node-exporter '2;smithi100=a;smithi162=b' 2021-01-28T03:56:29.807 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T03:56:30.259 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 03:56:29 smithi162 bash[22192]: debug Reading the configuration object to update local LIO configuration 2021-01-28T03:56:30.260 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 03:56:29 smithi162 bash[22192]: debug Configuration does not have an entry for this host(smithi162.front.sepia.ceph.com) - nothing to define to LIO 2021-01-28T03:56:30.260 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 03:56:29 smithi162 bash[22192]: debug * Running on http://[::]:5000/ (Press CTRL+C to quit) 2021-01-28T03:56:30.260 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:29 smithi162 bash[9856]: audit 2021-01-28T03:56:28.939434+0000 mgr.y (mgr.14138) 277 : audit [DBG] from='client.34451 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi162=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:56:30.260 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:29 smithi162 bash[9856]: cephadm 2021-01-28T03:56:28.941568+0000 mgr.y (mgr.14138) 278 : cephadm [INF] Saving service prometheus spec with placement smithi162=a;count:1 2021-01-28T03:56:30.261 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:29 smithi162 bash[9856]: audit 2021-01-28T03:56:28.947828+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:30.261 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:29 smithi162 bash[9856]: audit 2021-01-28T03:56:28.958567+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:30.261 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:29 smithi162 bash[9856]: cephadm 2021-01-28T03:56:28.960167+0000 mgr.y (mgr.14138) 279 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:56:30.261 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:29 smithi162 bash[9856]: cephadm 2021-01-28T03:56:28.961413+0000 mgr.y (mgr.14138) 280 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T03:56:30.262 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:29 smithi162 bash[9856]: cephadm 2021-01-28T03:56:28.962358+0000 mgr.y (mgr.14138) 281 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='iscsi.a')] + new hosts [] 2021-01-28T03:56:30.262 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:29 smithi162 bash[9856]: cephadm 2021-01-28T03:56:28.963394+0000 mgr.y (mgr.14138) 282 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi162', network='', name='a')] 2021-01-28T03:56:30.262 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:29 smithi162 bash[9856]: cephadm 2021-01-28T03:56:28.973615+0000 mgr.y (mgr.14138) 283 : cephadm [INF] Deploying daemon prometheus.a on smithi162 2021-01-28T03:56:30.262 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:29 smithi162 bash[9856]: cluster 2021-01-28T03:56:29.371680+0000 mgr.y (mgr.14138) 284 : cluster [DBG] pgmap v225: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 95 KiB/s rd, 6.5 KiB/s wr, 205 op/s 2021-01-28T03:56:30.262 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:29 smithi162 bash[9856]: audit 2021-01-28T03:56:29.804068+0000 mon.b (mon.2) 21 : audit [DBG] from='client.? 172.21.15.162:0/3407166423' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2021-01-28T03:56:30.324 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:29 smithi100 bash[13549]: audit 2021-01-28T03:56:28.939434+0000 mgr.y (mgr.14138) 277 : audit [DBG] from='client.34451 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi162=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:56:30.325 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:29 smithi100 bash[13549]: cephadm 2021-01-28T03:56:28.941568+0000 mgr.y (mgr.14138) 278 : cephadm [INF] Saving service prometheus spec with placement smithi162=a;count:1 2021-01-28T03:56:30.325 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:29 smithi100 bash[13549]: audit 2021-01-28T03:56:28.947828+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:30.325 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:29 smithi100 bash[13549]: audit 2021-01-28T03:56:28.958567+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:30.326 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:29 smithi100 bash[13549]: cephadm 2021-01-28T03:56:28.960167+0000 mgr.y (mgr.14138) 279 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:56:30.326 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:29 smithi100 bash[13549]: cephadm 2021-01-28T03:56:28.961413+0000 mgr.y (mgr.14138) 280 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T03:56:30.326 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:29 smithi100 bash[13549]: cephadm 2021-01-28T03:56:28.962358+0000 mgr.y (mgr.14138) 281 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='iscsi.a')] + new hosts [] 2021-01-28T03:56:30.326 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:29 smithi100 bash[13549]: cephadm 2021-01-28T03:56:28.963394+0000 mgr.y (mgr.14138) 282 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi162', network='', name='a')] 2021-01-28T03:56:30.326 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:29 smithi100 bash[13549]: cephadm 2021-01-28T03:56:28.973615+0000 mgr.y (mgr.14138) 283 : cephadm [INF] Deploying daemon prometheus.a on smithi162 2021-01-28T03:56:30.327 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:29 smithi100 bash[13549]: cluster 2021-01-28T03:56:29.371680+0000 mgr.y (mgr.14138) 284 : cluster [DBG] pgmap v225: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 95 KiB/s rd, 6.5 KiB/s wr, 205 op/s 2021-01-28T03:56:30.327 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:29 smithi100 bash[13549]: audit 2021-01-28T03:56:29.804068+0000 mon.b (mon.2) 21 : audit [DBG] from='client.? 172.21.15.162:0/3407166423' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2021-01-28T03:56:30.327 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:29 smithi100 bash[9834]: audit 2021-01-28T03:56:28.939434+0000 mgr.y (mgr.14138) 277 : audit [DBG] from='client.34451 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi162=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:56:30.327 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:29 smithi100 bash[9834]: cephadm 2021-01-28T03:56:28.941568+0000 mgr.y (mgr.14138) 278 : cephadm [INF] Saving service prometheus spec with placement smithi162=a;count:1 2021-01-28T03:56:30.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:29 smithi100 bash[9834]: audit 2021-01-28T03:56:28.947828+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:30.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:29 smithi100 bash[9834]: audit 2021-01-28T03:56:28.958567+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:30.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:29 smithi100 bash[9834]: cephadm 2021-01-28T03:56:28.960167+0000 mgr.y (mgr.14138) 279 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:56:30.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:29 smithi100 bash[9834]: cephadm 2021-01-28T03:56:28.961413+0000 mgr.y (mgr.14138) 280 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T03:56:30.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:29 smithi100 bash[9834]: cephadm 2021-01-28T03:56:28.962358+0000 mgr.y (mgr.14138) 281 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='iscsi.a')] + new hosts [] 2021-01-28T03:56:30.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:29 smithi100 bash[9834]: cephadm 2021-01-28T03:56:28.963394+0000 mgr.y (mgr.14138) 282 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi162', network='', name='a')] 2021-01-28T03:56:30.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:29 smithi100 bash[9834]: cephadm 2021-01-28T03:56:28.973615+0000 mgr.y (mgr.14138) 283 : cephadm [INF] Deploying daemon prometheus.a on smithi162 2021-01-28T03:56:30.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:29 smithi100 bash[9834]: cluster 2021-01-28T03:56:29.371680+0000 mgr.y (mgr.14138) 284 : cluster [DBG] pgmap v225: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 95 KiB/s rd, 6.5 KiB/s wr, 205 op/s 2021-01-28T03:56:30.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:29 smithi100 bash[9834]: audit 2021-01-28T03:56:29.804068+0000 mon.b (mon.2) 21 : audit [DBG] from='client.? 172.21.15.162:0/3407166423' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2021-01-28T03:56:32.510 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:32 smithi162 bash[9856]: cluster 2021-01-28T03:56:31.372681+0000 mgr.y (mgr.14138) 285 : cluster [DBG] pgmap v226: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 82 KiB/s rd, 5.6 KiB/s wr, 176 op/s 2021-01-28T03:56:32.824 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:32 smithi100 bash[13549]: cluster 2021-01-28T03:56:31.372681+0000 mgr.y (mgr.14138) 285 : cluster [DBG] pgmap v226: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 82 KiB/s rd, 5.6 KiB/s wr, 176 op/s 2021-01-28T03:56:32.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:32 smithi100 bash[9834]: cluster 2021-01-28T03:56:31.372681+0000 mgr.y (mgr.14138) 285 : cluster [DBG] pgmap v226: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 82 KiB/s rd, 5.6 KiB/s wr, 176 op/s 2021-01-28T03:56:34.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:34 smithi162 bash[9856]: cluster 2021-01-28T03:56:33.373811+0000 mgr.y (mgr.14138) 286 : cluster [DBG] pgmap v227: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 4.9 KiB/s wr, 154 op/s 2021-01-28T03:56:34.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:34 smithi100 bash[9834]: cluster 2021-01-28T03:56:33.373811+0000 mgr.y (mgr.14138) 286 : cluster [DBG] pgmap v227: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 4.9 KiB/s wr, 154 op/s 2021-01-28T03:56:34.825 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:34 smithi100 bash[13549]: cluster 2021-01-28T03:56:33.373811+0000 mgr.y (mgr.14138) 286 : cluster [DBG] pgmap v227: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 4.9 KiB/s wr, 154 op/s 2021-01-28T03:56:35.582 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.580+0000 7f80cc6b5700 1 -- 172.21.15.162:0/2821883641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80c40fb610 msgr2=0x7f80c40fdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:35.583 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.580+0000 7f80cc6b5700 1 --2- 172.21.15.162:0/2821883641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80c40fb610 0x7f80c40fdaa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f80bc009dc0 tx=0x7f80bc004d10).stop 2021-01-28T03:56:35.583 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.580+0000 7f80cc6b5700 1 -- 172.21.15.162:0/2821883641 shutdown_connections 2021-01-28T03:56:35.584 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.580+0000 7f80cc6b5700 1 --2- 172.21.15.162:0/2821883641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80c40fb610 0x7f80c40fdaa0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:35.584 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.580+0000 7f80cc6b5700 1 --2- 172.21.15.162:0/2821883641 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f80c405fbc0 0x7f80c40f8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:35.584 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.580+0000 7f80cc6b5700 1 --2- 172.21.15.162:0/2821883641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80c40f8b80 0x7f80c40fafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:35.585 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.580+0000 7f80cc6b5700 1 -- 172.21.15.162:0/2821883641 >> 172.21.15.162:0/2821883641 conn(0x7f80c40f0120 msgr2=0x7f80c40f2540 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:56:35.585 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.580+0000 7f80cc6b5700 1 -- 172.21.15.162:0/2821883641 shutdown_connections 2021-01-28T03:56:35.586 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.580+0000 7f80cc6b5700 1 -- 172.21.15.162:0/2821883641 wait complete. 2021-01-28T03:56:35.590 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.580+0000 7f80cc6b5700 1 Processor -- start 2021-01-28T03:56:35.590 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.580+0000 7f80cc6b5700 1 -- start start 2021-01-28T03:56:35.590 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.580+0000 7f80cc6b5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80c405fbc0 0x7f80c41056e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:56:35.591 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.580+0000 7f80cc6b5700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80c40f8b80 0x7f80c4105bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:56:35.591 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.580+0000 7f80cc6b5700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f80c40fb610 0x7f80c410ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:56:35.592 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.580+0000 7f80cc6b5700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c410d1a0 con 0x7f80c405fbc0 2021-01-28T03:56:35.592 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.580+0000 7f80cc6b5700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c410d2e0 con 0x7f80c40f8b80 2021-01-28T03:56:35.593 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.580+0000 7f80cc6b5700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c410d420 con 0x7f80c40fb610 2021-01-28T03:56:35.593 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.580+0000 7f80c9c50700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80c40f8b80 0x7f80c4105bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:56:35.593 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.580+0000 7f80c9c50700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80c40f8b80 0x7f80c4105bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:45460/0 (socket says 172.21.15.162:45460) 2021-01-28T03:56:35.594 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.580+0000 7f80c9c50700 1 -- 172.21.15.162:0/3671887590 learned_addr learned my addr 172.21.15.162:0/3671887590 (peer_addr_for_me v2:172.21.15.162:0/0) 2021-01-28T03:56:35.594 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.580+0000 7f80cac52700 1 --2- 172.21.15.162:0/3671887590 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f80c40fb610 0x7f80c410ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:56:35.595 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.580+0000 7f80ca451700 1 --2- 172.21.15.162:0/3671887590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80c405fbc0 0x7f80c41056e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:56:35.595 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.580+0000 7f80c9c50700 1 -- 172.21.15.162:0/3671887590 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f80c40fb610 msgr2=0x7f80c410ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:35.596 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.580+0000 7f80c9c50700 1 --2- 172.21.15.162:0/3671887590 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f80c40fb610 0x7f80c410ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:35.596 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.580+0000 7f80c9c50700 1 -- 172.21.15.162:0/3671887590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80c405fbc0 msgr2=0x7f80c41056e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:35.596 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.580+0000 7f80c9c50700 1 --2- 172.21.15.162:0/3671887590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80c405fbc0 0x7f80c41056e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:35.597 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.580+0000 7f80c9c50700 1 -- 172.21.15.162:0/3671887590 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c410d5e0 con 0x7f80c40f8b80 2021-01-28T03:56:35.597 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.580+0000 7f80c9c50700 1 --2- 172.21.15.162:0/3671887590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80c40f8b80 0x7f80c4105bd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f80c000eb90 tx=0x7f80c000b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:56:35.598 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.580+0000 7f80baffd700 1 -- 172.21.15.162:0/3671887590 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c00092e0 con 0x7f80c40f8b80 2021-01-28T03:56:35.598 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.580+0000 7f80baffd700 1 -- 172.21.15.162:0/3671887590 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f80c000f040 con 0x7f80c40f8b80 2021-01-28T03:56:35.598 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.580+0000 7f80baffd700 1 -- 172.21.15.162:0/3671887590 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80c0007ea0 con 0x7f80c40f8b80 2021-01-28T03:56:35.599 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.580+0000 7f80cc6b5700 1 -- 172.21.15.162:0/3671887590 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c40f4440 con 0x7f80c40f8b80 2021-01-28T03:56:35.599 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.584+0000 7f80cc6b5700 1 -- 172.21.15.162:0/3671887590 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c40f48e0 con 0x7f80c40f8b80 2021-01-28T03:56:35.600 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.584+0000 7f80cc6b5700 1 -- 172.21.15.162:0/3671887590 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80c4045420 con 0x7f80c40f8b80 2021-01-28T03:56:35.600 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.584+0000 7f80baffd700 1 -- 172.21.15.162:0/3671887590 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f80c00077b0 con 0x7f80c40f8b80 2021-01-28T03:56:35.600 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.584+0000 7f80baffd700 1 --2- 172.21.15.162:0/3671887590 >> v2:172.21.15.100:6800/928846103 conn(0x7f80b005bd20 0x7f80b005e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:56:35.601 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.584+0000 7f80baffd700 1 -- 172.21.15.162:0/3671887590 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f80c0075830 con 0x7f80c40f8b80 2021-01-28T03:56:35.601 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.584+0000 7f80ca451700 1 --2- 172.21.15.162:0/3671887590 >> v2:172.21.15.100:6800/928846103 conn(0x7f80b005bd20 0x7f80b005e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:56:35.602 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.584+0000 7f80ca451700 1 --2- 172.21.15.162:0/3671887590 >> v2:172.21.15.100:6800/928846103 conn(0x7f80b005bd20 0x7f80b005e1e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f80b4009fd0 tx=0x7f80b400b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:56:35.603 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.592+0000 7f80baffd700 1 -- 172.21.15.162:0/3671887590 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f80c00468c0 con 0x7f80c40f8b80 2021-01-28T03:56:35.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:35 smithi162 bash[9856]: audit 2021-01-28T03:56:35.305356+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-01-28T03:56:35.761 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:35 smithi162 bash[9856]: audit 2021-01-28T03:56:35.306073+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-01-28T03:56:35.761 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:35 smithi162 bash[9856]: audit 2021-01-28T03:56:35.306514+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-01-28T03:56:35.761 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:35 smithi162 bash[9856]: audit 2021-01-28T03:56:35.306949+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-01-28T03:56:35.808 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.804+0000 7f80cc6b5700 1 -- 172.21.15.162:0/3671887590 --> v2:172.21.15.100:6800/928846103 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi100=a;smithi162=b", "target": ["mon-mgr", ""]}) v1 -- 0x7f80c41008a0 con 0x7f80b005bd20 2021-01-28T03:56:35.822 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.820+0000 7f80baffd700 1 -- 172.21.15.162:0/3671887590 <== mgr.14138 v2:172.21.15.100:6800/928846103 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f80c41008a0 con 0x7f80b005bd20 2021-01-28T03:56:35.823 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled node-exporter update... 2021-01-28T03:56:35.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:35 smithi100 bash[9834]: audit 2021-01-28T03:56:35.305356+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-01-28T03:56:35.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:35 smithi100 bash[9834]: audit 2021-01-28T03:56:35.306073+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-01-28T03:56:35.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:35 smithi100 bash[9834]: audit 2021-01-28T03:56:35.306514+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-01-28T03:56:35.826 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:35 smithi100 bash[9834]: audit 2021-01-28T03:56:35.306949+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-01-28T03:56:35.826 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:35 smithi100 bash[13549]: audit 2021-01-28T03:56:35.305356+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-01-28T03:56:35.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:35 smithi100 bash[13549]: audit 2021-01-28T03:56:35.306073+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-01-28T03:56:35.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:35 smithi100 bash[13549]: audit 2021-01-28T03:56:35.306514+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-01-28T03:56:35.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:35 smithi100 bash[13549]: audit 2021-01-28T03:56:35.306949+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-01-28T03:56:35.828 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.824+0000 7f80cc6b5700 1 -- 172.21.15.162:0/3671887590 >> v2:172.21.15.100:6800/928846103 conn(0x7f80b005bd20 msgr2=0x7f80b005e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:35.829 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.824+0000 7f80cc6b5700 1 --2- 172.21.15.162:0/3671887590 >> v2:172.21.15.100:6800/928846103 conn(0x7f80b005bd20 0x7f80b005e1e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f80b4009fd0 tx=0x7f80b400b040).stop 2021-01-28T03:56:35.829 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.824+0000 7f80cc6b5700 1 -- 172.21.15.162:0/3671887590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80c40f8b80 msgr2=0x7f80c4105bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:35.829 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.824+0000 7f80cc6b5700 1 --2- 172.21.15.162:0/3671887590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80c40f8b80 0x7f80c4105bd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f80c000eb90 tx=0x7f80c000b040).stop 2021-01-28T03:56:35.829 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.824+0000 7f80cc6b5700 1 -- 172.21.15.162:0/3671887590 shutdown_connections 2021-01-28T03:56:35.830 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.824+0000 7f80cc6b5700 1 --2- 172.21.15.162:0/3671887590 >> v2:172.21.15.100:6800/928846103 conn(0x7f80b005bd20 0x7f80b005e1e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:35.830 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.824+0000 7f80cc6b5700 1 --2- 172.21.15.162:0/3671887590 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f80c40fb610 0x7f80c410ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:35.830 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.824+0000 7f80cc6b5700 1 --2- 172.21.15.162:0/3671887590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80c405fbc0 0x7f80c41056e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:35.831 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.824+0000 7f80cc6b5700 1 --2- 172.21.15.162:0/3671887590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80c40f8b80 0x7f80c4105bd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:35.831 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.824+0000 7f80cc6b5700 1 -- 172.21.15.162:0/3671887590 >> 172.21.15.162:0/3671887590 conn(0x7f80c40f0120 msgr2=0x7f80c40f97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:56:35.831 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.824+0000 7f80cc6b5700 1 -- 172.21.15.162:0/3671887590 shutdown_connections 2021-01-28T03:56:35.832 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:35.824+0000 7f80cc6b5700 1 -- 172.21.15.162:0/3671887590 wait complete. 2021-01-28T03:56:36.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:36 smithi162 bash[9856]: cluster 2021-01-28T03:56:35.374904+0000 mgr.y (mgr.14138) 287 : cluster [DBG] pgmap v228: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 1.2 KiB/s wr, 86 op/s 2021-01-28T03:56:36.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:36 smithi162 bash[9856]: audit 2021-01-28T03:56:35.449490+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]': finished 2021-01-28T03:56:36.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:36 smithi162 bash[9856]: audit 2021-01-28T03:56:35.449619+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]': finished 2021-01-28T03:56:36.761 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:36 smithi162 bash[9856]: audit 2021-01-28T03:56:35.449765+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]': finished 2021-01-28T03:56:36.761 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:36 smithi162 bash[9856]: audit 2021-01-28T03:56:35.449861+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]': finished 2021-01-28T03:56:36.761 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:36 smithi162 bash[9856]: cluster 2021-01-28T03:56:35.449921+0000 mon.a (mon.0) 597 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2021-01-28T03:56:36.761 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:36 smithi162 bash[9856]: audit 2021-01-28T03:56:35.480100+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T03:56:36.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:36 smithi162 bash[9856]: audit 2021-01-28T03:56:35.492739+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T03:56:36.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:36 smithi162 bash[9856]: audit 2021-01-28T03:56:35.822596+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:36.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:36 smithi100 bash[9834]: cluster 2021-01-28T03:56:35.374904+0000 mgr.y (mgr.14138) 287 : cluster [DBG] pgmap v228: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 1.2 KiB/s wr, 86 op/s 2021-01-28T03:56:36.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:36 smithi100 bash[9834]: audit 2021-01-28T03:56:35.449490+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]': finished 2021-01-28T03:56:36.826 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:36 smithi100 bash[9834]: audit 2021-01-28T03:56:35.449619+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]': finished 2021-01-28T03:56:36.826 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:36 smithi100 bash[9834]: audit 2021-01-28T03:56:35.449765+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]': finished 2021-01-28T03:56:36.826 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:36 smithi100 bash[9834]: audit 2021-01-28T03:56:35.449861+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]': finished 2021-01-28T03:56:36.826 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:36 smithi100 bash[9834]: cluster 2021-01-28T03:56:35.449921+0000 mon.a (mon.0) 597 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2021-01-28T03:56:36.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:36 smithi100 bash[9834]: audit 2021-01-28T03:56:35.480100+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T03:56:36.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:36 smithi100 bash[9834]: audit 2021-01-28T03:56:35.492739+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T03:56:36.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:36 smithi100 bash[9834]: audit 2021-01-28T03:56:35.822596+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:36.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:36 smithi100 bash[13549]: cluster 2021-01-28T03:56:35.374904+0000 mgr.y (mgr.14138) 287 : cluster [DBG] pgmap v228: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 1.2 KiB/s wr, 86 op/s 2021-01-28T03:56:36.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:36 smithi100 bash[13549]: audit 2021-01-28T03:56:35.449490+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]': finished 2021-01-28T03:56:36.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:36 smithi100 bash[13549]: audit 2021-01-28T03:56:35.449619+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]': finished 2021-01-28T03:56:36.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:36 smithi100 bash[13549]: audit 2021-01-28T03:56:35.449765+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]': finished 2021-01-28T03:56:36.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:36 smithi100 bash[13549]: audit 2021-01-28T03:56:35.449861+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]': finished 2021-01-28T03:56:36.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:36 smithi100 bash[13549]: cluster 2021-01-28T03:56:35.449921+0000 mon.a (mon.0) 597 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2021-01-28T03:56:36.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:36 smithi100 bash[13549]: audit 2021-01-28T03:56:35.480100+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T03:56:36.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:36 smithi100 bash[13549]: audit 2021-01-28T03:56:35.492739+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T03:56:36.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:36 smithi100 bash[13549]: audit 2021-01-28T03:56:35.822596+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:36.920 DEBUG:teuthology.orchestra.run.smithi100:node-exporter.a> sudo journalctl -f -n 0 -u ceph-c217df96-611b-11eb-8f9e-001a4aab830c@node-exporter.a.service 2021-01-28T03:56:36.925 DEBUG:teuthology.orchestra.run.smithi162:node-exporter.b> sudo journalctl -f -n 0 -u ceph-c217df96-611b-11eb-8f9e-001a4aab830c@node-exporter.b.service 2021-01-28T03:56:36.927 INFO:tasks.cephadm:Adding alertmanager.a on smithi100 2021-01-28T03:56:36.928 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph orch apply alertmanager '1;smithi100=a' 2021-01-28T03:56:36.957 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T03:56:36.962 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T03:56:37.458 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:37 smithi162 bash[9856]: audit 2021-01-28T03:56:35.811562+0000 mgr.y (mgr.14138) 288 : audit [DBG] from='client.34481 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi100=a;smithi162=b", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:56:37.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:37 smithi162 bash[9856]: cephadm 2021-01-28T03:56:35.813741+0000 mgr.y (mgr.14138) 289 : cephadm [INF] Saving service node-exporter spec with placement smithi100=a;smithi162=b;count:2 2021-01-28T03:56:37.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:37 smithi162 bash[9856]: cluster 2021-01-28T03:56:36.460181+0000 mon.a (mon.0) 601 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2021-01-28T03:56:37.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:37 smithi100 bash[9834]: audit 2021-01-28T03:56:35.811562+0000 mgr.y (mgr.14138) 288 : audit [DBG] from='client.34481 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi100=a;smithi162=b", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:56:37.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:37 smithi100 bash[9834]: cephadm 2021-01-28T03:56:35.813741+0000 mgr.y (mgr.14138) 289 : cephadm [INF] Saving service node-exporter spec with placement smithi100=a;smithi162=b;count:2 2021-01-28T03:56:37.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:37 smithi100 bash[9834]: cluster 2021-01-28T03:56:36.460181+0000 mon.a (mon.0) 601 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2021-01-28T03:56:37.826 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:37 smithi100 bash[13549]: audit 2021-01-28T03:56:35.811562+0000 mgr.y (mgr.14138) 288 : audit [DBG] from='client.34481 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi100=a;smithi162=b", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:56:37.826 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:37 smithi100 bash[13549]: cephadm 2021-01-28T03:56:35.813741+0000 mgr.y (mgr.14138) 289 : cephadm [INF] Saving service node-exporter spec with placement smithi100=a;smithi162=b;count:2 2021-01-28T03:56:37.826 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:37 smithi100 bash[13549]: cluster 2021-01-28T03:56:36.460181+0000 mon.a (mon.0) 601 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2021-01-28T03:56:38.744 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:38 smithi162 bash[9856]: cluster 2021-01-28T03:56:37.375794+0000 mgr.y (mgr.14138) 290 : cluster [DBG] pgmap v231: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s; 131 B/s, 1 objects/s recovering 2021-01-28T03:56:38.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:38 smithi100 bash[9834]: cluster 2021-01-28T03:56:37.375794+0000 mgr.y (mgr.14138) 290 : cluster [DBG] pgmap v231: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s; 131 B/s, 1 objects/s recovering 2021-01-28T03:56:38.825 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:38 smithi100 bash[13549]: cluster 2021-01-28T03:56:37.375794+0000 mgr.y (mgr.14138) 290 : cluster [DBG] pgmap v231: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 127 B/s wr, 3 op/s; 131 B/s, 1 objects/s recovering 2021-01-28T03:56:39.760 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 03:56:39 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T03:56:39.825 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:56:39 smithi100 bash[10061]: debug 2021-01-28T03:56:39.484+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T03:56:40.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:40 smithi162 bash[9856]: cluster 2021-01-28T03:56:39.377180+0000 mgr.y (mgr.14138) 291 : cluster [DBG] pgmap v232: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 127 B/s wr, 2 op/s; 237 B/s, 3 objects/s recovering 2021-01-28T03:56:40.825 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:40 smithi100 bash[13549]: cluster 2021-01-28T03:56:39.377180+0000 mgr.y (mgr.14138) 291 : cluster [DBG] pgmap v232: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 127 B/s wr, 2 op/s; 237 B/s, 3 objects/s recovering 2021-01-28T03:56:40.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:40 smithi100 bash[9834]: cluster 2021-01-28T03:56:39.377180+0000 mgr.y (mgr.14138) 291 : cluster [DBG] pgmap v232: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 127 B/s wr, 2 op/s; 237 B/s, 3 objects/s recovering 2021-01-28T03:56:41.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:41 smithi162 bash[9856]: audit 2021-01-28T03:56:39.487925+0000 mgr.y (mgr.14138) 292 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:56:41.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:41 smithi100 bash[9834]: audit 2021-01-28T03:56:39.487925+0000 mgr.y (mgr.14138) 292 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:56:41.825 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:41 smithi100 bash[13549]: audit 2021-01-28T03:56:39.487925+0000 mgr.y (mgr.14138) 292 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:56:42.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:42 smithi162 bash[9856]: cluster 2021-01-28T03:56:41.378159+0000 mgr.y (mgr.14138) 293 : cluster [DBG] pgmap v233: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 237 B/s, 3 objects/s recovering 2021-01-28T03:56:42.812 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.808+0000 7f8a4b32e700 1 -- 172.21.15.162:0/884876653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a440fb4a0 msgr2=0x7f8a440fd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:42.813 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.808+0000 7f8a4b32e700 1 --2- 172.21.15.162:0/884876653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a440fb4a0 0x7f8a440fd930 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f8a40004e00 tx=0x7f8a40009b30).stop 2021-01-28T03:56:42.813 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.808+0000 7f8a4b32e700 1 -- 172.21.15.162:0/884876653 shutdown_connections 2021-01-28T03:56:42.813 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.808+0000 7f8a4b32e700 1 --2- 172.21.15.162:0/884876653 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a440fb4a0 0x7f8a440fd930 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:42.813 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.808+0000 7f8a4b32e700 1 --2- 172.21.15.162:0/884876653 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a4405f610 0x7f8a440f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:42.813 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.808+0000 7f8a4b32e700 1 --2- 172.21.15.162:0/884876653 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8a440f8a30 0x7f8a440fae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:42.814 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.808+0000 7f8a4b32e700 1 -- 172.21.15.162:0/884876653 >> 172.21.15.162:0/884876653 conn(0x7f8a440effa0 msgr2=0x7f8a440f23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:56:42.814 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.808+0000 7f8a4b32e700 1 -- 172.21.15.162:0/884876653 shutdown_connections 2021-01-28T03:56:42.814 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.808+0000 7f8a4b32e700 1 -- 172.21.15.162:0/884876653 wait complete. 2021-01-28T03:56:42.816 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.808+0000 7f8a4b32e700 1 Processor -- start 2021-01-28T03:56:42.816 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.808+0000 7f8a4b32e700 1 -- start start 2021-01-28T03:56:42.816 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.808+0000 7f8a4b32e700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8a4405f610 0x7f8a44105670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:56:42.816 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.808+0000 7f8a4b32e700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a440f8a30 0x7f8a44105b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:56:42.817 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.808+0000 7f8a4b32e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a440fb4a0 0x7f8a44106a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:56:42.817 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.808+0000 7f8a4b32e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a44106f80 con 0x7f8a440fb4a0 2021-01-28T03:56:42.818 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.812+0000 7f8a4b32e700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a441070f0 con 0x7f8a440f8a30 2021-01-28T03:56:42.818 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.812+0000 7f8a4b32e700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a441072b0 con 0x7f8a4405f610 2021-01-28T03:56:42.819 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.812+0000 7f8a49b2b700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a440f8a30 0x7f8a44105b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:56:42.819 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.812+0000 7f8a49b2b700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a440f8a30 0x7f8a44105b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:45474/0 (socket says 172.21.15.162:45474) 2021-01-28T03:56:42.819 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.812+0000 7f8a49b2b700 1 -- 172.21.15.162:0/4207555452 learned_addr learned my addr 172.21.15.162:0/4207555452 (peer_addr_for_me v2:172.21.15.162:0/0) 2021-01-28T03:56:42.819 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.812+0000 7f8a4a32c700 1 --2- 172.21.15.162:0/4207555452 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8a4405f610 0x7f8a44105670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:56:42.820 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.812+0000 7f8a4ab2d700 1 --2- 172.21.15.162:0/4207555452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a440fb4a0 0x7f8a44106a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:56:42.820 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.812+0000 7f8a49b2b700 1 -- 172.21.15.162:0/4207555452 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8a4405f610 msgr2=0x7f8a44105670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:42.820 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.812+0000 7f8a49b2b700 1 --2- 172.21.15.162:0/4207555452 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8a4405f610 0x7f8a44105670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:42.820 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.812+0000 7f8a49b2b700 1 -- 172.21.15.162:0/4207555452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a440fb4a0 msgr2=0x7f8a44106a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:42.821 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.812+0000 7f8a49b2b700 1 --2- 172.21.15.162:0/4207555452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a440fb4a0 0x7f8a44106a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:42.821 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.812+0000 7f8a49b2b700 1 -- 172.21.15.162:0/4207555452 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a44107470 con 0x7f8a440f8a30 2021-01-28T03:56:42.821 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.812+0000 7f8a49b2b700 1 --2- 172.21.15.162:0/4207555452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a440f8a30 0x7f8a44105b60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f8a38002f40 tx=0x7f8a3800b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:56:42.821 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.812+0000 7f8a36ffd700 1 -- 172.21.15.162:0/4207555452 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a380092e0 con 0x7f8a440f8a30 2021-01-28T03:56:42.821 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.812+0000 7f8a4b32e700 1 -- 172.21.15.162:0/4207555452 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a441076c0 con 0x7f8a440f8a30 2021-01-28T03:56:42.822 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.812+0000 7f8a36ffd700 1 -- 172.21.15.162:0/4207555452 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f8a3800f040 con 0x7f8a440f8a30 2021-01-28T03:56:42.822 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.812+0000 7f8a4b32e700 1 -- 172.21.15.162:0/4207555452 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a4410dee0 con 0x7f8a440f8a30 2021-01-28T03:56:42.822 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.812+0000 7f8a36ffd700 1 -- 172.21.15.162:0/4207555452 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3800c890 con 0x7f8a440f8a30 2021-01-28T03:56:42.822 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.812+0000 7f8a4b32e700 1 -- 172.21.15.162:0/4207555452 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a4405d6c0 con 0x7f8a440f8a30 2021-01-28T03:56:42.823 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.812+0000 7f8a36ffd700 1 -- 172.21.15.162:0/4207555452 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f8a3800cc40 con 0x7f8a440f8a30 2021-01-28T03:56:42.823 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.816+0000 7f8a36ffd700 1 --2- 172.21.15.162:0/4207555452 >> v2:172.21.15.100:6800/928846103 conn(0x7f8a3005bc70 0x7f8a3005e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:56:42.824 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.816+0000 7f8a36ffd700 1 -- 172.21.15.162:0/4207555452 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f8a38075bc0 con 0x7f8a440f8a30 2021-01-28T03:56:42.824 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.816+0000 7f8a4a32c700 1 --2- 172.21.15.162:0/4207555452 >> v2:172.21.15.100:6800/928846103 conn(0x7f8a3005bc70 0x7f8a3005e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:56:42.824 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.816+0000 7f8a4a32c700 1 --2- 172.21.15.162:0/4207555452 >> v2:172.21.15.100:6800/928846103 conn(0x7f8a3005bc70 0x7f8a3005e130 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f8a3c004fd0 tx=0x7f8a3c00b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:56:42.824 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:42.820+0000 7f8a36ffd700 1 -- 172.21.15.162:0/4207555452 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f8a380468c0 con 0x7f8a440f8a30 2021-01-28T03:56:42.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:42 smithi100 bash[9834]: cluster 2021-01-28T03:56:41.378159+0000 mgr.y (mgr.14138) 293 : cluster [DBG] pgmap v233: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 237 B/s, 3 objects/s recovering 2021-01-28T03:56:42.825 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:42 smithi100 bash[13549]: cluster 2021-01-28T03:56:41.378159+0000 mgr.y (mgr.14138) 293 : cluster [DBG] pgmap v233: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s; 237 B/s, 3 objects/s recovering 2021-01-28T03:56:43.018 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:43.016+0000 7f8a4b32e700 1 -- 172.21.15.162:0/4207555452 --> v2:172.21.15.100:6800/928846103 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi100=a", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a44027230 con 0x7f8a3005bc70 2021-01-28T03:56:43.030 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:43.028+0000 7f8a36ffd700 1 -- 172.21.15.162:0/4207555452 <== mgr.14138 v2:172.21.15.100:6800/928846103 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f8a44027230 con 0x7f8a3005bc70 2021-01-28T03:56:43.030 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled alertmanager update... 2021-01-28T03:56:43.032 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:43.028+0000 7f8a4b32e700 1 -- 172.21.15.162:0/4207555452 >> v2:172.21.15.100:6800/928846103 conn(0x7f8a3005bc70 msgr2=0x7f8a3005e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:43.033 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:43.028+0000 7f8a4b32e700 1 --2- 172.21.15.162:0/4207555452 >> v2:172.21.15.100:6800/928846103 conn(0x7f8a3005bc70 0x7f8a3005e130 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f8a3c004fd0 tx=0x7f8a3c00b040).stop 2021-01-28T03:56:43.033 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:43.028+0000 7f8a4b32e700 1 -- 172.21.15.162:0/4207555452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a440f8a30 msgr2=0x7f8a44105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:43.033 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:43.028+0000 7f8a4b32e700 1 --2- 172.21.15.162:0/4207555452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a440f8a30 0x7f8a44105b60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f8a38002f40 tx=0x7f8a3800b040).stop 2021-01-28T03:56:43.033 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:43.028+0000 7f8a4b32e700 1 -- 172.21.15.162:0/4207555452 shutdown_connections 2021-01-28T03:56:43.033 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:43.028+0000 7f8a4b32e700 1 --2- 172.21.15.162:0/4207555452 >> v2:172.21.15.100:6800/928846103 conn(0x7f8a3005bc70 0x7f8a3005e130 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:43.034 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:43.028+0000 7f8a4b32e700 1 --2- 172.21.15.162:0/4207555452 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a440fb4a0 0x7f8a44106a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:43.034 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:43.028+0000 7f8a4b32e700 1 --2- 172.21.15.162:0/4207555452 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f8a4405f610 0x7f8a44105670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:43.034 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:43.028+0000 7f8a4b32e700 1 --2- 172.21.15.162:0/4207555452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a440f8a30 0x7f8a44105b60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:43.034 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:43.028+0000 7f8a4b32e700 1 -- 172.21.15.162:0/4207555452 >> 172.21.15.162:0/4207555452 conn(0x7f8a440effa0 msgr2=0x7f8a440f9670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:56:43.035 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:43.028+0000 7f8a4b32e700 1 -- 172.21.15.162:0/4207555452 shutdown_connections 2021-01-28T03:56:43.035 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:43.028+0000 7f8a4b32e700 1 -- 172.21.15.162:0/4207555452 wait complete. 2021-01-28T03:56:44.106 DEBUG:teuthology.orchestra.run.smithi100:alertmanager.a> sudo journalctl -f -n 0 -u ceph-c217df96-611b-11eb-8f9e-001a4aab830c@alertmanager.a.service 2021-01-28T03:56:44.110 INFO:tasks.cephadm:Adding grafana.a on smithi162 2021-01-28T03:56:44.111 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph orch apply grafana '1;smithi162=a' 2021-01-28T03:56:44.192 INFO:journalctl@ceph.alertmanager.a.smithi100.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T03:56:44.288 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:44 smithi162 bash[9856]: audit 2021-01-28T03:56:43.021374+0000 mgr.y (mgr.14138) 294 : audit [DBG] from='client.34487 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi100=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:56:44.288 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:44 smithi162 bash[9856]: cephadm 2021-01-28T03:56:43.023454+0000 mgr.y (mgr.14138) 295 : cephadm [INF] Saving service alertmanager spec with placement smithi100=a;count:1 2021-01-28T03:56:44.288 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:44 smithi162 bash[9856]: audit 2021-01-28T03:56:43.030020+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:44.289 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:44 smithi162 bash[9856]: cluster 2021-01-28T03:56:43.379386+0000 mgr.y (mgr.14138) 296 : cluster [DBG] pgmap v234: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 237 B/s, 3 objects/s recovering 2021-01-28T03:56:44.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:44 smithi100 bash[9834]: audit 2021-01-28T03:56:43.021374+0000 mgr.y (mgr.14138) 294 : audit [DBG] from='client.34487 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi100=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:56:44.326 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:44 smithi100 bash[9834]: cephadm 2021-01-28T03:56:43.023454+0000 mgr.y (mgr.14138) 295 : cephadm [INF] Saving service alertmanager spec with placement smithi100=a;count:1 2021-01-28T03:56:44.326 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:44 smithi100 bash[9834]: audit 2021-01-28T03:56:43.030020+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:44.326 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:44 smithi100 bash[9834]: cluster 2021-01-28T03:56:43.379386+0000 mgr.y (mgr.14138) 296 : cluster [DBG] pgmap v234: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 237 B/s, 3 objects/s recovering 2021-01-28T03:56:44.326 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:44 smithi100 bash[13549]: audit 2021-01-28T03:56:43.021374+0000 mgr.y (mgr.14138) 294 : audit [DBG] from='client.34487 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi100=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:56:44.327 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:44 smithi100 bash[13549]: cephadm 2021-01-28T03:56:43.023454+0000 mgr.y (mgr.14138) 295 : cephadm [INF] Saving service alertmanager spec with placement smithi100=a;count:1 2021-01-28T03:56:44.327 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:44 smithi100 bash[13549]: audit 2021-01-28T03:56:43.030020+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:44.327 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:44 smithi100 bash[13549]: cluster 2021-01-28T03:56:43.379386+0000 mgr.y (mgr.14138) 296 : cluster [DBG] pgmap v234: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 237 B/s, 3 objects/s recovering 2021-01-28T03:56:46.804 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:46 smithi162 bash[9856]: cluster 2021-01-28T03:56:45.380477+0000 mgr.y (mgr.14138) 297 : cluster [DBG] pgmap v235: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s; 191 B/s, 2 objects/s recovering 2021-01-28T03:56:46.804 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:46 smithi162 bash[9856]: audit 2021-01-28T03:56:46.164178+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:46.804 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:46 smithi162 bash[9856]: audit 2021-01-28T03:56:46.167412+0000 mon.a (mon.0) 604 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:56:46.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:46 smithi100 bash[9834]: cluster 2021-01-28T03:56:45.380477+0000 mgr.y (mgr.14138) 297 : cluster [DBG] pgmap v235: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s; 191 B/s, 2 objects/s recovering 2021-01-28T03:56:46.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:46 smithi100 bash[9834]: audit 2021-01-28T03:56:46.164178+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:46.826 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:46 smithi100 bash[9834]: audit 2021-01-28T03:56:46.167412+0000 mon.a (mon.0) 604 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:56:46.826 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:46 smithi100 bash[13549]: cluster 2021-01-28T03:56:45.380477+0000 mgr.y (mgr.14138) 297 : cluster [DBG] pgmap v235: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s; 191 B/s, 2 objects/s recovering 2021-01-28T03:56:46.826 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:46 smithi100 bash[13549]: audit 2021-01-28T03:56:46.164178+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:46.826 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:46 smithi100 bash[13549]: audit 2021-01-28T03:56:46.167412+0000 mon.a (mon.0) 604 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:56:47.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:47 smithi162 bash[9856]: cephadm 2021-01-28T03:56:46.166257+0000 mgr.y (mgr.14138) 298 : cephadm [INF] refreshing smithi100 facts 2021-01-28T03:56:47.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:47 smithi100 bash[9834]: cephadm 2021-01-28T03:56:46.166257+0000 mgr.y (mgr.14138) 298 : cephadm [INF] refreshing smithi100 facts 2021-01-28T03:56:47.826 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:47 smithi100 bash[13549]: cephadm 2021-01-28T03:56:46.166257+0000 mgr.y (mgr.14138) 298 : cephadm [INF] refreshing smithi100 facts 2021-01-28T03:56:48.542 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:48 smithi162 bash[9856]: cluster 2021-01-28T03:56:47.381436+0000 mgr.y (mgr.14138) 299 : cluster [DBG] pgmap v236: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 937 B/s rd, 0 op/s; 173 B/s, 2 objects/s recovering 2021-01-28T03:56:48.543 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Jan 28 03:56:48 smithi162 bash[23343]: level=info ts=2021-01-28T03:56:48.434Z caller=main.go:646 msg="Server is ready to receive web requests." 2021-01-28T03:56:48.714 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.707+0000 7fad3b566700 1 -- 172.21.15.162:0/269920740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad340f3f20 msgr2=0x7fad340f4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:48.714 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.707+0000 7fad3b566700 1 --2- 172.21.15.162:0/269920740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad340f3f20 0x7fad340f4340 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fad30004e30 tx=0x7fad30009b30).stop 2021-01-28T03:56:48.714 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.711+0000 7fad3b566700 1 -- 172.21.15.162:0/269920740 shutdown_connections 2021-01-28T03:56:48.715 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.711+0000 7fad3b566700 1 --2- 172.21.15.162:0/269920740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad340f3f20 0x7fad340f4340 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:48.715 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.711+0000 7fad3b566700 1 --2- 172.21.15.162:0/269920740 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fad340f5b10 0x7fad340fc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:48.715 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.711+0000 7fad3b566700 1 --2- 172.21.15.162:0/269920740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad340f51c0 0x7fad340f5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:48.715 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.711+0000 7fad3b566700 1 -- 172.21.15.162:0/269920740 >> 172.21.15.162:0/269920740 conn(0x7fad340ef740 msgr2=0x7fad340f1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:56:48.715 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.711+0000 7fad3b566700 1 -- 172.21.15.162:0/269920740 shutdown_connections 2021-01-28T03:56:48.716 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.711+0000 7fad3b566700 1 -- 172.21.15.162:0/269920740 wait complete. 2021-01-28T03:56:48.717 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.711+0000 7fad3b566700 1 Processor -- start 2021-01-28T03:56:48.717 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.711+0000 7fad3b566700 1 -- start start 2021-01-28T03:56:48.717 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.711+0000 7fad3b566700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fad340f3f20 0x7fad34106510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:56:48.718 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.711+0000 7fad3b566700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad340f51c0 0x7fad34108a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:56:48.718 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.711+0000 7fad3b566700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad340f5b10 0x7fad34108f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:56:48.718 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.711+0000 7fad3b566700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad341093f0 con 0x7fad340f51c0 2021-01-28T03:56:48.718 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.711+0000 7fad3b566700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad34109560 con 0x7fad340f5b10 2021-01-28T03:56:48.719 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.711+0000 7fad3b566700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad341096d0 con 0x7fad340f3f20 2021-01-28T03:56:48.719 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.711+0000 7fad3ad65700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad340f5b10 0x7fad34108f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:56:48.719 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.711+0000 7fad3ad65700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad340f5b10 0x7fad34108f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:45492/0 (socket says 172.21.15.162:45492) 2021-01-28T03:56:48.719 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.711+0000 7fad3ad65700 1 -- 172.21.15.162:0/962085199 learned_addr learned my addr 172.21.15.162:0/962085199 (peer_addr_for_me v2:172.21.15.162:0/0) 2021-01-28T03:56:48.719 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.711+0000 7fad3a564700 1 --2- 172.21.15.162:0/962085199 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fad340f3f20 0x7fad34106510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:56:48.720 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.711+0000 7fad39d63700 1 --2- 172.21.15.162:0/962085199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad340f51c0 0x7fad34108a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:56:48.720 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.711+0000 7fad3ad65700 1 -- 172.21.15.162:0/962085199 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fad340f3f20 msgr2=0x7fad34106510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:48.720 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.711+0000 7fad3ad65700 1 --2- 172.21.15.162:0/962085199 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fad340f3f20 0x7fad34106510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:48.720 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.711+0000 7fad3ad65700 1 -- 172.21.15.162:0/962085199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad340f51c0 msgr2=0x7fad34108a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:48.720 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.711+0000 7fad3ad65700 1 --2- 172.21.15.162:0/962085199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad340f51c0 0x7fad34108a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:48.721 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.711+0000 7fad3ad65700 1 -- 172.21.15.162:0/962085199 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad34109890 con 0x7fad340f5b10 2021-01-28T03:56:48.721 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.711+0000 7fad3ad65700 1 --2- 172.21.15.162:0/962085199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad340f5b10 0x7fad34108f00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fad2c00de20 tx=0x7fad2c004f00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:56:48.721 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.711+0000 7fad26ffd700 1 -- 172.21.15.162:0/962085199 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2c007e00 con 0x7fad340f5b10 2021-01-28T03:56:48.721 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.711+0000 7fad3b566700 1 -- 172.21.15.162:0/962085199 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad34109b40 con 0x7fad340f5b10 2021-01-28T03:56:48.722 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.711+0000 7fad3b566700 1 -- 172.21.15.162:0/962085199 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad3410a030 con 0x7fad340f5b10 2021-01-28T03:56:48.722 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.711+0000 7fad26ffd700 1 -- 172.21.15.162:0/962085199 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fad2c00f040 con 0x7fad340f5b10 2021-01-28T03:56:48.722 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.711+0000 7fad26ffd700 1 -- 172.21.15.162:0/962085199 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2c013b00 con 0x7fad340f5b10 2021-01-28T03:56:48.722 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.715+0000 7fad3b566700 1 -- 172.21.15.162:0/962085199 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad340f3310 con 0x7fad340f5b10 2021-01-28T03:56:48.723 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.715+0000 7fad26ffd700 1 -- 172.21.15.162:0/962085199 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7fad2c01a030 con 0x7fad340f5b10 2021-01-28T03:56:48.723 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.715+0000 7fad26ffd700 1 --2- 172.21.15.162:0/962085199 >> v2:172.21.15.100:6800/928846103 conn(0x7fad2005bc70 0x7fad2005e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:56:48.723 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.715+0000 7fad26ffd700 1 -- 172.21.15.162:0/962085199 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7fad2c075790 con 0x7fad340f5b10 2021-01-28T03:56:48.724 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.715+0000 7fad3a564700 1 --2- 172.21.15.162:0/962085199 >> v2:172.21.15.100:6800/928846103 conn(0x7fad2005bc70 0x7fad2005e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:56:48.724 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.715+0000 7fad3a564700 1 --2- 172.21.15.162:0/962085199 >> v2:172.21.15.100:6800/928846103 conn(0x7fad2005bc70 0x7fad2005e130 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fad300043d0 tx=0x7fad30009b30).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:56:48.725 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.723+0000 7fad26ffd700 1 -- 172.21.15.162:0/962085199 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fad2c0483a0 con 0x7fad340f5b10 2021-01-28T03:56:48.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:48 smithi100 bash[9834]: cluster 2021-01-28T03:56:47.381436+0000 mgr.y (mgr.14138) 299 : cluster [DBG] pgmap v236: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 937 B/s rd, 0 op/s; 173 B/s, 2 objects/s recovering 2021-01-28T03:56:48.826 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:48 smithi100 bash[13549]: cluster 2021-01-28T03:56:47.381436+0000 mgr.y (mgr.14138) 299 : cluster [DBG] pgmap v236: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 937 B/s rd, 0 op/s; 173 B/s, 2 objects/s recovering 2021-01-28T03:56:48.920 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.915+0000 7fad3b566700 1 -- 172.21.15.162:0/962085199 --> v2:172.21.15.100:6800/928846103 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi162=a", "target": ["mon-mgr", ""]}) v1 -- 0x7fad340fc1c0 con 0x7fad2005bc70 2021-01-28T03:56:48.933 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.927+0000 7fad26ffd700 1 -- 172.21.15.162:0/962085199 <== mgr.14138 v2:172.21.15.100:6800/928846103 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fad340fc1c0 con 0x7fad2005bc70 2021-01-28T03:56:48.933 INFO:teuthology.orchestra.run.smithi162.stdout:Scheduled grafana update... 2021-01-28T03:56:48.935 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.931+0000 7fad3b566700 1 -- 172.21.15.162:0/962085199 >> v2:172.21.15.100:6800/928846103 conn(0x7fad2005bc70 msgr2=0x7fad2005e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:48.935 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.931+0000 7fad3b566700 1 --2- 172.21.15.162:0/962085199 >> v2:172.21.15.100:6800/928846103 conn(0x7fad2005bc70 0x7fad2005e130 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fad300043d0 tx=0x7fad30009b30).stop 2021-01-28T03:56:48.936 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.931+0000 7fad3b566700 1 -- 172.21.15.162:0/962085199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad340f5b10 msgr2=0x7fad34108f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:48.936 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.931+0000 7fad3b566700 1 --2- 172.21.15.162:0/962085199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad340f5b10 0x7fad34108f00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fad2c00de20 tx=0x7fad2c004f00).stop 2021-01-28T03:56:48.936 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.931+0000 7fad3b566700 1 -- 172.21.15.162:0/962085199 shutdown_connections 2021-01-28T03:56:48.936 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.931+0000 7fad3b566700 1 --2- 172.21.15.162:0/962085199 >> v2:172.21.15.100:6800/928846103 conn(0x7fad2005bc70 0x7fad2005e130 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:48.936 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.931+0000 7fad3b566700 1 --2- 172.21.15.162:0/962085199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad340f5b10 0x7fad34108f00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:48.937 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.931+0000 7fad3b566700 1 --2- 172.21.15.162:0/962085199 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fad340f3f20 0x7fad34106510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:48.937 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.931+0000 7fad3b566700 1 --2- 172.21.15.162:0/962085199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad340f51c0 0x7fad34108a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:48.937 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.931+0000 7fad3b566700 1 -- 172.21.15.162:0/962085199 >> 172.21.15.162:0/962085199 conn(0x7fad340ef740 msgr2=0x7fad340f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:56:48.937 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.931+0000 7fad3b566700 1 -- 172.21.15.162:0/962085199 shutdown_connections 2021-01-28T03:56:48.937 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:56:48.931+0000 7fad3b566700 1 -- 172.21.15.162:0/962085199 wait complete. 2021-01-28T03:56:49.577 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 03:56:49 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T03:56:49.753 DEBUG:teuthology.orchestra.run.smithi162:grafana.a> sudo journalctl -f -n 0 -u ceph-c217df96-611b-11eb-8f9e-001a4aab830c@grafana.a.service 2021-01-28T03:56:49.756 INFO:tasks.cephadm:Setting up client nodes... 2021-01-28T03:56:49.756 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2021-01-28T03:56:49.769 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:56:49 smithi100 bash[10061]: debug 2021-01-28T03:56:49.491+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T03:56:49.770 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:49 smithi100 bash[9834]: audit 2021-01-28T03:56:48.698130+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:49.770 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:49 smithi100 bash[9834]: audit 2021-01-28T03:56:48.705031+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:49.770 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:49 smithi100 bash[9834]: cephadm 2021-01-28T03:56:48.706129+0000 mgr.y (mgr.14138) 300 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:56:49.771 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:49 smithi100 bash[9834]: cephadm 2021-01-28T03:56:48.706650+0000 mgr.y (mgr.14138) 301 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T03:56:49.771 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:49 smithi100 bash[9834]: cephadm 2021-01-28T03:56:48.707142+0000 mgr.y (mgr.14138) 302 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='iscsi.a')] + new hosts [] 2021-01-28T03:56:49.771 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:49 smithi100 bash[9834]: cephadm 2021-01-28T03:56:48.707641+0000 mgr.y (mgr.14138) 303 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='a')] + new hosts [] 2021-01-28T03:56:49.772 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:49 smithi100 bash[9834]: cephadm 2021-01-28T03:56:48.708181+0000 mgr.y (mgr.14138) 304 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi100', network='', name='a'), HostPlacementSpec(hostname='smithi162', network='', name='b')] 2021-01-28T03:56:49.772 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:49 smithi100 bash[9834]: cephadm 2021-01-28T03:56:48.708533+0000 mgr.y (mgr.14138) 305 : cephadm [INF] Deploying daemon node-exporter.b on smithi162 2021-01-28T03:56:49.772 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:49 smithi100 bash[9834]: audit 2021-01-28T03:56:48.923085+0000 mgr.y (mgr.14138) 306 : audit [DBG] from='client.34493 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi162=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:56:49.772 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:49 smithi100 bash[9834]: cephadm 2021-01-28T03:56:48.925222+0000 mgr.y (mgr.14138) 307 : cephadm [INF] Saving service grafana spec with placement smithi162=a;count:1 2021-01-28T03:56:49.772 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:49 smithi100 bash[9834]: audit 2021-01-28T03:56:48.932665+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:49.773 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:49 smithi100 bash[9834]: cluster 2021-01-28T03:56:49.382724+0000 mgr.y (mgr.14138) 308 : cluster [DBG] pgmap v237: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 70 B/s, 1 objects/s recovering 2021-01-28T03:56:49.773 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:49 smithi100 bash[9834]: audit 2021-01-28T03:56:49.616065+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:49.773 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:49 smithi100 bash[13549]: audit 2021-01-28T03:56:48.698130+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:49.774 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:49 smithi100 bash[13549]: audit 2021-01-28T03:56:48.705031+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:49.774 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:49 smithi100 bash[13549]: cephadm 2021-01-28T03:56:48.706129+0000 mgr.y (mgr.14138) 300 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:56:49.774 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:49 smithi100 bash[13549]: cephadm 2021-01-28T03:56:48.706650+0000 mgr.y (mgr.14138) 301 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T03:56:49.774 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:49 smithi100 bash[13549]: cephadm 2021-01-28T03:56:48.707142+0000 mgr.y (mgr.14138) 302 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='iscsi.a')] + new hosts [] 2021-01-28T03:56:49.775 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:49 smithi100 bash[13549]: cephadm 2021-01-28T03:56:48.707641+0000 mgr.y (mgr.14138) 303 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='a')] + new hosts [] 2021-01-28T03:56:49.775 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:49 smithi100 bash[13549]: cephadm 2021-01-28T03:56:48.708181+0000 mgr.y (mgr.14138) 304 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi100', network='', name='a'), HostPlacementSpec(hostname='smithi162', network='', name='b')] 2021-01-28T03:56:49.775 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:49 smithi100 bash[13549]: cephadm 2021-01-28T03:56:48.708533+0000 mgr.y (mgr.14138) 305 : cephadm [INF] Deploying daemon node-exporter.b on smithi162 2021-01-28T03:56:49.775 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:49 smithi100 bash[13549]: audit 2021-01-28T03:56:48.923085+0000 mgr.y (mgr.14138) 306 : audit [DBG] from='client.34493 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi162=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:56:49.776 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:49 smithi100 bash[13549]: cephadm 2021-01-28T03:56:48.925222+0000 mgr.y (mgr.14138) 307 : cephadm [INF] Saving service grafana spec with placement smithi162=a;count:1 2021-01-28T03:56:49.776 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:49 smithi100 bash[13549]: audit 2021-01-28T03:56:48.932665+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:49.776 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:49 smithi100 bash[13549]: cluster 2021-01-28T03:56:49.382724+0000 mgr.y (mgr.14138) 308 : cluster [DBG] pgmap v237: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 70 B/s, 1 objects/s recovering 2021-01-28T03:56:49.776 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:49 smithi100 bash[13549]: audit 2021-01-28T03:56:49.616065+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:49.787 INFO:journalctl@ceph.grafana.a.smithi162.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T03:56:49.980 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:49 smithi162 systemd[1]: Started Ceph node-exporter.b for c217df96-611b-11eb-8f9e-001a4aab830c. 2021-01-28T03:56:49.980 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:49 smithi162 bash[23835]: Unable to find image 'prom/node-exporter:v0.18.1' locally 2021-01-28T03:56:49.981 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:49 smithi162 bash[23835]: v0.18.1: Pulling from prom/node-exporter 2021-01-28T03:56:49.981 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:49 smithi162 bash[9856]: audit 2021-01-28T03:56:48.698130+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:49.981 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:49 smithi162 bash[9856]: audit 2021-01-28T03:56:48.705031+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:49.981 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:49 smithi162 bash[9856]: cephadm 2021-01-28T03:56:48.706129+0000 mgr.y (mgr.14138) 300 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:56:49.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:49 smithi162 bash[9856]: cephadm 2021-01-28T03:56:48.706650+0000 mgr.y (mgr.14138) 301 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T03:56:49.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:49 smithi162 bash[9856]: cephadm 2021-01-28T03:56:48.707142+0000 mgr.y (mgr.14138) 302 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='iscsi.a')] + new hosts [] 2021-01-28T03:56:49.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:49 smithi162 bash[9856]: cephadm 2021-01-28T03:56:48.707641+0000 mgr.y (mgr.14138) 303 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='a')] + new hosts [] 2021-01-28T03:56:49.982 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:49 smithi162 bash[9856]: cephadm 2021-01-28T03:56:48.708181+0000 mgr.y (mgr.14138) 304 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi100', network='', name='a'), HostPlacementSpec(hostname='smithi162', network='', name='b')] 2021-01-28T03:56:49.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:49 smithi162 bash[9856]: cephadm 2021-01-28T03:56:48.708533+0000 mgr.y (mgr.14138) 305 : cephadm [INF] Deploying daemon node-exporter.b on smithi162 2021-01-28T03:56:49.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:49 smithi162 bash[9856]: audit 2021-01-28T03:56:48.923085+0000 mgr.y (mgr.14138) 306 : audit [DBG] from='client.34493 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi162=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T03:56:49.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:49 smithi162 bash[9856]: cephadm 2021-01-28T03:56:48.925222+0000 mgr.y (mgr.14138) 307 : cephadm [INF] Saving service grafana spec with placement smithi162=a;count:1 2021-01-28T03:56:49.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:49 smithi162 bash[9856]: audit 2021-01-28T03:56:48.932665+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:49.983 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:49 smithi162 bash[9856]: cluster 2021-01-28T03:56:49.382724+0000 mgr.y (mgr.14138) 308 : cluster [DBG] pgmap v237: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 70 B/s, 1 objects/s recovering 2021-01-28T03:56:49.984 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:49 smithi162 bash[9856]: audit 2021-01-28T03:56:49.616065+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:50.260 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:50 smithi162 bash[23835]: 49a2d53aa1af: Pulling fs layer 2021-01-28T03:56:50.261 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:50 smithi162 bash[23835]: 3589a6efd9ce: Pulling fs layer 2021-01-28T03:56:50.261 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:50 smithi162 bash[23835]: 190160031744: Pulling fs layer 2021-01-28T03:56:50.261 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:50 smithi162 bash[23835]: 3589a6efd9ce: Verifying Checksum 2021-01-28T03:56:50.261 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:50 smithi162 bash[23835]: 3589a6efd9ce: Download complete 2021-01-28T03:56:50.262 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:50 smithi162 bash[23835]: 49a2d53aa1af: Verifying Checksum 2021-01-28T03:56:50.262 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:50 smithi162 bash[23835]: 49a2d53aa1af: Download complete 2021-01-28T03:56:50.262 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:50 smithi162 bash[23835]: 190160031744: Verifying Checksum 2021-01-28T03:56:50.262 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:50 smithi162 bash[23835]: 190160031744: Download complete 2021-01-28T03:56:50.742 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:50 smithi162 bash[23835]: 49a2d53aa1af: Pull complete 2021-01-28T03:56:50.766 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:50 smithi100 systemd[1]: Started Ceph node-exporter.a for c217df96-611b-11eb-8f9e-001a4aab830c. 2021-01-28T03:56:50.767 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:50 smithi100 bash[26183]: Unable to find image 'prom/node-exporter:v0.18.1' locally 2021-01-28T03:56:51.010 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:50 smithi162 bash[23835]: 3589a6efd9ce: Pull complete 2021-01-28T03:56:51.011 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:50 smithi162 bash[9856]: audit 2021-01-28T03:56:49.498972+0000 mgr.y (mgr.14138) 309 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:56:51.011 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:50 smithi162 bash[9856]: cephadm 2021-01-28T03:56:49.617886+0000 mgr.y (mgr.14138) 310 : cephadm [INF] Deploying daemon node-exporter.a on smithi100 2021-01-28T03:56:51.011 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:50 smithi162 bash[9856]: audit 2021-01-28T03:56:50.510228+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:51.075 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:50 smithi100 bash[9834]: audit 2021-01-28T03:56:49.498972+0000 mgr.y (mgr.14138) 309 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:56:51.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:50 smithi100 bash[9834]: cephadm 2021-01-28T03:56:49.617886+0000 mgr.y (mgr.14138) 310 : cephadm [INF] Deploying daemon node-exporter.a on smithi100 2021-01-28T03:56:51.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:50 smithi100 bash[9834]: audit 2021-01-28T03:56:50.510228+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:51.076 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:50 smithi100 bash[13549]: audit 2021-01-28T03:56:49.498972+0000 mgr.y (mgr.14138) 309 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:56:51.077 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:50 smithi100 bash[13549]: cephadm 2021-01-28T03:56:49.617886+0000 mgr.y (mgr.14138) 310 : cephadm [INF] Deploying daemon node-exporter.a on smithi100 2021-01-28T03:56:51.077 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:50 smithi100 bash[13549]: audit 2021-01-28T03:56:50.510228+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:56:51.077 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:50 smithi100 bash[26183]: v0.18.1: Pulling from prom/node-exporter 2021-01-28T03:56:51.077 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:50 smithi100 bash[26183]: 49a2d53aa1af: Pulling fs layer 2021-01-28T03:56:51.078 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:50 smithi100 bash[26183]: 3589a6efd9ce: Pulling fs layer 2021-01-28T03:56:51.078 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:50 smithi100 bash[26183]: 190160031744: Pulling fs layer 2021-01-28T03:56:51.078 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:50 smithi100 bash[26183]: 3589a6efd9ce: Verifying Checksum 2021-01-28T03:56:51.078 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:50 smithi100 bash[26183]: 3589a6efd9ce: Download complete 2021-01-28T03:56:51.078 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:50 smithi100 bash[26183]: 49a2d53aa1af: Verifying Checksum 2021-01-28T03:56:51.079 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:50 smithi100 bash[26183]: 49a2d53aa1af: Download complete 2021-01-28T03:56:51.079 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:50 smithi100 bash[26183]: 190160031744: Verifying Checksum 2021-01-28T03:56:51.079 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:50 smithi100 bash[26183]: 190160031744: Download complete 2021-01-28T03:56:51.510 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:51 smithi162 bash[23835]: 190160031744: Pull complete 2021-01-28T03:56:51.511 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:51 smithi162 bash[23835]: Digest: sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee 2021-01-28T03:56:51.511 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:51 smithi162 bash[23835]: Status: Downloaded newer image for prom/node-exporter:v0.18.1 2021-01-28T03:56:51.519 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:51 smithi100 bash[26183]: 49a2d53aa1af: Pull complete 2021-01-28T03:56:52.261 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:51 smithi162 bash[9856]: cephadm 2021-01-28T03:56:50.511731+0000 mgr.y (mgr.14138) 311 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi100', network='', name='a')] 2021-01-28T03:56:52.261 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:51 smithi162 bash[9856]: cephadm 2021-01-28T03:56:50.516954+0000 mgr.y (mgr.14138) 312 : cephadm [INF] Deploying daemon alertmanager.a on smithi100 2021-01-28T03:56:52.261 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:51 smithi162 bash[9856]: cluster 2021-01-28T03:56:51.383361+0000 mgr.y (mgr.14138) 313 : cluster [DBG] pgmap v238: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:56:52.325 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:51 smithi100 bash[9834]: cephadm 2021-01-28T03:56:50.511731+0000 mgr.y (mgr.14138) 311 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi100', network='', name='a')] 2021-01-28T03:56:52.326 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:51 smithi100 bash[9834]: cephadm 2021-01-28T03:56:50.516954+0000 mgr.y (mgr.14138) 312 : cephadm [INF] Deploying daemon alertmanager.a on smithi100 2021-01-28T03:56:52.326 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:51 smithi100 bash[9834]: cluster 2021-01-28T03:56:51.383361+0000 mgr.y (mgr.14138) 313 : cluster [DBG] pgmap v238: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:56:52.327 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:51 smithi100 bash[13549]: cephadm 2021-01-28T03:56:50.511731+0000 mgr.y (mgr.14138) 311 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi100', network='', name='a')] 2021-01-28T03:56:52.327 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:51 smithi100 bash[13549]: cephadm 2021-01-28T03:56:50.516954+0000 mgr.y (mgr.14138) 312 : cephadm [INF] Deploying daemon alertmanager.a on smithi100 2021-01-28T03:56:52.327 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:51 smithi100 bash[13549]: cluster 2021-01-28T03:56:51.383361+0000 mgr.y (mgr.14138) 313 : cluster [DBG] pgmap v238: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:56:52.328 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:51 smithi100 bash[26183]: 3589a6efd9ce: Pull complete 2021-01-28T03:56:53.011 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:52 smithi162 bash[23835]: time="2021-01-28T03:56:52Z" level=info msg="Starting node_exporter (version=0.18.1, branch=HEAD, revision=3db77732e925c08f675d7404a8c46466b2ece83e)" source="node_exporter.go:156" 2021-01-28T03:56:53.012 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:52 smithi162 bash[23835]: time="2021-01-28T03:56:52Z" level=info msg="Build context (go=go1.12.5, user=root@b50852a1acba, date=20190604-16:41:18)" source="node_exporter.go:157" 2021-01-28T03:56:53.012 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:52 smithi162 bash[23835]: time="2021-01-28T03:56:52Z" level=info msg="Enabled collectors:" source="node_exporter.go:97" 2021-01-28T03:56:53.012 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:52 smithi162 bash[23835]: time="2021-01-28T03:56:52Z" level=info msg=" - arp" source="node_exporter.go:104" 2021-01-28T03:56:53.012 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:52 smithi162 bash[23835]: time="2021-01-28T03:56:52Z" level=info msg=" - bcache" source="node_exporter.go:104" 2021-01-28T03:56:53.012 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:52 smithi162 bash[23835]: time="2021-01-28T03:56:52Z" level=info msg=" - bonding" source="node_exporter.go:104" 2021-01-28T03:56:53.013 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:52 smithi162 bash[23835]: time="2021-01-28T03:56:52Z" level=info msg=" - conntrack" source="node_exporter.go:104" 2021-01-28T03:56:53.013 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:52 smithi162 bash[23835]: time="2021-01-28T03:56:52Z" level=info msg=" - cpu" source="node_exporter.go:104" 2021-01-28T03:56:53.013 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:52 smithi162 bash[23835]: time="2021-01-28T03:56:52Z" level=info msg=" - cpufreq" source="node_exporter.go:104" 2021-01-28T03:56:53.013 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:52 smithi162 bash[23835]: time="2021-01-28T03:56:52Z" level=info msg=" - diskstats" source="node_exporter.go:104" 2021-01-28T03:56:53.013 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:52 smithi162 bash[23835]: time="2021-01-28T03:56:52Z" level=info msg=" - edac" source="node_exporter.go:104" 2021-01-28T03:56:53.014 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:52 smithi162 bash[23835]: time="2021-01-28T03:56:52Z" level=info msg=" - entropy" source="node_exporter.go:104" 2021-01-28T03:56:53.014 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:52 smithi162 bash[23835]: time="2021-01-28T03:56:52Z" level=info msg=" - filefd" source="node_exporter.go:104" 2021-01-28T03:56:53.014 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:52 smithi162 bash[23835]: time="2021-01-28T03:56:52Z" level=info msg=" - filesystem" source="node_exporter.go:104" 2021-01-28T03:56:53.014 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:52 smithi162 bash[23835]: time="2021-01-28T03:56:52Z" level=info msg=" - hwmon" source="node_exporter.go:104" 2021-01-28T03:56:53.015 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:52 smithi162 bash[23835]: time="2021-01-28T03:56:52Z" level=info msg=" - infiniband" source="node_exporter.go:104" 2021-01-28T03:56:53.015 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:52 smithi162 bash[23835]: time="2021-01-28T03:56:52Z" level=info msg=" - ipvs" source="node_exporter.go:104" 2021-01-28T03:56:53.015 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:52 smithi162 bash[23835]: time="2021-01-28T03:56:52Z" level=info msg=" - loadavg" source="node_exporter.go:104" 2021-01-28T03:56:53.015 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:52 smithi162 bash[23835]: time="2021-01-28T03:56:52Z" level=info msg=" - mdadm" source="node_exporter.go:104" 2021-01-28T03:56:53.015 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:52 smithi162 bash[23835]: time="2021-01-28T03:56:52Z" level=info msg=" - meminfo" source="node_exporter.go:104" 2021-01-28T03:56:53.016 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:52 smithi162 bash[23835]: time="2021-01-28T03:56:52Z" level=info msg=" - netclass" source="node_exporter.go:104" 2021-01-28T03:56:53.016 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:52 smithi162 bash[23835]: time="2021-01-28T03:56:52Z" level=info msg=" - netdev" source="node_exporter.go:104" 2021-01-28T03:56:53.016 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:52 smithi162 bash[23835]: time="2021-01-28T03:56:52Z" level=info msg=" - netstat" source="node_exporter.go:104" 2021-01-28T03:56:53.016 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:52 smithi162 bash[23835]: time="2021-01-28T03:56:52Z" level=info msg=" - nfs" source="node_exporter.go:104" 2021-01-28T03:56:53.016 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:52 smithi162 bash[23835]: time="2021-01-28T03:56:52Z" level=info msg=" - nfsd" source="node_exporter.go:104" 2021-01-28T03:56:53.017 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:52 smithi162 bash[23835]: time="2021-01-28T03:56:52Z" level=info msg=" - pressure" source="node_exporter.go:104" 2021-01-28T03:56:53.017 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:52 smithi162 bash[23835]: time="2021-01-28T03:56:52Z" level=info msg=" - sockstat" source="node_exporter.go:104" 2021-01-28T03:56:53.017 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:52 smithi162 bash[23835]: time="2021-01-28T03:56:52Z" level=info msg=" - stat" source="node_exporter.go:104" 2021-01-28T03:56:53.017 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:52 smithi162 bash[23835]: time="2021-01-28T03:56:52Z" level=info msg=" - textfile" source="node_exporter.go:104" 2021-01-28T03:56:53.017 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:52 smithi162 bash[23835]: time="2021-01-28T03:56:52Z" level=info msg=" - time" source="node_exporter.go:104" 2021-01-28T03:56:53.017 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:52 smithi162 bash[23835]: time="2021-01-28T03:56:52Z" level=info msg=" - uname" source="node_exporter.go:104" 2021-01-28T03:56:53.018 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:52 smithi162 bash[23835]: time="2021-01-28T03:56:52Z" level=info msg=" - vmstat" source="node_exporter.go:104" 2021-01-28T03:56:53.018 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:52 smithi162 bash[23835]: time="2021-01-28T03:56:52Z" level=info msg=" - xfs" source="node_exporter.go:104" 2021-01-28T03:56:53.018 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:52 smithi162 bash[23835]: time="2021-01-28T03:56:52Z" level=info msg=" - zfs" source="node_exporter.go:104" 2021-01-28T03:56:53.018 INFO:journalctl@ceph.node-exporter.b.smithi162.stdout:Jan 28 03:56:52 smithi162 bash[23835]: time="2021-01-28T03:56:52Z" level=info msg="Listening on :9100" source="node_exporter.go:170" 2021-01-28T03:56:53.825 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:53 smithi100 bash[26183]: 190160031744: Pull complete 2021-01-28T03:56:53.826 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:53 smithi100 bash[26183]: Digest: sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee 2021-01-28T03:56:54.325 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:53 smithi100 bash[26183]: Status: Downloaded newer image for prom/node-exporter:v0.18.1 2021-01-28T03:56:54.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:54 smithi162 bash[9856]: cluster 2021-01-28T03:56:53.384437+0000 mgr.y (mgr.14138) 314 : cluster [DBG] pgmap v239: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:56:54.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:54 smithi100 bash[9834]: cluster 2021-01-28T03:56:53.384437+0000 mgr.y (mgr.14138) 314 : cluster [DBG] pgmap v239: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:56:54.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:54 smithi100 bash[13549]: cluster 2021-01-28T03:56:53.384437+0000 mgr.y (mgr.14138) 314 : cluster [DBG] pgmap v239: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:56:56.647 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.647+0000 7fcc21386700 1 -- 172.21.15.100:0/1529363542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc1c0fb4c0 msgr2=0x7fcc1c0fd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:56.648 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.647+0000 7fcc21386700 1 --2- 172.21.15.100:0/1529363542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc1c0fb4c0 0x7fcc1c0fd950 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fcc14009dc0 tx=0x7fcc14004d10).stop 2021-01-28T03:56:56.648 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.647+0000 7fcc21386700 1 -- 172.21.15.100:0/1529363542 shutdown_connections 2021-01-28T03:56:56.649 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.647+0000 7fcc21386700 1 --2- 172.21.15.100:0/1529363542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc1c05f710 0x7fcc1c0f8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:56.649 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.647+0000 7fcc21386700 1 --2- 172.21.15.100:0/1529363542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc1c0fb4c0 0x7fcc1c0fd950 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:56.649 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.647+0000 7fcc21386700 1 --2- 172.21.15.100:0/1529363542 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcc1c0f8a50 0x7fcc1c0fae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:56.649 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.647+0000 7fcc21386700 1 -- 172.21.15.100:0/1529363542 >> 172.21.15.100:0/1529363542 conn(0x7fcc1c0effe0 msgr2=0x7fcc1c0f2400 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:56:56.650 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.647+0000 7fcc21386700 1 -- 172.21.15.100:0/1529363542 shutdown_connections 2021-01-28T03:56:56.650 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.647+0000 7fcc21386700 1 -- 172.21.15.100:0/1529363542 wait complete. 2021-01-28T03:56:56.651 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.647+0000 7fcc21386700 1 Processor -- start 2021-01-28T03:56:56.652 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.647+0000 7fcc21386700 1 -- start start 2021-01-28T03:56:56.652 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.647+0000 7fcc21386700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc1c05f710 0x7fcc1c0f5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:56:56.652 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.647+0000 7fcc21386700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcc1c0f8a50 0x7fcc1c0f4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:56:56.652 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.647+0000 7fcc21386700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc1c0fb4c0 0x7fcc1c0f4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:56:56.653 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.647+0000 7fcc21386700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c0f51a0 con 0x7fcc1c05f710 2021-01-28T03:56:56.653 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.647+0000 7fcc21386700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c0f5310 con 0x7fcc1c0fb4c0 2021-01-28T03:56:56.653 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.647+0000 7fcc21386700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1c10f7f0 con 0x7fcc1c0f8a50 2021-01-28T03:56:56.654 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.647+0000 7fcc1bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc1c05f710 0x7fcc1c0f5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:56:56.654 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.647+0000 7fcc1bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc1c05f710 0x7fcc1c0f5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59760/0 (socket says 172.21.15.100:59760) 2021-01-28T03:56:56.654 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.647+0000 7fcc1bfff700 1 -- 172.21.15.100:0/4171610821 learned_addr learned my addr 172.21.15.100:0/4171610821 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:56:56.654 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.647+0000 7fcc20b85700 1 --2- 172.21.15.100:0/4171610821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc1c0fb4c0 0x7fcc1c0f4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:56:56.655 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.651+0000 7fcc1b7fe700 1 --2- 172.21.15.100:0/4171610821 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcc1c0f8a50 0x7fcc1c0f4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:56:56.655 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.651+0000 7fcc1bfff700 1 -- 172.21.15.100:0/4171610821 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcc1c0f8a50 msgr2=0x7fcc1c0f4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:56.655 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.651+0000 7fcc1bfff700 1 --2- 172.21.15.100:0/4171610821 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcc1c0f8a50 0x7fcc1c0f4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:56.655 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.651+0000 7fcc1bfff700 1 -- 172.21.15.100:0/4171610821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc1c0fb4c0 msgr2=0x7fcc1c0f4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:56.655 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.651+0000 7fcc1bfff700 1 --2- 172.21.15.100:0/4171610821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc1c0fb4c0 0x7fcc1c0f4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:56.656 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.651+0000 7fcc1bfff700 1 -- 172.21.15.100:0/4171610821 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1c10f9b0 con 0x7fcc1c05f710 2021-01-28T03:56:56.656 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.651+0000 7fcc20b85700 1 --2- 172.21.15.100:0/4171610821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc1c0fb4c0 0x7fcc1c0f4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-28T03:56:56.656 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.651+0000 7fcc1b7fe700 1 --2- 172.21.15.100:0/4171610821 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcc1c0f8a50 0x7fcc1c0f4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-28T03:56:56.656 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.651+0000 7fcc1bfff700 1 --2- 172.21.15.100:0/4171610821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc1c05f710 0x7fcc1c0f5fe0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fcc0c00ebc0 tx=0x7fcc0c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:56:56.657 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.651+0000 7fcc18ff9700 1 -- 172.21.15.100:0/4171610821 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c0092e0 con 0x7fcc1c05f710 2021-01-28T03:56:56.657 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.651+0000 7fcc21386700 1 -- 172.21.15.100:0/4171610821 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc1c10fc60 con 0x7fcc1c05f710 2021-01-28T03:56:56.657 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.651+0000 7fcc18ff9700 1 -- 172.21.15.100:0/4171610821 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fcc0c00f040 con 0x7fcc1c05f710 2021-01-28T03:56:56.657 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.651+0000 7fcc18ff9700 1 -- 172.21.15.100:0/4171610821 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0c00c940 con 0x7fcc1c05f710 2021-01-28T03:56:56.658 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.651+0000 7fcc21386700 1 -- 172.21.15.100:0/4171610821 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc1c1101a0 con 0x7fcc1c05f710 2021-01-28T03:56:56.659 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.655+0000 7fcc21386700 1 -- 172.21.15.100:0/4171610821 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc1c0f3bb0 con 0x7fcc1c05f710 2021-01-28T03:56:56.659 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.655+0000 7fcc18ff9700 1 -- 172.21.15.100:0/4171610821 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7fcc0c00cd30 con 0x7fcc1c05f710 2021-01-28T03:56:56.659 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.659+0000 7fcc18ff9700 1 --2- 172.21.15.100:0/4171610821 >> v2:172.21.15.100:6800/928846103 conn(0x7fcc0405bc70 0x7fcc0405e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:56:56.660 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.659+0000 7fcc18ff9700 1 -- 172.21.15.100:0/4171610821 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7fcc0c075910 con 0x7fcc1c05f710 2021-01-28T03:56:56.660 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.659+0000 7fcc1b7fe700 1 --2- 172.21.15.100:0/4171610821 >> v2:172.21.15.100:6800/928846103 conn(0x7fcc0405bc70 0x7fcc0405e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:56:56.660 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.659+0000 7fcc1b7fe700 1 --2- 172.21.15.100:0/4171610821 >> v2:172.21.15.100:6800/928846103 conn(0x7fcc0405bc70 0x7fcc0405e130 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fcc10009fd0 tx=0x7fcc1000b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:56:56.662 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.663+0000 7fcc18ff9700 1 -- 172.21.15.100:0/4171610821 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fcc0c048600 con 0x7fcc1c05f710 2021-01-28T03:56:56.760 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:56 smithi162 bash[9856]: cluster 2021-01-28T03:56:55.385548+0000 mgr.y (mgr.14138) 315 : cluster [DBG] pgmap v240: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:56:56.825 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:56 smithi100 bash[9834]: cluster 2021-01-28T03:56:55.385548+0000 mgr.y (mgr.14138) 315 : cluster [DBG] pgmap v240: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:56:56.826 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:56 smithi100 bash[13549]: cluster 2021-01-28T03:56:55.385548+0000 mgr.y (mgr.14138) 315 : cluster [DBG] pgmap v240: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:56:56.891 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.891+0000 7fcc21386700 1 -- 172.21.15.100:0/4171610821 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fcc1c044bc0 con 0x7fcc1c05f710 2021-01-28T03:56:56.901 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.899+0000 7fcc18ff9700 1 -- 172.21.15.100:0/4171610821 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v18) v1 ==== 170+0+59 (secure 0 0 0) 0x7fcc0c0190f0 con 0x7fcc1c05f710 2021-01-28T03:56:56.901 INFO:teuthology.orchestra.run.smithi100.stdout:[client.0] 2021-01-28T03:56:56.901 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQAINhJgVmk6NRAAM8LqHgfjQbVf0HVB8QEHpQ== 2021-01-28T03:56:56.903 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.903+0000 7fcc21386700 1 -- 172.21.15.100:0/4171610821 >> v2:172.21.15.100:6800/928846103 conn(0x7fcc0405bc70 msgr2=0x7fcc0405e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:56.903 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.903+0000 7fcc21386700 1 --2- 172.21.15.100:0/4171610821 >> v2:172.21.15.100:6800/928846103 conn(0x7fcc0405bc70 0x7fcc0405e130 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7fcc10009fd0 tx=0x7fcc1000b040).stop 2021-01-28T03:56:56.904 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.903+0000 7fcc21386700 1 -- 172.21.15.100:0/4171610821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc1c05f710 msgr2=0x7fcc1c0f5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:56:56.904 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.903+0000 7fcc21386700 1 --2- 172.21.15.100:0/4171610821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc1c05f710 0x7fcc1c0f5fe0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fcc0c00ebc0 tx=0x7fcc0c00b040).stop 2021-01-28T03:56:56.904 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.903+0000 7fcc21386700 1 -- 172.21.15.100:0/4171610821 shutdown_connections 2021-01-28T03:56:56.904 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.903+0000 7fcc21386700 1 --2- 172.21.15.100:0/4171610821 >> v2:172.21.15.100:6800/928846103 conn(0x7fcc0405bc70 0x7fcc0405e130 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:56.905 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.903+0000 7fcc21386700 1 --2- 172.21.15.100:0/4171610821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc1c0fb4c0 0x7fcc1c0f4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:56.905 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.903+0000 7fcc21386700 1 --2- 172.21.15.100:0/4171610821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc1c05f710 0x7fcc1c0f5fe0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:56.905 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.903+0000 7fcc21386700 1 --2- 172.21.15.100:0/4171610821 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fcc1c0f8a50 0x7fcc1c0f4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:56:56.905 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.903+0000 7fcc21386700 1 -- 172.21.15.100:0/4171610821 >> 172.21.15.100:0/4171610821 conn(0x7fcc1c0effe0 msgr2=0x7fcc1c0fa2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:56:56.905 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.903+0000 7fcc21386700 1 -- 172.21.15.100:0/4171610821 shutdown_connections 2021-01-28T03:56:56.906 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:56:56.903+0000 7fcc21386700 1 -- 172.21.15.100:0/4171610821 wait complete. 2021-01-28T03:56:57.326 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[26183]: time="2021-01-28T03:56:57Z" level=info msg="Starting node_exporter (version=0.18.1, branch=HEAD, revision=3db77732e925c08f675d7404a8c46466b2ece83e)" source="node_exporter.go:156" 2021-01-28T03:56:57.326 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[26183]: time="2021-01-28T03:56:57Z" level=info msg="Build context (go=go1.12.5, user=root@b50852a1acba, date=20190604-16:41:18)" source="node_exporter.go:157" 2021-01-28T03:56:57.327 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[26183]: time="2021-01-28T03:56:57Z" level=info msg="Enabled collectors:" source="node_exporter.go:97" 2021-01-28T03:56:57.327 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[26183]: time="2021-01-28T03:56:57Z" level=info msg=" - arp" source="node_exporter.go:104" 2021-01-28T03:56:57.327 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[26183]: time="2021-01-28T03:56:57Z" level=info msg=" - bcache" source="node_exporter.go:104" 2021-01-28T03:56:57.327 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[26183]: time="2021-01-28T03:56:57Z" level=info msg=" - bonding" source="node_exporter.go:104" 2021-01-28T03:56:57.328 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[26183]: time="2021-01-28T03:56:57Z" level=info msg=" - conntrack" source="node_exporter.go:104" 2021-01-28T03:56:57.328 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[26183]: time="2021-01-28T03:56:57Z" level=info msg=" - cpu" source="node_exporter.go:104" 2021-01-28T03:56:57.328 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[26183]: time="2021-01-28T03:56:57Z" level=info msg=" - cpufreq" source="node_exporter.go:104" 2021-01-28T03:56:57.328 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[26183]: time="2021-01-28T03:56:57Z" level=info msg=" - diskstats" source="node_exporter.go:104" 2021-01-28T03:56:57.328 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[26183]: time="2021-01-28T03:56:57Z" level=info msg=" - edac" source="node_exporter.go:104" 2021-01-28T03:56:57.329 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[26183]: time="2021-01-28T03:56:57Z" level=info msg=" - entropy" source="node_exporter.go:104" 2021-01-28T03:56:57.329 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[26183]: time="2021-01-28T03:56:57Z" level=info msg=" - filefd" source="node_exporter.go:104" 2021-01-28T03:56:57.329 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[26183]: time="2021-01-28T03:56:57Z" level=info msg=" - filesystem" source="node_exporter.go:104" 2021-01-28T03:56:57.329 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[26183]: time="2021-01-28T03:56:57Z" level=info msg=" - hwmon" source="node_exporter.go:104" 2021-01-28T03:56:57.329 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[26183]: time="2021-01-28T03:56:57Z" level=info msg=" - infiniband" source="node_exporter.go:104" 2021-01-28T03:56:57.330 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[26183]: time="2021-01-28T03:56:57Z" level=info msg=" - ipvs" source="node_exporter.go:104" 2021-01-28T03:56:57.330 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[26183]: time="2021-01-28T03:56:57Z" level=info msg=" - loadavg" source="node_exporter.go:104" 2021-01-28T03:56:57.330 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[26183]: time="2021-01-28T03:56:57Z" level=info msg=" - mdadm" source="node_exporter.go:104" 2021-01-28T03:56:57.330 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[26183]: time="2021-01-28T03:56:57Z" level=info msg=" - meminfo" source="node_exporter.go:104" 2021-01-28T03:56:57.330 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[26183]: time="2021-01-28T03:56:57Z" level=info msg=" - netclass" source="node_exporter.go:104" 2021-01-28T03:56:57.331 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[26183]: time="2021-01-28T03:56:57Z" level=info msg=" - netdev" source="node_exporter.go:104" 2021-01-28T03:56:57.331 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[26183]: time="2021-01-28T03:56:57Z" level=info msg=" - netstat" source="node_exporter.go:104" 2021-01-28T03:56:57.331 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[26183]: time="2021-01-28T03:56:57Z" level=info msg=" - nfs" source="node_exporter.go:104" 2021-01-28T03:56:57.331 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[26183]: time="2021-01-28T03:56:57Z" level=info msg=" - nfsd" source="node_exporter.go:104" 2021-01-28T03:56:57.332 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[26183]: time="2021-01-28T03:56:57Z" level=info msg=" - pressure" source="node_exporter.go:104" 2021-01-28T03:56:57.332 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[26183]: time="2021-01-28T03:56:57Z" level=info msg=" - sockstat" source="node_exporter.go:104" 2021-01-28T03:56:57.332 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[26183]: time="2021-01-28T03:56:57Z" level=info msg=" - stat" source="node_exporter.go:104" 2021-01-28T03:56:57.332 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[26183]: time="2021-01-28T03:56:57Z" level=info msg=" - textfile" source="node_exporter.go:104" 2021-01-28T03:56:57.332 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[26183]: time="2021-01-28T03:56:57Z" level=info msg=" - time" source="node_exporter.go:104" 2021-01-28T03:56:57.333 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[26183]: time="2021-01-28T03:56:57Z" level=info msg=" - uname" source="node_exporter.go:104" 2021-01-28T03:56:57.333 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[26183]: time="2021-01-28T03:56:57Z" level=info msg=" - vmstat" source="node_exporter.go:104" 2021-01-28T03:56:57.333 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[26183]: time="2021-01-28T03:56:57Z" level=info msg=" - xfs" source="node_exporter.go:104" 2021-01-28T03:56:57.333 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[26183]: time="2021-01-28T03:56:57Z" level=info msg=" - zfs" source="node_exporter.go:104" 2021-01-28T03:56:57.333 INFO:journalctl@ceph.node-exporter.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[26183]: time="2021-01-28T03:56:57Z" level=info msg="Listening on :9100" source="node_exporter.go:170" 2021-01-28T03:56:57.826 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[9834]: audit 2021-01-28T03:56:56.892591+0000 mon.a (mon.0) 610 : audit [INF] from='client.? 172.21.15.100:0/4171610821' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-28T03:56:57.826 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[9834]: audit 2021-01-28T03:56:56.901351+0000 mon.a (mon.0) 611 : audit [INF] from='client.? 172.21.15.100:0/4171610821' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-01-28T03:56:57.826 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[9834]: cluster 2021-01-28T03:56:57.386494+0000 mgr.y (mgr.14138) 316 : cluster [DBG] pgmap v241: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:56:57.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[13549]: audit 2021-01-28T03:56:56.892591+0000 mon.a (mon.0) 610 : audit [INF] from='client.? 172.21.15.100:0/4171610821' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-28T03:56:57.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[13549]: audit 2021-01-28T03:56:56.901351+0000 mon.a (mon.0) 611 : audit [INF] from='client.? 172.21.15.100:0/4171610821' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-01-28T03:56:57.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:56:57 smithi100 bash[13549]: cluster 2021-01-28T03:56:57.386494+0000 mgr.y (mgr.14138) 316 : cluster [DBG] pgmap v241: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:56:58.011 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:57 smithi162 bash[9856]: audit 2021-01-28T03:56:56.892591+0000 mon.a (mon.0) 610 : audit [INF] from='client.? 172.21.15.100:0/4171610821' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-28T03:56:58.011 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:57 smithi162 bash[9856]: audit 2021-01-28T03:56:56.901351+0000 mon.a (mon.0) 611 : audit [INF] from='client.? 172.21.15.100:0/4171610821' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-01-28T03:56:58.011 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:56:57 smithi162 bash[9856]: cluster 2021-01-28T03:56:57.386494+0000 mgr.y (mgr.14138) 316 : cluster [DBG] pgmap v241: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:56:58.395 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2021-01-28T03:56:58.395 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2021-01-28T03:56:58.396 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2021-01-28T03:56:58.418 DEBUG:teuthology.orchestra.run.smithi162:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2021-01-28T03:56:59.755 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:56:59 smithi100 bash[10061]: debug 2021-01-28T03:56:59.507+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T03:56:59.760 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 03:56:59 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T03:57:00.761 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:00 smithi162 bash[9856]: cluster 2021-01-28T03:56:59.387872+0000 mgr.y (mgr.14138) 317 : cluster [DBG] pgmap v242: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:00.769 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:00 smithi100 bash[9834]: cluster 2021-01-28T03:56:59.387872+0000 mgr.y (mgr.14138) 317 : cluster [DBG] pgmap v242: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:00.770 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:00 smithi100 bash[13549]: cluster 2021-01-28T03:56:59.387872+0000 mgr.y (mgr.14138) 317 : cluster [DBG] pgmap v242: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:01.539 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:01 smithi100 bash[9834]: audit 2021-01-28T03:56:59.507738+0000 mgr.y (mgr.14138) 318 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:57:01.539 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:01 smithi100 bash[13549]: audit 2021-01-28T03:56:59.507738+0000 mgr.y (mgr.14138) 318 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:57:01.692 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.690+0000 7fb422787700 1 -- 172.21.15.162:0/3804088565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb41c0fadd0 msgr2=0x7fb41c0fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:01.693 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.690+0000 7fb422787700 1 --2- 172.21.15.162:0/3804088565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb41c0fadd0 0x7fb41c0fd1c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fb410004e00 tx=0x7fb410009b30).stop 2021-01-28T03:57:01.693 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.690+0000 7fb422787700 1 -- 172.21.15.162:0/3804088565 shutdown_connections 2021-01-28T03:57:01.693 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.690+0000 7fb422787700 1 --2- 172.21.15.162:0/3804088565 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb41c0fd6b0 0x7fb41c0ffb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:01.693 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.690+0000 7fb422787700 1 --2- 172.21.15.162:0/3804088565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb41c05f7b0 0x7fb41c0fa8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:01.693 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.690+0000 7fb422787700 1 --2- 172.21.15.162:0/3804088565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb41c0fadd0 0x7fb41c0fd1c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:01.694 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.690+0000 7fb422787700 1 -- 172.21.15.162:0/3804088565 >> 172.21.15.162:0/3804088565 conn(0x7fb41c0effe0 msgr2=0x7fb41c0f2400 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:57:01.694 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.690+0000 7fb422787700 1 -- 172.21.15.162:0/3804088565 shutdown_connections 2021-01-28T03:57:01.694 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.690+0000 7fb422787700 1 -- 172.21.15.162:0/3804088565 wait complete. 2021-01-28T03:57:01.695 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.690+0000 7fb422787700 1 Processor -- start 2021-01-28T03:57:01.696 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.690+0000 7fb422787700 1 -- start start 2021-01-28T03:57:01.696 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.690+0000 7fb422787700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb41c05f7b0 0x7fb41c107d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:01.696 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.690+0000 7fb422787700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb41c0fd6b0 0x7fb41c1081f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:01.696 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.690+0000 7fb422787700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb41c108fa0 0x7fb41c109420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:01.696 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.690+0000 7fb422787700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41c109950 con 0x7fb41c0fd6b0 2021-01-28T03:57:01.697 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.690+0000 7fb422787700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41c109ac0 con 0x7fb41c108fa0 2021-01-28T03:57:01.697 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.690+0000 7fb422787700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb41c109c80 con 0x7fb41c05f7b0 2021-01-28T03:57:01.697 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.690+0000 7fb421f86700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb41c108fa0 0x7fb41c109420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:01.697 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.690+0000 7fb421f86700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb41c108fa0 0x7fb41c109420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:45522/0 (socket says 172.21.15.162:45522) 2021-01-28T03:57:01.697 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.690+0000 7fb421f86700 1 -- 172.21.15.162:0/3801956650 learned_addr learned my addr 172.21.15.162:0/3801956650 (peer_addr_for_me v2:172.21.15.162:0/0) 2021-01-28T03:57:01.698 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.690+0000 7fb421785700 1 --2- 172.21.15.162:0/3801956650 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb41c05f7b0 0x7fb41c107d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:01.698 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.690+0000 7fb420f84700 1 --2- 172.21.15.162:0/3801956650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb41c0fd6b0 0x7fb41c1081f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:01.698 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.694+0000 7fb421f86700 1 -- 172.21.15.162:0/3801956650 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb41c05f7b0 msgr2=0x7fb41c107d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:01.698 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.694+0000 7fb421f86700 1 --2- 172.21.15.162:0/3801956650 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb41c05f7b0 0x7fb41c107d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:01.699 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.694+0000 7fb421f86700 1 -- 172.21.15.162:0/3801956650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb41c0fd6b0 msgr2=0x7fb41c1081f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:01.699 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.694+0000 7fb421f86700 1 --2- 172.21.15.162:0/3801956650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb41c0fd6b0 0x7fb41c1081f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:01.699 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.694+0000 7fb421f86700 1 -- 172.21.15.162:0/3801956650 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb41c1101f0 con 0x7fb41c108fa0 2021-01-28T03:57:01.699 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.694+0000 7fb421f86700 1 --2- 172.21.15.162:0/3801956650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb41c108fa0 0x7fb41c109420 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fb41400ee40 tx=0x7fb41400b040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:57:01.699 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.694+0000 7fb419ffb700 1 -- 172.21.15.162:0/3801956650 <== mon.2 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4140097d0 con 0x7fb41c108fa0 2021-01-28T03:57:01.700 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.694+0000 7fb419ffb700 1 -- 172.21.15.162:0/3801956650 <== mon.2 v2:172.21.15.162:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fb41400f040 con 0x7fb41c108fa0 2021-01-28T03:57:01.700 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.694+0000 7fb422787700 1 -- 172.21.15.162:0/3801956650 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb41c110380 con 0x7fb41c108fa0 2021-01-28T03:57:01.700 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.694+0000 7fb419ffb700 1 -- 172.21.15.162:0/3801956650 <== mon.2 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb414007620 con 0x7fb41c108fa0 2021-01-28T03:57:01.700 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.694+0000 7fb422787700 1 -- 172.21.15.162:0/3801956650 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb41c1108c0 con 0x7fb41c108fa0 2021-01-28T03:57:01.701 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.694+0000 7fb422787700 1 -- 172.21.15.162:0/3801956650 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb41c0f3bb0 con 0x7fb41c108fa0 2021-01-28T03:57:01.701 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.694+0000 7fb419ffb700 1 -- 172.21.15.162:0/3801956650 <== mon.2 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7fb414004020 con 0x7fb41c108fa0 2021-01-28T03:57:01.701 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.698+0000 7fb419ffb700 1 --2- 172.21.15.162:0/3801956650 >> v2:172.21.15.100:6800/928846103 conn(0x7fb40405bc70 0x7fb40405e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:01.702 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.698+0000 7fb419ffb700 1 -- 172.21.15.162:0/3801956650 <== mon.2 v2:172.21.15.162:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7fb414075a20 con 0x7fb41c108fa0 2021-01-28T03:57:01.702 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.698+0000 7fb421785700 1 --2- 172.21.15.162:0/3801956650 >> v2:172.21.15.100:6800/928846103 conn(0x7fb40405bc70 0x7fb40405e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:01.702 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.698+0000 7fb421785700 1 --2- 172.21.15.162:0/3801956650 >> v2:172.21.15.100:6800/928846103 conn(0x7fb40405bc70 0x7fb40405e130 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fb40c009fd0 tx=0x7fb40c00b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:57:01.704 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.702+0000 7fb419ffb700 1 -- 172.21.15.162:0/3801956650 <== mon.2 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fb4140468c0 con 0x7fb41c108fa0 2021-01-28T03:57:01.761 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:01 smithi162 bash[9856]: audit 2021-01-28T03:56:59.507738+0000 mgr.y (mgr.14138) 318 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:57:01.825 INFO:journalctl@ceph.alertmanager.a.smithi100.stdout:Jan 28 03:57:01 smithi100 systemd[1]: Started Ceph alertmanager.a for c217df96-611b-11eb-8f9e-001a4aab830c. 2021-01-28T03:57:01.928 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.926+0000 7fb422787700 1 -- 172.21.15.162:0/3801956650 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fb41c044bc0 con 0x7fb41c108fa0 2021-01-28T03:57:01.938 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.938+0000 7fb419ffb700 1 -- 172.21.15.162:0/3801956650 <== mon.2 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v19) v1 ==== 170+0+59 (secure 0 0 0) 0x7fb414048710 con 0x7fb41c108fa0 2021-01-28T03:57:01.939 INFO:teuthology.orchestra.run.smithi162.stdout:[client.1] 2021-01-28T03:57:01.939 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQANNhJgjU53NxAASmBQo8QNrsYpaYCCj9Sm9A== 2021-01-28T03:57:01.942 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.938+0000 7fb422787700 1 -- 172.21.15.162:0/3801956650 >> v2:172.21.15.100:6800/928846103 conn(0x7fb40405bc70 msgr2=0x7fb40405e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:01.942 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.938+0000 7fb422787700 1 --2- 172.21.15.162:0/3801956650 >> v2:172.21.15.100:6800/928846103 conn(0x7fb40405bc70 0x7fb40405e130 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7fb40c009fd0 tx=0x7fb40c00b040).stop 2021-01-28T03:57:01.942 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.938+0000 7fb422787700 1 -- 172.21.15.162:0/3801956650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb41c108fa0 msgr2=0x7fb41c109420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:01.942 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.938+0000 7fb422787700 1 --2- 172.21.15.162:0/3801956650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb41c108fa0 0x7fb41c109420 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fb41400ee40 tx=0x7fb41400b040).stop 2021-01-28T03:57:01.943 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.938+0000 7fb422787700 1 -- 172.21.15.162:0/3801956650 shutdown_connections 2021-01-28T03:57:01.943 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.938+0000 7fb422787700 1 --2- 172.21.15.162:0/3801956650 >> v2:172.21.15.100:6800/928846103 conn(0x7fb40405bc70 0x7fb40405e130 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:01.943 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.938+0000 7fb422787700 1 --2- 172.21.15.162:0/3801956650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb41c108fa0 0x7fb41c109420 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:01.943 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.938+0000 7fb422787700 1 --2- 172.21.15.162:0/3801956650 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb41c05f7b0 0x7fb41c107d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:01.943 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.938+0000 7fb422787700 1 --2- 172.21.15.162:0/3801956650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb41c0fd6b0 0x7fb41c1081f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:01.944 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.938+0000 7fb422787700 1 -- 172.21.15.162:0/3801956650 >> 172.21.15.162:0/3801956650 conn(0x7fb41c0effe0 msgr2=0x7fb41c0fc9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:57:01.944 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.938+0000 7fb422787700 1 -- 172.21.15.162:0/3801956650 shutdown_connections 2021-01-28T03:57:01.944 INFO:teuthology.orchestra.run.smithi162.stderr:2021-01-28T03:57:01.938+0000 7fb422787700 1 -- 172.21.15.162:0/3801956650 wait complete. 2021-01-28T03:57:02.678 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:02 smithi162 bash[9856]: cluster 2021-01-28T03:57:01.388627+0000 mgr.y (mgr.14138) 319 : cluster [DBG] pgmap v243: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:02.678 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:02 smithi162 bash[9856]: audit 2021-01-28T03:57:01.812191+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:02.679 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:02 smithi162 bash[9856]: audit 2021-01-28T03:57:01.814212+0000 mon.a (mon.0) 613 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:57:02.679 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:02 smithi162 bash[9856]: audit 2021-01-28T03:57:01.814653+0000 mon.a (mon.0) 614 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:57:02.679 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:02 smithi162 bash[9856]: audit 2021-01-28T03:57:01.929855+0000 mon.b (mon.2) 22 : audit [INF] from='client.? 172.21.15.162:0/3801956650' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-28T03:57:02.679 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:02 smithi162 bash[9856]: audit 2021-01-28T03:57:01.930274+0000 mon.a (mon.0) 615 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-28T03:57:02.680 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:02 smithi162 bash[9856]: audit 2021-01-28T03:57:01.938730+0000 mon.a (mon.0) 616 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-01-28T03:57:02.680 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2021-01-28T03:57:02.681 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2021-01-28T03:57:02.681 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2021-01-28T03:57:02.708 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph osd dump --format=json 2021-01-28T03:57:02.719 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:02 smithi100 bash[13549]: cluster 2021-01-28T03:57:01.388627+0000 mgr.y (mgr.14138) 319 : cluster [DBG] pgmap v243: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:02.719 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:02 smithi100 bash[13549]: audit 2021-01-28T03:57:01.812191+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:02.719 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:02 smithi100 bash[13549]: audit 2021-01-28T03:57:01.814212+0000 mon.a (mon.0) 613 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:57:02.720 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:02 smithi100 bash[13549]: audit 2021-01-28T03:57:01.814653+0000 mon.a (mon.0) 614 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:57:02.720 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:02 smithi100 bash[13549]: audit 2021-01-28T03:57:01.929855+0000 mon.b (mon.2) 22 : audit [INF] from='client.? 172.21.15.162:0/3801956650' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-28T03:57:02.720 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:02 smithi100 bash[13549]: audit 2021-01-28T03:57:01.930274+0000 mon.a (mon.0) 615 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-28T03:57:02.720 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:02 smithi100 bash[13549]: audit 2021-01-28T03:57:01.938730+0000 mon.a (mon.0) 616 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-01-28T03:57:02.721 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:02 smithi100 bash[9834]: cluster 2021-01-28T03:57:01.388627+0000 mgr.y (mgr.14138) 319 : cluster [DBG] pgmap v243: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:02.721 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:02 smithi100 bash[9834]: audit 2021-01-28T03:57:01.812191+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:02.721 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:02 smithi100 bash[9834]: audit 2021-01-28T03:57:01.814212+0000 mon.a (mon.0) 613 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:57:02.721 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:02 smithi100 bash[9834]: audit 2021-01-28T03:57:01.814653+0000 mon.a (mon.0) 614 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:57:02.721 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:02 smithi100 bash[9834]: audit 2021-01-28T03:57:01.929855+0000 mon.b (mon.2) 22 : audit [INF] from='client.? 172.21.15.162:0/3801956650' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-28T03:57:02.722 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:02 smithi100 bash[9834]: audit 2021-01-28T03:57:01.930274+0000 mon.a (mon.0) 615 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-28T03:57:02.722 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:02 smithi100 bash[9834]: audit 2021-01-28T03:57:01.938730+0000 mon.a (mon.0) 616 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-01-28T03:57:02.876 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c217df96-611b-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T03:57:04.326 INFO:journalctl@ceph.alertmanager.a.smithi100.stdout:Jan 28 03:57:04 smithi100 bash[26728]: level=info ts=2021-01-28T03:57:04.107Z caller=main.go:231 msg="Starting Alertmanager" version="(version=0.20.0, branch=HEAD, revision=f74be0400a6243d10bb53812d6fa408ad71ff32d)" 2021-01-28T03:57:04.326 INFO:journalctl@ceph.alertmanager.a.smithi100.stdout:Jan 28 03:57:04 smithi100 bash[26728]: level=info ts=2021-01-28T03:57:04.107Z caller=main.go:232 build_context="(go=go1.13.5, user=root@00c3106655f8, date=20191211-14:13:14)" 2021-01-28T03:57:04.326 INFO:journalctl@ceph.alertmanager.a.smithi100.stdout:Jan 28 03:57:04 smithi100 bash[26728]: level=info ts=2021-01-28T03:57:04.110Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.15.100 port=9094 2021-01-28T03:57:04.326 INFO:journalctl@ceph.alertmanager.a.smithi100.stdout:Jan 28 03:57:04 smithi100 bash[26728]: level=info ts=2021-01-28T03:57:04.112Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2021-01-28T03:57:04.327 INFO:journalctl@ceph.alertmanager.a.smithi100.stdout:Jan 28 03:57:04 smithi100 bash[26728]: level=info ts=2021-01-28T03:57:04.154Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2021-01-28T03:57:04.327 INFO:journalctl@ceph.alertmanager.a.smithi100.stdout:Jan 28 03:57:04 smithi100 bash[26728]: level=info ts=2021-01-28T03:57:04.154Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2021-01-28T03:57:04.327 INFO:journalctl@ceph.alertmanager.a.smithi100.stdout:Jan 28 03:57:04 smithi100 bash[26728]: level=info ts=2021-01-28T03:57:04.160Z caller=main.go:497 msg=Listening address=:9093 2021-01-28T03:57:04.711 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:04 smithi100 bash[9834]: cluster 2021-01-28T03:57:03.390260+0000 mgr.y (mgr.14138) 320 : cluster [DBG] pgmap v244: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:04.711 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:04 smithi100 bash[9834]: audit 2021-01-28T03:57:03.791649+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:04.711 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:04 smithi100 bash[9834]: audit 2021-01-28T03:57:04.458659+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:04.712 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:04 smithi100 bash[13549]: cluster 2021-01-28T03:57:03.390260+0000 mgr.y (mgr.14138) 320 : cluster [DBG] pgmap v244: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:04.712 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:04 smithi100 bash[13549]: audit 2021-01-28T03:57:03.791649+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:04.712 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:04 smithi100 bash[13549]: audit 2021-01-28T03:57:04.458659+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:04.761 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:04 smithi162 bash[9856]: cluster 2021-01-28T03:57:03.390260+0000 mgr.y (mgr.14138) 320 : cluster [DBG] pgmap v244: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:04.761 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:04 smithi162 bash[9856]: audit 2021-01-28T03:57:03.791649+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:04.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:04 smithi162 bash[9856]: audit 2021-01-28T03:57:04.458659+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:05.576 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:05 smithi100 bash[13549]: audit 2021-01-28T03:57:04.472086+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:05.576 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:05 smithi100 bash[13549]: cephadm 2021-01-28T03:57:04.473051+0000 mgr.y (mgr.14138) 321 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:57:05.577 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:05 smithi100 bash[13549]: cephadm 2021-01-28T03:57:04.473752+0000 mgr.y (mgr.14138) 322 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T03:57:05.577 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:05 smithi100 bash[13549]: cephadm 2021-01-28T03:57:04.474212+0000 mgr.y (mgr.14138) 323 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='iscsi.a')] + new hosts [] 2021-01-28T03:57:05.577 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:05 smithi100 bash[13549]: cephadm 2021-01-28T03:57:04.474663+0000 mgr.y (mgr.14138) 324 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='a')] + new hosts [] 2021-01-28T03:57:05.577 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:05 smithi100 bash[13549]: audit 2021-01-28T03:57:04.590896+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:05.577 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:05 smithi100 bash[13549]: audit 2021-01-28T03:57:04.598129+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:05.578 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:05 smithi100 bash[13549]: audit 2021-01-28T03:57:04.599177+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-01-28T03:57:05.578 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:05 smithi100 bash[13549]: audit 2021-01-28T03:57:04.605277+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:05.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:05 smithi100 bash[9834]: audit 2021-01-28T03:57:04.472086+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:05.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:05 smithi100 bash[9834]: cephadm 2021-01-28T03:57:04.473051+0000 mgr.y (mgr.14138) 321 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:57:05.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:05 smithi100 bash[9834]: cephadm 2021-01-28T03:57:04.473752+0000 mgr.y (mgr.14138) 322 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T03:57:05.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:05 smithi100 bash[9834]: cephadm 2021-01-28T03:57:04.474212+0000 mgr.y (mgr.14138) 323 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='iscsi.a')] + new hosts [] 2021-01-28T03:57:05.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:05 smithi100 bash[9834]: cephadm 2021-01-28T03:57:04.474663+0000 mgr.y (mgr.14138) 324 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='a')] + new hosts [] 2021-01-28T03:57:05.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:05 smithi100 bash[9834]: audit 2021-01-28T03:57:04.590896+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:05.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:05 smithi100 bash[9834]: audit 2021-01-28T03:57:04.598129+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:05.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:05 smithi100 bash[9834]: audit 2021-01-28T03:57:04.599177+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-01-28T03:57:05.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:05 smithi100 bash[9834]: audit 2021-01-28T03:57:04.605277+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:05.761 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:05 smithi162 bash[9856]: audit 2021-01-28T03:57:04.472086+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:05.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:05 smithi162 bash[9856]: cephadm 2021-01-28T03:57:04.473051+0000 mgr.y (mgr.14138) 321 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:57:05.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:05 smithi162 bash[9856]: cephadm 2021-01-28T03:57:04.473752+0000 mgr.y (mgr.14138) 322 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T03:57:05.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:05 smithi162 bash[9856]: cephadm 2021-01-28T03:57:04.474212+0000 mgr.y (mgr.14138) 323 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='iscsi.a')] + new hosts [] 2021-01-28T03:57:05.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:05 smithi162 bash[9856]: cephadm 2021-01-28T03:57:04.474663+0000 mgr.y (mgr.14138) 324 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='a')] + new hosts [] 2021-01-28T03:57:05.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:05 smithi162 bash[9856]: audit 2021-01-28T03:57:04.590896+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:05.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:05 smithi162 bash[9856]: audit 2021-01-28T03:57:04.598129+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:05.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:05 smithi162 bash[9856]: audit 2021-01-28T03:57:04.599177+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-01-28T03:57:05.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:05 smithi162 bash[9856]: audit 2021-01-28T03:57:04.605277+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:06.471 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.470+0000 7f9713fff700 1 -- 172.21.15.100:0/1239618288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97140f8a80 msgr2=0x7f97140fae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:06.471 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.470+0000 7f9713fff700 1 --2- 172.21.15.100:0/1239618288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97140f8a80 0x7f97140fae70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f96fc004e00 tx=0x7f96fc009b30).stop 2021-01-28T03:57:06.472 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.470+0000 7f9713fff700 1 -- 172.21.15.100:0/1239618288 shutdown_connections 2021-01-28T03:57:06.472 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.470+0000 7f9713fff700 1 --2- 172.21.15.100:0/1239618288 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f971405f750 0x7f97140f8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:06.472 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.470+0000 7f9713fff700 1 --2- 172.21.15.100:0/1239618288 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f97140fb490 0x7f97140fd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:06.472 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.470+0000 7f9713fff700 1 --2- 172.21.15.100:0/1239618288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97140f8a80 0x7f97140fae70 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:06.473 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.470+0000 7f9713fff700 1 -- 172.21.15.100:0/1239618288 >> 172.21.15.100:0/1239618288 conn(0x7f97140effa0 msgr2=0x7f97140f23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:57:06.473 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.470+0000 7f9713fff700 1 -- 172.21.15.100:0/1239618288 shutdown_connections 2021-01-28T03:57:06.473 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.470+0000 7f9713fff700 1 -- 172.21.15.100:0/1239618288 wait complete. 2021-01-28T03:57:06.474 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.470+0000 7f9713fff700 1 Processor -- start 2021-01-28T03:57:06.475 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.470+0000 7f9713fff700 1 -- start start 2021-01-28T03:57:06.475 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.470+0000 7f9713fff700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f971405f750 0x7f9714107ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:06.475 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.470+0000 7f9713fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97140f8a80 0x7f9714107fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:06.475 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.470+0000 7f9713fff700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f97140fb490 0x7f9714108e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:06.476 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.470+0000 7f9713fff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97141093c0 con 0x7f97140f8a80 2021-01-28T03:57:06.476 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.470+0000 7f9713fff700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9714109530 con 0x7f971405f750 2021-01-28T03:57:06.476 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.470+0000 7f9713fff700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97141096f0 con 0x7f97140fb490 2021-01-28T03:57:06.476 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.470+0000 7f970bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97140f8a80 0x7f9714107fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:06.476 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.470+0000 7f970bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97140f8a80 0x7f9714107fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59776/0 (socket says 172.21.15.100:59776) 2021-01-28T03:57:06.477 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.470+0000 7f970bfff700 1 -- 172.21.15.100:0/3465734182 learned_addr learned my addr 172.21.15.100:0/3465734182 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:57:06.477 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.470+0000 7f9712ffd700 1 --2- 172.21.15.100:0/3465734182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f971405f750 0x7f9714107ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:06.477 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.470+0000 7f97137fe700 1 --2- 172.21.15.100:0/3465734182 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f97140fb490 0x7f9714108e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:06.477 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.470+0000 7f970bfff700 1 -- 172.21.15.100:0/3465734182 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f97140fb490 msgr2=0x7f9714108e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:06.478 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.470+0000 7f970bfff700 1 --2- 172.21.15.100:0/3465734182 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f97140fb490 0x7f9714108e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:06.478 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.470+0000 7f970bfff700 1 -- 172.21.15.100:0/3465734182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f971405f750 msgr2=0x7f9714107ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:06.478 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.470+0000 7f970bfff700 1 --2- 172.21.15.100:0/3465734182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f971405f750 0x7f9714107ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:06.478 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.470+0000 7f970bfff700 1 -- 172.21.15.100:0/3465734182 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97141098b0 con 0x7f97140f8a80 2021-01-28T03:57:06.478 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.470+0000 7f97137fe700 1 --2- 172.21.15.100:0/3465734182 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f97140fb490 0x7f9714108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-28T03:57:06.479 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.470+0000 7f970bfff700 1 --2- 172.21.15.100:0/3465734182 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97140f8a80 0x7f9714107fa0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f96fc009c20 tx=0x7f96fc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:57:06.479 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.470+0000 7f970b7fe700 1 -- 172.21.15.100:0/3465734182 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96fc00e030 con 0x7f97140f8a80 2021-01-28T03:57:06.479 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.470+0000 7f970b7fe700 1 -- 172.21.15.100:0/3465734182 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f96fc013a80 con 0x7f97140f8a80 2021-01-28T03:57:06.479 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.470+0000 7f9713fff700 1 -- 172.21.15.100:0/3465734182 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9714109b00 con 0x7f97140f8a80 2021-01-28T03:57:06.479 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.470+0000 7f9713fff700 1 -- 172.21.15.100:0/3465734182 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97141102a0 con 0x7f97140f8a80 2021-01-28T03:57:06.480 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.470+0000 7f970b7fe700 1 -- 172.21.15.100:0/3465734182 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96fc018070 con 0x7f97140f8a80 2021-01-28T03:57:06.481 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.474+0000 7f9713fff700 1 -- 172.21.15.100:0/3465734182 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97140f3b90 con 0x7f97140f8a80 2021-01-28T03:57:06.481 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.474+0000 7f970b7fe700 1 -- 172.21.15.100:0/3465734182 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f96fc013cf0 con 0x7f97140f8a80 2021-01-28T03:57:06.481 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.474+0000 7f970b7fe700 1 --2- 172.21.15.100:0/3465734182 >> v2:172.21.15.100:6800/928846103 conn(0x7f96f405bc70 0x7f96f405e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:06.481 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.474+0000 7f970b7fe700 1 -- 172.21.15.100:0/3465734182 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f96fc077880 con 0x7f97140f8a80 2021-01-28T03:57:06.482 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.474+0000 7f9712ffd700 1 --2- 172.21.15.100:0/3465734182 >> v2:172.21.15.100:6800/928846103 conn(0x7f96f405bc70 0x7f96f405e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:06.482 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.478+0000 7f9712ffd700 1 --2- 172.21.15.100:0/3465734182 >> v2:172.21.15.100:6800/928846103 conn(0x7f96f405bc70 0x7f96f405e130 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f9704004c40 tx=0x7f970400b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:57:06.482 INFO:journalctl@ceph.alertmanager.a.smithi100.stdout:Jan 28 03:57:06 smithi100 bash[26728]: level=info ts=2021-01-28T03:57:06.112Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000192129s 2021-01-28T03:57:06.486 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.482+0000 7f970b7fe700 1 -- 172.21.15.100:0/3465734182 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f96fc04a4f0 con 0x7f97140f8a80 2021-01-28T03:57:06.650 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.646+0000 7f9713fff700 1 -- 172.21.15.100:0/3465734182 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97141005f0 con 0x7f97140f8a80 2021-01-28T03:57:06.652 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.650+0000 7f970b7fe700 1 -- 172.21.15.100:0/3465734182 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+18965 (secure 0 0 0) 0x7f96fc04db10 con 0x7f97140f8a80 2021-01-28T03:57:06.653 INFO:teuthology.orchestra.run.smithi100.stdout: 2021-01-28T03:57:06.653 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":60,"fsid":"c217df96-611b-11eb-8f9e-001a4aab830c","created":"2021-01-28T03:49:43.977596+0000","modified":"2021-01-28T03:56:36.444276+0000","last_up_change":"2021-01-28T03:55:57.540370+0000","last_in_change":"2021-01-28T03:55:57.540370+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-28T03:51:27.917203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2021-01-28T03:55:54.463101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"iscsi","create_time":"2021-01-28T03:56:12.308562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"zone.rgw.log","create_time":"2021-01-28T03:56:13.689563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"zone.rgw.control","create_time":"2021-01-28T03:56:15.185590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"zone.rgw.meta","create_time":"2021-01-28T03:56:18.285095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":8},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"b19e5679-7a32-467e-bef2-460c896020db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":2076626497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2076626497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2076626497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6803","nonce":2076626497}]},"public_addr":"172.21.15.100:6801/2076626497","cluster_addr":"172.21.15.100:6802/2076626497","heartbeat_back_addr":"172.21.15.100:6804/2076626497","heartbeat_front_addr":"172.21.15.100:6803/2076626497","state":["exists","up"]},{"osd":1,"uuid":"7a144678-be9c-4a85-acc7-4a7522a434d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":315903268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":315903268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":315903268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6807","nonce":315903268}]},"public_addr":"172.21.15.100:6805/315903268","cluster_addr":"172.21.15.100:6806/315903268","heartbeat_back_addr":"172.21.15.100:6808/315903268","heartbeat_front_addr":"172.21.15.100:6807/315903268","state":["exists","up"]},{"osd":2,"uuid":"5866a31a-7066-4ae4-a7c9-d155b09460fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1600283162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1600283162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1600283162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":1600283162}]},"public_addr":"172.21.15.100:6809/1600283162","cluster_addr":"172.21.15.100:6810/1600283162","heartbeat_back_addr":"172.21.15.100:6812/1600283162","heartbeat_front_addr":"172.21.15.100:6811/1600283162","state":["exists","up"]},{"osd":3,"uuid":"5de112f2-cf7c-4075-9d15-b8566a707947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":799206422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":799206422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":799206422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":799206422}]},"public_addr":"172.21.15.100:6813/799206422","cluster_addr":"172.21.15.100:6814/799206422","heartbeat_back_addr":"172.21.15.100:6816/799206422","heartbeat_front_addr":"172.21.15.100:6815/799206422","state":["exists","up"]},{"osd":4,"uuid":"fda3d97f-42ca-4449-a4c0-c3256b8c64a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4274488621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6801","nonce":4274488621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6803","nonce":4274488621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4274488621}]},"public_addr":"172.21.15.162:6800/4274488621","cluster_addr":"172.21.15.162:6801/4274488621","heartbeat_back_addr":"172.21.15.162:6803/4274488621","heartbeat_front_addr":"172.21.15.162:6802/4274488621","state":["exists","up"]},{"osd":5,"uuid":"69c742c7-276f-4c30-a60f-18362a187b5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1953061558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6805","nonce":1953061558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":1953061558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1953061558}]},"public_addr":"172.21.15.162:6804/1953061558","cluster_addr":"172.21.15.162:6805/1953061558","heartbeat_back_addr":"172.21.15.162:6807/1953061558","heartbeat_front_addr":"172.21.15.162:6806/1953061558","state":["exists","up"]},{"osd":6,"uuid":"95a3b8cf-fdc9-43b4-8cd6-f7c92161409a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3682466023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":3682466023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6811","nonce":3682466023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3682466023}]},"public_addr":"172.21.15.162:6808/3682466023","cluster_addr":"172.21.15.162:6809/3682466023","heartbeat_back_addr":"172.21.15.162:6811/3682466023","heartbeat_front_addr":"172.21.15.162:6810/3682466023","state":["exists","up"]},{"osd":7,"uuid":"8ac18dc9-7208-4f26-b6a6-f9d11c3257be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2319408968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":2319408968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6815","nonce":2319408968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2319408968}]},"public_addr":"172.21.15.162:6812/2319408968","cluster_addr":"172.21.15.162:6813/2319408968","heartbeat_back_addr":"172.21.15.162:6815/2319408968","heartbeat_front_addr":"172.21.15.162:6814/2319408968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T03:52:46.582666+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T03:53:15.777781+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T03:53:44.401966+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T03:54:12.075880+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T03:54:36.048933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T03:55:04.310974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T03:55:28.994413+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T03:55:56.253535+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.1c","mappings":[{"from":1,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/2387903268":"2021-01-29T03:50:35.208992+0000","172.21.15.100:0/3466898363":"2021-01-29T03:50:35.208992+0000","172.21.15.100:6800/2057733473":"2021-01-29T03:50:35.208992+0000","172.21.15.100:0/542796331":"2021-01-29T03:50:13.341337+0000","172.21.15.100:6800/728127347":"2021-01-29T03:50:13.341337+0000","172.21.15.100:0/1692305047":"2021-01-29T03:50:13.341337+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-01-28T03:57:06.655 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.654+0000 7f9713fff700 1 -- 172.21.15.100:0/3465734182 >> v2:172.21.15.100:6800/928846103 conn(0x7f96f405bc70 msgr2=0x7f96f405e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:06.655 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.654+0000 7f9713fff700 1 --2- 172.21.15.100:0/3465734182 >> v2:172.21.15.100:6800/928846103 conn(0x7f96f405bc70 0x7f96f405e130 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f9704004c40 tx=0x7f970400b040).stop 2021-01-28T03:57:06.655 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.654+0000 7f9713fff700 1 -- 172.21.15.100:0/3465734182 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97140f8a80 msgr2=0x7f9714107fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:06.656 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.654+0000 7f9713fff700 1 --2- 172.21.15.100:0/3465734182 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97140f8a80 0x7f9714107fa0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f96fc009c20 tx=0x7f96fc009b30).stop 2021-01-28T03:57:06.656 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.654+0000 7f9713fff700 1 -- 172.21.15.100:0/3465734182 shutdown_connections 2021-01-28T03:57:06.657 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.654+0000 7f9713fff700 1 --2- 172.21.15.100:0/3465734182 >> v2:172.21.15.100:6800/928846103 conn(0x7f96f405bc70 0x7f96f405e130 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:06.657 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.654+0000 7f9713fff700 1 --2- 172.21.15.100:0/3465734182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f971405f750 0x7f9714107ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:06.657 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.654+0000 7f9713fff700 1 --2- 172.21.15.100:0/3465734182 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f97140fb490 0x7f9714108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:06.657 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.654+0000 7f9713fff700 1 --2- 172.21.15.100:0/3465734182 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97140f8a80 0x7f9714107fa0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:06.658 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.654+0000 7f9713fff700 1 -- 172.21.15.100:0/3465734182 >> 172.21.15.100:0/3465734182 conn(0x7f97140effa0 msgr2=0x7f97140f5da0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:57:06.667 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.654+0000 7f9713fff700 1 -- 172.21.15.100:0/3465734182 shutdown_connections 2021-01-28T03:57:06.667 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:06.654+0000 7f9713fff700 1 -- 172.21.15.100:0/3465734182 wait complete. 2021-01-28T03:57:06.761 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:06 smithi162 bash[9856]: cephadm 2021-01-28T03:57:04.475119+0000 mgr.y (mgr.14138) 325 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='a'), HostPlacementSpec(hostname='smithi162', network='', name='b')] + new hosts [] 2021-01-28T03:57:06.761 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:06 smithi162 bash[9856]: cephadm 2021-01-28T03:57:04.475595+0000 mgr.y (mgr.14138) 326 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='a')] + new hosts [] 2021-01-28T03:57:06.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:06 smithi162 bash[9856]: cephadm 2021-01-28T03:57:04.476089+0000 mgr.y (mgr.14138) 327 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi162', network='', name='a')] 2021-01-28T03:57:06.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:06 smithi162 bash[9856]: audit 2021-01-28T03:57:04.599901+0000 mgr.y (mgr.14138) 328 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-01-28T03:57:06.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:06 smithi162 bash[9856]: cephadm 2021-01-28T03:57:04.610132+0000 mgr.y (mgr.14138) 329 : cephadm [INF] Deploying daemon grafana.a on smithi162 2021-01-28T03:57:06.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:06 smithi162 bash[9856]: cluster 2021-01-28T03:57:05.391736+0000 mgr.y (mgr.14138) 330 : cluster [DBG] pgmap v245: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:06.826 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:06 smithi100 bash[9834]: cephadm 2021-01-28T03:57:04.475119+0000 mgr.y (mgr.14138) 325 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='a'), HostPlacementSpec(hostname='smithi162', network='', name='b')] + new hosts [] 2021-01-28T03:57:06.826 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:06 smithi100 bash[9834]: cephadm 2021-01-28T03:57:04.475595+0000 mgr.y (mgr.14138) 326 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='a')] + new hosts [] 2021-01-28T03:57:06.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:06 smithi100 bash[9834]: cephadm 2021-01-28T03:57:04.476089+0000 mgr.y (mgr.14138) 327 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi162', network='', name='a')] 2021-01-28T03:57:06.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:06 smithi100 bash[9834]: audit 2021-01-28T03:57:04.599901+0000 mgr.y (mgr.14138) 328 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-01-28T03:57:06.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:06 smithi100 bash[9834]: cephadm 2021-01-28T03:57:04.610132+0000 mgr.y (mgr.14138) 329 : cephadm [INF] Deploying daemon grafana.a on smithi162 2021-01-28T03:57:06.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:06 smithi100 bash[9834]: cluster 2021-01-28T03:57:05.391736+0000 mgr.y (mgr.14138) 330 : cluster [DBG] pgmap v245: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:06.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:06 smithi100 bash[13549]: cephadm 2021-01-28T03:57:04.475119+0000 mgr.y (mgr.14138) 325 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='a'), HostPlacementSpec(hostname='smithi162', network='', name='b')] + new hosts [] 2021-01-28T03:57:06.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:06 smithi100 bash[13549]: cephadm 2021-01-28T03:57:04.475595+0000 mgr.y (mgr.14138) 326 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='a')] + new hosts [] 2021-01-28T03:57:06.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:06 smithi100 bash[13549]: cephadm 2021-01-28T03:57:04.476089+0000 mgr.y (mgr.14138) 327 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi162', network='', name='a')] 2021-01-28T03:57:06.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:06 smithi100 bash[13549]: audit 2021-01-28T03:57:04.599901+0000 mgr.y (mgr.14138) 328 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-01-28T03:57:06.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:06 smithi100 bash[13549]: cephadm 2021-01-28T03:57:04.610132+0000 mgr.y (mgr.14138) 329 : cephadm [INF] Deploying daemon grafana.a on smithi162 2021-01-28T03:57:06.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:06 smithi100 bash[13549]: cluster 2021-01-28T03:57:05.391736+0000 mgr.y (mgr.14138) 330 : cluster [DBG] pgmap v245: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:07.401 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-28T03:51:27.917203+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2021-01-28T03:55:54.463101+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'iscsi', 'create_time': '2021-01-28T03:56:12.308562+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 3, 'pg_placement_num': 3, 'pg_placement_num_target': 3, 'pg_num_target': 3, 'pg_num_pending': 3, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'zone.rgw.log', 'create_time': '2021-01-28T03:56:13.689563+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'zone.rgw.control', 'create_time': '2021-01-28T03:56:15.185590+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'zone.rgw.meta', 'create_time': '2021-01-28T03:56:18.285095+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 8}, 'application_metadata': {'rgw': {}}}] 2021-01-28T03:57:07.402 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph osd pool get device_health_metrics pg_num 2021-01-28T03:57:07.554 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c217df96-611b-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T03:57:07.826 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:07 smithi100 bash[9834]: audit 2021-01-28T03:57:06.650934+0000 mon.a (mon.0) 624 : audit [DBG] from='client.? 172.21.15.100:0/3465734182' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-28T03:57:07.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:07 smithi100 bash[9834]: cluster 2021-01-28T03:57:07.392690+0000 mgr.y (mgr.14138) 331 : cluster [DBG] pgmap v246: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:07.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:07 smithi100 bash[13549]: audit 2021-01-28T03:57:06.650934+0000 mon.a (mon.0) 624 : audit [DBG] from='client.? 172.21.15.100:0/3465734182' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-28T03:57:07.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:07 smithi100 bash[13549]: cluster 2021-01-28T03:57:07.392690+0000 mgr.y (mgr.14138) 331 : cluster [DBG] pgmap v246: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:08.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:07 smithi162 bash[9856]: audit 2021-01-28T03:57:06.650934+0000 mon.a (mon.0) 624 : audit [DBG] from='client.? 172.21.15.100:0/3465734182' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-28T03:57:08.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:07 smithi162 bash[9856]: cluster 2021-01-28T03:57:07.392690+0000 mgr.y (mgr.14138) 331 : cluster [DBG] pgmap v246: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:09.826 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:57:09 smithi100 bash[10061]: debug 2021-01-28T03:57:09.514+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T03:57:10.011 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 03:57:09 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T03:57:10.622 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.618+0000 7f566359e700 1 -- 172.21.15.100:0/3377728135 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f56640f72b0 msgr2=0x7f56640f7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:10.622 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.618+0000 7f566359e700 1 --2- 172.21.15.100:0/3377728135 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f56640f72b0 0x7f56640f7730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f565c004e00 tx=0x7f565c009b30).stop 2021-01-28T03:57:10.623 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.618+0000 7f566359e700 1 -- 172.21.15.100:0/3377728135 shutdown_connections 2021-01-28T03:57:10.623 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.618+0000 7f566359e700 1 --2- 172.21.15.100:0/3377728135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56640f3b70 0x7f56640f3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:10.623 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.618+0000 7f566359e700 1 --2- 172.21.15.100:0/3377728135 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f56640f72b0 0x7f56640f7730 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:10.623 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.618+0000 7f566359e700 1 --2- 172.21.15.100:0/3377728135 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56640f4510 0x7f56640f6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:10.623 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.618+0000 7f566359e700 1 -- 172.21.15.100:0/3377728135 >> 172.21.15.100:0/3377728135 conn(0x7f56640ef730 msgr2=0x7f56640f1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:57:10.624 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.618+0000 7f566359e700 1 -- 172.21.15.100:0/3377728135 shutdown_connections 2021-01-28T03:57:10.624 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.618+0000 7f566359e700 1 -- 172.21.15.100:0/3377728135 wait complete. 2021-01-28T03:57:10.625 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.622+0000 7f566359e700 1 Processor -- start 2021-01-28T03:57:10.626 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.622+0000 7f566359e700 1 -- start start 2021-01-28T03:57:10.626 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.622+0000 7f566359e700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f56640f3b70 0x7f56641078b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:10.626 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.622+0000 7f566359e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56640f4510 0x7f5664107da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:10.626 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.622+0000 7f566359e700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56640f72b0 0x7f5664108c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:10.626 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.622+0000 7f566359e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56641091c0 con 0x7f56640f4510 2021-01-28T03:57:10.627 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.622+0000 7f566359e700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5664109330 con 0x7f56640f72b0 2021-01-28T03:57:10.627 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.622+0000 7f566359e700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56641094f0 con 0x7f56640f3b70 2021-01-28T03:57:10.627 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.622+0000 7f5661d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56640f4510 0x7f5664107da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:10.627 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.622+0000 7f566259c700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f56640f3b70 0x7f56641078b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:10.628 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.622+0000 7f566259c700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f56640f3b70 0x7f56641078b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:40770/0 (socket says 172.21.15.100:40770) 2021-01-28T03:57:10.628 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.622+0000 7f566259c700 1 -- 172.21.15.100:0/757780323 learned_addr learned my addr 172.21.15.100:0/757780323 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:57:10.628 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.622+0000 7f5661d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56640f4510 0x7f5664107da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59790/0 (socket says 172.21.15.100:59790) 2021-01-28T03:57:10.628 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.622+0000 7f5662d9d700 1 --2- 172.21.15.100:0/757780323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56640f72b0 0x7f5664108c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:10.628 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.622+0000 7f566259c700 1 -- 172.21.15.100:0/757780323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56640f72b0 msgr2=0x7f5664108c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:10.629 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.622+0000 7f566259c700 1 --2- 172.21.15.100:0/757780323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56640f72b0 0x7f5664108c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:10.629 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.622+0000 7f566259c700 1 -- 172.21.15.100:0/757780323 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56640f4510 msgr2=0x7f5664107da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:10.629 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.622+0000 7f566259c700 1 --2- 172.21.15.100:0/757780323 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56640f4510 0x7f5664107da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:10.629 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.622+0000 7f566259c700 1 -- 172.21.15.100:0/757780323 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56641096b0 con 0x7f56640f3b70 2021-01-28T03:57:10.629 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.622+0000 7f5662d9d700 1 --2- 172.21.15.100:0/757780323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56640f72b0 0x7f5664108c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-28T03:57:10.630 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.622+0000 7f5661d9b700 1 --2- 172.21.15.100:0/757780323 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56640f4510 0x7f5664107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-28T03:57:10.630 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.622+0000 7f566259c700 1 --2- 172.21.15.100:0/757780323 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f56640f3b70 0x7f56641078b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f565400eec0 tx=0x7f565400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:57:10.630 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.622+0000 7f565affd700 1 -- 172.21.15.100:0/757780323 <== mon.1 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5654009790 con 0x7f56640f3b70 2021-01-28T03:57:10.630 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.622+0000 7f566359e700 1 -- 172.21.15.100:0/757780323 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5664109960 con 0x7f56640f3b70 2021-01-28T03:57:10.631 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.622+0000 7f565affd700 1 -- 172.21.15.100:0/757780323 <== mon.1 v2:172.21.15.100:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f565400f040 con 0x7f56640f3b70 2021-01-28T03:57:10.631 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.622+0000 7f565affd700 1 -- 172.21.15.100:0/757780323 <== mon.1 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56540079c0 con 0x7f56640f3b70 2021-01-28T03:57:10.631 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.622+0000 7f566359e700 1 -- 172.21.15.100:0/757780323 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56641100f0 con 0x7f56640f3b70 2021-01-28T03:57:10.631 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.622+0000 7f566359e700 1 -- 172.21.15.100:0/757780323 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56640f3320 con 0x7f56640f3b70 2021-01-28T03:57:10.632 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.626+0000 7f565affd700 1 -- 172.21.15.100:0/757780323 <== mon.1 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f565401b030 con 0x7f56640f3b70 2021-01-28T03:57:10.633 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.626+0000 7f565affd700 1 --2- 172.21.15.100:0/757780323 >> v2:172.21.15.100:6800/928846103 conn(0x7f565005bc70 0x7f565005e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:10.633 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.626+0000 7f565affd700 1 -- 172.21.15.100:0/757780323 <== mon.1 v2:172.21.15.100:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f5654075d50 con 0x7f56640f3b70 2021-01-28T03:57:10.633 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.626+0000 7f5661d9b700 1 --2- 172.21.15.100:0/757780323 >> v2:172.21.15.100:6800/928846103 conn(0x7f565005bc70 0x7f565005e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:10.633 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.626+0000 7f5661d9b700 1 --2- 172.21.15.100:0/757780323 >> v2:172.21.15.100:6800/928846103 conn(0x7f565005bc70 0x7f565005e130 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f564c009fd0 tx=0x7f564c00b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:57:10.633 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.626+0000 7f565affd700 1 -- 172.21.15.100:0/757780323 <== mon.1 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f56540489f0 con 0x7f56640f3b70 2021-01-28T03:57:10.761 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:10 smithi162 bash[9856]: cluster 2021-01-28T03:57:09.394024+0000 mgr.y (mgr.14138) 332 : cluster [DBG] pgmap v247: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:10.798 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.794+0000 7f566359e700 1 -- 172.21.15.100:0/757780323 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f5664100670 con 0x7f56640f3b70 2021-01-28T03:57:10.799 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.798+0000 7f565affd700 1 -- 172.21.15.100:0/757780323 <== mon.1 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v60) v1 ==== 110+0+10 (secure 0 0 0) 0x7f56540190b0 con 0x7f56640f3b70 2021-01-28T03:57:10.799 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2021-01-28T03:57:10.801 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.798+0000 7f566359e700 1 -- 172.21.15.100:0/757780323 >> v2:172.21.15.100:6800/928846103 conn(0x7f565005bc70 msgr2=0x7f565005e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:10.802 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.798+0000 7f566359e700 1 --2- 172.21.15.100:0/757780323 >> v2:172.21.15.100:6800/928846103 conn(0x7f565005bc70 0x7f565005e130 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f564c009fd0 tx=0x7f564c00b040).stop 2021-01-28T03:57:10.802 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.798+0000 7f566359e700 1 -- 172.21.15.100:0/757780323 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f56640f3b70 msgr2=0x7f56641078b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:10.802 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.798+0000 7f566359e700 1 --2- 172.21.15.100:0/757780323 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f56640f3b70 0x7f56641078b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f565400eec0 tx=0x7f565400b040).stop 2021-01-28T03:57:10.803 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.798+0000 7f566359e700 1 -- 172.21.15.100:0/757780323 shutdown_connections 2021-01-28T03:57:10.803 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.798+0000 7f566359e700 1 --2- 172.21.15.100:0/757780323 >> v2:172.21.15.100:6800/928846103 conn(0x7f565005bc70 0x7f565005e130 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:10.803 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.798+0000 7f566359e700 1 --2- 172.21.15.100:0/757780323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56640f72b0 0x7f5664108c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:10.803 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.798+0000 7f566359e700 1 --2- 172.21.15.100:0/757780323 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f56640f3b70 0x7f56641078b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:10.804 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.798+0000 7f566359e700 1 --2- 172.21.15.100:0/757780323 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56640f4510 0x7f5664107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:10.804 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.798+0000 7f566359e700 1 -- 172.21.15.100:0/757780323 >> 172.21.15.100:0/757780323 conn(0x7f56640ef730 msgr2=0x7f56640f14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:57:10.804 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.798+0000 7f566359e700 1 -- 172.21.15.100:0/757780323 shutdown_connections 2021-01-28T03:57:10.804 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:10.798+0000 7f566359e700 1 -- 172.21.15.100:0/757780323 wait complete. 2021-01-28T03:57:10.826 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:10 smithi100 bash[9834]: cluster 2021-01-28T03:57:09.394024+0000 mgr.y (mgr.14138) 332 : cluster [DBG] pgmap v247: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:10.826 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:10 smithi100 bash[13549]: cluster 2021-01-28T03:57:09.394024+0000 mgr.y (mgr.14138) 332 : cluster [DBG] pgmap v247: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:11.572 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph osd pool get .rgw.root pg_num 2021-01-28T03:57:11.727 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c217df96-611b-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T03:57:11.761 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:11 smithi162 bash[9856]: audit 2021-01-28T03:57:09.515802+0000 mgr.y (mgr.14138) 333 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:57:11.761 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:11 smithi162 bash[9856]: audit 2021-01-28T03:57:10.799600+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.15.100:0/757780323' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-01-28T03:57:11.777 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:11 smithi100 bash[13549]: audit 2021-01-28T03:57:09.515802+0000 mgr.y (mgr.14138) 333 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:57:11.777 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:11 smithi100 bash[13549]: audit 2021-01-28T03:57:10.799600+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.15.100:0/757780323' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-01-28T03:57:11.778 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:11 smithi100 bash[9834]: audit 2021-01-28T03:57:09.515802+0000 mgr.y (mgr.14138) 333 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:57:11.778 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:11 smithi100 bash[9834]: audit 2021-01-28T03:57:10.799600+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.15.100:0/757780323' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-01-28T03:57:12.749 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:12 smithi100 bash[9834]: cluster 2021-01-28T03:57:11.394976+0000 mgr.y (mgr.14138) 334 : cluster [DBG] pgmap v248: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:12.749 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:12 smithi100 bash[13549]: cluster 2021-01-28T03:57:11.394976+0000 mgr.y (mgr.14138) 334 : cluster [DBG] pgmap v248: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:12.761 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:12 smithi162 bash[9856]: cluster 2021-01-28T03:57:11.394976+0000 mgr.y (mgr.14138) 334 : cluster [DBG] pgmap v248: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:14.467 INFO:journalctl@ceph.alertmanager.a.smithi100.stdout:Jan 28 03:57:14 smithi100 bash[26728]: level=info ts=2021-01-28T03:57:14.113Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.001201813s 2021-01-28T03:57:14.761 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:14 smithi162 bash[9856]: cluster 2021-01-28T03:57:13.396215+0000 mgr.y (mgr.14138) 335 : cluster [DBG] pgmap v249: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:14.780 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.778+0000 7fa63359e700 1 -- 172.21.15.100:0/605864966 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa63406aa50 msgr2=0x7fa634068f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:14.780 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.778+0000 7fa63359e700 1 --2- 172.21.15.100:0/605864966 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa63406aa50 0x7fa634068f50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fa624009dc0 tx=0x7fa624004d10).stop 2021-01-28T03:57:14.781 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.778+0000 7fa63359e700 1 -- 172.21.15.100:0/605864966 shutdown_connections 2021-01-28T03:57:14.781 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.778+0000 7fa63359e700 1 --2- 172.21.15.100:0/605864966 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6340fd830 0x7fa6340ffc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:14.781 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.778+0000 7fa63359e700 1 --2- 172.21.15.100:0/605864966 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa63406aa50 0x7fa634068f50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:14.781 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.778+0000 7fa63359e700 1 --2- 172.21.15.100:0/605864966 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa634069440 0x7fa6340698c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:14.782 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.778+0000 7fa63359e700 1 -- 172.21.15.100:0/605864966 >> 172.21.15.100:0/605864966 conn(0x7fa6340f10a0 msgr2=0x7fa6340f34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:57:14.782 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.778+0000 7fa63359e700 1 -- 172.21.15.100:0/605864966 shutdown_connections 2021-01-28T03:57:14.782 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.778+0000 7fa63359e700 1 -- 172.21.15.100:0/605864966 wait complete. 2021-01-28T03:57:14.784 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.778+0000 7fa63359e700 1 Processor -- start 2021-01-28T03:57:14.784 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.778+0000 7fa63359e700 1 -- start start 2021-01-28T03:57:14.784 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.778+0000 7fa63359e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa634069440 0x7fa634107b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:14.784 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.778+0000 7fa63359e700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa63406aa50 0x7fa634107ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:14.785 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.778+0000 7fa63359e700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa6340fd830 0x7fa634108ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:14.785 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.778+0000 7fa63359e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa634109410 con 0x7fa634069440 2021-01-28T03:57:14.785 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.778+0000 7fa63359e700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa634109580 con 0x7fa63406aa50 2021-01-28T03:57:14.785 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.778+0000 7fa63359e700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa634109740 con 0x7fa6340fd830 2021-01-28T03:57:14.785 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.778+0000 7fa63259c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa634069440 0x7fa634107b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:14.786 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.778+0000 7fa63259c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa634069440 0x7fa634107b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59802/0 (socket says 172.21.15.100:59802) 2021-01-28T03:57:14.786 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.778+0000 7fa63259c700 1 -- 172.21.15.100:0/135476676 learned_addr learned my addr 172.21.15.100:0/135476676 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:57:14.786 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.778+0000 7fa631d9b700 1 --2- 172.21.15.100:0/135476676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa63406aa50 0x7fa634107ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:14.786 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.782+0000 7fa632d9d700 1 --2- 172.21.15.100:0/135476676 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa6340fd830 0x7fa634108ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:14.786 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.782+0000 7fa63259c700 1 -- 172.21.15.100:0/135476676 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa6340fd830 msgr2=0x7fa634108ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:14.787 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.782+0000 7fa63259c700 1 --2- 172.21.15.100:0/135476676 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa6340fd830 0x7fa634108ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:14.787 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.782+0000 7fa63259c700 1 -- 172.21.15.100:0/135476676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa63406aa50 msgr2=0x7fa634107ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:14.787 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.782+0000 7fa63259c700 1 --2- 172.21.15.100:0/135476676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa63406aa50 0x7fa634107ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:14.787 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.782+0000 7fa63259c700 1 -- 172.21.15.100:0/135476676 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa634109900 con 0x7fa634069440 2021-01-28T03:57:14.787 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.782+0000 7fa632d9d700 1 --2- 172.21.15.100:0/135476676 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa6340fd830 0x7fa634108ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-28T03:57:14.788 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.782+0000 7fa63259c700 1 --2- 172.21.15.100:0/135476676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa634069440 0x7fa634107b00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fa62400b7c0 tx=0x7fa624004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:57:14.788 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.782+0000 7fa62affd700 1 -- 172.21.15.100:0/135476676 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62400e030 con 0x7fa634069440 2021-01-28T03:57:14.788 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.782+0000 7fa62affd700 1 -- 172.21.15.100:0/135476676 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fa624004500 con 0x7fa634069440 2021-01-28T03:57:14.788 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.782+0000 7fa63359e700 1 -- 172.21.15.100:0/135476676 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa634109b50 con 0x7fa634069440 2021-01-28T03:57:14.789 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.782+0000 7fa62affd700 1 -- 172.21.15.100:0/135476676 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa624018070 con 0x7fa634069440 2021-01-28T03:57:14.789 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.782+0000 7fa63359e700 1 -- 172.21.15.100:0/135476676 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6341102f0 con 0x7fa634069440 2021-01-28T03:57:14.790 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.782+0000 7fa62affd700 1 -- 172.21.15.100:0/135476676 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7fa62401dbd0 con 0x7fa634069440 2021-01-28T03:57:14.790 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.782+0000 7fa63359e700 1 -- 172.21.15.100:0/135476676 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa63405e330 con 0x7fa634069440 2021-01-28T03:57:14.790 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.782+0000 7fa62affd700 1 --2- 172.21.15.100:0/135476676 >> v2:172.21.15.100:6800/928846103 conn(0x7fa62005bc70 0x7fa62005e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:14.791 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.782+0000 7fa62affd700 1 -- 172.21.15.100:0/135476676 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7fa624077ba0 con 0x7fa634069440 2021-01-28T03:57:14.791 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.782+0000 7fa631d9b700 1 --2- 172.21.15.100:0/135476676 >> v2:172.21.15.100:6800/928846103 conn(0x7fa62005bc70 0x7fa62005e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:14.791 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.782+0000 7fa631d9b700 1 --2- 172.21.15.100:0/135476676 >> v2:172.21.15.100:6800/928846103 conn(0x7fa62005bc70 0x7fa62005e130 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fa61c009fd0 tx=0x7fa61c00b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:57:14.792 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.790+0000 7fa62affd700 1 -- 172.21.15.100:0/135476676 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fa63405e330 con 0x7fa634069440 2021-01-28T03:57:14.826 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:14 smithi100 bash[9834]: cluster 2021-01-28T03:57:13.396215+0000 mgr.y (mgr.14138) 335 : cluster [DBG] pgmap v249: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:14.826 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:14 smithi100 bash[13549]: cluster 2021-01-28T03:57:13.396215+0000 mgr.y (mgr.14138) 335 : cluster [DBG] pgmap v249: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:14.956 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.954+0000 7fa63359e700 1 -- 172.21.15.100:0/135476676 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"} v 0) v1 -- 0x7fa63405e330 con 0x7fa634069440 2021-01-28T03:57:14.957 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.954+0000 7fa62affd700 1 -- 172.21.15.100:0/135476676 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]=0 v60) v1 ==== 98+0+11 (secure 0 0 0) 0x7fa63405e330 con 0x7fa634069440 2021-01-28T03:57:14.957 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2021-01-28T03:57:14.958 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.958+0000 7fa63359e700 1 -- 172.21.15.100:0/135476676 >> v2:172.21.15.100:6800/928846103 conn(0x7fa62005bc70 msgr2=0x7fa62005e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:14.959 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.958+0000 7fa63359e700 1 --2- 172.21.15.100:0/135476676 >> v2:172.21.15.100:6800/928846103 conn(0x7fa62005bc70 0x7fa62005e130 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fa61c009fd0 tx=0x7fa61c00b040).stop 2021-01-28T03:57:14.959 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.958+0000 7fa63359e700 1 -- 172.21.15.100:0/135476676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa634069440 msgr2=0x7fa634107b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:14.959 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.958+0000 7fa63359e700 1 --2- 172.21.15.100:0/135476676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa634069440 0x7fa634107b00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fa62400b7c0 tx=0x7fa624004d10).stop 2021-01-28T03:57:14.960 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.958+0000 7fa63359e700 1 -- 172.21.15.100:0/135476676 shutdown_connections 2021-01-28T03:57:14.960 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.958+0000 7fa63359e700 1 --2- 172.21.15.100:0/135476676 >> v2:172.21.15.100:6800/928846103 conn(0x7fa62005bc70 0x7fa62005e130 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:14.960 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.958+0000 7fa63359e700 1 --2- 172.21.15.100:0/135476676 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa6340fd830 0x7fa634108ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:14.961 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.958+0000 7fa63359e700 1 --2- 172.21.15.100:0/135476676 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa634069440 0x7fa634107b00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:14.961 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.958+0000 7fa63359e700 1 --2- 172.21.15.100:0/135476676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa63406aa50 0x7fa634107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:14.961 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.958+0000 7fa63359e700 1 -- 172.21.15.100:0/135476676 >> 172.21.15.100:0/135476676 conn(0x7fa6340f10a0 msgr2=0x7fa6340f1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:57:14.961 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.958+0000 7fa63359e700 1 -- 172.21.15.100:0/135476676 shutdown_connections 2021-01-28T03:57:14.961 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:14.958+0000 7fa63359e700 1 -- 172.21.15.100:0/135476676 wait complete. 2021-01-28T03:57:15.707 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph osd pool get iscsi pg_num 2021-01-28T03:57:15.761 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:15 smithi162 bash[9856]: audit 2021-01-28T03:57:14.957516+0000 mon.a (mon.0) 625 : audit [DBG] from='client.? 172.21.15.100:0/135476676' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]: dispatch 2021-01-28T03:57:15.826 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:15 smithi100 bash[13549]: audit 2021-01-28T03:57:14.957516+0000 mon.a (mon.0) 625 : audit [DBG] from='client.? 172.21.15.100:0/135476676' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]: dispatch 2021-01-28T03:57:15.826 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:15 smithi100 bash[9834]: audit 2021-01-28T03:57:14.957516+0000 mon.a (mon.0) 625 : audit [DBG] from='client.? 172.21.15.100:0/135476676' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]: dispatch 2021-01-28T03:57:15.859 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c217df96-611b-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T03:57:16.761 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:16 smithi162 bash[9856]: cluster 2021-01-28T03:57:15.397363+0000 mgr.y (mgr.14138) 336 : cluster [DBG] pgmap v250: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:16.826 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:16 smithi100 bash[9834]: cluster 2021-01-28T03:57:15.397363+0000 mgr.y (mgr.14138) 336 : cluster [DBG] pgmap v250: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:16.826 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:16 smithi100 bash[13549]: cluster 2021-01-28T03:57:15.397363+0000 mgr.y (mgr.14138) 336 : cluster [DBG] pgmap v250: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:18.011 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:17 smithi162 bash[9856]: cluster 2021-01-28T03:57:17.398312+0000 mgr.y (mgr.14138) 337 : cluster [DBG] pgmap v251: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:18.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:17 smithi100 bash[9834]: cluster 2021-01-28T03:57:17.398312+0000 mgr.y (mgr.14138) 337 : cluster [DBG] pgmap v251: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:18.077 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:17 smithi100 bash[13549]: cluster 2021-01-28T03:57:17.398312+0000 mgr.y (mgr.14138) 337 : cluster [DBG] pgmap v251: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:19.019 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.014+0000 7f3cc759e700 1 -- 172.21.15.100:0/3306565539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cc80f6b70 msgr2=0x7f3cc80f6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:19.019 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.014+0000 7f3cc759e700 1 --2- 172.21.15.100:0/3306565539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cc80f6b70 0x7f3cc80f6fd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f3cb0004e00 tx=0x7f3cb0009b30).stop 2021-01-28T03:57:19.019 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.014+0000 7f3cc759e700 1 -- 172.21.15.100:0/3306565539 shutdown_connections 2021-01-28T03:57:19.020 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.014+0000 7f3cc759e700 1 --2- 172.21.15.100:0/3306565539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cc80f58d0 0x7f3cc80f5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:19.020 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.014+0000 7f3cc759e700 1 --2- 172.21.15.100:0/3306565539 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3cc80f74c0 0x7f3cc80fddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:19.020 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.014+0000 7f3cc759e700 1 --2- 172.21.15.100:0/3306565539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cc80f6b70 0x7f3cc80f6fd0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:19.020 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.014+0000 7f3cc759e700 1 -- 172.21.15.100:0/3306565539 >> 172.21.15.100:0/3306565539 conn(0x7f3cc80f10d0 msgr2=0x7f3cc80f34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:57:19.021 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.018+0000 7f3cc759e700 1 -- 172.21.15.100:0/3306565539 shutdown_connections 2021-01-28T03:57:19.021 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.018+0000 7f3cc759e700 1 -- 172.21.15.100:0/3306565539 wait complete. 2021-01-28T03:57:19.022 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.018+0000 7f3cc759e700 1 Processor -- start 2021-01-28T03:57:19.022 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.018+0000 7f3cc759e700 1 -- start start 2021-01-28T03:57:19.023 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.018+0000 7f3cc759e700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cc80f58d0 0x7f3cc806aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:19.023 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.018+0000 7f3cc759e700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3cc80f6b70 0x7f3cc8068f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:19.023 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.018+0000 7f3cc759e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cc80f74c0 0x7f3cc8069560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:19.023 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.018+0000 7f3cc759e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc8069c50 con 0x7f3cc80f74c0 2021-01-28T03:57:19.024 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.018+0000 7f3cc759e700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc8069dc0 con 0x7f3cc80f58d0 2021-01-28T03:57:19.024 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.018+0000 7f3cc759e700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc810f9e0 con 0x7f3cc80f6b70 2021-01-28T03:57:19.024 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.018+0000 7f3cc5d9b700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3cc80f6b70 0x7f3cc8068f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:19.024 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.018+0000 7f3cc6d9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cc80f74c0 0x7f3cc8069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:19.024 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.018+0000 7f3cc5d9b700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3cc80f6b70 0x7f3cc8068f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:40800/0 (socket says 172.21.15.100:40800) 2021-01-28T03:57:19.025 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.018+0000 7f3cc5d9b700 1 -- 172.21.15.100:0/404312630 learned_addr learned my addr 172.21.15.100:0/404312630 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:57:19.025 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.018+0000 7f3cc659c700 1 --2- 172.21.15.100:0/404312630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cc80f58d0 0x7f3cc806aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:19.025 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.018+0000 7f3cc5d9b700 1 -- 172.21.15.100:0/404312630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cc80f58d0 msgr2=0x7f3cc806aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:19.025 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.018+0000 7f3cc5d9b700 1 --2- 172.21.15.100:0/404312630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cc80f58d0 0x7f3cc806aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:19.025 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.018+0000 7f3cc5d9b700 1 -- 172.21.15.100:0/404312630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cc80f74c0 msgr2=0x7f3cc8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:19.026 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.018+0000 7f3cc5d9b700 1 --2- 172.21.15.100:0/404312630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cc80f74c0 0x7f3cc8069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:19.026 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.018+0000 7f3cc5d9b700 1 -- 172.21.15.100:0/404312630 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc810fba0 con 0x7f3cc80f6b70 2021-01-28T03:57:19.026 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.018+0000 7f3cc5d9b700 1 --2- 172.21.15.100:0/404312630 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3cc80f6b70 0x7f3cc8068f10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f3cb0009c20 tx=0x7f3cb0009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:57:19.026 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.018+0000 7f3cbeffd700 1 -- 172.21.15.100:0/404312630 <== mon.1 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb000e030 con 0x7f3cc80f6b70 2021-01-28T03:57:19.027 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.018+0000 7f3cbeffd700 1 -- 172.21.15.100:0/404312630 <== mon.1 v2:172.21.15.100:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f3cb0004160 con 0x7f3cc80f6b70 2021-01-28T03:57:19.027 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.018+0000 7f3cc759e700 1 -- 172.21.15.100:0/404312630 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cc810fdf0 con 0x7f3cc80f6b70 2021-01-28T03:57:19.027 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.018+0000 7f3cbeffd700 1 -- 172.21.15.100:0/404312630 <== mon.1 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0018070 con 0x7f3cc80f6b70 2021-01-28T03:57:19.027 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.018+0000 7f3cc759e700 1 -- 172.21.15.100:0/404312630 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cc81101a0 con 0x7f3cc80f6b70 2021-01-28T03:57:19.028 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.022+0000 7f3cc759e700 1 -- 172.21.15.100:0/404312630 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cc80f4cc0 con 0x7f3cc80f6b70 2021-01-28T03:57:19.028 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.022+0000 7f3cbeffd700 1 -- 172.21.15.100:0/404312630 <== mon.1 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f3cb001d420 con 0x7f3cc80f6b70 2021-01-28T03:57:19.029 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.022+0000 7f3cbeffd700 1 --2- 172.21.15.100:0/404312630 >> v2:172.21.15.100:6800/928846103 conn(0x7f3cb405bc70 0x7f3cb405e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:19.029 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.022+0000 7f3cbeffd700 1 -- 172.21.15.100:0/404312630 <== mon.1 v2:172.21.15.100:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f3cb00775e0 con 0x7f3cc80f6b70 2021-01-28T03:57:19.029 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.022+0000 7f3cc659c700 1 --2- 172.21.15.100:0/404312630 >> v2:172.21.15.100:6800/928846103 conn(0x7f3cb405bc70 0x7f3cb405e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:19.029 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.022+0000 7f3cc659c700 1 --2- 172.21.15.100:0/404312630 >> v2:172.21.15.100:6800/928846103 conn(0x7f3cb405bc70 0x7f3cb405e130 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f3cc806a820 tx=0x7f3cb8009040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:57:19.032 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.030+0000 7f3cbeffd700 1 -- 172.21.15.100:0/404312630 <== mon.1 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f3cb004a250 con 0x7f3cc80f6b70 2021-01-28T03:57:19.203 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.202+0000 7f3cc759e700 1 -- 172.21.15.100:0/404312630 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"} v 0) v1 -- 0x7f3cc8044bc0 con 0x7f3cc80f6b70 2021-01-28T03:57:19.204 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.202+0000 7f3cbeffd700 1 -- 172.21.15.100:0/404312630 <== mon.1 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]=0 v60) v1 ==== 94+0+10 (secure 0 0 0) 0x7f3cb004d870 con 0x7f3cc80f6b70 2021-01-28T03:57:19.204 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 3 2021-01-28T03:57:19.206 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.202+0000 7f3cc759e700 1 -- 172.21.15.100:0/404312630 >> v2:172.21.15.100:6800/928846103 conn(0x7f3cb405bc70 msgr2=0x7f3cb405e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:19.206 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.202+0000 7f3cc759e700 1 --2- 172.21.15.100:0/404312630 >> v2:172.21.15.100:6800/928846103 conn(0x7f3cb405bc70 0x7f3cb405e130 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f3cc806a820 tx=0x7f3cb8009040).stop 2021-01-28T03:57:19.206 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.202+0000 7f3cc759e700 1 -- 172.21.15.100:0/404312630 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3cc80f6b70 msgr2=0x7f3cc8068f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:19.206 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.202+0000 7f3cc759e700 1 --2- 172.21.15.100:0/404312630 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3cc80f6b70 0x7f3cc8068f10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f3cb0009c20 tx=0x7f3cb0009b30).stop 2021-01-28T03:57:19.207 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.202+0000 7f3cc759e700 1 -- 172.21.15.100:0/404312630 shutdown_connections 2021-01-28T03:57:19.207 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.202+0000 7f3cc759e700 1 --2- 172.21.15.100:0/404312630 >> v2:172.21.15.100:6800/928846103 conn(0x7f3cb405bc70 0x7f3cb405e130 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:19.207 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.202+0000 7f3cc759e700 1 --2- 172.21.15.100:0/404312630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cc80f58d0 0x7f3cc806aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:19.207 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.202+0000 7f3cc759e700 1 --2- 172.21.15.100:0/404312630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cc80f74c0 0x7f3cc8069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:19.207 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.202+0000 7f3cc759e700 1 --2- 172.21.15.100:0/404312630 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3cc80f6b70 0x7f3cc8068f10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:19.208 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.202+0000 7f3cc759e700 1 -- 172.21.15.100:0/404312630 >> 172.21.15.100:0/404312630 conn(0x7f3cc80f10d0 msgr2=0x7f3cc80f9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:57:19.208 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.202+0000 7f3cc759e700 1 -- 172.21.15.100:0/404312630 shutdown_connections 2021-01-28T03:57:19.208 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:19.202+0000 7f3cc759e700 1 -- 172.21.15.100:0/404312630 wait complete. 2021-01-28T03:57:19.511 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:19 smithi162 bash[9856]: audit 2021-01-28T03:57:19.204061+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.100:0/404312630' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]: dispatch 2021-01-28T03:57:19.524 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:19 smithi100 bash[9834]: audit 2021-01-28T03:57:19.204061+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.100:0/404312630' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]: dispatch 2021-01-28T03:57:19.524 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:19 smithi100 bash[13549]: audit 2021-01-28T03:57:19.204061+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.100:0/404312630' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]: dispatch 2021-01-28T03:57:19.826 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:57:19 smithi100 bash[10061]: debug 2021-01-28T03:57:19.522+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T03:57:20.007 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph osd pool get zone.rgw.log pg_num 2021-01-28T03:57:20.012 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 03:57:19 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T03:57:20.187 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c217df96-611b-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T03:57:20.267 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:20 smithi100 bash[13549]: cluster 2021-01-28T03:57:19.399753+0000 mgr.y (mgr.14138) 338 : cluster [DBG] pgmap v252: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:20.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:20 smithi100 bash[9834]: cluster 2021-01-28T03:57:19.399753+0000 mgr.y (mgr.14138) 338 : cluster [DBG] pgmap v252: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:20.722 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:20 smithi162 bash[9856]: cluster 2021-01-28T03:57:19.399753+0000 mgr.y (mgr.14138) 338 : cluster [DBG] pgmap v252: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:21.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:21 smithi162 bash[9856]: audit 2021-01-28T03:57:19.524021+0000 mgr.y (mgr.14138) 339 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:57:21.567 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:21 smithi100 bash[9834]: audit 2021-01-28T03:57:19.524021+0000 mgr.y (mgr.14138) 339 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:57:21.567 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:21 smithi100 bash[13549]: audit 2021-01-28T03:57:19.524021+0000 mgr.y (mgr.14138) 339 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:57:22.556 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:22 smithi162 bash[9856]: cluster 2021-01-28T03:57:21.400760+0000 mgr.y (mgr.14138) 340 : cluster [DBG] pgmap v253: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:22.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:22 smithi100 bash[9834]: cluster 2021-01-28T03:57:21.400760+0000 mgr.y (mgr.14138) 340 : cluster [DBG] pgmap v253: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:22.576 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:22 smithi100 bash[13549]: cluster 2021-01-28T03:57:21.400760+0000 mgr.y (mgr.14138) 340 : cluster [DBG] pgmap v253: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:23.312 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.309+0000 7fe4dbfff700 1 -- 172.21.15.100:0/3545453605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4dc0fd810 msgr2=0x7fe4dc1043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:23.313 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.309+0000 7fe4dbfff700 1 --2- 172.21.15.100:0/3545453605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4dc0fd810 0x7fe4dc1043d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fe4d4004e00 tx=0x7fe4d4009b30).stop 2021-01-28T03:57:23.313 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.309+0000 7fe4dbfff700 1 -- 172.21.15.100:0/3545453605 shutdown_connections 2021-01-28T03:57:23.313 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.309+0000 7fe4dbfff700 1 --2- 172.21.15.100:0/3545453605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4dc0fd810 0x7fe4dc1043d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:23.314 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.309+0000 7fe4dbfff700 1 --2- 172.21.15.100:0/3545453605 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe4dc0fbe70 0x7fe4dc0fc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:23.314 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.309+0000 7fe4dbfff700 1 --2- 172.21.15.100:0/3545453605 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4dc0fc7a0 0x7fe4dc0fd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:23.314 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.309+0000 7fe4dbfff700 1 -- 172.21.15.100:0/3545453605 >> 172.21.15.100:0/3545453605 conn(0x7fe4dc06b0e0 msgr2=0x7fe4dc06d500 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:57:23.314 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.309+0000 7fe4dbfff700 1 -- 172.21.15.100:0/3545453605 shutdown_connections 2021-01-28T03:57:23.314 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.309+0000 7fe4dbfff700 1 -- 172.21.15.100:0/3545453605 wait complete. 2021-01-28T03:57:23.316 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.309+0000 7fe4dbfff700 1 Processor -- start 2021-01-28T03:57:23.316 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.309+0000 7fe4dbfff700 1 -- start start 2021-01-28T03:57:23.317 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.309+0000 7fe4dbfff700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4dc0fbe70 0x7fe4dc10bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:23.317 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.309+0000 7fe4dbfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4dc0fd810 0x7fe4dc10c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:23.317 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.309+0000 7fe4dbfff700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe4dc10cfc0 0x7fe4dc10d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:23.317 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.309+0000 7fe4dbfff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc10d970 con 0x7fe4dc0fd810 2021-01-28T03:57:23.318 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.309+0000 7fe4dbfff700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc10dae0 con 0x7fe4dc0fbe70 2021-01-28T03:57:23.318 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.309+0000 7fe4dbfff700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc10dca0 con 0x7fe4dc10cfc0 2021-01-28T03:57:23.318 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.309+0000 7fe4da7fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4dc0fd810 0x7fe4dc10c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:23.318 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.309+0000 7fe4da7fc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4dc0fd810 0x7fe4dc10c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59832/0 (socket says 172.21.15.100:59832) 2021-01-28T03:57:23.318 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.309+0000 7fe4da7fc700 1 -- 172.21.15.100:0/3008146632 learned_addr learned my addr 172.21.15.100:0/3008146632 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:57:23.319 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.309+0000 7fe4db7fe700 1 --2- 172.21.15.100:0/3008146632 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe4dc10cfc0 0x7fe4dc10d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:23.319 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.309+0000 7fe4daffd700 1 --2- 172.21.15.100:0/3008146632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4dc0fbe70 0x7fe4dc10bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:23.319 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.309+0000 7fe4da7fc700 1 -- 172.21.15.100:0/3008146632 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe4dc10cfc0 msgr2=0x7fe4dc10d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:23.319 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.309+0000 7fe4da7fc700 1 --2- 172.21.15.100:0/3008146632 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe4dc10cfc0 0x7fe4dc10d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:23.319 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.309+0000 7fe4da7fc700 1 -- 172.21.15.100:0/3008146632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4dc0fbe70 msgr2=0x7fe4dc10bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:23.320 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.309+0000 7fe4da7fc700 1 --2- 172.21.15.100:0/3008146632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4dc0fbe70 0x7fe4dc10bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:23.320 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.309+0000 7fe4da7fc700 1 -- 172.21.15.100:0/3008146632 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4dc114210 con 0x7fe4dc0fd810 2021-01-28T03:57:23.320 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.309+0000 7fe4da7fc700 1 --2- 172.21.15.100:0/3008146632 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4dc0fd810 0x7fe4dc10c210 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fe4cc00de20 tx=0x7fe4cc004ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:57:23.320 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.313+0000 7fe4d37fe700 1 -- 172.21.15.100:0/3008146632 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc007e30 con 0x7fe4dc0fd810 2021-01-28T03:57:23.320 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.313+0000 7fe4d37fe700 1 -- 172.21.15.100:0/3008146632 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fe4cc00f040 con 0x7fe4dc0fd810 2021-01-28T03:57:23.321 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.313+0000 7fe4dbfff700 1 -- 172.21.15.100:0/3008146632 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4dc1143a0 con 0x7fe4dc0fd810 2021-01-28T03:57:23.321 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.313+0000 7fe4d37fe700 1 -- 172.21.15.100:0/3008146632 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc013bd0 con 0x7fe4dc0fd810 2021-01-28T03:57:23.321 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.313+0000 7fe4dbfff700 1 -- 172.21.15.100:0/3008146632 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4dc114890 con 0x7fe4dc0fd810 2021-01-28T03:57:23.321 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.313+0000 7fe4dbfff700 1 -- 172.21.15.100:0/3008146632 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4dc05d560 con 0x7fe4dc0fd810 2021-01-28T03:57:23.322 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.313+0000 7fe4d37fe700 1 -- 172.21.15.100:0/3008146632 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7fe4cc01a030 con 0x7fe4dc0fd810 2021-01-28T03:57:23.322 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.313+0000 7fe4d37fe700 1 --2- 172.21.15.100:0/3008146632 >> v2:172.21.15.100:6800/928846103 conn(0x7fe4c805bc70 0x7fe4c805e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:23.323 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.313+0000 7fe4d37fe700 1 -- 172.21.15.100:0/3008146632 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7fe4cc075930 con 0x7fe4dc0fd810 2021-01-28T03:57:23.323 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.313+0000 7fe4daffd700 1 --2- 172.21.15.100:0/3008146632 >> v2:172.21.15.100:6800/928846103 conn(0x7fe4c805bc70 0x7fe4c805e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:23.323 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.317+0000 7fe4daffd700 1 --2- 172.21.15.100:0/3008146632 >> v2:172.21.15.100:6800/928846103 conn(0x7fe4c805bc70 0x7fe4c805e130 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fe4dc0fbc40 tx=0x7fe4c400b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:57:23.323 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.317+0000 7fe4d37fe700 1 -- 172.21.15.100:0/3008146632 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fe4dc05d560 con 0x7fe4dc0fd810 2021-01-28T03:57:23.491 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.489+0000 7fe4dbfff700 1 -- 172.21.15.100:0/3008146632 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "zone.rgw.log", "var": "pg_num"} v 0) v1 -- 0x7fe4dc05d560 con 0x7fe4dc0fd810 2021-01-28T03:57:23.492 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.489+0000 7fe4d37fe700 1 -- 172.21.15.100:0/3008146632 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "zone.rgw.log", "var": "pg_num"}]=0 v60) v1 ==== 101+0+11 (secure 0 0 0) 0x7fe4dc05d560 con 0x7fe4dc0fd810 2021-01-28T03:57:23.492 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2021-01-28T03:57:23.493 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.489+0000 7fe4dbfff700 1 -- 172.21.15.100:0/3008146632 >> v2:172.21.15.100:6800/928846103 conn(0x7fe4c805bc70 msgr2=0x7fe4c805e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:23.494 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.489+0000 7fe4dbfff700 1 --2- 172.21.15.100:0/3008146632 >> v2:172.21.15.100:6800/928846103 conn(0x7fe4c805bc70 0x7fe4c805e130 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fe4dc0fbc40 tx=0x7fe4c400b040).stop 2021-01-28T03:57:23.494 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.489+0000 7fe4dbfff700 1 -- 172.21.15.100:0/3008146632 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4dc0fd810 msgr2=0x7fe4dc10c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:23.494 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.489+0000 7fe4dbfff700 1 --2- 172.21.15.100:0/3008146632 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4dc0fd810 0x7fe4dc10c210 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fe4cc00de20 tx=0x7fe4cc004ee0).stop 2021-01-28T03:57:23.494 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.489+0000 7fe4dbfff700 1 -- 172.21.15.100:0/3008146632 shutdown_connections 2021-01-28T03:57:23.495 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.489+0000 7fe4dbfff700 1 --2- 172.21.15.100:0/3008146632 >> v2:172.21.15.100:6800/928846103 conn(0x7fe4c805bc70 0x7fe4c805e130 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:23.495 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.489+0000 7fe4dbfff700 1 --2- 172.21.15.100:0/3008146632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4dc0fbe70 0x7fe4dc10bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:23.495 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.489+0000 7fe4dbfff700 1 --2- 172.21.15.100:0/3008146632 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe4dc10cfc0 0x7fe4dc10d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:23.495 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.489+0000 7fe4dbfff700 1 --2- 172.21.15.100:0/3008146632 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4dc0fd810 0x7fe4dc10c210 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:23.495 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.489+0000 7fe4dbfff700 1 -- 172.21.15.100:0/3008146632 >> 172.21.15.100:0/3008146632 conn(0x7fe4dc06b0e0 msgr2=0x7fe4dc06d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:57:23.496 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.489+0000 7fe4dbfff700 1 -- 172.21.15.100:0/3008146632 shutdown_connections 2021-01-28T03:57:23.496 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:23.489+0000 7fe4dbfff700 1 -- 172.21.15.100:0/3008146632 wait complete. 2021-01-28T03:57:23.901 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:23 smithi162 systemd[1]: Started Ceph grafana.a for c217df96-611b-11eb-8f9e-001a4aab830c. 2021-01-28T03:57:24.235 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph osd pool get zone.rgw.control pg_num 2021-01-28T03:57:24.390 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c217df96-611b-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T03:57:24.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:24 smithi100 bash[9834]: cluster 2021-01-28T03:57:23.401916+0000 mgr.y (mgr.14138) 341 : cluster [DBG] pgmap v254: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:24.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:24 smithi100 bash[9834]: audit 2021-01-28T03:57:23.491767+0000 mon.a (mon.0) 626 : audit [DBG] from='client.? 172.21.15.100:0/3008146632' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.log", "var": "pg_num"}]: dispatch 2021-01-28T03:57:24.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:24 smithi100 bash[9834]: audit 2021-01-28T03:57:23.843270+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:24.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:24 smithi100 bash[9834]: audit 2021-01-28T03:57:23.845383+0000 mon.a (mon.0) 628 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:57:24.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:24 smithi100 bash[9834]: audit 2021-01-28T03:57:23.845940+0000 mon.a (mon.0) 629 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:57:24.577 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:24 smithi100 bash[13549]: cluster 2021-01-28T03:57:23.401916+0000 mgr.y (mgr.14138) 341 : cluster [DBG] pgmap v254: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:24.578 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:24 smithi100 bash[13549]: audit 2021-01-28T03:57:23.491767+0000 mon.a (mon.0) 626 : audit [DBG] from='client.? 172.21.15.100:0/3008146632' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.log", "var": "pg_num"}]: dispatch 2021-01-28T03:57:24.578 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:24 smithi100 bash[13549]: audit 2021-01-28T03:57:23.843270+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:24.578 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:24 smithi100 bash[13549]: audit 2021-01-28T03:57:23.845383+0000 mon.a (mon.0) 628 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:57:24.578 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:24 smithi100 bash[13549]: audit 2021-01-28T03:57:23.845940+0000 mon.a (mon.0) 629 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:57:24.761 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:24 smithi162 bash[9856]: cluster 2021-01-28T03:57:23.401916+0000 mgr.y (mgr.14138) 341 : cluster [DBG] pgmap v254: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:24.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:24 smithi162 bash[9856]: audit 2021-01-28T03:57:23.491767+0000 mon.a (mon.0) 626 : audit [DBG] from='client.? 172.21.15.100:0/3008146632' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.log", "var": "pg_num"}]: dispatch 2021-01-28T03:57:24.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:24 smithi162 bash[9856]: audit 2021-01-28T03:57:23.843270+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:24.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:24 smithi162 bash[9856]: audit 2021-01-28T03:57:23.845383+0000 mon.a (mon.0) 628 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:57:24.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:24 smithi162 bash[9856]: audit 2021-01-28T03:57:23.845940+0000 mon.a (mon.0) 629 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:57:25.123 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:25 smithi162 bash[24692]: t=2021-01-28T03:57:25+0000 lvl=info msg="Starting Grafana" logger=server version=6.7.4 commit=8e44bbc5f5 branch=HEAD compiled=2020-05-26T17:35:38+0000 2021-01-28T03:57:25.124 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:25 smithi162 bash[24692]: t=2021-01-28T03:57:25+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2021-01-28T03:57:25.124 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:25 smithi162 bash[24692]: t=2021-01-28T03:57:25+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2021-01-28T03:57:25.124 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:25 smithi162 bash[24692]: t=2021-01-28T03:57:25+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2021-01-28T03:57:25.124 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:25 smithi162 bash[24692]: t=2021-01-28T03:57:25+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2021-01-28T03:57:25.124 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:25 smithi162 bash[24692]: t=2021-01-28T03:57:25+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2021-01-28T03:57:25.125 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:25 smithi162 bash[24692]: t=2021-01-28T03:57:25+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2021-01-28T03:57:25.125 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:25 smithi162 bash[24692]: t=2021-01-28T03:57:25+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2021-01-28T03:57:25.125 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:25 smithi162 bash[24692]: t=2021-01-28T03:57:25+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2021-01-28T03:57:25.125 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:25 smithi162 bash[24692]: t=2021-01-28T03:57:25+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2021-01-28T03:57:25.126 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:25 smithi162 bash[24692]: t=2021-01-28T03:57:25+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2021-01-28T03:57:25.126 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:25 smithi162 bash[24692]: t=2021-01-28T03:57:25+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2021-01-28T03:57:25.126 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:25 smithi162 bash[24692]: t=2021-01-28T03:57:25+0000 lvl=info msg="App mode production" logger=settings 2021-01-28T03:57:25.126 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:25 smithi162 bash[24692]: t=2021-01-28T03:57:25+0000 lvl=info msg="Initializing SqlStore" logger=server 2021-01-28T03:57:25.126 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:25 smithi162 bash[24692]: t=2021-01-28T03:57:25+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2021-01-28T03:57:25.127 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:25 smithi162 bash[24692]: t=2021-01-28T03:57:25+0000 lvl=info msg="Starting DB migration" logger=migrator 2021-01-28T03:57:25.127 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:25 smithi162 bash[24692]: t=2021-01-28T03:57:25+0000 lvl=info msg="Executing migration" logger=migrator id="create migration_log table" 2021-01-28T03:57:25.127 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:25 smithi162 bash[24692]: t=2021-01-28T03:57:25+0000 lvl=info msg="Executing migration" logger=migrator id="create user table" 2021-01-28T03:57:25.127 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:25 smithi162 bash[24692]: t=2021-01-28T03:57:25+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.login" 2021-01-28T03:57:25.400 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:25 smithi162 bash[24692]: t=2021-01-28T03:57:25+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.email" 2021-01-28T03:57:25.400 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:25 smithi162 bash[24692]: t=2021-01-28T03:57:25+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_login - v1" 2021-01-28T03:57:25.400 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:25 smithi162 bash[24692]: t=2021-01-28T03:57:25+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_email - v1" 2021-01-28T03:57:25.711 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:25 smithi162 bash[24692]: t=2021-01-28T03:57:25+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table user to user_v1 - v1" 2021-01-28T03:57:25.711 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:25 smithi162 bash[24692]: t=2021-01-28T03:57:25+0000 lvl=info msg="Executing migration" logger=migrator id="create user table v2" 2021-01-28T03:57:25.711 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:25 smithi162 bash[24692]: t=2021-01-28T03:57:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_login - v2" 2021-01-28T03:57:25.712 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:25 smithi162 bash[24692]: t=2021-01-28T03:57:25+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_email - v2" 2021-01-28T03:57:25.996 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:25 smithi162 bash[24692]: t=2021-01-28T03:57:25+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2021-01-28T03:57:25.996 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:25 smithi162 bash[24692]: t=2021-01-28T03:57:25+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table user_v1" 2021-01-28T03:57:25.996 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:25 smithi162 bash[24692]: t=2021-01-28T03:57:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add column help_flags1 to user table" 2021-01-28T03:57:25.996 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:25 smithi162 bash[24692]: t=2021-01-28T03:57:25+0000 lvl=info msg="Executing migration" logger=migrator id="Update user table charset" 2021-01-28T03:57:25.997 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:25 smithi162 bash[24692]: t=2021-01-28T03:57:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add last_seen_at column to user" 2021-01-28T03:57:25.997 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:25 smithi162 bash[24692]: t=2021-01-28T03:57:25+0000 lvl=info msg="Executing migration" logger=migrator id="Add missing user data" 2021-01-28T03:57:26.261 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:26 smithi162 bash[24692]: t=2021-01-28T03:57:26+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_disabled column to user" 2021-01-28T03:57:26.262 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:26 smithi162 bash[24692]: t=2021-01-28T03:57:26+0000 lvl=info msg="Executing migration" logger=migrator id="create temp user table v1-7" 2021-01-28T03:57:26.262 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:26 smithi162 bash[24692]: t=2021-01-28T03:57:26+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v1-7" 2021-01-28T03:57:26.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:26 smithi162 bash[9856]: cluster 2021-01-28T03:57:25.402995+0000 mgr.y (mgr.14138) 342 : cluster [DBG] pgmap v255: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:26.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:26 smithi162 bash[9856]: audit 2021-01-28T03:57:25.517861+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:26.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:26 smithi162 bash[9856]: audit 2021-01-28T03:57:25.893195+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:26.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:26 smithi162 bash[9856]: audit 2021-01-28T03:57:26.310680+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:26.517 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:26 smithi162 bash[24692]: t=2021-01-28T03:57:26+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v1-7" 2021-01-28T03:57:26.517 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:26 smithi162 bash[24692]: t=2021-01-28T03:57:26+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v1-7" 2021-01-28T03:57:26.517 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:26 smithi162 bash[24692]: t=2021-01-28T03:57:26+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v1-7" 2021-01-28T03:57:26.517 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:26 smithi162 bash[24692]: t=2021-01-28T03:57:26+0000 lvl=info msg="Executing migration" logger=migrator id="Update temp_user table charset" 2021-01-28T03:57:26.518 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:26 smithi162 bash[24692]: t=2021-01-28T03:57:26+0000 lvl=info msg="Executing migration" logger=migrator id="create star table" 2021-01-28T03:57:26.728 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:26 smithi100 bash[13549]: cluster 2021-01-28T03:57:25.402995+0000 mgr.y (mgr.14138) 342 : cluster [DBG] pgmap v255: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:26.729 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:26 smithi100 bash[13549]: audit 2021-01-28T03:57:25.517861+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:26.729 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:26 smithi100 bash[13549]: audit 2021-01-28T03:57:25.893195+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:26.729 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:26 smithi100 bash[13549]: audit 2021-01-28T03:57:26.310680+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:26.729 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:26 smithi100 bash[9834]: cluster 2021-01-28T03:57:25.402995+0000 mgr.y (mgr.14138) 342 : cluster [DBG] pgmap v255: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:26.730 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:26 smithi100 bash[9834]: audit 2021-01-28T03:57:25.517861+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:26.730 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:26 smithi100 bash[9834]: audit 2021-01-28T03:57:25.893195+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:26.730 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:26 smithi100 bash[9834]: audit 2021-01-28T03:57:26.310680+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:26.801 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:26 smithi162 bash[24692]: t=2021-01-28T03:57:26+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index star.user_id_dashboard_id" 2021-01-28T03:57:26.801 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:26 smithi162 bash[24692]: t=2021-01-28T03:57:26+0000 lvl=info msg="Executing migration" logger=migrator id="create org table v1" 2021-01-28T03:57:26.801 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:26 smithi162 bash[24692]: t=2021-01-28T03:57:26+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_name - v1" 2021-01-28T03:57:27.052 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:26 smithi162 bash[24692]: t=2021-01-28T03:57:26+0000 lvl=info msg="Executing migration" logger=migrator id="create org_user table v1" 2021-01-28T03:57:27.052 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:26 smithi162 bash[24692]: t=2021-01-28T03:57:26+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_org_id - v1" 2021-01-28T03:57:27.052 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:26 smithi162 bash[24692]: t=2021-01-28T03:57:26+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_user_org_id_user_id - v1" 2021-01-28T03:57:27.345 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:27 smithi162 bash[24692]: t=2021-01-28T03:57:27+0000 lvl=info msg="Executing migration" logger=migrator id="Update org table charset" 2021-01-28T03:57:27.345 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:27 smithi162 bash[24692]: t=2021-01-28T03:57:27+0000 lvl=info msg="Executing migration" logger=migrator id="Update org_user table charset" 2021-01-28T03:57:27.345 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:27 smithi162 bash[24692]: t=2021-01-28T03:57:27+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate all Read Only Viewers to Viewers" 2021-01-28T03:57:27.503 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:27 smithi100 bash[9834]: cephadm 2021-01-28T03:57:25.894363+0000 mgr.y (mgr.14138) 343 : cephadm [INF] refreshing smithi162 facts 2021-01-28T03:57:27.621 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:27 smithi162 bash[24692]: t=2021-01-28T03:57:27+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard table" 2021-01-28T03:57:27.622 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:27 smithi162 bash[24692]: t=2021-01-28T03:57:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard.account_id" 2021-01-28T03:57:27.622 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:27 smithi162 bash[24692]: t=2021-01-28T03:57:27+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_account_id_slug" 2021-01-28T03:57:27.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:27 smithi162 bash[9856]: cephadm 2021-01-28T03:57:25.894363+0000 mgr.y (mgr.14138) 343 : cephadm [INF] refreshing smithi162 facts 2021-01-28T03:57:27.622 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:27 smithi162 bash[9856]: cephadm 2021-01-28T03:57:26.313233+0000 mgr.y (mgr.14138) 344 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:57:27.623 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:27 smithi162 bash[9856]: cephadm 2021-01-28T03:57:26.314449+0000 mgr.y (mgr.14138) 345 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T03:57:27.623 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:27 smithi162 bash[9856]: cephadm 2021-01-28T03:57:26.315695+0000 mgr.y (mgr.14138) 346 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='iscsi.a')] + new hosts [] 2021-01-28T03:57:27.623 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:27 smithi162 bash[9856]: cephadm 2021-01-28T03:57:26.316391+0000 mgr.y (mgr.14138) 347 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='a')] + new hosts [] 2021-01-28T03:57:27.623 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:27 smithi162 bash[9856]: cephadm 2021-01-28T03:57:26.317164+0000 mgr.y (mgr.14138) 348 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='a'), HostPlacementSpec(hostname='smithi162', network='', name='b')] + new hosts [] 2021-01-28T03:57:27.624 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:27 smithi162 bash[9856]: cephadm 2021-01-28T03:57:26.317868+0000 mgr.y (mgr.14138) 349 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='a')] + new hosts [] 2021-01-28T03:57:27.624 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:27 smithi162 bash[9856]: cephadm 2021-01-28T03:57:26.318574+0000 mgr.y (mgr.14138) 350 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='a')] + new hosts [] 2021-01-28T03:57:27.624 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:27 smithi162 bash[9856]: cephadm 2021-01-28T03:57:26.320741+0000 mgr.y (mgr.14138) 351 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-01-28T03:57:27.624 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:27 smithi162 bash[9856]: cephadm 2021-01-28T03:57:26.325214+0000 mgr.y (mgr.14138) 352 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi100 2021-01-28T03:57:27.826 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:27 smithi100 bash[9834]: cephadm 2021-01-28T03:57:26.313233+0000 mgr.y (mgr.14138) 344 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:57:27.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:27 smithi100 bash[9834]: cephadm 2021-01-28T03:57:26.314449+0000 mgr.y (mgr.14138) 345 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T03:57:27.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:27 smithi100 bash[9834]: cephadm 2021-01-28T03:57:26.315695+0000 mgr.y (mgr.14138) 346 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='iscsi.a')] + new hosts [] 2021-01-28T03:57:27.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:27 smithi100 bash[9834]: cephadm 2021-01-28T03:57:26.316391+0000 mgr.y (mgr.14138) 347 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='a')] + new hosts [] 2021-01-28T03:57:27.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:27 smithi100 bash[9834]: cephadm 2021-01-28T03:57:26.317164+0000 mgr.y (mgr.14138) 348 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='a'), HostPlacementSpec(hostname='smithi162', network='', name='b')] + new hosts [] 2021-01-28T03:57:27.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:27 smithi100 bash[9834]: cephadm 2021-01-28T03:57:26.317868+0000 mgr.y (mgr.14138) 349 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='a')] + new hosts [] 2021-01-28T03:57:27.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:27 smithi100 bash[9834]: cephadm 2021-01-28T03:57:26.318574+0000 mgr.y (mgr.14138) 350 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='a')] + new hosts [] 2021-01-28T03:57:27.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:27 smithi100 bash[9834]: cephadm 2021-01-28T03:57:26.320741+0000 mgr.y (mgr.14138) 351 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-01-28T03:57:27.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:27 smithi100 bash[9834]: cephadm 2021-01-28T03:57:26.325214+0000 mgr.y (mgr.14138) 352 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi100 2021-01-28T03:57:27.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:27 smithi100 bash[13549]: cephadm 2021-01-28T03:57:25.894363+0000 mgr.y (mgr.14138) 343 : cephadm [INF] refreshing smithi162 facts 2021-01-28T03:57:27.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:27 smithi100 bash[13549]: cephadm 2021-01-28T03:57:26.313233+0000 mgr.y (mgr.14138) 344 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:57:27.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:27 smithi100 bash[13549]: cephadm 2021-01-28T03:57:26.314449+0000 mgr.y (mgr.14138) 345 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T03:57:27.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:27 smithi100 bash[13549]: cephadm 2021-01-28T03:57:26.315695+0000 mgr.y (mgr.14138) 346 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='iscsi.a')] + new hosts [] 2021-01-28T03:57:27.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:27 smithi100 bash[13549]: cephadm 2021-01-28T03:57:26.316391+0000 mgr.y (mgr.14138) 347 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='a')] + new hosts [] 2021-01-28T03:57:27.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:27 smithi100 bash[13549]: cephadm 2021-01-28T03:57:26.317164+0000 mgr.y (mgr.14138) 348 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='a'), HostPlacementSpec(hostname='smithi162', network='', name='b')] + new hosts [] 2021-01-28T03:57:27.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:27 smithi100 bash[13549]: cephadm 2021-01-28T03:57:26.317868+0000 mgr.y (mgr.14138) 349 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='a')] + new hosts [] 2021-01-28T03:57:27.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:27 smithi100 bash[13549]: cephadm 2021-01-28T03:57:26.318574+0000 mgr.y (mgr.14138) 350 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='a')] + new hosts [] 2021-01-28T03:57:27.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:27 smithi100 bash[13549]: cephadm 2021-01-28T03:57:26.320741+0000 mgr.y (mgr.14138) 351 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-01-28T03:57:27.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:27 smithi100 bash[13549]: cephadm 2021-01-28T03:57:26.325214+0000 mgr.y (mgr.14138) 352 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi100 2021-01-28T03:57:27.872 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:27 smithi162 bash[24692]: t=2021-01-28T03:57:27+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_tag table" 2021-01-28T03:57:27.873 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:27 smithi162 bash[24692]: t=2021-01-28T03:57:27+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_tag.dasboard_id_term" 2021-01-28T03:57:27.873 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:27 smithi162 bash[24692]: t=2021-01-28T03:57:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2021-01-28T03:57:28.124 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:27 smithi162 bash[24692]: t=2021-01-28T03:57:27+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard to dashboard_v1 - v1" 2021-01-28T03:57:28.124 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:27 smithi162 bash[24692]: t=2021-01-28T03:57:27+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard v2" 2021-01-28T03:57:28.124 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:27 smithi162 bash[24692]: t=2021-01-28T03:57:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_org_id - v2" 2021-01-28T03:57:28.125 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:28 smithi162 bash[24692]: t=2021-01-28T03:57:28+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_org_id_slug - v2" 2021-01-28T03:57:28.163 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.161+0000 7fc3096bf700 1 -- 172.21.15.100:0/3995201147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3040fb4a0 msgr2=0x7fc3040fd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:28.163 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.161+0000 7fc3096bf700 1 --2- 172.21.15.100:0/3995201147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3040fb4a0 0x7fc3040fd930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fc2fc009dc0 tx=0x7fc2fc004d10).stop 2021-01-28T03:57:28.164 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.161+0000 7fc3096bf700 1 -- 172.21.15.100:0/3995201147 shutdown_connections 2021-01-28T03:57:28.164 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.161+0000 7fc3096bf700 1 --2- 172.21.15.100:0/3995201147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc30405f610 0x7fc3040f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:28.164 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.161+0000 7fc3096bf700 1 --2- 172.21.15.100:0/3995201147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3040fb4a0 0x7fc3040fd930 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:28.164 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.161+0000 7fc3096bf700 1 --2- 172.21.15.100:0/3995201147 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc3040f8a30 0x7fc3040fae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-28T03:57:28.165 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.161+0000 7fc3096bf700 1 -- 172.21.15.100:0/3995201147 >> 172.21.15.100:0/3995201147 conn(0x7fc3040effa0 msgr2=0x7fc3040f23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:57:28.165 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.161+0000 7fc3096bf700 1 -- 172.21.15.100:0/3995201147 shutdown_connections 2021-01-28T03:57:28.165 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.161+0000 7fc3096bf700 1 -- 172.21.15.100:0/3995201147 wait complete. 2021-01-28T03:57:28.166 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.161+0000 7fc3096bf700 1 Processor -- start 2021-01-28T03:57:28.167 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.161+0000 7fc3096bf700 1 -- start start 2021-01-28T03:57:28.167 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.161+0000 7fc3096bf700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc30405f610 0x7fc3040f5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:28.167 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.161+0000 7fc3096bf700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3040f8a30 0x7fc3040f4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:28.167 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.161+0000 7fc3096bf700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc3040fb4a0 0x7fc3040f4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:28.167 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.161+0000 7fc3096bf700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3040f5210 con 0x7fc3040f8a30 2021-01-28T03:57:28.168 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.161+0000 7fc3096bf700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30410f780 con 0x7fc30405f610 2021-01-28T03:57:28.168 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.161+0000 7fc3096bf700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30410f8c0 con 0x7fc3040fb4a0 2021-01-28T03:57:28.168 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.161+0000 7fc308ebe700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc3040fb4a0 0x7fc3040f4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:28.168 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.161+0000 7fc2fb7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3040f8a30 0x7fc3040f4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:28.169 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.161+0000 7fc308ebe700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc3040fb4a0 0x7fc3040f4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:40828/0 (socket says 172.21.15.100:40828) 2021-01-28T03:57:28.169 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.161+0000 7fc308ebe700 1 -- 172.21.15.100:0/4011625584 learned_addr learned my addr 172.21.15.100:0/4011625584 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:57:28.169 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.161+0000 7fc303fff700 1 --2- 172.21.15.100:0/4011625584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc30405f610 0x7fc3040f5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:28.169 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.161+0000 7fc308ebe700 1 -- 172.21.15.100:0/4011625584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc30405f610 msgr2=0x7fc3040f5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:28.170 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.161+0000 7fc308ebe700 1 --2- 172.21.15.100:0/4011625584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc30405f610 0x7fc3040f5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:28.170 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.161+0000 7fc308ebe700 1 -- 172.21.15.100:0/4011625584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3040f8a30 msgr2=0x7fc3040f4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:28.170 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.161+0000 7fc308ebe700 1 --2- 172.21.15.100:0/4011625584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3040f8a30 0x7fc3040f4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:28.170 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.161+0000 7fc308ebe700 1 -- 172.21.15.100:0/4011625584 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc30410fa30 con 0x7fc3040fb4a0 2021-01-28T03:57:28.170 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.161+0000 7fc2fb7fe700 1 --2- 172.21.15.100:0/4011625584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3040f8a30 0x7fc3040f4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-28T03:57:28.171 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.161+0000 7fc308ebe700 1 --2- 172.21.15.100:0/4011625584 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc3040fb4a0 0x7fc3040f4a90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fc2fc00b740 tx=0x7fc2fc004d10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:57:28.171 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.161+0000 7fc3017fa700 1 -- 172.21.15.100:0/4011625584 <== mon.1 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc00e030 con 0x7fc3040fb4a0 2021-01-28T03:57:28.171 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.161+0000 7fc3017fa700 1 -- 172.21.15.100:0/4011625584 <== mon.1 v2:172.21.15.100:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fc2fc004e90 con 0x7fc3040fb4a0 2021-01-28T03:57:28.171 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.161+0000 7fc3096bf700 1 -- 172.21.15.100:0/4011625584 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc30410fc80 con 0x7fc3040fb4a0 2021-01-28T03:57:28.172 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.161+0000 7fc3017fa700 1 -- 172.21.15.100:0/4011625584 <== mon.1 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2fc018070 con 0x7fc3040fb4a0 2021-01-28T03:57:28.172 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.161+0000 7fc3096bf700 1 -- 172.21.15.100:0/4011625584 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc304110030 con 0x7fc3040fb4a0 2021-01-28T03:57:28.173 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.165+0000 7fc3096bf700 1 -- 172.21.15.100:0/4011625584 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3040f3b90 con 0x7fc3040fb4a0 2021-01-28T03:57:28.173 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.165+0000 7fc3017fa700 1 -- 172.21.15.100:0/4011625584 <== mon.1 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7fc2fc024060 con 0x7fc3040fb4a0 2021-01-28T03:57:28.173 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.165+0000 7fc3017fa700 1 --2- 172.21.15.100:0/4011625584 >> v2:172.21.15.100:6800/928846103 conn(0x7fc2f005bc70 0x7fc2f005e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:28.173 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.165+0000 7fc3017fa700 1 -- 172.21.15.100:0/4011625584 <== mon.1 v2:172.21.15.100:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7fc2fc077790 con 0x7fc3040fb4a0 2021-01-28T03:57:28.174 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.165+0000 7fc303fff700 1 --2- 172.21.15.100:0/4011625584 >> v2:172.21.15.100:6800/928846103 conn(0x7fc2f005bc70 0x7fc2f005e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:28.174 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.165+0000 7fc303fff700 1 --2- 172.21.15.100:0/4011625584 >> v2:172.21.15.100:6800/928846103 conn(0x7fc2f005bc70 0x7fc2f005e130 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fc3040f5d50 tx=0x7fc2f400b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:57:28.174 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.169+0000 7fc3017fa700 1 -- 172.21.15.100:0/4011625584 <== mon.1 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fc2fc04a400 con 0x7fc3040fb4a0 2021-01-28T03:57:28.353 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.349+0000 7fc3096bf700 1 -- 172.21.15.100:0/4011625584 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "zone.rgw.control", "var": "pg_num"} v 0) v1 -- 0x7fc304100650 con 0x7fc3040fb4a0 2021-01-28T03:57:28.354 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.349+0000 7fc3017fa700 1 -- 172.21.15.100:0/4011625584 <== mon.1 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "zone.rgw.control", "var": "pg_num"}]=0 v60) v1 ==== 105+0+11 (secure 0 0 0) 0x7fc2fc04da20 con 0x7fc3040fb4a0 2021-01-28T03:57:28.354 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2021-01-28T03:57:28.355 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.353+0000 7fc3096bf700 1 -- 172.21.15.100:0/4011625584 >> v2:172.21.15.100:6800/928846103 conn(0x7fc2f005bc70 msgr2=0x7fc2f005e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:28.356 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.353+0000 7fc3096bf700 1 --2- 172.21.15.100:0/4011625584 >> v2:172.21.15.100:6800/928846103 conn(0x7fc2f005bc70 0x7fc2f005e130 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fc3040f5d50 tx=0x7fc2f400b040).stop 2021-01-28T03:57:28.356 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.353+0000 7fc3096bf700 1 -- 172.21.15.100:0/4011625584 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc3040fb4a0 msgr2=0x7fc3040f4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:28.356 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.353+0000 7fc3096bf700 1 --2- 172.21.15.100:0/4011625584 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc3040fb4a0 0x7fc3040f4a90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fc2fc00b740 tx=0x7fc2fc004d10).stop 2021-01-28T03:57:28.357 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.353+0000 7fc3096bf700 1 -- 172.21.15.100:0/4011625584 shutdown_connections 2021-01-28T03:57:28.357 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.353+0000 7fc3096bf700 1 --2- 172.21.15.100:0/4011625584 >> v2:172.21.15.100:6800/928846103 conn(0x7fc2f005bc70 0x7fc2f005e130 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:28.357 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.353+0000 7fc3096bf700 1 --2- 172.21.15.100:0/4011625584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc30405f610 0x7fc3040f5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:28.357 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.353+0000 7fc3096bf700 1 --2- 172.21.15.100:0/4011625584 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc3040fb4a0 0x7fc3040f4a90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:28.358 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.353+0000 7fc3096bf700 1 --2- 172.21.15.100:0/4011625584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3040f8a30 0x7fc3040f4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:28.358 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.353+0000 7fc3096bf700 1 -- 172.21.15.100:0/4011625584 >> 172.21.15.100:0/4011625584 conn(0x7fc3040effa0 msgr2=0x7fc3040f9670 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:57:28.358 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.353+0000 7fc3096bf700 1 -- 172.21.15.100:0/4011625584 shutdown_connections 2021-01-28T03:57:28.358 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:28.353+0000 7fc3096bf700 1 -- 172.21.15.100:0/4011625584 wait complete. 2021-01-28T03:57:28.375 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:28 smithi162 bash[24692]: t=2021-01-28T03:57:28+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard v1 to v2" 2021-01-28T03:57:28.375 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:28 smithi162 bash[24692]: t=2021-01-28T03:57:28+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_v1" 2021-01-28T03:57:28.376 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:28 smithi162 bash[24692]: t=2021-01-28T03:57:28+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard.data to mediumtext v1" 2021-01-28T03:57:28.635 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:28 smithi162 bash[9856]: cluster 2021-01-28T03:57:27.403957+0000 mgr.y (mgr.14138) 353 : cluster [DBG] pgmap v256: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:28.635 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:28 smithi162 bash[9856]: audit 2021-01-28T03:57:28.354001+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.15.100:0/4011625584' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.control", "var": "pg_num"}]: dispatch 2021-01-28T03:57:28.636 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:28 smithi162 bash[24692]: t=2021-01-28T03:57:28+0000 lvl=info msg="Executing migration" logger=migrator id="Add column updated_by in dashboard - v2" 2021-01-28T03:57:28.636 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:28 smithi162 bash[24692]: t=2021-01-28T03:57:28+0000 lvl=info msg="Executing migration" logger=migrator id="Add column created_by in dashboard - v2" 2021-01-28T03:57:28.636 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:28 smithi162 bash[24692]: t=2021-01-28T03:57:28+0000 lvl=info msg="Executing migration" logger=migrator id="Add column gnetId in dashboard" 2021-01-28T03:57:28.826 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:28 smithi100 bash[9834]: cluster 2021-01-28T03:57:27.403957+0000 mgr.y (mgr.14138) 353 : cluster [DBG] pgmap v256: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:28.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:28 smithi100 bash[9834]: audit 2021-01-28T03:57:28.354001+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.15.100:0/4011625584' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.control", "var": "pg_num"}]: dispatch 2021-01-28T03:57:28.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:28 smithi100 bash[13549]: cluster 2021-01-28T03:57:27.403957+0000 mgr.y (mgr.14138) 353 : cluster [DBG] pgmap v256: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:28.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:28 smithi100 bash[13549]: audit 2021-01-28T03:57:28.354001+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.15.100:0/4011625584' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.control", "var": "pg_num"}]: dispatch 2021-01-28T03:57:28.912 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:28 smithi162 bash[24692]: t=2021-01-28T03:57:28+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for gnetId in dashboard" 2021-01-28T03:57:28.912 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:28 smithi162 bash[24692]: t=2021-01-28T03:57:28+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_id in dashboard" 2021-01-28T03:57:28.912 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:28 smithi162 bash[24692]: t=2021-01-28T03:57:28+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for plugin_id in dashboard" 2021-01-28T03:57:28.913 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:28 smithi162 bash[24692]: t=2021-01-28T03:57:28+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_id in dashboard_tag" 2021-01-28T03:57:29.237 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:28 smithi162 bash[24692]: t=2021-01-28T03:57:28+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard table charset" 2021-01-28T03:57:29.238 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:28 smithi162 bash[24692]: t=2021-01-28T03:57:28+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_tag table charset" 2021-01-28T03:57:29.238 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:29 smithi162 bash[24692]: t=2021-01-28T03:57:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add column folder_id in dashboard" 2021-01-28T03:57:29.238 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:29 smithi162 bash[24692]: t=2021-01-28T03:57:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add column isFolder in dashboard" 2021-01-28T03:57:29.511 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:29 smithi162 bash[24692]: t=2021-01-28T03:57:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add column has_acl in dashboard" 2021-01-28T03:57:29.512 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:29 smithi162 bash[24692]: t=2021-01-28T03:57:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in dashboard" 2021-01-28T03:57:29.512 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:29 smithi162 bash[24692]: t=2021-01-28T03:57:29+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in dashboard" 2021-01-28T03:57:29.512 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:29 smithi162 bash[24692]: t=2021-01-28T03:57:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index dashboard_org_id_uid" 2021-01-28T03:57:29.512 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:29 smithi162 bash[24692]: t=2021-01-28T03:57:29+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_slug" 2021-01-28T03:57:29.743 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph osd pool get zone.rgw.meta pg_num 2021-01-28T03:57:29.826 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:57:29 smithi100 bash[10061]: debug 2021-01-28T03:57:29.529+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T03:57:29.833 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 03:57:29 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T03:57:29.833 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:29 smithi162 bash[24692]: t=2021-01-28T03:57:29+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard title length" 2021-01-28T03:57:29.833 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:29 smithi162 bash[24692]: t=2021-01-28T03:57:29+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index for dashboard_org_id_title_folder_id" 2021-01-28T03:57:29.833 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:29 smithi162 bash[24692]: t=2021-01-28T03:57:29+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning" 2021-01-28T03:57:29.834 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:29 smithi162 bash[24692]: t=2021-01-28T03:57:29+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2021-01-28T03:57:29.834 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:29 smithi162 bash[24692]: t=2021-01-28T03:57:29+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning v2" 2021-01-28T03:57:29.892 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c217df96-611b-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T03:57:30.109 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:29 smithi162 bash[24692]: t=2021-01-28T03:57:29+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2021-01-28T03:57:30.110 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:29 smithi162 bash[24692]: t=2021-01-28T03:57:29+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2021-01-28T03:57:30.111 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:29 smithi162 bash[24692]: t=2021-01-28T03:57:29+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard_provisioning v1 to v2" 2021-01-28T03:57:30.111 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:30 smithi162 bash[24692]: t=2021-01-28T03:57:30+0000 lvl=info msg="Executing migration" logger=migrator id="drop dashboard_provisioning_tmp_qwerty" 2021-01-28T03:57:30.111 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:30 smithi162 bash[24692]: t=2021-01-28T03:57:30+0000 lvl=info msg="Executing migration" logger=migrator id="Add check_sum column" 2021-01-28T03:57:30.361 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:30 smithi162 bash[24692]: t=2021-01-28T03:57:30+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table" 2021-01-28T03:57:30.361 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:30 smithi162 bash[24692]: t=2021-01-28T03:57:30+0000 lvl=info msg="Executing migration" logger=migrator id="add index data_source.account_id" 2021-01-28T03:57:30.704 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:30 smithi162 bash[9856]: cluster 2021-01-28T03:57:29.405220+0000 mgr.y (mgr.14138) 354 : cluster [DBG] pgmap v257: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:30.704 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:30 smithi162 bash[24692]: t=2021-01-28T03:57:30+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index data_source.account_id_name" 2021-01-28T03:57:30.705 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:30 smithi162 bash[24692]: t=2021-01-28T03:57:30+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_data_source_account_id - v1" 2021-01-28T03:57:30.705 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:30 smithi162 bash[24692]: t=2021-01-28T03:57:30+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_data_source_account_id_name - v1" 2021-01-28T03:57:30.705 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:30 smithi162 bash[24692]: t=2021-01-28T03:57:30+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table data_source to data_source_v1 - v1" 2021-01-28T03:57:30.706 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:30 smithi162 bash[24692]: t=2021-01-28T03:57:30+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table v2" 2021-01-28T03:57:30.706 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:30 smithi162 bash[24692]: t=2021-01-28T03:57:30+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_data_source_org_id - v2" 2021-01-28T03:57:30.826 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:30 smithi100 bash[9834]: cluster 2021-01-28T03:57:29.405220+0000 mgr.y (mgr.14138) 354 : cluster [DBG] pgmap v257: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:30.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:30 smithi100 bash[13549]: cluster 2021-01-28T03:57:29.405220+0000 mgr.y (mgr.14138) 354 : cluster [DBG] pgmap v257: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:31.005 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:30 smithi162 bash[24692]: t=2021-01-28T03:57:30+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_data_source_org_id_name - v2" 2021-01-28T03:57:31.006 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:30 smithi162 bash[24692]: t=2021-01-28T03:57:30+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2021-01-28T03:57:31.006 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:30 smithi162 bash[24692]: t=2021-01-28T03:57:30+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table data_source_v1 #2" 2021-01-28T03:57:31.261 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:31 smithi162 bash[24692]: t=2021-01-28T03:57:31+0000 lvl=info msg="Executing migration" logger=migrator id="Add column with_credentials" 2021-01-28T03:57:31.262 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:31 smithi162 bash[24692]: t=2021-01-28T03:57:31+0000 lvl=info msg="Executing migration" logger=migrator id="Add secure json data column" 2021-01-28T03:57:31.262 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:31 smithi162 bash[24692]: t=2021-01-28T03:57:31+0000 lvl=info msg="Executing migration" logger=migrator id="Update data_source table charset" 2021-01-28T03:57:31.262 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:31 smithi162 bash[24692]: t=2021-01-28T03:57:31+0000 lvl=info msg="Executing migration" logger=migrator id="Update initial version to 1" 2021-01-28T03:57:31.263 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:31 smithi162 bash[24692]: t=2021-01-28T03:57:31+0000 lvl=info msg="Executing migration" logger=migrator id="Add read_only data column" 2021-01-28T03:57:31.618 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:31 smithi162 bash[9856]: audit 2021-01-28T03:57:29.532101+0000 mgr.y (mgr.14138) 355 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:57:31.618 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:31 smithi162 bash[24692]: t=2021-01-28T03:57:31+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate logging ds to loki ds" 2021-01-28T03:57:31.618 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:31 smithi162 bash[24692]: t=2021-01-28T03:57:31+0000 lvl=info msg="Executing migration" logger=migrator id="Update json_data with nulls" 2021-01-28T03:57:31.618 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:31 smithi162 bash[24692]: t=2021-01-28T03:57:31+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table" 2021-01-28T03:57:31.619 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:31 smithi162 bash[24692]: t=2021-01-28T03:57:31+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id" 2021-01-28T03:57:31.781 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:31 smithi100 bash[9834]: audit 2021-01-28T03:57:29.532101+0000 mgr.y (mgr.14138) 355 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:57:31.781 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:31 smithi100 bash[13549]: audit 2021-01-28T03:57:29.532101+0000 mgr.y (mgr.14138) 355 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:57:31.902 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:31 smithi162 bash[24692]: t=2021-01-28T03:57:31+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.key" 2021-01-28T03:57:31.903 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:31 smithi162 bash[24692]: t=2021-01-28T03:57:31+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id_name" 2021-01-28T03:57:31.903 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:31 smithi162 bash[24692]: t=2021-01-28T03:57:31+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_api_key_account_id - v1" 2021-01-28T03:57:31.903 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:31 smithi162 bash[24692]: t=2021-01-28T03:57:31+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_key - v1" 2021-01-28T03:57:31.904 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:31 smithi162 bash[24692]: t=2021-01-28T03:57:31+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_account_id_name - v1" 2021-01-28T03:57:32.187 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:31 smithi162 bash[24692]: t=2021-01-28T03:57:31+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table api_key to api_key_v1 - v1" 2021-01-28T03:57:32.187 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:32 smithi162 bash[24692]: t=2021-01-28T03:57:32+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table v2" 2021-01-28T03:57:32.187 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:32 smithi162 bash[24692]: t=2021-01-28T03:57:32+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_api_key_org_id - v2" 2021-01-28T03:57:32.455 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:32 smithi162 bash[24692]: t=2021-01-28T03:57:32+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_key - v2" 2021-01-28T03:57:32.456 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:32 smithi162 bash[24692]: t=2021-01-28T03:57:32+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_org_id_name - v2" 2021-01-28T03:57:32.456 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:32 smithi162 bash[24692]: t=2021-01-28T03:57:32+0000 lvl=info msg="Executing migration" logger=migrator id="copy api_key v1 to v2" 2021-01-28T03:57:32.456 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:32 smithi162 bash[24692]: t=2021-01-28T03:57:32+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table api_key_v1" 2021-01-28T03:57:32.457 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:32 smithi162 bash[24692]: t=2021-01-28T03:57:32+0000 lvl=info msg="Executing migration" logger=migrator id="Update api_key table charset" 2021-01-28T03:57:32.715 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:32 smithi162 bash[9856]: cluster 2021-01-28T03:57:31.406163+0000 mgr.y (mgr.14138) 356 : cluster [DBG] pgmap v258: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:32.715 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:32 smithi162 bash[24692]: t=2021-01-28T03:57:32+0000 lvl=info msg="Executing migration" logger=migrator id="Add expires to api_key table" 2021-01-28T03:57:32.716 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:32 smithi162 bash[24692]: t=2021-01-28T03:57:32+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v4" 2021-01-28T03:57:32.716 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:32 smithi162 bash[24692]: t=2021-01-28T03:57:32+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_snapshot_v4 #1" 2021-01-28T03:57:32.826 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:32 smithi100 bash[9834]: cluster 2021-01-28T03:57:31.406163+0000 mgr.y (mgr.14138) 356 : cluster [DBG] pgmap v258: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:32.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:32 smithi100 bash[13549]: cluster 2021-01-28T03:57:31.406163+0000 mgr.y (mgr.14138) 356 : cluster [DBG] pgmap v258: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:32.966 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:32 smithi162 bash[24692]: t=2021-01-28T03:57:32+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v5 #2" 2021-01-28T03:57:32.967 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:32 smithi162 bash[24692]: t=2021-01-28T03:57:32+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_key - v5" 2021-01-28T03:57:32.967 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:32 smithi162 bash[24692]: t=2021-01-28T03:57:32+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_delete_key - v5" 2021-01-28T03:57:32.967 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:32 smithi162 bash[24692]: t=2021-01-28T03:57:32+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_snapshot_user_id - v5" 2021-01-28T03:57:33.262 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:32 smithi162 bash[24692]: t=2021-01-28T03:57:32+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_snapshot to mediumtext v2" 2021-01-28T03:57:33.262 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:33 smithi162 bash[24692]: t=2021-01-28T03:57:33+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_snapshot table charset" 2021-01-28T03:57:33.262 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:33 smithi162 bash[24692]: t=2021-01-28T03:57:33+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external_delete_url to dashboard_snapshots table" 2021-01-28T03:57:33.262 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:33 smithi162 bash[24692]: t=2021-01-28T03:57:33+0000 lvl=info msg="Executing migration" logger=migrator id="create quota table v1" 2021-01-28T03:57:33.492 INFO:journalctl@ceph.alertmanager.a.smithi100.stdout:Jan 28 03:57:33 smithi100 systemd[1]: Stopping Ceph alertmanager.a for c217df96-611b-11eb-8f9e-001a4aab830c... 2021-01-28T03:57:33.493 INFO:journalctl@ceph.alertmanager.a.smithi100.stdout:Jan 28 03:57:33 smithi100 bash[26728]: level=info ts=2021-01-28T03:57:33.238Z caller=main.go:536 msg="Received SIGTERM, exiting gracefully..." 2021-01-28T03:57:33.493 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:33 smithi100 bash[13549]: cluster 2021-01-28T03:57:33.407377+0000 mgr.y (mgr.14138) 357 : cluster [DBG] pgmap v259: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:33.586 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:33 smithi162 bash[9856]: cluster 2021-01-28T03:57:33.407377+0000 mgr.y (mgr.14138) 357 : cluster [DBG] pgmap v259: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:33.587 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:33 smithi162 bash[24692]: t=2021-01-28T03:57:33+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_quota_org_id_user_id_target - v1" 2021-01-28T03:57:33.587 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:33 smithi162 bash[24692]: t=2021-01-28T03:57:33+0000 lvl=info msg="Executing migration" logger=migrator id="Update quota table charset" 2021-01-28T03:57:33.587 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:33 smithi162 bash[24692]: t=2021-01-28T03:57:33+0000 lvl=info msg="Executing migration" logger=migrator id="create plugin_setting table" 2021-01-28T03:57:33.588 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:33 smithi162 bash[24692]: t=2021-01-28T03:57:33+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2021-01-28T03:57:33.588 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:33 smithi162 bash[24692]: t=2021-01-28T03:57:33+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_version to plugin_settings" 2021-01-28T03:57:33.826 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:33 smithi100 bash[9834]: cluster 2021-01-28T03:57:33.407377+0000 mgr.y (mgr.14138) 357 : cluster [DBG] pgmap v259: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:33.838 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:33 smithi162 bash[24692]: t=2021-01-28T03:57:33+0000 lvl=info msg="Executing migration" logger=migrator id="Update plugin_setting table charset" 2021-01-28T03:57:33.838 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:33 smithi162 bash[24692]: t=2021-01-28T03:57:33+0000 lvl=info msg="Executing migration" logger=migrator id="create session table" 2021-01-28T03:57:33.838 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:33 smithi162 bash[24692]: t=2021-01-28T03:57:33+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist table" 2021-01-28T03:57:34.123 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:33 smithi162 bash[24692]: t=2021-01-28T03:57:33+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist_item table" 2021-01-28T03:57:34.123 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:33 smithi162 bash[24692]: t=2021-01-28T03:57:33+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist table v2" 2021-01-28T03:57:34.124 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:33 smithi162 bash[24692]: t=2021-01-28T03:57:33+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist item table v2" 2021-01-28T03:57:34.124 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:34 smithi162 bash[24692]: t=2021-01-28T03:57:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist table charset" 2021-01-28T03:57:34.407 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:34 smithi162 bash[24692]: t=2021-01-28T03:57:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist_item table charset" 2021-01-28T03:57:34.408 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:34 smithi162 bash[24692]: t=2021-01-28T03:57:34+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v2" 2021-01-28T03:57:34.408 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:34 smithi162 bash[24692]: t=2021-01-28T03:57:34+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v3" 2021-01-28T03:57:34.408 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:34 smithi162 bash[24692]: t=2021-01-28T03:57:34+0000 lvl=info msg="Executing migration" logger=migrator id="create preferences table v3" 2021-01-28T03:57:34.659 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:34 smithi162 bash[24692]: t=2021-01-28T03:57:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update preferences table charset" 2021-01-28T03:57:34.659 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:34 smithi162 bash[24692]: t=2021-01-28T03:57:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add column team_id in preferences" 2021-01-28T03:57:34.660 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:34 smithi162 bash[24692]: t=2021-01-28T03:57:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update team_id column values in preferences" 2021-01-28T03:57:34.660 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:34 smithi162 bash[24692]: t=2021-01-28T03:57:34+0000 lvl=info msg="Executing migration" logger=migrator id="create alert table v1" 2021-01-28T03:57:34.660 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:34 smithi162 bash[24692]: t=2021-01-28T03:57:34+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert org_id & id " 2021-01-28T03:57:34.901 INFO:journalctl@ceph.alertmanager.a.smithi100.stdout:Jan 28 03:57:34 smithi100 docker[28467]: ceph-c217df96-611b-11eb-8f9e-001a4aab830c-alertmanager.a 2021-01-28T03:57:34.901 INFO:journalctl@ceph.alertmanager.a.smithi100.stdout:Jan 28 03:57:34 smithi100 systemd[1]: ceph-c217df96-611b-11eb-8f9e-001a4aab830c@alertmanager.a.service: Succeeded. 2021-01-28T03:57:34.902 INFO:journalctl@ceph.alertmanager.a.smithi100.stdout:Jan 28 03:57:34 smithi100 systemd[1]: Stopped Ceph alertmanager.a for c217df96-611b-11eb-8f9e-001a4aab830c. 2021-01-28T03:57:34.902 INFO:journalctl@ceph.alertmanager.a.smithi100.stdout:Jan 28 03:57:34 smithi100 systemd[1]: Started Ceph alertmanager.a for c217df96-611b-11eb-8f9e-001a4aab830c. 2021-01-28T03:57:34.994 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:34 smithi162 bash[24692]: t=2021-01-28T03:57:34+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert state" 2021-01-28T03:57:34.994 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:34 smithi162 bash[24692]: t=2021-01-28T03:57:34+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert dashboard_id" 2021-01-28T03:57:34.994 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:34 smithi162 bash[24692]: t=2021-01-28T03:57:34+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v1" 2021-01-28T03:57:34.995 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:34 smithi162 bash[24692]: t=2021-01-28T03:57:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_rule_tag.alert_id_tag_id" 2021-01-28T03:57:35.262 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:35 smithi162 bash[24692]: t=2021-01-28T03:57:35+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification table v1" 2021-01-28T03:57:35.324 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:35 smithi162 bash[24692]: t=2021-01-28T03:57:35+0000 lvl=info msg="Executing migration" logger=migrator id="Add column is_default" 2021-01-28T03:57:35.327 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.305+0000 7f1cb7fff700 1 -- 172.21.15.100:0/2486266310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cb80f8a00 msgr2=0x7f1cb80fae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:35.328 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.305+0000 7f1cb7fff700 1 --2- 172.21.15.100:0/2486266310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cb80f8a00 0x7f1cb80fae50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f1ca0004e00 tx=0x7f1ca0009b30).stop 2021-01-28T03:57:35.328 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.305+0000 7f1cb7fff700 1 -- 172.21.15.100:0/2486266310 shutdown_connections 2021-01-28T03:57:35.328 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.305+0000 7f1cb7fff700 1 --2- 172.21.15.100:0/2486266310 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cb80fb490 0x7f1cb80fd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:35.329 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.305+0000 7f1cb7fff700 1 --2- 172.21.15.100:0/2486266310 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1cb805f7d0 0x7f1cb80f8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:35.329 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.305+0000 7f1cb7fff700 1 --2- 172.21.15.100:0/2486266310 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cb80f8a00 0x7f1cb80fae50 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:35.329 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.305+0000 7f1cb7fff700 1 -- 172.21.15.100:0/2486266310 >> 172.21.15.100:0/2486266310 conn(0x7f1cb80effa0 msgr2=0x7f1cb80f23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:57:35.330 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.305+0000 7f1cb7fff700 1 -- 172.21.15.100:0/2486266310 shutdown_connections 2021-01-28T03:57:35.330 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.305+0000 7f1cb7fff700 1 -- 172.21.15.100:0/2486266310 wait complete. 2021-01-28T03:57:35.330 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.305+0000 7f1cb7fff700 1 Processor -- start 2021-01-28T03:57:35.330 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.305+0000 7f1cb7fff700 1 -- start start 2021-01-28T03:57:35.331 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.305+0000 7f1cb7fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cb805f7d0 0x7f1cb81058d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:35.331 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.305+0000 7f1cb7fff700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cb80f8a00 0x7f1cb8105dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:35.331 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.305+0000 7f1cb7fff700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1cb80fb490 0x7f1cb8106cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:35.332 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.305+0000 7f1cb7fff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb81071e0 con 0x7f1cb805f7d0 2021-01-28T03:57:35.332 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.305+0000 7f1cb7fff700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb8107350 con 0x7f1cb80f8a00 2021-01-28T03:57:35.332 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.305+0000 7f1cb7fff700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb8107510 con 0x7f1cb80fb490 2021-01-28T03:57:35.332 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.305+0000 7f1cb6ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cb805f7d0 0x7f1cb81058d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:35.333 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.305+0000 7f1cb77fe700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1cb80fb490 0x7f1cb8106cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:35.333 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.305+0000 7f1cb6ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cb805f7d0 0x7f1cb81058d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59860/0 (socket says 172.21.15.100:59860) 2021-01-28T03:57:35.333 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.305+0000 7f1cb6ffd700 1 -- 172.21.15.100:0/2020715779 learned_addr learned my addr 172.21.15.100:0/2020715779 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:57:35.333 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.305+0000 7f1caffff700 1 --2- 172.21.15.100:0/2020715779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cb80f8a00 0x7f1cb8105dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:35.334 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.309+0000 7f1cb77fe700 1 -- 172.21.15.100:0/2020715779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cb80f8a00 msgr2=0x7f1cb8105dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:35.334 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.309+0000 7f1cb77fe700 1 --2- 172.21.15.100:0/2020715779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cb80f8a00 0x7f1cb8105dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:35.334 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.309+0000 7f1cb77fe700 1 -- 172.21.15.100:0/2020715779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cb805f7d0 msgr2=0x7f1cb81058d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:35.335 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.309+0000 7f1cb77fe700 1 --2- 172.21.15.100:0/2020715779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cb805f7d0 0x7f1cb81058d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:35.335 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.309+0000 7f1cb77fe700 1 -- 172.21.15.100:0/2020715779 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb81076d0 con 0x7f1cb80fb490 2021-01-28T03:57:35.335 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.309+0000 7f1cb77fe700 1 --2- 172.21.15.100:0/2020715779 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1cb80fb490 0x7f1cb8106cb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f1cb000dad0 tx=0x7f1cb0004db0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:57:35.335 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.309+0000 7f1caf7fe700 1 -- 172.21.15.100:0/2020715779 <== mon.1 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb0004020 con 0x7f1cb80fb490 2021-01-28T03:57:35.336 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.309+0000 7f1cb7fff700 1 -- 172.21.15.100:0/2020715779 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cb8107980 con 0x7f1cb80fb490 2021-01-28T03:57:35.336 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.309+0000 7f1caf7fe700 1 -- 172.21.15.100:0/2020715779 <== mon.1 v2:172.21.15.100:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f1cb000f040 con 0x7f1cb80fb490 2021-01-28T03:57:35.336 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.309+0000 7f1cb7fff700 1 -- 172.21.15.100:0/2020715779 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb810e0c0 con 0x7f1cb80fb490 2021-01-28T03:57:35.336 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.309+0000 7f1caf7fe700 1 -- 172.21.15.100:0/2020715779 <== mon.1 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb00036c0 con 0x7f1cb80fb490 2021-01-28T03:57:35.337 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.309+0000 7f1cb7fff700 1 -- 172.21.15.100:0/2020715779 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cb80f3b90 con 0x7f1cb80fb490 2021-01-28T03:57:35.337 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.309+0000 7f1caf7fe700 1 -- 172.21.15.100:0/2020715779 <== mon.1 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f1cb0003af0 con 0x7f1cb80fb490 2021-01-28T03:57:35.337 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.309+0000 7f1caf7fe700 1 --2- 172.21.15.100:0/2020715779 >> v2:172.21.15.100:6800/928846103 conn(0x7f1c9805bc70 0x7f1c9805e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:35.337 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.313+0000 7f1cb6ffd700 1 --2- 172.21.15.100:0/2020715779 >> v2:172.21.15.100:6800/928846103 conn(0x7f1c9805bc70 0x7f1c9805e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:35.338 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.313+0000 7f1caf7fe700 1 -- 172.21.15.100:0/2020715779 <== mon.1 v2:172.21.15.100:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f1cb0075840 con 0x7f1cb80fb490 2021-01-28T03:57:35.338 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.313+0000 7f1cb6ffd700 1 --2- 172.21.15.100:0/2020715779 >> v2:172.21.15.100:6800/928846103 conn(0x7f1c9805bc70 0x7f1c9805e130 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f1ca8004cf0 tx=0x7f1ca800b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:57:35.339 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.313+0000 7f1caf7fe700 1 -- 172.21.15.100:0/2020715779 <== mon.1 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f1cb00458c0 con 0x7f1cb80fb490 2021-01-28T03:57:35.474 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:35 smithi162 bash[24692]: t=2021-01-28T03:57:35+0000 lvl=info msg="Executing migration" logger=migrator id="Add column frequency" 2021-01-28T03:57:35.486 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.481+0000 7f1cb7fff700 1 -- 172.21.15.100:0/2020715779 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "zone.rgw.meta", "var": "pg_num"} v 0) v1 -- 0x7f1cb8100640 con 0x7f1cb80fb490 2021-01-28T03:57:35.487 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.485+0000 7f1caf7fe700 1 -- 172.21.15.100:0/2020715779 <== mon.1 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "zone.rgw.meta", "var": "pg_num"}]=0 v60) v1 ==== 102+0+11 (secure 0 0 0) 0x7f1cb00484b0 con 0x7f1cb80fb490 2021-01-28T03:57:35.487 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2021-01-28T03:57:35.490 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.485+0000 7f1cb7fff700 1 -- 172.21.15.100:0/2020715779 >> v2:172.21.15.100:6800/928846103 conn(0x7f1c9805bc70 msgr2=0x7f1c9805e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:35.491 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.485+0000 7f1cb7fff700 1 --2- 172.21.15.100:0/2020715779 >> v2:172.21.15.100:6800/928846103 conn(0x7f1c9805bc70 0x7f1c9805e130 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f1ca8004cf0 tx=0x7f1ca800b040).stop 2021-01-28T03:57:35.491 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.485+0000 7f1cb7fff700 1 -- 172.21.15.100:0/2020715779 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1cb80fb490 msgr2=0x7f1cb8106cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:35.491 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.485+0000 7f1cb7fff700 1 --2- 172.21.15.100:0/2020715779 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1cb80fb490 0x7f1cb8106cb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f1cb000dad0 tx=0x7f1cb0004db0).stop 2021-01-28T03:57:35.491 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.485+0000 7f1cb7fff700 1 -- 172.21.15.100:0/2020715779 shutdown_connections 2021-01-28T03:57:35.491 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.485+0000 7f1cb7fff700 1 --2- 172.21.15.100:0/2020715779 >> v2:172.21.15.100:6800/928846103 conn(0x7f1c9805bc70 0x7f1c9805e130 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:35.492 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.485+0000 7f1cb7fff700 1 --2- 172.21.15.100:0/2020715779 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1cb80fb490 0x7f1cb8106cb0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:35.492 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.485+0000 7f1cb7fff700 1 --2- 172.21.15.100:0/2020715779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cb805f7d0 0x7f1cb81058d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:35.492 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.485+0000 7f1cb7fff700 1 --2- 172.21.15.100:0/2020715779 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cb80f8a00 0x7f1cb8105dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:35.492 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.485+0000 7f1cb7fff700 1 -- 172.21.15.100:0/2020715779 >> 172.21.15.100:0/2020715779 conn(0x7f1cb80effa0 msgr2=0x7f1cb80fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:57:35.493 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.489+0000 7f1cb7fff700 1 -- 172.21.15.100:0/2020715779 shutdown_connections 2021-01-28T03:57:35.493 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:35.489+0000 7f1cb7fff700 1 -- 172.21.15.100:0/2020715779 wait complete. 2021-01-28T03:57:35.739 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:35 smithi162 bash[24692]: t=2021-01-28T03:57:35+0000 lvl=info msg="Executing migration" logger=migrator id="Add column send_reminder" 2021-01-28T03:57:36.014 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:35 smithi162 bash[24692]: t=2021-01-28T03:57:35+0000 lvl=info msg="Executing migration" logger=migrator id="Add column disable_resolve_message" 2021-01-28T03:57:36.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:35 smithi162 bash[9856]: audit 2021-01-28T03:57:34.727985+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:36.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:35 smithi162 bash[9856]: cephadm 2021-01-28T03:57:34.729807+0000 mgr.y (mgr.14138) 358 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2021-01-28T03:57:36.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:35 smithi162 bash[9856]: cephadm 2021-01-28T03:57:34.733584+0000 mgr.y (mgr.14138) 359 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi162 2021-01-28T03:57:36.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:35 smithi162 bash[9856]: cluster 2021-01-28T03:57:35.408480+0000 mgr.y (mgr.14138) 360 : cluster [DBG] pgmap v260: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:36.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:35 smithi162 bash[9856]: audit 2021-01-28T03:57:35.486170+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T03:57:36.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:35 smithi162 bash[9856]: audit 2021-01-28T03:57:35.487088+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.15.100:0/2020715779' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.meta", "var": "pg_num"}]: dispatch 2021-01-28T03:57:36.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:35 smithi162 bash[9856]: audit 2021-01-28T03:57:35.497358+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T03:57:36.076 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:35 smithi100 bash[9834]: audit 2021-01-28T03:57:34.727985+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:36.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:35 smithi100 bash[9834]: cephadm 2021-01-28T03:57:34.729807+0000 mgr.y (mgr.14138) 358 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2021-01-28T03:57:36.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:35 smithi100 bash[9834]: cephadm 2021-01-28T03:57:34.733584+0000 mgr.y (mgr.14138) 359 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi162 2021-01-28T03:57:36.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:35 smithi100 bash[9834]: cluster 2021-01-28T03:57:35.408480+0000 mgr.y (mgr.14138) 360 : cluster [DBG] pgmap v260: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:36.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:35 smithi100 bash[9834]: audit 2021-01-28T03:57:35.486170+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T03:57:36.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:35 smithi100 bash[9834]: audit 2021-01-28T03:57:35.487088+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.15.100:0/2020715779' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.meta", "var": "pg_num"}]: dispatch 2021-01-28T03:57:36.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:35 smithi100 bash[9834]: audit 2021-01-28T03:57:35.497358+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T03:57:36.078 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:35 smithi100 bash[13549]: audit 2021-01-28T03:57:34.727985+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:36.079 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:35 smithi100 bash[13549]: cephadm 2021-01-28T03:57:34.729807+0000 mgr.y (mgr.14138) 358 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2021-01-28T03:57:36.079 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:35 smithi100 bash[13549]: cephadm 2021-01-28T03:57:34.733584+0000 mgr.y (mgr.14138) 359 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi162 2021-01-28T03:57:36.079 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:35 smithi100 bash[13549]: cluster 2021-01-28T03:57:35.408480+0000 mgr.y (mgr.14138) 360 : cluster [DBG] pgmap v260: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:36.079 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:35 smithi100 bash[13549]: audit 2021-01-28T03:57:35.486170+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T03:57:36.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:35 smithi100 bash[13549]: audit 2021-01-28T03:57:35.487088+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.15.100:0/2020715779' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.meta", "var": "pg_num"}]: dispatch 2021-01-28T03:57:36.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:35 smithi100 bash[13549]: audit 2021-01-28T03:57:35.497358+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T03:57:36.512 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:36 smithi162 bash[24692]: t=2021-01-28T03:57:36+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification org_id & name" 2021-01-28T03:57:36.512 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:36 smithi162 bash[24692]: t=2021-01-28T03:57:36+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert table charset" 2021-01-28T03:57:36.642 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2021-01-28T03:57:36.647 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2021-01-28T03:57:36.648 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph mgr dump --format=json 2021-01-28T03:57:36.821 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c217df96-611b-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T03:57:37.012 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:36 smithi162 bash[24692]: t=2021-01-28T03:57:36+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert_notification table charset" 2021-01-28T03:57:37.012 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:36 smithi162 bash[24692]: t=2021-01-28T03:57:36+0000 lvl=info msg="Executing migration" logger=migrator id="create notification_journal table v1" 2021-01-28T03:57:37.076 INFO:journalctl@ceph.alertmanager.a.smithi100.stdout:Jan 28 03:57:36 smithi100 bash[28529]: level=info ts=2021-01-28T03:57:36.783Z caller=main.go:231 msg="Starting Alertmanager" version="(version=0.20.0, branch=HEAD, revision=f74be0400a6243d10bb53812d6fa408ad71ff32d)" 2021-01-28T03:57:37.077 INFO:journalctl@ceph.alertmanager.a.smithi100.stdout:Jan 28 03:57:36 smithi100 bash[28529]: level=info ts=2021-01-28T03:57:36.783Z caller=main.go:232 build_context="(go=go1.13.5, user=root@00c3106655f8, date=20191211-14:13:14)" 2021-01-28T03:57:37.077 INFO:journalctl@ceph.alertmanager.a.smithi100.stdout:Jan 28 03:57:36 smithi100 bash[28529]: level=info ts=2021-01-28T03:57:36.786Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.15.100 port=9094 2021-01-28T03:57:37.077 INFO:journalctl@ceph.alertmanager.a.smithi100.stdout:Jan 28 03:57:36 smithi100 bash[28529]: level=info ts=2021-01-28T03:57:36.793Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2021-01-28T03:57:37.077 INFO:journalctl@ceph.alertmanager.a.smithi100.stdout:Jan 28 03:57:36 smithi100 bash[28529]: level=info ts=2021-01-28T03:57:36.825Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2021-01-28T03:57:37.078 INFO:journalctl@ceph.alertmanager.a.smithi100.stdout:Jan 28 03:57:36 smithi100 bash[28529]: level=info ts=2021-01-28T03:57:36.825Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2021-01-28T03:57:37.078 INFO:journalctl@ceph.alertmanager.a.smithi100.stdout:Jan 28 03:57:36 smithi100 bash[28529]: level=info ts=2021-01-28T03:57:36.828Z caller=main.go:497 msg=Listening address=:9093 2021-01-28T03:57:37.329 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:37 smithi162 bash[24692]: t=2021-01-28T03:57:37+0000 lvl=info msg="Executing migration" logger=migrator id="add index notification_journal org_id & alert_id & notifier_id" 2021-01-28T03:57:37.329 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:37 smithi162 bash[24692]: t=2021-01-28T03:57:37+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_notification_journal" 2021-01-28T03:57:37.585 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:37 smithi162 bash[24692]: t=2021-01-28T03:57:37+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification_state table v1" 2021-01-28T03:57:37.586 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:37 smithi162 bash[24692]: t=2021-01-28T03:57:37+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification_state org_id & alert_id & notifier_id" 2021-01-28T03:57:37.586 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:37 smithi162 bash[24692]: t=2021-01-28T03:57:37+0000 lvl=info msg="Executing migration" logger=migrator id="Add for to alert table" 2021-01-28T03:57:37.918 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:37 smithi100 bash[9834]: cluster 2021-01-28T03:57:37.409458+0000 mgr.y (mgr.14138) 361 : cluster [DBG] pgmap v261: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:37.919 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:37 smithi100 bash[13549]: cluster 2021-01-28T03:57:37.409458+0000 mgr.y (mgr.14138) 361 : cluster [DBG] pgmap v261: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:38.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:37 smithi162 bash[9856]: cluster 2021-01-28T03:57:37.409458+0000 mgr.y (mgr.14138) 361 : cluster [DBG] pgmap v261: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:38.013 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:37 smithi162 bash[24692]: t=2021-01-28T03:57:37+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in alert_notification" 2021-01-28T03:57:38.013 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:37 smithi162 bash[24692]: t=2021-01-28T03:57:37+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in alert_notification" 2021-01-28T03:57:38.512 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:38 smithi162 bash[24692]: t=2021-01-28T03:57:38+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_notification_org_id_uid" 2021-01-28T03:57:38.512 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:38 smithi162 bash[24692]: t=2021-01-28T03:57:38+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_name" 2021-01-28T03:57:39.012 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:38 smithi162 bash[24692]: t=2021-01-28T03:57:38+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old annotation table v4" 2021-01-28T03:57:39.012 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:38 smithi162 bash[24692]: t=2021-01-28T03:57:38+0000 lvl=info msg="Executing migration" logger=migrator id="create annotation table v5" 2021-01-28T03:57:39.080 INFO:journalctl@ceph.alertmanager.a.smithi100.stdout:Jan 28 03:57:38 smithi100 bash[28529]: level=info ts=2021-01-28T03:57:38.793Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000210805s 2021-01-28T03:57:39.441 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:39 smithi162 bash[24692]: t=2021-01-28T03:57:39+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 0 v3" 2021-01-28T03:57:39.441 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:39 smithi162 bash[24692]: t=2021-01-28T03:57:39+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 1 v3" 2021-01-28T03:57:39.762 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 03:57:39 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T03:57:39.763 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:39 smithi162 bash[24692]: t=2021-01-28T03:57:39+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 2 v3" 2021-01-28T03:57:39.768 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.765+0000 7fc6e6cfe700 1 -- 172.21.15.100:0/4174280240 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc6e00fb4a0 msgr2=0x7fc6e00fd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:39.769 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.765+0000 7fc6e6cfe700 1 --2- 172.21.15.100:0/4174280240 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc6e00fb4a0 0x7fc6e00fd930 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fc6d8009dc0 tx=0x7fc6d8004d10).stop 2021-01-28T03:57:39.769 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.765+0000 7fc6e6cfe700 1 -- 172.21.15.100:0/4174280240 shutdown_connections 2021-01-28T03:57:39.769 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.765+0000 7fc6e6cfe700 1 --2- 172.21.15.100:0/4174280240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6e005f7d0 0x7fc6e00f8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:39.769 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.765+0000 7fc6e6cfe700 1 --2- 172.21.15.100:0/4174280240 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc6e00fb4a0 0x7fc6e00fd930 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:39.769 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.765+0000 7fc6e6cfe700 1 --2- 172.21.15.100:0/4174280240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6e00f8a10 0x7fc6e00fae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:39.770 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.765+0000 7fc6e6cfe700 1 -- 172.21.15.100:0/4174280240 >> 172.21.15.100:0/4174280240 conn(0x7fc6e00effb0 msgr2=0x7fc6e00f23d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:57:39.770 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.765+0000 7fc6e6cfe700 1 -- 172.21.15.100:0/4174280240 shutdown_connections 2021-01-28T03:57:39.770 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.765+0000 7fc6e6cfe700 1 -- 172.21.15.100:0/4174280240 wait complete. 2021-01-28T03:57:39.773 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.765+0000 7fc6e6cfe700 1 Processor -- start 2021-01-28T03:57:39.774 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.765+0000 7fc6e6cfe700 1 -- start start 2021-01-28T03:57:39.774 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.765+0000 7fc6e6cfe700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6e005f7d0 0x7fc6e01056e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:39.774 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.765+0000 7fc6e6cfe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6e00f8a10 0x7fc6e0105bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:39.775 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.765+0000 7fc6e6cfe700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc6e00fb4a0 0x7fc6e0106ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:39.775 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.765+0000 7fc6e6cfe700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e0106ff0 con 0x7fc6e00f8a10 2021-01-28T03:57:39.775 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.765+0000 7fc6e6cfe700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e0107160 con 0x7fc6e005f7d0 2021-01-28T03:57:39.775 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.765+0000 7fc6e6cfe700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e0107320 con 0x7fc6e00fb4a0 2021-01-28T03:57:39.775 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.765+0000 7fc6e64fd700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc6e00fb4a0 0x7fc6e0106ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:39.776 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.765+0000 7fc6e64fd700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc6e00fb4a0 0x7fc6e0106ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:40858/0 (socket says 172.21.15.100:40858) 2021-01-28T03:57:39.776 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.765+0000 7fc6e64fd700 1 -- 172.21.15.100:0/2885103038 learned_addr learned my addr 172.21.15.100:0/2885103038 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:57:39.776 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.765+0000 7fc6e54fb700 1 --2- 172.21.15.100:0/2885103038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6e00f8a10 0x7fc6e0105bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:39.777 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.765+0000 7fc6e5cfc700 1 --2- 172.21.15.100:0/2885103038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6e005f7d0 0x7fc6e01056e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:39.777 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.765+0000 7fc6e64fd700 1 -- 172.21.15.100:0/2885103038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6e005f7d0 msgr2=0x7fc6e01056e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:39.777 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.765+0000 7fc6e64fd700 1 --2- 172.21.15.100:0/2885103038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6e005f7d0 0x7fc6e01056e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:39.778 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.765+0000 7fc6e64fd700 1 -- 172.21.15.100:0/2885103038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6e00f8a10 msgr2=0x7fc6e0105bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:39.778 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.765+0000 7fc6e64fd700 1 --2- 172.21.15.100:0/2885103038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6e00f8a10 0x7fc6e0105bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:39.779 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.765+0000 7fc6e64fd700 1 -- 172.21.15.100:0/2885103038 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e01074e0 con 0x7fc6e00fb4a0 2021-01-28T03:57:39.779 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.765+0000 7fc6e54fb700 1 --2- 172.21.15.100:0/2885103038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6e00f8a10 0x7fc6e0105bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-28T03:57:39.779 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.765+0000 7fc6e5cfc700 1 --2- 172.21.15.100:0/2885103038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6e005f7d0 0x7fc6e01056e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-28T03:57:39.780 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.765+0000 7fc6e64fd700 1 --2- 172.21.15.100:0/2885103038 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc6e00fb4a0 0x7fc6e0106ac0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fc6d8013730 tx=0x7fc6d8004d10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:57:39.780 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.765+0000 7fc6d67fc700 1 -- 172.21.15.100:0/2885103038 <== mon.1 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d800e030 con 0x7fc6e00fb4a0 2021-01-28T03:57:39.780 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.765+0000 7fc6d67fc700 1 -- 172.21.15.100:0/2885103038 <== mon.1 v2:172.21.15.100:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fc6d8004540 con 0x7fc6e00fb4a0 2021-01-28T03:57:39.780 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.765+0000 7fc6e6cfe700 1 -- 172.21.15.100:0/2885103038 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e0107730 con 0x7fc6e00fb4a0 2021-01-28T03:57:39.780 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.765+0000 7fc6e6cfe700 1 -- 172.21.15.100:0/2885103038 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e010ded0 con 0x7fc6e00fb4a0 2021-01-28T03:57:39.781 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.765+0000 7fc6d67fc700 1 -- 172.21.15.100:0/2885103038 <== mon.1 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8018070 con 0x7fc6e00fb4a0 2021-01-28T03:57:39.781 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.769+0000 7fc6e6cfe700 1 -- 172.21.15.100:0/2885103038 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e00f3ba0 con 0x7fc6e00fb4a0 2021-01-28T03:57:39.781 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.769+0000 7fc6d67fc700 1 -- 172.21.15.100:0/2885103038 <== mon.1 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7fc6d801d420 con 0x7fc6e00fb4a0 2021-01-28T03:57:39.781 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.769+0000 7fc6d67fc700 1 --2- 172.21.15.100:0/2885103038 >> v2:172.21.15.100:6800/928846103 conn(0x7fc6cc05bc70 0x7fc6cc05e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:39.781 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.769+0000 7fc6d67fc700 1 -- 172.21.15.100:0/2885103038 <== mon.1 v2:172.21.15.100:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7fc6d8077da0 con 0x7fc6e00fb4a0 2021-01-28T03:57:39.782 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.769+0000 7fc6e5cfc700 1 --2- 172.21.15.100:0/2885103038 >> v2:172.21.15.100:6800/928846103 conn(0x7fc6cc05bc70 0x7fc6cc05e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:39.783 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.769+0000 7fc6e5cfc700 1 --2- 172.21.15.100:0/2885103038 >> v2:172.21.15.100:6800/928846103 conn(0x7fc6cc05bc70 0x7fc6cc05e130 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fc6dc007fc0 tx=0x7fc6dc00b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:57:39.783 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.777+0000 7fc6d67fc700 1 -- 172.21.15.100:0/2885103038 <== mon.1 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fc6d804aa10 con 0x7fc6e00fb4a0 2021-01-28T03:57:39.826 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:57:39 smithi100 bash[10061]: debug 2021-01-28T03:57:39.529+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T03:57:39.985 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.981+0000 7fc6e6cfe700 1 -- 172.21.15.100:0/2885103038 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fc6e0100650 con 0x7fc6e00fb4a0 2021-01-28T03:57:39.988 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.985+0000 7fc6d67fc700 1 -- 172.21.15.100:0/2885103038 <== mon.1 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v15) v1 ==== 74+0+142230 (secure 0 0 0) 0x7fc6d804e030 con 0x7fc6e00fb4a0 2021-01-28T03:57:39.990 INFO:teuthology.orchestra.run.smithi100.stdout: 2021-01-28T03:57:39.992 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.989+0000 7fc6e6cfe700 1 -- 172.21.15.100:0/2885103038 >> v2:172.21.15.100:6800/928846103 conn(0x7fc6cc05bc70 msgr2=0x7fc6cc05e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:39.993 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.989+0000 7fc6e6cfe700 1 --2- 172.21.15.100:0/2885103038 >> v2:172.21.15.100:6800/928846103 conn(0x7fc6cc05bc70 0x7fc6cc05e130 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fc6dc007fc0 tx=0x7fc6dc00b040).stop 2021-01-28T03:57:39.993 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.989+0000 7fc6e6cfe700 1 -- 172.21.15.100:0/2885103038 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc6e00fb4a0 msgr2=0x7fc6e0106ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:39.993 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.989+0000 7fc6e6cfe700 1 --2- 172.21.15.100:0/2885103038 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc6e00fb4a0 0x7fc6e0106ac0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fc6d8013730 tx=0x7fc6d8004d10).stop 2021-01-28T03:57:39.993 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.989+0000 7fc6e6cfe700 1 -- 172.21.15.100:0/2885103038 shutdown_connections 2021-01-28T03:57:39.993 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.989+0000 7fc6e6cfe700 1 --2- 172.21.15.100:0/2885103038 >> v2:172.21.15.100:6800/928846103 conn(0x7fc6cc05bc70 0x7fc6cc05e130 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:39.994 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.989+0000 7fc6e6cfe700 1 --2- 172.21.15.100:0/2885103038 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6e005f7d0 0x7fc6e01056e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:39.994 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.989+0000 7fc6e6cfe700 1 --2- 172.21.15.100:0/2885103038 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fc6e00fb4a0 0x7fc6e0106ac0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:39.994 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.989+0000 7fc6e6cfe700 1 --2- 172.21.15.100:0/2885103038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6e00f8a10 0x7fc6e0105bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:39.994 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.989+0000 7fc6e6cfe700 1 -- 172.21.15.100:0/2885103038 >> 172.21.15.100:0/2885103038 conn(0x7fc6e00effb0 msgr2=0x7fc6e00f9650 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:57:39.994 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.989+0000 7fc6e6cfe700 1 -- 172.21.15.100:0/2885103038 shutdown_connections 2021-01-28T03:57:39.995 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:39.989+0000 7fc6e6cfe700 1 -- 172.21.15.100:0/2885103038 wait complete. 2021-01-28T03:57:40.262 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:40 smithi162 bash[24692]: t=2021-01-28T03:57:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 3 v3" 2021-01-28T03:57:40.262 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:40 smithi162 bash[24692]: t=2021-01-28T03:57:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 4 v3" 2021-01-28T03:57:40.577 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:40 smithi162 bash[24692]: t=2021-01-28T03:57:40+0000 lvl=info msg="Executing migration" logger=migrator id="Update annotation table charset" 2021-01-28T03:57:40.577 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:40 smithi162 bash[24692]: t=2021-01-28T03:57:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column region_id to annotation table" 2021-01-28T03:57:40.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:40 smithi162 bash[9856]: cluster 2021-01-28T03:57:39.410786+0000 mgr.y (mgr.14138) 362 : cluster [DBG] pgmap v262: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:40.578 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:40 smithi162 bash[9856]: audit 2021-01-28T03:57:39.986033+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.15.100:0/2885103038' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-01-28T03:57:40.725 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":15,"active_gid":14138,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":928846103}]},"active_addr":"172.21.15.100:6800/928846103","active_change":"2021-01-28T03:50:35.209696+0000","active_mgr_features":4540138303579357183,"available":true,"standbys":[{"gid":34112,"name":"x","mgr_features":4540138303579357183,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"haproxy","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"haproxy","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://smithi100.front.sepia.ceph.com:8443/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":3,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":1478241502}]},{"addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":3752310505}]},{"addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":1794338411}]}]}} 2021-01-28T03:57:40.730 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2021-01-28T03:57:40.731 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2021-01-28T03:57:40.731 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph osd dump --format=json 2021-01-28T03:57:40.745 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:40 smithi100 bash[9834]: cluster 2021-01-28T03:57:39.410786+0000 mgr.y (mgr.14138) 362 : cluster [DBG] pgmap v262: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:40.745 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:40 smithi100 bash[9834]: audit 2021-01-28T03:57:39.986033+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.15.100:0/2885103038' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-01-28T03:57:40.746 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:40 smithi100 bash[13549]: cluster 2021-01-28T03:57:39.410786+0000 mgr.y (mgr.14138) 362 : cluster [DBG] pgmap v262: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:40.746 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:40 smithi100 bash[13549]: audit 2021-01-28T03:57:39.986033+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.15.100:0/2885103038' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-01-28T03:57:40.840 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:40 smithi162 bash[24692]: t=2021-01-28T03:57:40+0000 lvl=info msg="Executing migration" logger=migrator id="Drop category_id index" 2021-01-28T03:57:40.841 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:40 smithi162 bash[24692]: t=2021-01-28T03:57:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column tags to annotation table" 2021-01-28T03:57:40.841 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:40 smithi162 bash[24692]: t=2021-01-28T03:57:40+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v2" 2021-01-28T03:57:40.887 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c217df96-611b-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T03:57:41.230 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:40 smithi162 bash[24692]: t=2021-01-28T03:57:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index annotation_tag.annotation_id_tag_id" 2021-01-28T03:57:41.231 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:41 smithi162 bash[24692]: t=2021-01-28T03:57:41+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert annotations and set TEXT to empty" 2021-01-28T03:57:41.485 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:41 smithi162 bash[24692]: t=2021-01-28T03:57:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add created time to annotation table" 2021-01-28T03:57:41.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:41 smithi162 bash[9856]: audit 2021-01-28T03:57:39.534013+0000 mgr.y (mgr.14138) 363 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:57:41.762 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:41 smithi162 bash[24692]: t=2021-01-28T03:57:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add updated time to annotation table" 2021-01-28T03:57:41.763 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:41 smithi162 bash[24692]: t=2021-01-28T03:57:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for created in annotation table" 2021-01-28T03:57:41.826 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:41 smithi100 bash[9834]: audit 2021-01-28T03:57:39.534013+0000 mgr.y (mgr.14138) 363 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:57:41.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:41 smithi100 bash[13549]: audit 2021-01-28T03:57:39.534013+0000 mgr.y (mgr.14138) 363 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:57:42.179 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:41 smithi162 bash[24692]: t=2021-01-28T03:57:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for updated in annotation table" 2021-01-28T03:57:42.179 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:41 smithi162 bash[24692]: t=2021-01-28T03:57:41+0000 lvl=info msg="Executing migration" logger=migrator id="Convert existing annotations from seconds to milliseconds" 2021-01-28T03:57:42.179 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:42 smithi162 bash[24692]: t=2021-01-28T03:57:42+0000 lvl=info msg="Executing migration" logger=migrator id="Add epoch_end column" 2021-01-28T03:57:42.180 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Jan 28 03:57:41 smithi162 systemd[1]: Stopping Ceph prometheus.a for c217df96-611b-11eb-8f9e-001a4aab830c... 2021-01-28T03:57:42.180 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Jan 28 03:57:42 smithi162 bash[23343]: level=warn ts=2021-01-28T03:57:42.054Z caller=main.go:524 msg="Received SIGTERM, exiting gracefully..." 2021-01-28T03:57:42.180 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Jan 28 03:57:42 smithi162 bash[23343]: level=info ts=2021-01-28T03:57:42.054Z caller=main.go:547 msg="Stopping scrape discovery manager..." 2021-01-28T03:57:42.180 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Jan 28 03:57:42 smithi162 bash[23343]: level=info ts=2021-01-28T03:57:42.055Z caller=main.go:561 msg="Stopping notify discovery manager..." 2021-01-28T03:57:42.180 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Jan 28 03:57:42 smithi162 bash[23343]: level=info ts=2021-01-28T03:57:42.055Z caller=main.go:583 msg="Stopping scrape manager..." 2021-01-28T03:57:42.181 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Jan 28 03:57:42 smithi162 bash[23343]: level=info ts=2021-01-28T03:57:42.055Z caller=main.go:543 msg="Scrape discovery manager stopped" 2021-01-28T03:57:42.181 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Jan 28 03:57:42 smithi162 bash[23343]: level=info ts=2021-01-28T03:57:42.055Z caller=manager.go:882 component="rule manager" msg="Stopping rule manager..." 2021-01-28T03:57:42.181 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Jan 28 03:57:42 smithi162 bash[23343]: level=info ts=2021-01-28T03:57:42.055Z caller=main.go:557 msg="Notify discovery manager stopped" 2021-01-28T03:57:42.181 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Jan 28 03:57:42 smithi162 bash[23343]: level=info ts=2021-01-28T03:57:42.055Z caller=manager.go:892 component="rule manager" msg="Rule manager stopped" 2021-01-28T03:57:42.181 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Jan 28 03:57:42 smithi162 bash[23343]: level=info ts=2021-01-28T03:57:42.055Z caller=main.go:577 msg="Scrape manager stopped" 2021-01-28T03:57:42.182 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Jan 28 03:57:42 smithi162 bash[23343]: level=info ts=2021-01-28T03:57:42.055Z caller=notifier.go:601 component=notifier msg="Stopping notification manager..." 2021-01-28T03:57:42.182 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Jan 28 03:57:42 smithi162 bash[23343]: level=info ts=2021-01-28T03:57:42.055Z caller=main.go:749 msg="Notifier manager stopped" 2021-01-28T03:57:42.182 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Jan 28 03:57:42 smithi162 bash[23343]: level=info ts=2021-01-28T03:57:42.055Z caller=main.go:761 msg="See you next time!" 2021-01-28T03:57:42.489 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:42 smithi162 bash[24692]: t=2021-01-28T03:57:42+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for epoch_end" 2021-01-28T03:57:42.489 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:42 smithi162 bash[24692]: t=2021-01-28T03:57:42+0000 lvl=info msg="Executing migration" logger=migrator id="Make epoch_end the same as epoch" 2021-01-28T03:57:42.668 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:42 smithi162 bash[9856]: cluster 2021-01-28T03:57:41.411762+0000 mgr.y (mgr.14138) 364 : cluster [DBG] pgmap v263: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:42.792 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:42 smithi162 bash[24692]: t=2021-01-28T03:57:42+0000 lvl=info msg="Executing migration" logger=migrator id="Move region to single row" 2021-01-28T03:57:42.818 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:42 smithi100 bash[9834]: cluster 2021-01-28T03:57:41.411762+0000 mgr.y (mgr.14138) 364 : cluster [DBG] pgmap v263: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:42.819 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:42 smithi100 bash[13549]: cluster 2021-01-28T03:57:41.411762+0000 mgr.y (mgr.14138) 364 : cluster [DBG] pgmap v263: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:43.373 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:43 smithi162 bash[24692]: t=2021-01-28T03:57:43+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch from annotation table" 2021-01-28T03:57:43.374 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:43 smithi162 bash[24692]: t=2021-01-28T03:57:43+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2021-01-28T03:57:43.374 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:43 smithi162 bash[24692]: t=2021-01-28T03:57:43+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2021-01-28T03:57:43.374 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Jan 28 03:57:43 smithi162 docker[25299]: ceph-c217df96-611b-11eb-8f9e-001a4aab830c-prometheus.a 2021-01-28T03:57:43.375 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Jan 28 03:57:43 smithi162 systemd[1]: ceph-c217df96-611b-11eb-8f9e-001a4aab830c@prometheus.a.service: Succeeded. 2021-01-28T03:57:43.375 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Jan 28 03:57:43 smithi162 systemd[1]: Stopped Ceph prometheus.a for c217df96-611b-11eb-8f9e-001a4aab830c. 2021-01-28T03:57:43.375 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Jan 28 03:57:43 smithi162 systemd[1]: Started Ceph prometheus.a for c217df96-611b-11eb-8f9e-001a4aab830c. 2021-01-28T03:57:43.766 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:43 smithi162 bash[24692]: t=2021-01-28T03:57:43+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_epoch_end_epoch on annotation table" 2021-01-28T03:57:43.767 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:43 smithi162 bash[24692]: t=2021-01-28T03:57:43+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch_epoch_end from annotation table" 2021-01-28T03:57:44.065 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.061+0000 7fa2d6636700 1 -- 172.21.15.100:0/922297619 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa2d00f63b0 msgr2=0x7fa2d00fccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:44.065 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.061+0000 7fa2d6636700 1 --2- 172.21.15.100:0/922297619 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa2d00f63b0 0x7fa2d00fccb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fa2c8009df0 tx=0x7fa2c8004d10).stop 2021-01-28T03:57:44.065 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.061+0000 7fa2d6636700 1 -- 172.21.15.100:0/922297619 shutdown_connections 2021-01-28T03:57:44.066 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.061+0000 7fa2d6636700 1 --2- 172.21.15.100:0/922297619 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2d00f47c0 0x7fa2d00f4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:44.066 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.061+0000 7fa2d6636700 1 --2- 172.21.15.100:0/922297619 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa2d00f63b0 0x7fa2d00fccb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:44.066 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.061+0000 7fa2d6636700 1 --2- 172.21.15.100:0/922297619 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2d00f5a60 0x7fa2d00f5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:44.066 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.061+0000 7fa2d6636700 1 -- 172.21.15.100:0/922297619 >> 172.21.15.100:0/922297619 conn(0x7fa2d00effe0 msgr2=0x7fa2d00f2400 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:57:44.067 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.061+0000 7fa2d6636700 1 -- 172.21.15.100:0/922297619 shutdown_connections 2021-01-28T03:57:44.067 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.061+0000 7fa2d6636700 1 -- 172.21.15.100:0/922297619 wait complete. 2021-01-28T03:57:44.068 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.061+0000 7fa2d6636700 1 Processor -- start 2021-01-28T03:57:44.069 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.061+0000 7fa2d6636700 1 -- start start 2021-01-28T03:57:44.069 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.061+0000 7fa2d6636700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2d00f47c0 0x7fa2d00fee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:44.069 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.061+0000 7fa2d6636700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2d00f5a60 0x7fa2d00fd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:44.069 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.061+0000 7fa2d6636700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa2d00f63b0 0x7fa2d00fd910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:44.069 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.061+0000 7fa2d6636700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d00fe000 con 0x7fa2d00f5a60 2021-01-28T03:57:44.070 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.061+0000 7fa2d6636700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d00fe170 con 0x7fa2d00f47c0 2021-01-28T03:57:44.071 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.061+0000 7fa2d6636700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d010f7a0 con 0x7fa2d00f63b0 2021-01-28T03:57:44.071 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.061+0000 7fa2d4e33700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2d00f5a60 0x7fa2d00fd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:44.072 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.061+0000 7fa2d5e35700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa2d00f63b0 0x7fa2d00fd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:44.072 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.061+0000 7fa2d5e35700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa2d00f63b0 0x7fa2d00fd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:40872/0 (socket says 172.21.15.100:40872) 2021-01-28T03:57:44.072 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.061+0000 7fa2d5e35700 1 -- 172.21.15.100:0/1592010839 learned_addr learned my addr 172.21.15.100:0/1592010839 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:57:44.072 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.061+0000 7fa2d4e33700 1 -- 172.21.15.100:0/1592010839 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa2d00f63b0 msgr2=0x7fa2d00fd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:44.072 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.061+0000 7fa2d4e33700 1 --2- 172.21.15.100:0/1592010839 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa2d00f63b0 0x7fa2d00fd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:44.073 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.061+0000 7fa2d4e33700 1 -- 172.21.15.100:0/1592010839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2d00f47c0 msgr2=0x7fa2d00fee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:44.073 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.061+0000 7fa2d4e33700 1 --2- 172.21.15.100:0/1592010839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2d00f47c0 0x7fa2d00fee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-28T03:57:44.073 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.061+0000 7fa2d4e33700 1 -- 172.21.15.100:0/1592010839 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d010f960 con 0x7fa2d00f5a60 2021-01-28T03:57:44.073 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.061+0000 7fa2d5e35700 1 --2- 172.21.15.100:0/1592010839 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa2d00f63b0 0x7fa2d00fd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-28T03:57:44.074 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.061+0000 7fa2d4e33700 1 --2- 172.21.15.100:0/1592010839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2d00f5a60 0x7fa2d00fd2c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fa2cc0096a0 tx=0x7fa2cc009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:57:44.074 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.065+0000 7fa2c5ffb700 1 -- 172.21.15.100:0/1592010839 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc0096d0 con 0x7fa2d00f5a60 2021-01-28T03:57:44.074 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.065+0000 7fa2c5ffb700 1 -- 172.21.15.100:0/1592010839 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fa2cc00f040 con 0x7fa2d00f5a60 2021-01-28T03:57:44.074 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.065+0000 7fa2d6636700 1 -- 172.21.15.100:0/1592010839 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d010fc10 con 0x7fa2d00f5a60 2021-01-28T03:57:44.074 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.065+0000 7fa2c5ffb700 1 -- 172.21.15.100:0/1592010839 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc014b40 con 0x7fa2d00f5a60 2021-01-28T03:57:44.075 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.065+0000 7fa2d6636700 1 -- 172.21.15.100:0/1592010839 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d0110150 con 0x7fa2d00f5a60 2021-01-28T03:57:44.076 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.065+0000 7fa2d6636700 1 -- 172.21.15.100:0/1592010839 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d00f3bb0 con 0x7fa2d00f5a60 2021-01-28T03:57:44.077 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.065+0000 7fa2c5ffb700 1 -- 172.21.15.100:0/1592010839 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7fa2cc00ebd0 con 0x7fa2d00f5a60 2021-01-28T03:57:44.077 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.065+0000 7fa2c5ffb700 1 --2- 172.21.15.100:0/1592010839 >> v2:172.21.15.100:6800/928846103 conn(0x7fa2bc05bc70 0x7fa2bc05e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:44.078 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.065+0000 7fa2c5ffb700 1 -- 172.21.15.100:0/1592010839 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7fa2cc076300 con 0x7fa2d00f5a60 2021-01-28T03:57:44.078 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.065+0000 7fa2d5634700 1 --2- 172.21.15.100:0/1592010839 >> v2:172.21.15.100:6800/928846103 conn(0x7fa2bc05bc70 0x7fa2bc05e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:44.079 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.065+0000 7fa2d5634700 1 --2- 172.21.15.100:0/1592010839 >> v2:172.21.15.100:6800/928846103 conn(0x7fa2bc05bc70 0x7fa2bc05e130 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fa2d00febd0 tx=0x7fa2c000b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:57:44.079 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.069+0000 7fa2c5ffb700 1 -- 172.21.15.100:0/1592010839 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fa2cc048ee0 con 0x7fa2d00f5a60 2021-01-28T03:57:44.240 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.237+0000 7fa2d6636700 1 -- 172.21.15.100:0/1592010839 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2d0100670 con 0x7fa2d00f5a60 2021-01-28T03:57:44.243 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.241+0000 7fa2c5ffb700 1 -- 172.21.15.100:0/1592010839 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+18965 (secure 0 0 0) 0x7fa2cc04c500 con 0x7fa2d00f5a60 2021-01-28T03:57:44.246 INFO:teuthology.orchestra.run.smithi100.stdout: 2021-01-28T03:57:44.246 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":60,"fsid":"c217df96-611b-11eb-8f9e-001a4aab830c","created":"2021-01-28T03:49:43.977596+0000","modified":"2021-01-28T03:56:36.444276+0000","last_up_change":"2021-01-28T03:55:57.540370+0000","last_in_change":"2021-01-28T03:55:57.540370+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-28T03:51:27.917203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2021-01-28T03:55:54.463101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"iscsi","create_time":"2021-01-28T03:56:12.308562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"zone.rgw.log","create_time":"2021-01-28T03:56:13.689563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"zone.rgw.control","create_time":"2021-01-28T03:56:15.185590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"zone.rgw.meta","create_time":"2021-01-28T03:56:18.285095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":8},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"b19e5679-7a32-467e-bef2-460c896020db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":2076626497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2076626497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2076626497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6803","nonce":2076626497}]},"public_addr":"172.21.15.100:6801/2076626497","cluster_addr":"172.21.15.100:6802/2076626497","heartbeat_back_addr":"172.21.15.100:6804/2076626497","heartbeat_front_addr":"172.21.15.100:6803/2076626497","state":["exists","up"]},{"osd":1,"uuid":"7a144678-be9c-4a85-acc7-4a7522a434d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":315903268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":315903268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":315903268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6807","nonce":315903268}]},"public_addr":"172.21.15.100:6805/315903268","cluster_addr":"172.21.15.100:6806/315903268","heartbeat_back_addr":"172.21.15.100:6808/315903268","heartbeat_front_addr":"172.21.15.100:6807/315903268","state":["exists","up"]},{"osd":2,"uuid":"5866a31a-7066-4ae4-a7c9-d155b09460fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1600283162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1600283162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1600283162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":1600283162}]},"public_addr":"172.21.15.100:6809/1600283162","cluster_addr":"172.21.15.100:6810/1600283162","heartbeat_back_addr":"172.21.15.100:6812/1600283162","heartbeat_front_addr":"172.21.15.100:6811/1600283162","state":["exists","up"]},{"osd":3,"uuid":"5de112f2-cf7c-4075-9d15-b8566a707947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":799206422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":799206422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":799206422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":799206422}]},"public_addr":"172.21.15.100:6813/799206422","cluster_addr":"172.21.15.100:6814/799206422","heartbeat_back_addr":"172.21.15.100:6816/799206422","heartbeat_front_addr":"172.21.15.100:6815/799206422","state":["exists","up"]},{"osd":4,"uuid":"fda3d97f-42ca-4449-a4c0-c3256b8c64a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4274488621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6801","nonce":4274488621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6803","nonce":4274488621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4274488621}]},"public_addr":"172.21.15.162:6800/4274488621","cluster_addr":"172.21.15.162:6801/4274488621","heartbeat_back_addr":"172.21.15.162:6803/4274488621","heartbeat_front_addr":"172.21.15.162:6802/4274488621","state":["exists","up"]},{"osd":5,"uuid":"69c742c7-276f-4c30-a60f-18362a187b5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1953061558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6805","nonce":1953061558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":1953061558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1953061558}]},"public_addr":"172.21.15.162:6804/1953061558","cluster_addr":"172.21.15.162:6805/1953061558","heartbeat_back_addr":"172.21.15.162:6807/1953061558","heartbeat_front_addr":"172.21.15.162:6806/1953061558","state":["exists","up"]},{"osd":6,"uuid":"95a3b8cf-fdc9-43b4-8cd6-f7c92161409a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3682466023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":3682466023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6811","nonce":3682466023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3682466023}]},"public_addr":"172.21.15.162:6808/3682466023","cluster_addr":"172.21.15.162:6809/3682466023","heartbeat_back_addr":"172.21.15.162:6811/3682466023","heartbeat_front_addr":"172.21.15.162:6810/3682466023","state":["exists","up"]},{"osd":7,"uuid":"8ac18dc9-7208-4f26-b6a6-f9d11c3257be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2319408968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":2319408968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6815","nonce":2319408968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2319408968}]},"public_addr":"172.21.15.162:6812/2319408968","cluster_addr":"172.21.15.162:6813/2319408968","heartbeat_back_addr":"172.21.15.162:6815/2319408968","heartbeat_front_addr":"172.21.15.162:6814/2319408968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T03:52:46.582666+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T03:53:15.777781+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T03:53:44.401966+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T03:54:12.075880+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T03:54:36.048933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T03:55:04.310974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T03:55:28.994413+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T03:55:56.253535+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.1c","mappings":[{"from":1,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/2387903268":"2021-01-29T03:50:35.208992+0000","172.21.15.100:0/3466898363":"2021-01-29T03:50:35.208992+0000","172.21.15.100:6800/2057733473":"2021-01-29T03:50:35.208992+0000","172.21.15.100:0/542796331":"2021-01-29T03:50:13.341337+0000","172.21.15.100:6800/728127347":"2021-01-29T03:50:13.341337+0000","172.21.15.100:0/1692305047":"2021-01-29T03:50:13.341337+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-01-28T03:57:44.247 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.241+0000 7fa2d6636700 1 -- 172.21.15.100:0/1592010839 >> v2:172.21.15.100:6800/928846103 conn(0x7fa2bc05bc70 msgr2=0x7fa2bc05e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:44.247 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.241+0000 7fa2d6636700 1 --2- 172.21.15.100:0/1592010839 >> v2:172.21.15.100:6800/928846103 conn(0x7fa2bc05bc70 0x7fa2bc05e130 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fa2d00febd0 tx=0x7fa2c000b040).stop 2021-01-28T03:57:44.247 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.241+0000 7fa2d6636700 1 -- 172.21.15.100:0/1592010839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2d00f5a60 msgr2=0x7fa2d00fd2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:44.247 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.241+0000 7fa2d6636700 1 --2- 172.21.15.100:0/1592010839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2d00f5a60 0x7fa2d00fd2c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fa2cc0096a0 tx=0x7fa2cc009b30).stop 2021-01-28T03:57:44.248 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.241+0000 7fa2d6636700 1 -- 172.21.15.100:0/1592010839 shutdown_connections 2021-01-28T03:57:44.248 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.241+0000 7fa2d6636700 1 --2- 172.21.15.100:0/1592010839 >> v2:172.21.15.100:6800/928846103 conn(0x7fa2bc05bc70 0x7fa2bc05e130 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:44.248 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.241+0000 7fa2d6636700 1 --2- 172.21.15.100:0/1592010839 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2d00f47c0 0x7fa2d00fee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2021-01-28T03:57:44.248 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.241+0000 7fa2d6636700 1 --2- 172.21.15.100:0/1592010839 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa2d00f63b0 0x7fa2d00fd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:44.248 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.241+0000 7fa2d6636700 1 --2- 172.21.15.100:0/1592010839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2d00f5a60 0x7fa2d00fd2c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:44.249 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.241+0000 7fa2d6636700 1 -- 172.21.15.100:0/1592010839 >> 172.21.15.100:0/1592010839 conn(0x7fa2d00effe0 msgr2=0x7fa2d00f32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:57:44.249 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.241+0000 7fa2d6636700 1 -- 172.21.15.100:0/1592010839 shutdown_connections 2021-01-28T03:57:44.249 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:44.241+0000 7fa2d6636700 1 -- 172.21.15.100:0/1592010839 wait complete. 2021-01-28T03:57:44.262 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:44 smithi162 bash[24692]: t=2021-01-28T03:57:44+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for alert_id on annotation table" 2021-01-28T03:57:44.262 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:44 smithi162 bash[24692]: t=2021-01-28T03:57:44+0000 lvl=info msg="Executing migration" logger=migrator id="create test_data table" 2021-01-28T03:57:44.361 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[9834]: audit 2021-01-28T03:57:43.349274+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:44.361 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[9834]: audit 2021-01-28T03:57:43.356582+0000 mon.a (mon.0) 637 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-01-28T03:57:44.362 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[9834]: audit 2021-01-28T03:57:43.357166+0000 mgr.y (mgr.14138) 365 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-01-28T03:57:44.362 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[9834]: audit 2021-01-28T03:57:43.358879+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi100:9093"}]: dispatch 2021-01-28T03:57:44.362 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[9834]: audit 2021-01-28T03:57:43.359368+0000 mgr.y (mgr.14138) 366 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi100:9093"}]: dispatch 2021-01-28T03:57:44.362 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[9834]: audit 2021-01-28T03:57:43.366614+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:44.363 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[9834]: audit 2021-01-28T03:57:43.374558+0000 mon.a (mon.0) 640 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-01-28T03:57:44.363 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[9834]: audit 2021-01-28T03:57:43.375210+0000 mgr.y (mgr.14138) 367 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-01-28T03:57:44.363 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[9834]: audit 2021-01-28T03:57:43.385835+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi162:9095"}]: dispatch 2021-01-28T03:57:44.363 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[9834]: audit 2021-01-28T03:57:43.386438+0000 mgr.y (mgr.14138) 368 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi162:9095"}]: dispatch 2021-01-28T03:57:44.363 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[9834]: audit 2021-01-28T03:57:43.393451+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:44.364 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[9834]: audit 2021-01-28T03:57:43.402444+0000 mon.a (mon.0) 643 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-01-28T03:57:44.364 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[9834]: audit 2021-01-28T03:57:43.402945+0000 mgr.y (mgr.14138) 369 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-01-28T03:57:44.365 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[13549]: audit 2021-01-28T03:57:43.349274+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:44.365 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[13549]: audit 2021-01-28T03:57:43.356582+0000 mon.a (mon.0) 637 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-01-28T03:57:44.365 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[13549]: audit 2021-01-28T03:57:43.357166+0000 mgr.y (mgr.14138) 365 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-01-28T03:57:44.365 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[13549]: audit 2021-01-28T03:57:43.358879+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi100:9093"}]: dispatch 2021-01-28T03:57:44.365 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[13549]: audit 2021-01-28T03:57:43.359368+0000 mgr.y (mgr.14138) 366 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi100:9093"}]: dispatch 2021-01-28T03:57:44.366 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[13549]: audit 2021-01-28T03:57:43.366614+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:44.366 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[13549]: audit 2021-01-28T03:57:43.374558+0000 mon.a (mon.0) 640 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-01-28T03:57:44.366 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[13549]: audit 2021-01-28T03:57:43.375210+0000 mgr.y (mgr.14138) 367 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-01-28T03:57:44.366 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[13549]: audit 2021-01-28T03:57:43.385835+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi162:9095"}]: dispatch 2021-01-28T03:57:44.367 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[13549]: audit 2021-01-28T03:57:43.386438+0000 mgr.y (mgr.14138) 368 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi162:9095"}]: dispatch 2021-01-28T03:57:44.367 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[13549]: audit 2021-01-28T03:57:43.393451+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:44.367 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[13549]: audit 2021-01-28T03:57:43.402444+0000 mon.a (mon.0) 643 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-01-28T03:57:44.367 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[13549]: audit 2021-01-28T03:57:43.402945+0000 mgr.y (mgr.14138) 369 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-01-28T03:57:44.367 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[13549]: cluster 2021-01-28T03:57:43.413018+0000 mgr.y (mgr.14138) 370 : cluster [DBG] pgmap v264: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:44.368 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[13549]: audit 2021-01-28T03:57:43.415709+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi162:3000"}]: dispatch 2021-01-28T03:57:44.368 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[13549]: audit 2021-01-28T03:57:43.416414+0000 mgr.y (mgr.14138) 371 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi162:3000"}]: dispatch 2021-01-28T03:57:44.368 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[13549]: audit 2021-01-28T03:57:43.424626+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:44.368 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[13549]: audit 2021-01-28T03:57:43.431060+0000 mon.a (mon.0) 646 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:57:44.368 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[13549]: audit 2021-01-28T03:57:43.431638+0000 mon.a (mon.0) 647 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:57:44.369 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[13549]: audit 2021-01-28T03:57:44.241212+0000 mon.a (mon.0) 648 : audit [DBG] from='client.? 172.21.15.100:0/1592010839' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-28T03:57:44.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[9834]: cluster 2021-01-28T03:57:43.413018+0000 mgr.y (mgr.14138) 370 : cluster [DBG] pgmap v264: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:44.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[9834]: audit 2021-01-28T03:57:43.415709+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi162:3000"}]: dispatch 2021-01-28T03:57:44.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[9834]: audit 2021-01-28T03:57:43.416414+0000 mgr.y (mgr.14138) 371 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi162:3000"}]: dispatch 2021-01-28T03:57:44.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[9834]: audit 2021-01-28T03:57:43.424626+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:44.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[9834]: audit 2021-01-28T03:57:43.431060+0000 mon.a (mon.0) 646 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:57:44.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[9834]: audit 2021-01-28T03:57:43.431638+0000 mon.a (mon.0) 647 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:57:44.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:44 smithi100 bash[9834]: audit 2021-01-28T03:57:44.241212+0000 mon.a (mon.0) 648 : audit [DBG] from='client.? 172.21.15.100:0/1592010839' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-28T03:57:44.688 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:44 smithi162 bash[24692]: t=2021-01-28T03:57:44+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_version table v1" 2021-01-28T03:57:44.688 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:44 smithi162 bash[9856]: audit 2021-01-28T03:57:43.349274+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:44.689 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:44 smithi162 bash[9856]: audit 2021-01-28T03:57:43.356582+0000 mon.a (mon.0) 637 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-01-28T03:57:44.689 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:44 smithi162 bash[9856]: audit 2021-01-28T03:57:43.357166+0000 mgr.y (mgr.14138) 365 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-01-28T03:57:44.689 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:44 smithi162 bash[9856]: audit 2021-01-28T03:57:43.358879+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi100:9093"}]: dispatch 2021-01-28T03:57:44.689 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:44 smithi162 bash[9856]: audit 2021-01-28T03:57:43.359368+0000 mgr.y (mgr.14138) 366 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi100:9093"}]: dispatch 2021-01-28T03:57:44.689 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:44 smithi162 bash[9856]: audit 2021-01-28T03:57:43.366614+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:44.690 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:44 smithi162 bash[9856]: audit 2021-01-28T03:57:43.374558+0000 mon.a (mon.0) 640 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-01-28T03:57:44.690 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:44 smithi162 bash[9856]: audit 2021-01-28T03:57:43.375210+0000 mgr.y (mgr.14138) 367 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-01-28T03:57:44.690 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:44 smithi162 bash[9856]: audit 2021-01-28T03:57:43.385835+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi162:9095"}]: dispatch 2021-01-28T03:57:44.690 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:44 smithi162 bash[9856]: audit 2021-01-28T03:57:43.386438+0000 mgr.y (mgr.14138) 368 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi162:9095"}]: dispatch 2021-01-28T03:57:44.691 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:44 smithi162 bash[9856]: audit 2021-01-28T03:57:43.393451+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:44.691 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:44 smithi162 bash[9856]: audit 2021-01-28T03:57:43.402444+0000 mon.a (mon.0) 643 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-01-28T03:57:44.691 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:44 smithi162 bash[9856]: audit 2021-01-28T03:57:43.402945+0000 mgr.y (mgr.14138) 369 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-01-28T03:57:44.691 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:44 smithi162 bash[9856]: cluster 2021-01-28T03:57:43.413018+0000 mgr.y (mgr.14138) 370 : cluster [DBG] pgmap v264: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:44.691 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:44 smithi162 bash[9856]: audit 2021-01-28T03:57:43.415709+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi162:3000"}]: dispatch 2021-01-28T03:57:44.692 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:44 smithi162 bash[9856]: audit 2021-01-28T03:57:43.416414+0000 mgr.y (mgr.14138) 371 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi162:3000"}]: dispatch 2021-01-28T03:57:44.692 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:44 smithi162 bash[9856]: audit 2021-01-28T03:57:43.424626+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:44.692 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:44 smithi162 bash[9856]: audit 2021-01-28T03:57:43.431060+0000 mon.a (mon.0) 646 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:57:44.692 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:44 smithi162 bash[9856]: audit 2021-01-28T03:57:43.431638+0000 mon.a (mon.0) 647 : audit [DBG] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T03:57:44.693 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:44 smithi162 bash[9856]: audit 2021-01-28T03:57:44.241212+0000 mon.a (mon.0) 648 : audit [DBG] from='client.? 172.21.15.100:0/1592010839' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-28T03:57:44.963 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:44 smithi162 bash[24692]: t=2021-01-28T03:57:44+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_version.dashboard_id" 2021-01-28T03:57:44.964 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:44 smithi162 bash[24692]: t=2021-01-28T03:57:44+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2021-01-28T03:57:45.047 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2021-01-28T03:57:45.050 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph osd dump --format=json 2021-01-28T03:57:45.232 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:44 smithi162 bash[24692]: t=2021-01-28T03:57:44+0000 lvl=info msg="Executing migration" logger=migrator id="Set dashboard version to 1 where 0" 2021-01-28T03:57:45.232 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:45 smithi162 bash[24692]: t=2021-01-28T03:57:45+0000 lvl=info msg="Executing migration" logger=migrator id="save existing dashboard data in dashboard_version table v1" 2021-01-28T03:57:45.233 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:45 smithi162 bash[24692]: t=2021-01-28T03:57:45+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_version.data to mediumtext v1" 2021-01-28T03:57:45.234 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c217df96-611b-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T03:57:45.483 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:45 smithi162 bash[24692]: t=2021-01-28T03:57:45+0000 lvl=info msg="Executing migration" logger=migrator id="create team table" 2021-01-28T03:57:45.484 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:45 smithi162 bash[24692]: t=2021-01-28T03:57:45+0000 lvl=info msg="Executing migration" logger=migrator id="add index team.org_id" 2021-01-28T03:57:45.484 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Jan 28 03:57:45 smithi162 bash[25346]: level=info ts=2021-01-28T03:57:45.392Z caller=main.go:302 msg="No time or size retention was set so using the default time retention" duration=15d 2021-01-28T03:57:45.484 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Jan 28 03:57:45 smithi162 bash[25346]: level=info ts=2021-01-28T03:57:45.392Z caller=main.go:337 msg="Starting Prometheus" version="(version=2.18.1, branch=HEAD, revision=ecee9c8abfd118f139014cb1b174b08db3f342cf)" 2021-01-28T03:57:45.485 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Jan 28 03:57:45 smithi162 bash[25346]: level=info ts=2021-01-28T03:57:45.392Z caller=main.go:338 build_context="(go=go1.14.2, user=root@2117a9e64a7e, date=20200507-16:51:47)" 2021-01-28T03:57:45.485 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Jan 28 03:57:45 smithi162 bash[25346]: level=info ts=2021-01-28T03:57:45.392Z caller=main.go:339 host_details="(Linux 5.4.0-65-generic #73-Ubuntu SMP Mon Jan 18 17:25:17 UTC 2021 x86_64 smithi162 (none))" 2021-01-28T03:57:45.485 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Jan 28 03:57:45 smithi162 bash[25346]: level=info ts=2021-01-28T03:57:45.392Z caller=main.go:340 fd_limits="(soft=1048576, hard=1048576)" 2021-01-28T03:57:45.485 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Jan 28 03:57:45 smithi162 bash[25346]: level=info ts=2021-01-28T03:57:45.392Z caller=main.go:341 vm_limits="(soft=unlimited, hard=unlimited)" 2021-01-28T03:57:45.485 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Jan 28 03:57:45 smithi162 bash[25346]: level=info ts=2021-01-28T03:57:45.394Z caller=main.go:678 msg="Starting TSDB ..." 2021-01-28T03:57:45.486 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Jan 28 03:57:45 smithi162 bash[25346]: level=info ts=2021-01-28T03:57:45.394Z caller=web.go:523 component=web msg="Start listening for connections" address=:9095 2021-01-28T03:57:45.486 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Jan 28 03:57:45 smithi162 bash[25346]: level=info ts=2021-01-28T03:57:45.399Z caller=head.go:575 component=tsdb msg="Replaying WAL, this may take awhile" 2021-01-28T03:57:45.486 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Jan 28 03:57:45 smithi162 bash[25346]: level=info ts=2021-01-28T03:57:45.400Z caller=head.go:624 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2021-01-28T03:57:45.486 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Jan 28 03:57:45 smithi162 bash[25346]: level=info ts=2021-01-28T03:57:45.400Z caller=head.go:624 component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2021-01-28T03:57:45.487 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Jan 28 03:57:45 smithi162 bash[25346]: level=info ts=2021-01-28T03:57:45.400Z caller=head.go:627 component=tsdb msg="WAL replay completed" duration=1.430857ms 2021-01-28T03:57:45.487 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Jan 28 03:57:45 smithi162 bash[25346]: level=info ts=2021-01-28T03:57:45.402Z caller=main.go:694 fs_type=XFS_SUPER_MAGIC 2021-01-28T03:57:45.487 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Jan 28 03:57:45 smithi162 bash[25346]: level=info ts=2021-01-28T03:57:45.402Z caller=main.go:695 msg="TSDB started" 2021-01-28T03:57:45.487 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Jan 28 03:57:45 smithi162 bash[25346]: level=info ts=2021-01-28T03:57:45.402Z caller=main.go:799 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2021-01-28T03:57:45.487 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Jan 28 03:57:45 smithi162 bash[25346]: level=info ts=2021-01-28T03:57:45.404Z caller=main.go:827 msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml 2021-01-28T03:57:45.488 INFO:journalctl@ceph.prometheus.a.smithi162.stdout:Jan 28 03:57:45 smithi162 bash[25346]: level=info ts=2021-01-28T03:57:45.404Z caller=main.go:646 msg="Server is ready to receive web requests." 2021-01-28T03:57:45.762 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:45 smithi162 bash[24692]: t=2021-01-28T03:57:45+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_org_id_name" 2021-01-28T03:57:45.762 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:45 smithi162 bash[24692]: t=2021-01-28T03:57:45+0000 lvl=info msg="Executing migration" logger=migrator id="create team member table" 2021-01-28T03:57:45.762 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:45 smithi162 bash[24692]: t=2021-01-28T03:57:45+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.org_id" 2021-01-28T03:57:45.763 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:45 smithi162 bash[24692]: t=2021-01-28T03:57:45+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_member_org_id_team_id_user_id" 2021-01-28T03:57:46.054 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:45 smithi162 bash[24692]: t=2021-01-28T03:57:45+0000 lvl=info msg="Executing migration" logger=migrator id="Add column email to team table" 2021-01-28T03:57:46.055 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:45 smithi162 bash[24692]: t=2021-01-28T03:57:45+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external to team_member table" 2021-01-28T03:57:46.055 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:45 smithi162 bash[24692]: t=2021-01-28T03:57:45+0000 lvl=info msg="Executing migration" logger=migrator id="Add column permission to team_member table" 2021-01-28T03:57:46.055 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:46 smithi162 bash[24692]: t=2021-01-28T03:57:46+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard acl table" 2021-01-28T03:57:46.262 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:46 smithi162 bash[24692]: t=2021-01-28T03:57:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_dashboard_id" 2021-01-28T03:57:46.262 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:46 smithi162 bash[24692]: t=2021-01-28T03:57:46+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_user_id" 2021-01-28T03:57:46.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:46 smithi162 bash[9856]: audit 2021-01-28T03:57:45.141281+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:46.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:46 smithi162 bash[9856]: cluster 2021-01-28T03:57:45.414117+0000 mgr.y (mgr.14138) 372 : cluster [DBG] pgmap v265: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:46.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:46 smithi162 bash[9856]: audit 2021-01-28T03:57:46.096067+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:46.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:46 smithi162 bash[9856]: audit 2021-01-28T03:57:46.101872+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:46.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:46 smithi162 bash[9856]: audit 2021-01-28T03:57:46.121945+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:46.339 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:46 smithi162 bash[24692]: t=2021-01-28T03:57:46+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_team_id" 2021-01-28T03:57:46.397 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:46 smithi100 bash[9834]: audit 2021-01-28T03:57:45.141281+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:46.398 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:46 smithi100 bash[9834]: cluster 2021-01-28T03:57:45.414117+0000 mgr.y (mgr.14138) 372 : cluster [DBG] pgmap v265: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:46.398 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:46 smithi100 bash[9834]: audit 2021-01-28T03:57:46.096067+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:46.398 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:46 smithi100 bash[9834]: audit 2021-01-28T03:57:46.101872+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:46.398 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:46 smithi100 bash[9834]: audit 2021-01-28T03:57:46.121945+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:46.399 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:46 smithi100 bash[13549]: audit 2021-01-28T03:57:45.141281+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:46.399 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:46 smithi100 bash[13549]: cluster 2021-01-28T03:57:45.414117+0000 mgr.y (mgr.14138) 372 : cluster [DBG] pgmap v265: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:46.399 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:46 smithi100 bash[13549]: audit 2021-01-28T03:57:46.096067+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:46.399 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:46 smithi100 bash[13549]: audit 2021-01-28T03:57:46.101872+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:46.400 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:46 smithi100 bash[13549]: audit 2021-01-28T03:57:46.121945+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' 2021-01-28T03:57:46.599 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:46 smithi162 bash[24692]: t=2021-01-28T03:57:46+0000 lvl=info msg="Executing migration" logger=migrator id="save default acl rules in dashboard_acl table" 2021-01-28T03:57:46.600 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:46 smithi162 bash[24692]: t=2021-01-28T03:57:46+0000 lvl=info msg="Executing migration" logger=migrator id="create tag table" 2021-01-28T03:57:46.600 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:46 smithi162 bash[24692]: t=2021-01-28T03:57:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index tag.key_value" 2021-01-28T03:57:46.600 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:46 smithi162 bash[24692]: t=2021-01-28T03:57:46+0000 lvl=info msg="Executing migration" logger=migrator id="create login attempt table" 2021-01-28T03:57:46.901 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:46 smithi162 bash[24692]: t=2021-01-28T03:57:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index login_attempt.username" 2021-01-28T03:57:46.901 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:46 smithi162 bash[24692]: t=2021-01-28T03:57:46+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_login_attempt_username - v1" 2021-01-28T03:57:46.901 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:46 smithi162 bash[24692]: t=2021-01-28T03:57:46+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2021-01-28T03:57:46.901 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:46 smithi162 bash[24692]: t=2021-01-28T03:57:46+0000 lvl=info msg="Executing migration" logger=migrator id="create login_attempt v2" 2021-01-28T03:57:46.902 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:46 smithi162 bash[24692]: t=2021-01-28T03:57:46+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_login_attempt_username - v2" 2021-01-28T03:57:47.076 INFO:journalctl@ceph.alertmanager.a.smithi100.stdout:Jan 28 03:57:46 smithi100 bash[28529]: level=info ts=2021-01-28T03:57:46.794Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.00113881s 2021-01-28T03:57:47.152 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:47 smithi162 bash[9856]: cephadm 2021-01-28T03:57:46.103883+0000 mgr.y (mgr.14138) 373 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:57:47.152 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:47 smithi162 bash[9856]: cephadm 2021-01-28T03:57:46.105697+0000 mgr.y (mgr.14138) 374 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T03:57:47.152 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:46 smithi162 bash[24692]: t=2021-01-28T03:57:46+0000 lvl=info msg="Executing migration" logger=migrator id="copy login_attempt v1 to v2" 2021-01-28T03:57:47.153 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:47 smithi162 bash[24692]: t=2021-01-28T03:57:47+0000 lvl=info msg="Executing migration" logger=migrator id="drop login_attempt_tmp_qwerty" 2021-01-28T03:57:47.153 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:47 smithi162 bash[24692]: t=2021-01-28T03:57:47+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth table" 2021-01-28T03:57:47.153 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:47 smithi162 bash[24692]: t=2021-01-28T03:57:47+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_user_auth_auth_module_auth_id - v1" 2021-01-28T03:57:47.462 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:47 smithi162 bash[24692]: t=2021-01-28T03:57:47+0000 lvl=info msg="Executing migration" logger=migrator id="alter user_auth.auth_id to length 190" 2021-01-28T03:57:47.463 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:47 smithi162 bash[24692]: t=2021-01-28T03:57:47+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth access token to user_auth" 2021-01-28T03:57:47.463 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:47 smithi162 bash[24692]: t=2021-01-28T03:57:47+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth refresh token to user_auth" 2021-01-28T03:57:47.463 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:47 smithi162 bash[9856]: cephadm 2021-01-28T03:57:46.107141+0000 mgr.y (mgr.14138) 375 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='iscsi.a')] + new hosts [] 2021-01-28T03:57:47.464 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:47 smithi162 bash[9856]: cephadm 2021-01-28T03:57:46.108342+0000 mgr.y (mgr.14138) 376 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='a')] + new hosts [] 2021-01-28T03:57:47.464 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:47 smithi162 bash[9856]: cephadm 2021-01-28T03:57:46.109555+0000 mgr.y (mgr.14138) 377 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='a'), HostPlacementSpec(hostname='smithi162', network='', name='b')] + new hosts [] 2021-01-28T03:57:47.464 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:47 smithi162 bash[9856]: cephadm 2021-01-28T03:57:46.110699+0000 mgr.y (mgr.14138) 378 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='a')] + new hosts [] 2021-01-28T03:57:47.464 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:47 smithi162 bash[9856]: cephadm 2021-01-28T03:57:46.111857+0000 mgr.y (mgr.14138) 379 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='a')] + new hosts [] 2021-01-28T03:57:47.465 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:47 smithi162 bash[9856]: cephadm 2021-01-28T03:57:46.123504+0000 mgr.y (mgr.14138) 380 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:57:47.465 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:47 smithi162 bash[9856]: cephadm 2021-01-28T03:57:46.124397+0000 mgr.y (mgr.14138) 381 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T03:57:47.465 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:47 smithi162 bash[9856]: cephadm 2021-01-28T03:57:46.125346+0000 mgr.y (mgr.14138) 382 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='iscsi.a')] + new hosts [] 2021-01-28T03:57:47.465 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:47 smithi162 bash[9856]: cephadm 2021-01-28T03:57:46.126201+0000 mgr.y (mgr.14138) 383 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='a')] + new hosts [] 2021-01-28T03:57:47.465 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:47 smithi162 bash[9856]: cephadm 2021-01-28T03:57:46.127199+0000 mgr.y (mgr.14138) 384 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='a'), HostPlacementSpec(hostname='smithi162', network='', name='b')] + new hosts [] 2021-01-28T03:57:47.466 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:47 smithi162 bash[9856]: cephadm 2021-01-28T03:57:46.128271+0000 mgr.y (mgr.14138) 385 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='a')] + new hosts [] 2021-01-28T03:57:47.466 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:47 smithi162 bash[9856]: cephadm 2021-01-28T03:57:46.129294+0000 mgr.y (mgr.14138) 386 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='a')] + new hosts [] 2021-01-28T03:57:47.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:47 smithi100 bash[9834]: cephadm 2021-01-28T03:57:46.103883+0000 mgr.y (mgr.14138) 373 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:57:47.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:47 smithi100 bash[9834]: cephadm 2021-01-28T03:57:46.105697+0000 mgr.y (mgr.14138) 374 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T03:57:47.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:47 smithi100 bash[9834]: cephadm 2021-01-28T03:57:46.107141+0000 mgr.y (mgr.14138) 375 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='iscsi.a')] + new hosts [] 2021-01-28T03:57:47.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:47 smithi100 bash[9834]: cephadm 2021-01-28T03:57:46.108342+0000 mgr.y (mgr.14138) 376 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='a')] + new hosts [] 2021-01-28T03:57:47.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:47 smithi100 bash[9834]: cephadm 2021-01-28T03:57:46.109555+0000 mgr.y (mgr.14138) 377 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='a'), HostPlacementSpec(hostname='smithi162', network='', name='b')] + new hosts [] 2021-01-28T03:57:47.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:47 smithi100 bash[9834]: cephadm 2021-01-28T03:57:46.110699+0000 mgr.y (mgr.14138) 378 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='a')] + new hosts [] 2021-01-28T03:57:47.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:47 smithi100 bash[9834]: cephadm 2021-01-28T03:57:46.111857+0000 mgr.y (mgr.14138) 379 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='a')] + new hosts [] 2021-01-28T03:57:47.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:47 smithi100 bash[9834]: cephadm 2021-01-28T03:57:46.123504+0000 mgr.y (mgr.14138) 380 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:57:47.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:47 smithi100 bash[9834]: cephadm 2021-01-28T03:57:46.124397+0000 mgr.y (mgr.14138) 381 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T03:57:47.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:47 smithi100 bash[9834]: cephadm 2021-01-28T03:57:46.125346+0000 mgr.y (mgr.14138) 382 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='iscsi.a')] + new hosts [] 2021-01-28T03:57:47.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:47 smithi100 bash[9834]: cephadm 2021-01-28T03:57:46.126201+0000 mgr.y (mgr.14138) 383 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='a')] + new hosts [] 2021-01-28T03:57:47.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:47 smithi100 bash[9834]: cephadm 2021-01-28T03:57:46.127199+0000 mgr.y (mgr.14138) 384 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='a'), HostPlacementSpec(hostname='smithi162', network='', name='b')] + new hosts [] 2021-01-28T03:57:47.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:47 smithi100 bash[9834]: cephadm 2021-01-28T03:57:46.128271+0000 mgr.y (mgr.14138) 385 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='a')] + new hosts [] 2021-01-28T03:57:47.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:47 smithi100 bash[9834]: cephadm 2021-01-28T03:57:46.129294+0000 mgr.y (mgr.14138) 386 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='a')] + new hosts [] 2021-01-28T03:57:47.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:47 smithi100 bash[13549]: cephadm 2021-01-28T03:57:46.103883+0000 mgr.y (mgr.14138) 373 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:57:47.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:47 smithi100 bash[13549]: cephadm 2021-01-28T03:57:46.105697+0000 mgr.y (mgr.14138) 374 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T03:57:47.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:47 smithi100 bash[13549]: cephadm 2021-01-28T03:57:46.107141+0000 mgr.y (mgr.14138) 375 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='iscsi.a')] + new hosts [] 2021-01-28T03:57:47.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:47 smithi100 bash[13549]: cephadm 2021-01-28T03:57:46.108342+0000 mgr.y (mgr.14138) 376 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='a')] + new hosts [] 2021-01-28T03:57:47.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:47 smithi100 bash[13549]: cephadm 2021-01-28T03:57:46.109555+0000 mgr.y (mgr.14138) 377 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='a'), HostPlacementSpec(hostname='smithi162', network='', name='b')] + new hosts [] 2021-01-28T03:57:47.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:47 smithi100 bash[13549]: cephadm 2021-01-28T03:57:46.110699+0000 mgr.y (mgr.14138) 378 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='a')] + new hosts [] 2021-01-28T03:57:47.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:47 smithi100 bash[13549]: cephadm 2021-01-28T03:57:46.111857+0000 mgr.y (mgr.14138) 379 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='a')] + new hosts [] 2021-01-28T03:57:47.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:47 smithi100 bash[13549]: cephadm 2021-01-28T03:57:46.123504+0000 mgr.y (mgr.14138) 380 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='y'), HostPlacementSpec(hostname='smithi162', network='', name='x')] + new hosts [] 2021-01-28T03:57:47.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:47 smithi100 bash[13549]: cephadm 2021-01-28T03:57:46.124397+0000 mgr.y (mgr.14138) 381 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T03:57:47.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:47 smithi100 bash[13549]: cephadm 2021-01-28T03:57:46.125346+0000 mgr.y (mgr.14138) 382 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='iscsi.a')] + new hosts [] 2021-01-28T03:57:47.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:47 smithi100 bash[13549]: cephadm 2021-01-28T03:57:46.126201+0000 mgr.y (mgr.14138) 383 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='a')] + new hosts [] 2021-01-28T03:57:47.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:47 smithi100 bash[13549]: cephadm 2021-01-28T03:57:46.127199+0000 mgr.y (mgr.14138) 384 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='a'), HostPlacementSpec(hostname='smithi162', network='', name='b')] + new hosts [] 2021-01-28T03:57:47.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:47 smithi100 bash[13549]: cephadm 2021-01-28T03:57:46.128271+0000 mgr.y (mgr.14138) 385 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi100', network='', name='a')] + new hosts [] 2021-01-28T03:57:47.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:47 smithi100 bash[13549]: cephadm 2021-01-28T03:57:46.129294+0000 mgr.y (mgr.14138) 386 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi162', network='', name='a')] + new hosts [] 2021-01-28T03:57:47.762 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:47 smithi162 bash[24692]: t=2021-01-28T03:57:47+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth token type to user_auth" 2021-01-28T03:57:47.762 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:47 smithi162 bash[24692]: t=2021-01-28T03:57:47+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth expiry to user_auth" 2021-01-28T03:57:47.763 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:47 smithi162 bash[24692]: t=2021-01-28T03:57:47+0000 lvl=info msg="Executing migration" logger=migrator id="Add index to user_id column in user_auth" 2021-01-28T03:57:47.763 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:47 smithi162 bash[24692]: t=2021-01-28T03:57:47+0000 lvl=info msg="Executing migration" logger=migrator id="create server_lock table" 2021-01-28T03:57:47.763 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:47 smithi162 bash[24692]: t=2021-01-28T03:57:47+0000 lvl=info msg="Executing migration" logger=migrator id="add index server_lock.operation_uid" 2021-01-28T03:57:48.130 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:47 smithi162 bash[24692]: t=2021-01-28T03:57:47+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth token table" 2021-01-28T03:57:48.131 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:47 smithi162 bash[24692]: t=2021-01-28T03:57:47+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.auth_token" 2021-01-28T03:57:48.131 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:47 smithi162 bash[24692]: t=2021-01-28T03:57:47+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.prev_auth_token" 2021-01-28T03:57:48.131 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:48 smithi162 bash[24692]: t=2021-01-28T03:57:48+0000 lvl=info msg="Executing migration" logger=migrator id="create cache_data table" 2021-01-28T03:57:48.428 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:48 smithi162 bash[9856]: cluster 2021-01-28T03:57:47.415058+0000 mgr.y (mgr.14138) 387 : cluster [DBG] pgmap v266: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:48.429 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:48 smithi162 bash[24692]: t=2021-01-28T03:57:48+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index cache_data.cache_key" 2021-01-28T03:57:48.430 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:48 smithi162 bash[24692]: t=2021-01-28T03:57:48+0000 lvl=info msg="Created default admin" logger=sqlstore user=admin 2021-01-28T03:57:48.430 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:48 smithi162 bash[24692]: t=2021-01-28T03:57:48+0000 lvl=info msg="Initializing HTTPServer" logger=server 2021-01-28T03:57:48.430 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:48 smithi162 bash[24692]: t=2021-01-28T03:57:48+0000 lvl=info msg="Initializing BackendPluginManager" logger=server 2021-01-28T03:57:48.430 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:48 smithi162 bash[24692]: t=2021-01-28T03:57:48+0000 lvl=info msg="Initializing PluginManager" logger=server 2021-01-28T03:57:48.431 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:48 smithi162 bash[24692]: t=2021-01-28T03:57:48+0000 lvl=info msg="Starting plugin search" logger=plugins 2021-01-28T03:57:48.431 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:48 smithi162 bash[24692]: t=2021-01-28T03:57:48+0000 lvl=info msg="Registering plugin" logger=plugins name="Pie Chart" 2021-01-28T03:57:48.431 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:48 smithi162 bash[24692]: t=2021-01-28T03:57:48+0000 lvl=info msg="Registering plugin" logger=plugins name="Status Panel" 2021-01-28T03:57:48.431 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:48 smithi162 bash[24692]: t=2021-01-28T03:57:48+0000 lvl=info msg="Initializing HooksService" logger=server 2021-01-28T03:57:48.432 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:48 smithi162 bash[24692]: t=2021-01-28T03:57:48+0000 lvl=info msg="Initializing OSSLicensingService" logger=server 2021-01-28T03:57:48.432 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:48 smithi162 bash[24692]: t=2021-01-28T03:57:48+0000 lvl=info msg="Initializing InternalMetricsService" logger=server 2021-01-28T03:57:48.432 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:48 smithi162 bash[24692]: t=2021-01-28T03:57:48+0000 lvl=info msg="Initializing RemoteCache" logger=server 2021-01-28T03:57:48.432 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:48 smithi162 bash[24692]: t=2021-01-28T03:57:48+0000 lvl=info msg="Initializing RenderingService" logger=server 2021-01-28T03:57:48.432 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:48 smithi162 bash[24692]: t=2021-01-28T03:57:48+0000 lvl=info msg="Initializing AlertEngine" logger=server 2021-01-28T03:57:48.433 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:48 smithi162 bash[24692]: t=2021-01-28T03:57:48+0000 lvl=info msg="Initializing QuotaService" logger=server 2021-01-28T03:57:48.433 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:48 smithi162 bash[24692]: t=2021-01-28T03:57:48+0000 lvl=info msg="Initializing ServerLockService" logger=server 2021-01-28T03:57:48.433 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:48 smithi162 bash[24692]: t=2021-01-28T03:57:48+0000 lvl=info msg="Initializing UserAuthTokenService" logger=server 2021-01-28T03:57:48.433 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:48 smithi162 bash[24692]: t=2021-01-28T03:57:48+0000 lvl=info msg="Initializing DatasourceCacheService" logger=server 2021-01-28T03:57:48.434 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:48 smithi162 bash[24692]: t=2021-01-28T03:57:48+0000 lvl=info msg="Initializing LoginService" logger=server 2021-01-28T03:57:48.434 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:48 smithi162 bash[24692]: t=2021-01-28T03:57:48+0000 lvl=info msg="Initializing SearchService" logger=server 2021-01-28T03:57:48.434 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:48 smithi162 bash[24692]: t=2021-01-28T03:57:48+0000 lvl=info msg="Initializing TracingService" logger=server 2021-01-28T03:57:48.434 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:48 smithi162 bash[24692]: t=2021-01-28T03:57:48+0000 lvl=info msg="Initializing UsageStatsService" logger=server 2021-01-28T03:57:48.434 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:48 smithi162 bash[24692]: t=2021-01-28T03:57:48+0000 lvl=info msg="Initializing CleanUpService" logger=server 2021-01-28T03:57:48.435 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:48 smithi162 bash[24692]: t=2021-01-28T03:57:48+0000 lvl=info msg="Initializing NotificationService" logger=server 2021-01-28T03:57:48.435 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:48 smithi162 bash[24692]: t=2021-01-28T03:57:48+0000 lvl=info msg="Initializing provisioningServiceImpl" logger=server 2021-01-28T03:57:48.435 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:48 smithi162 bash[24692]: t=2021-01-28T03:57:48+0000 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2021-01-28T03:57:48.435 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:48 smithi162 bash[24692]: t=2021-01-28T03:57:48+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name=Dashboard1 2021-01-28T03:57:48.435 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:48 smithi162 bash[24692]: t=2021-01-28T03:57:48+0000 lvl=info msg="Backend rendering via phantomJS" logger=rendering renderer=phantomJS 2021-01-28T03:57:48.436 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:48 smithi162 bash[24692]: t=2021-01-28T03:57:48+0000 lvl=warn msg="phantomJS is deprecated and will be removed in a future release. You should consider migrating from phantomJS to grafana-image-renderer plugin. Read more at https://grafana.com/docs/grafana/latest/administration/image_rendering/" logger=rendering renderer=phantomJS 2021-01-28T03:57:48.503 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.496+0000 7faaba163700 1 -- 172.21.15.100:0/4031320819 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faab40f6390 msgr2=0x7faab40fcc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:48.503 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.496+0000 7faaba163700 1 --2- 172.21.15.100:0/4031320819 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faab40f6390 0x7faab40fcc90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7faab0004d40 tx=0x7faab0009b30).stop 2021-01-28T03:57:48.503 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.496+0000 7faaba163700 1 -- 172.21.15.100:0/4031320819 shutdown_connections 2021-01-28T03:57:48.504 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.496+0000 7faaba163700 1 --2- 172.21.15.100:0/4031320819 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faab40f47a0 0x7faab40f4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:48.504 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.496+0000 7faaba163700 1 --2- 172.21.15.100:0/4031320819 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faab40f6390 0x7faab40fcc90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:48.504 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.496+0000 7faaba163700 1 --2- 172.21.15.100:0/4031320819 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faab40f5a40 0x7faab40f5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:48.504 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.496+0000 7faaba163700 1 -- 172.21.15.100:0/4031320819 >> 172.21.15.100:0/4031320819 conn(0x7faab40effa0 msgr2=0x7faab40f23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:57:48.505 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.496+0000 7faaba163700 1 -- 172.21.15.100:0/4031320819 shutdown_connections 2021-01-28T03:57:48.505 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.500+0000 7faaba163700 1 -- 172.21.15.100:0/4031320819 wait complete. 2021-01-28T03:57:48.507 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.500+0000 7faaba163700 1 Processor -- start 2021-01-28T03:57:48.507 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.500+0000 7faaba163700 1 -- start start 2021-01-28T03:57:48.507 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.500+0000 7faaba163700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faab40f47a0 0x7faab410a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:48.508 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.500+0000 7faaba163700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faab40f5a40 0x7faab410ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:48.508 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.500+0000 7faaba163700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faab40f6390 0x7faab410f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:48.508 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.500+0000 7faaba163700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab405f850 con 0x7faab40f47a0 2021-01-28T03:57:48.508 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.500+0000 7faaba163700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab410f6a0 con 0x7faab40f5a40 2021-01-28T03:57:48.509 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.500+0000 7faaba163700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab410f7e0 con 0x7faab40f6390 2021-01-28T03:57:48.509 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.500+0000 7faab9161700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faab40f47a0 0x7faab410a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:48.509 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.500+0000 7faab9962700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faab40f6390 0x7faab410f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:48.509 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.500+0000 7faab8960700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faab40f5a40 0x7faab410ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:48.510 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.500+0000 7faab9962700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faab40f6390 0x7faab410f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:40886/0 (socket says 172.21.15.100:40886) 2021-01-28T03:57:48.510 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.500+0000 7faab9962700 1 -- 172.21.15.100:0/1285603039 learned_addr learned my addr 172.21.15.100:0/1285603039 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:57:48.510 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.500+0000 7faab9962700 1 -- 172.21.15.100:0/1285603039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faab40f5a40 msgr2=0x7faab410ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:48.510 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.500+0000 7faab9962700 1 --2- 172.21.15.100:0/1285603039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faab40f5a40 0x7faab410ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:48.511 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.500+0000 7faab9962700 1 -- 172.21.15.100:0/1285603039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faab40f47a0 msgr2=0x7faab410a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:48.511 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.500+0000 7faab9962700 1 --2- 172.21.15.100:0/1285603039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faab40f47a0 0x7faab410a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:48.511 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.500+0000 7faab9962700 1 -- 172.21.15.100:0/1285603039 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab410f920 con 0x7faab40f6390 2021-01-28T03:57:48.511 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.500+0000 7faab9161700 1 --2- 172.21.15.100:0/1285603039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faab40f47a0 0x7faab410a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-28T03:57:48.511 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.500+0000 7faab9962700 1 --2- 172.21.15.100:0/1285603039 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faab40f6390 0x7faab410f1b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7faab000b690 tx=0x7faab0009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:57:48.512 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.500+0000 7faaa5ffb700 1 -- 172.21.15.100:0/1285603039 <== mon.1 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab000e030 con 0x7faab40f6390 2021-01-28T03:57:48.512 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.500+0000 7faaa5ffb700 1 -- 172.21.15.100:0/1285603039 <== mon.1 v2:172.21.15.100:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7faab001d880 con 0x7faab40f6390 2021-01-28T03:57:48.512 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.500+0000 7faaba163700 1 -- 172.21.15.100:0/1285603039 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faab410fb70 con 0x7faab40f6390 2021-01-28T03:57:48.512 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.500+0000 7faaa5ffb700 1 -- 172.21.15.100:0/1285603039 <== mon.1 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab0018070 con 0x7faab40f6390 2021-01-28T03:57:48.513 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.500+0000 7faaba163700 1 -- 172.21.15.100:0/1285603039 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faab410ff70 con 0x7faab40f6390 2021-01-28T03:57:48.514 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.504+0000 7faaba163700 1 -- 172.21.15.100:0/1285603039 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faab40f3b90 con 0x7faab40f6390 2021-01-28T03:57:48.514 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.504+0000 7faaa5ffb700 1 -- 172.21.15.100:0/1285603039 <== mon.1 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7faab001d420 con 0x7faab40f6390 2021-01-28T03:57:48.514 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.504+0000 7faaa5ffb700 1 --2- 172.21.15.100:0/1285603039 >> v2:172.21.15.100:6800/928846103 conn(0x7faaa005bc70 0x7faaa005e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:48.514 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.504+0000 7faaa5ffb700 1 -- 172.21.15.100:0/1285603039 <== mon.1 v2:172.21.15.100:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7faab0077430 con 0x7faab40f6390 2021-01-28T03:57:48.515 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.504+0000 7faab9161700 1 --2- 172.21.15.100:0/1285603039 >> v2:172.21.15.100:6800/928846103 conn(0x7faaa005bc70 0x7faaa005e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:48.515 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.504+0000 7faab9161700 1 --2- 172.21.15.100:0/1285603039 >> v2:172.21.15.100:6800/928846103 conn(0x7faaa005bc70 0x7faaa005e130 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7faab405f400 tx=0x7faaac00b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:57:48.516 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.508+0000 7faaa5ffb700 1 -- 172.21.15.100:0/1285603039 <== mon.1 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7faab004a120 con 0x7faab40f6390 2021-01-28T03:57:48.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:48 smithi100 bash[9834]: cluster 2021-01-28T03:57:47.415058+0000 mgr.y (mgr.14138) 387 : cluster [DBG] pgmap v266: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:48.577 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:48 smithi100 bash[13549]: cluster 2021-01-28T03:57:47.415058+0000 mgr.y (mgr.14138) 387 : cluster [DBG] pgmap v266: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:48.677 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.672+0000 7faaba163700 1 -- 172.21.15.100:0/1285603039 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faab40ff560 con 0x7faab40f6390 2021-01-28T03:57:48.679 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.676+0000 7faaa5ffb700 1 -- 172.21.15.100:0/1285603039 <== mon.1 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+18965 (secure 0 0 0) 0x7faab004d740 con 0x7faab40f6390 2021-01-28T03:57:48.680 INFO:teuthology.orchestra.run.smithi100.stdout: 2021-01-28T03:57:48.680 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":60,"fsid":"c217df96-611b-11eb-8f9e-001a4aab830c","created":"2021-01-28T03:49:43.977596+0000","modified":"2021-01-28T03:56:36.444276+0000","last_up_change":"2021-01-28T03:55:57.540370+0000","last_in_change":"2021-01-28T03:55:57.540370+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-28T03:51:27.917203+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2021-01-28T03:55:54.463101+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"iscsi","create_time":"2021-01-28T03:56:12.308562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"zone.rgw.log","create_time":"2021-01-28T03:56:13.689563+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"zone.rgw.control","create_time":"2021-01-28T03:56:15.185590+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"zone.rgw.meta","create_time":"2021-01-28T03:56:18.285095+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":8},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"b19e5679-7a32-467e-bef2-460c896020db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6801","nonce":2076626497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2076626497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2076626497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6803","nonce":2076626497}]},"public_addr":"172.21.15.100:6801/2076626497","cluster_addr":"172.21.15.100:6802/2076626497","heartbeat_back_addr":"172.21.15.100:6804/2076626497","heartbeat_front_addr":"172.21.15.100:6803/2076626497","state":["exists","up"]},{"osd":1,"uuid":"7a144678-be9c-4a85-acc7-4a7522a434d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6805","nonce":315903268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":315903268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":315903268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6807","nonce":315903268}]},"public_addr":"172.21.15.100:6805/315903268","cluster_addr":"172.21.15.100:6806/315903268","heartbeat_back_addr":"172.21.15.100:6808/315903268","heartbeat_front_addr":"172.21.15.100:6807/315903268","state":["exists","up"]},{"osd":2,"uuid":"5866a31a-7066-4ae4-a7c9-d155b09460fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6809","nonce":1600283162}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1600283162}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1600283162}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":1600283162}]},"public_addr":"172.21.15.100:6809/1600283162","cluster_addr":"172.21.15.100:6810/1600283162","heartbeat_back_addr":"172.21.15.100:6812/1600283162","heartbeat_front_addr":"172.21.15.100:6811/1600283162","state":["exists","up"]},{"osd":3,"uuid":"5de112f2-cf7c-4075-9d15-b8566a707947","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6813","nonce":799206422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":799206422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":799206422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":799206422}]},"public_addr":"172.21.15.100:6813/799206422","cluster_addr":"172.21.15.100:6814/799206422","heartbeat_back_addr":"172.21.15.100:6816/799206422","heartbeat_front_addr":"172.21.15.100:6815/799206422","state":["exists","up"]},{"osd":4,"uuid":"fda3d97f-42ca-4449-a4c0-c3256b8c64a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":4274488621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6801","nonce":4274488621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6803","nonce":4274488621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":4274488621}]},"public_addr":"172.21.15.162:6800/4274488621","cluster_addr":"172.21.15.162:6801/4274488621","heartbeat_back_addr":"172.21.15.162:6803/4274488621","heartbeat_front_addr":"172.21.15.162:6802/4274488621","state":["exists","up"]},{"osd":5,"uuid":"69c742c7-276f-4c30-a60f-18362a187b5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":1953061558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6805","nonce":1953061558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6807","nonce":1953061558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":1953061558}]},"public_addr":"172.21.15.162:6804/1953061558","cluster_addr":"172.21.15.162:6805/1953061558","heartbeat_back_addr":"172.21.15.162:6807/1953061558","heartbeat_front_addr":"172.21.15.162:6806/1953061558","state":["exists","up"]},{"osd":6,"uuid":"95a3b8cf-fdc9-43b4-8cd6-f7c92161409a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3682466023}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6809","nonce":3682466023}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6811","nonce":3682466023}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":3682466023}]},"public_addr":"172.21.15.162:6808/3682466023","cluster_addr":"172.21.15.162:6809/3682466023","heartbeat_back_addr":"172.21.15.162:6811/3682466023","heartbeat_front_addr":"172.21.15.162:6810/3682466023","state":["exists","up"]},{"osd":7,"uuid":"8ac18dc9-7208-4f26-b6a6-f9d11c3257be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2319408968}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6813","nonce":2319408968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6815","nonce":2319408968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2319408968}]},"public_addr":"172.21.15.162:6812/2319408968","cluster_addr":"172.21.15.162:6813/2319408968","heartbeat_back_addr":"172.21.15.162:6815/2319408968","heartbeat_front_addr":"172.21.15.162:6814/2319408968","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T03:52:46.582666+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T03:53:15.777781+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T03:53:44.401966+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T03:54:12.075880+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T03:54:36.048933+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T03:55:04.310974+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T03:55:28.994413+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T03:55:56.253535+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]},{"pgid":"4.1c","mappings":[{"from":1,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:0/2387903268":"2021-01-29T03:50:35.208992+0000","172.21.15.100:0/3466898363":"2021-01-29T03:50:35.208992+0000","172.21.15.100:6800/2057733473":"2021-01-29T03:50:35.208992+0000","172.21.15.100:0/542796331":"2021-01-29T03:50:13.341337+0000","172.21.15.100:6800/728127347":"2021-01-29T03:50:13.341337+0000","172.21.15.100:0/1692305047":"2021-01-29T03:50:13.341337+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-01-28T03:57:48.683 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.676+0000 7faaba163700 1 -- 172.21.15.100:0/1285603039 >> v2:172.21.15.100:6800/928846103 conn(0x7faaa005bc70 msgr2=0x7faaa005e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:48.683 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.676+0000 7faaba163700 1 --2- 172.21.15.100:0/1285603039 >> v2:172.21.15.100:6800/928846103 conn(0x7faaa005bc70 0x7faaa005e130 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7faab405f400 tx=0x7faaac00b040).stop 2021-01-28T03:57:48.683 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.676+0000 7faaba163700 1 -- 172.21.15.100:0/1285603039 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faab40f6390 msgr2=0x7faab410f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:48.684 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.676+0000 7faaba163700 1 --2- 172.21.15.100:0/1285603039 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faab40f6390 0x7faab410f1b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7faab000b690 tx=0x7faab0009b30).stop 2021-01-28T03:57:48.684 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.680+0000 7faaba163700 1 -- 172.21.15.100:0/1285603039 shutdown_connections 2021-01-28T03:57:48.684 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.680+0000 7faaba163700 1 --2- 172.21.15.100:0/1285603039 >> v2:172.21.15.100:6800/928846103 conn(0x7faaa005bc70 0x7faaa005e130 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:48.684 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.680+0000 7faaba163700 1 --2- 172.21.15.100:0/1285603039 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7faab40f6390 0x7faab410f1b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:48.685 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.680+0000 7faaba163700 1 --2- 172.21.15.100:0/1285603039 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faab40f47a0 0x7faab410a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:48.685 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.680+0000 7faaba163700 1 --2- 172.21.15.100:0/1285603039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faab40f5a40 0x7faab410ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:48.685 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.680+0000 7faaba163700 1 -- 172.21.15.100:0/1285603039 >> 172.21.15.100:0/1285603039 conn(0x7faab40effa0 msgr2=0x7faab40f2240 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:57:48.685 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.680+0000 7faaba163700 1 -- 172.21.15.100:0/1285603039 shutdown_connections 2021-01-28T03:57:48.685 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:48.680+0000 7faaba163700 1 -- 172.21.15.100:0/1285603039 wait complete. 2021-01-28T03:57:48.762 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:48 smithi162 bash[24692]: t=2021-01-28T03:57:48+0000 lvl=info msg="Initializing Stream Manager" 2021-01-28T03:57:48.762 INFO:journalctl@ceph.grafana.a.smithi162.stdout:Jan 28 03:57:48 smithi162 bash[24692]: t=2021-01-28T03:57:48+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=[::]:3000 protocol=https subUrl= socket= 2021-01-28T03:57:49.461 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:49 smithi100 bash[9834]: audit 2021-01-28T03:57:48.678132+0000 mon.c (mon.1) 24 : audit [DBG] from='client.? 172.21.15.100:0/1285603039' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-28T03:57:49.461 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:49 smithi100 bash[13549]: audit 2021-01-28T03:57:48.678132+0000 mon.c (mon.1) 24 : audit [DBG] from='client.? 172.21.15.100:0/1285603039' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-28T03:57:49.463 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2021-01-28T03:57:49.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:49 smithi162 bash[9856]: audit 2021-01-28T03:57:48.678132+0000 mon.c (mon.1) 24 : audit [DBG] from='client.? 172.21.15.100:0/1285603039' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-28T03:57:49.620 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c217df96-611b-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T03:57:49.826 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:57:49 smithi100 bash[10061]: debug 2021-01-28T03:57:49.540+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T03:57:50.012 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 03:57:49 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T03:57:50.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:50 smithi162 bash[9856]: cluster 2021-01-28T03:57:49.416409+0000 mgr.y (mgr.14138) 388 : cluster [DBG] pgmap v267: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:50.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:50 smithi100 bash[9834]: cluster 2021-01-28T03:57:49.416409+0000 mgr.y (mgr.14138) 388 : cluster [DBG] pgmap v267: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:50.577 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:50 smithi100 bash[13549]: cluster 2021-01-28T03:57:49.416409+0000 mgr.y (mgr.14138) 388 : cluster [DBG] pgmap v267: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:51.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:51 smithi162 bash[9856]: audit 2021-01-28T03:57:49.545405+0000 mgr.y (mgr.14138) 389 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:57:51.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:51 smithi100 bash[9834]: audit 2021-01-28T03:57:49.545405+0000 mgr.y (mgr.14138) 389 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:57:51.578 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:51 smithi100 bash[13549]: audit 2021-01-28T03:57:49.545405+0000 mgr.y (mgr.14138) 389 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:57:52.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:52 smithi162 bash[9856]: cluster 2021-01-28T03:57:51.417113+0000 mgr.y (mgr.14138) 390 : cluster [DBG] pgmap v268: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:52.576 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:52 smithi100 bash[9834]: cluster 2021-01-28T03:57:51.417113+0000 mgr.y (mgr.14138) 390 : cluster [DBG] pgmap v268: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:52.577 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:52 smithi100 bash[13549]: cluster 2021-01-28T03:57:51.417113+0000 mgr.y (mgr.14138) 390 : cluster [DBG] pgmap v268: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:52.980 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.976+0000 7f0075bb5700 1 -- 172.21.15.100:0/1068454174 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f00700f8a00 msgr2=0x7f00700fae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:52.980 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.976+0000 7f0075bb5700 1 --2- 172.21.15.100:0/1068454174 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f00700f8a00 0x7f00700fae50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f0058004e00 tx=0x7f0058009b30).stop 2021-01-28T03:57:52.980 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.976+0000 7f0075bb5700 1 -- 172.21.15.100:0/1068454174 shutdown_connections 2021-01-28T03:57:52.981 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.976+0000 7f0075bb5700 1 --2- 172.21.15.100:0/1068454174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00700fb490 0x7f00700fd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:52.981 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.976+0000 7f0075bb5700 1 --2- 172.21.15.100:0/1068454174 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f007005f7d0 0x7f00700f8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:52.981 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.976+0000 7f0075bb5700 1 --2- 172.21.15.100:0/1068454174 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f00700f8a00 0x7f00700fae50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:52.981 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.976+0000 7f0075bb5700 1 -- 172.21.15.100:0/1068454174 >> 172.21.15.100:0/1068454174 conn(0x7f00700effa0 msgr2=0x7f00700f23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:57:52.982 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.976+0000 7f0075bb5700 1 -- 172.21.15.100:0/1068454174 shutdown_connections 2021-01-28T03:57:52.982 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.976+0000 7f0075bb5700 1 -- 172.21.15.100:0/1068454174 wait complete. 2021-01-28T03:57:52.983 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.976+0000 7f0075bb5700 1 Processor -- start 2021-01-28T03:57:52.983 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.976+0000 7f0075bb5700 1 -- start start 2021-01-28T03:57:52.984 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.976+0000 7f0075bb5700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f007005f7d0 0x7f00701058b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:52.984 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.976+0000 7f0075bb5700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00700f8a00 0x7f0070105da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:52.984 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.976+0000 7f0075bb5700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00700fb490 0x7f0070106c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:52.984 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.976+0000 7f0074bb3700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f007005f7d0 0x7f00701058b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:52.984 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.976+0000 7f0074bb3700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f007005f7d0 0x7f00701058b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:40896/0 (socket says 172.21.15.100:40896) 2021-01-28T03:57:52.985 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.976+0000 7f00753b4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00700fb490 0x7f0070106c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:52.985 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.976+0000 7f006ffff700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00700f8a00 0x7f0070105da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:52.985 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.976+0000 7f00753b4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00700fb490 0x7f0070106c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59918/0 (socket says 172.21.15.100:59918) 2021-01-28T03:57:52.985 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.976+0000 7f006ffff700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00700f8a00 0x7f0070105da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.100:55404/0 (socket says 172.21.15.100:55404) 2021-01-28T03:57:52.986 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.976+0000 7f006ffff700 1 -- 172.21.15.100:0/180903060 learned_addr learned my addr 172.21.15.100:0/180903060 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:57:52.986 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.976+0000 7f0075bb5700 1 -- 172.21.15.100:0/180903060 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00701071c0 con 0x7f00700fb490 2021-01-28T03:57:52.986 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.976+0000 7f0075bb5700 1 -- 172.21.15.100:0/180903060 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0070107330 con 0x7f00700f8a00 2021-01-28T03:57:52.986 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.976+0000 7f0075bb5700 1 -- 172.21.15.100:0/180903060 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00701074f0 con 0x7f007005f7d0 2021-01-28T03:57:52.986 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.980+0000 7f0074bb3700 1 -- 172.21.15.100:0/180903060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00700f8a00 msgr2=0x7f0070105da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:52.987 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.980+0000 7f0074bb3700 1 --2- 172.21.15.100:0/180903060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00700f8a00 0x7f0070105da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:52.987 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.980+0000 7f0074bb3700 1 -- 172.21.15.100:0/180903060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00700fb490 msgr2=0x7f0070106c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:52.987 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.980+0000 7f0074bb3700 1 --2- 172.21.15.100:0/180903060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00700fb490 0x7f0070106c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:52.987 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.980+0000 7f0074bb3700 1 -- 172.21.15.100:0/180903060 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00701076b0 con 0x7f007005f7d0 2021-01-28T03:57:52.987 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.980+0000 7f00753b4700 1 --2- 172.21.15.100:0/180903060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00700fb490 0x7f0070106c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-28T03:57:52.988 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.980+0000 7f0074bb3700 1 --2- 172.21.15.100:0/180903060 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f007005f7d0 0x7f00701058b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f006000ee90 tx=0x7f006000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:57:52.989 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.980+0000 7f006d7fa700 1 -- 172.21.15.100:0/180903060 <== mon.1 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006000eec0 con 0x7f007005f7d0 2021-01-28T03:57:52.989 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.980+0000 7f006d7fa700 1 -- 172.21.15.100:0/180903060 <== mon.1 v2:172.21.15.100:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f006000f040 con 0x7f007005f7d0 2021-01-28T03:57:52.990 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.980+0000 7f0075bb5700 1 -- 172.21.15.100:0/180903060 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0070107900 con 0x7f007005f7d0 2021-01-28T03:57:52.990 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.980+0000 7f006d7fa700 1 -- 172.21.15.100:0/180903060 <== mon.1 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006000cdb0 con 0x7f007005f7d0 2021-01-28T03:57:52.990 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.980+0000 7f0075bb5700 1 -- 172.21.15.100:0/180903060 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f007010e0a0 con 0x7f007005f7d0 2021-01-28T03:57:52.990 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.980+0000 7f0075bb5700 1 -- 172.21.15.100:0/180903060 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f007005e330 con 0x7f007005f7d0 2021-01-28T03:57:52.990 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.980+0000 7f006d7fa700 1 -- 172.21.15.100:0/180903060 <== mon.1 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f0060007830 con 0x7f007005f7d0 2021-01-28T03:57:52.991 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.984+0000 7f006d7fa700 1 --2- 172.21.15.100:0/180903060 >> v2:172.21.15.100:6800/928846103 conn(0x7f005005bc70 0x7f005005e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:52.991 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.984+0000 7f006d7fa700 1 -- 172.21.15.100:0/180903060 <== mon.1 v2:172.21.15.100:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f006007cbd0 con 0x7f007005f7d0 2021-01-28T03:57:52.991 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.984+0000 7f006ffff700 1 --2- 172.21.15.100:0/180903060 >> v2:172.21.15.100:6800/928846103 conn(0x7f005005bc70 0x7f005005e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:52.991 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.984+0000 7f006d7fa700 1 --2- 172.21.15.100:0/180903060 >> v2:172.21.15.100:6801/2076626497 conn(0x7f00500655e0 0x7f0050067a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:52.992 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.984+0000 7f006d7fa700 1 -- 172.21.15.100:0/180903060 --> v2:172.21.15.100:6801/2076626497 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f00500680c0 con 0x7f00500655e0 2021-01-28T03:57:52.992 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.984+0000 7f006d7fa700 1 -- 172.21.15.100:0/180903060 <== mon.1 v2:172.21.15.100:3301/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00600763a0 con 0x7f007005f7d0 2021-01-28T03:57:52.992 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.984+0000 7f00753b4700 1 --2- 172.21.15.100:0/180903060 >> v2:172.21.15.100:6801/2076626497 conn(0x7f00500655e0 0x7f0050067a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:52.992 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.984+0000 7f006ffff700 1 --2- 172.21.15.100:0/180903060 >> v2:172.21.15.100:6800/928846103 conn(0x7f005005bc70 0x7f005005e130 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f00580095b0 tx=0x7f0058009b30).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:57:52.992 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.984+0000 7f00753b4700 1 --2- 172.21.15.100:0/180903060 >> v2:172.21.15.100:6801/2076626497 conn(0x7f00500655e0 0x7f0050067a80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:57:52.993 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:52.988+0000 7f006d7fa700 1 -- 172.21.15.100:0/180903060 <== osd.0 v2:172.21.15.100:6801/2076626497 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7f00500680c0 con 0x7f00500655e0 2021-01-28T03:57:53.010 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:53.004+0000 7f0075bb5700 1 -- 172.21.15.100:0/180903060 --> v2:172.21.15.100:6801/2076626497 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0070057280 con 0x7f00500655e0 2021-01-28T03:57:53.011 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:53.008+0000 7f006d7fa700 1 -- 172.21.15.100:0/180903060 <== osd.0 v2:172.21.15.100:6801/2076626497 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0070057280 con 0x7f00500655e0 2021-01-28T03:57:53.011 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:53.008+0000 7f0075bb5700 1 -- 172.21.15.100:0/180903060 >> v2:172.21.15.100:6801/2076626497 conn(0x7f00500655e0 msgr2=0x7f0050067a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:53.012 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:53.008+0000 7f0075bb5700 1 --2- 172.21.15.100:0/180903060 >> v2:172.21.15.100:6801/2076626497 conn(0x7f00500655e0 0x7f0050067a80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:53.013 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:53.008+0000 7f0075bb5700 1 -- 172.21.15.100:0/180903060 >> v2:172.21.15.100:6800/928846103 conn(0x7f005005bc70 msgr2=0x7f005005e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:53.013 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:53.008+0000 7f0075bb5700 1 --2- 172.21.15.100:0/180903060 >> v2:172.21.15.100:6800/928846103 conn(0x7f005005bc70 0x7f005005e130 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f00580095b0 tx=0x7f0058009b30).stop 2021-01-28T03:57:53.013 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:53.008+0000 7f0075bb5700 1 -- 172.21.15.100:0/180903060 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f007005f7d0 msgr2=0x7f00701058b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:53.013 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:53.008+0000 7f0075bb5700 1 --2- 172.21.15.100:0/180903060 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f007005f7d0 0x7f00701058b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f006000ee90 tx=0x7f006000b040).stop 2021-01-28T03:57:53.014 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:53.008+0000 7f00753b4700 1 -- 172.21.15.100:0/180903060 reap_dead start 2021-01-28T03:57:53.014 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:53.008+0000 7f0075bb5700 1 -- 172.21.15.100:0/180903060 shutdown_connections 2021-01-28T03:57:53.014 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:53.008+0000 7f0075bb5700 1 -- 172.21.15.100:0/180903060 >> 172.21.15.100:0/180903060 conn(0x7f00700effa0 msgr2=0x7f00700fc130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:57:53.014 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:53.008+0000 7f0075bb5700 1 -- 172.21.15.100:0/180903060 shutdown_connections 2021-01-28T03:57:53.015 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:53.008+0000 7f0075bb5700 1 -- 172.21.15.100:0/180903060 wait complete. 2021-01-28T03:57:53.752 INFO:teuthology.orchestra.run.smithi100.stdout:42949673023 2021-01-28T03:57:53.753 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2021-01-28T03:57:53.915 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c217df96-611b-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T03:57:54.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:54 smithi162 bash[9856]: cluster 2021-01-28T03:57:53.418339+0000 mgr.y (mgr.14138) 391 : cluster [DBG] pgmap v269: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:54.826 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:54 smithi100 bash[9834]: cluster 2021-01-28T03:57:53.418339+0000 mgr.y (mgr.14138) 391 : cluster [DBG] pgmap v269: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:54.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:54 smithi100 bash[13549]: cluster 2021-01-28T03:57:53.418339+0000 mgr.y (mgr.14138) 391 : cluster [DBG] pgmap v269: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:56.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:56 smithi162 bash[9856]: cluster 2021-01-28T03:57:55.419499+0000 mgr.y (mgr.14138) 392 : cluster [DBG] pgmap v270: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:56.808 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:56 smithi100 bash[9834]: cluster 2021-01-28T03:57:55.419499+0000 mgr.y (mgr.14138) 392 : cluster [DBG] pgmap v270: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:56.809 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:56 smithi100 bash[13549]: cluster 2021-01-28T03:57:55.419499+0000 mgr.y (mgr.14138) 392 : cluster [DBG] pgmap v270: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:57:57.015 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.008+0000 7fb694df9700 1 -- 172.21.15.100:0/2365259761 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb6900f7ad0 msgr2=0x7fb6900f7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:57.016 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.008+0000 7fb694df9700 1 --2- 172.21.15.100:0/2365259761 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb6900f7ad0 0x7fb6900f7ef0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fb678004e30 tx=0x7fb678009b30).stop 2021-01-28T03:57:57.016 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.012+0000 7fb694df9700 1 -- 172.21.15.100:0/2365259761 shutdown_connections 2021-01-28T03:57:57.016 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.012+0000 7fb694df9700 1 --2- 172.21.15.100:0/2365259761 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6900f96c0 0x7fb6900fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:57.016 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.012+0000 7fb694df9700 1 --2- 172.21.15.100:0/2365259761 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb6900f7ad0 0x7fb6900f7ef0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:57.017 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.012+0000 7fb694df9700 1 --2- 172.21.15.100:0/2365259761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6900f8d70 0x7fb6900f91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:57.017 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.012+0000 7fb694df9700 1 -- 172.21.15.100:0/2365259761 >> 172.21.15.100:0/2365259761 conn(0x7fb6900f3390 msgr2=0x7fb6900f5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:57:57.017 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.012+0000 7fb694df9700 1 -- 172.21.15.100:0/2365259761 shutdown_connections 2021-01-28T03:57:57.017 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.012+0000 7fb694df9700 1 -- 172.21.15.100:0/2365259761 wait complete. 2021-01-28T03:57:57.019 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.012+0000 7fb694df9700 1 Processor -- start 2021-01-28T03:57:57.019 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.012+0000 7fb694df9700 1 -- start start 2021-01-28T03:57:57.019 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.012+0000 7fb694df9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6900f7ad0 0x7fb690107da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:57.020 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.012+0000 7fb694df9700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb6900f8d70 0x7fb690108290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:57.020 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.012+0000 7fb694df9700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6900f96c0 0x7fb6901090d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:57.020 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.012+0000 7fb694df9700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb690109690 con 0x7fb6900f7ad0 2021-01-28T03:57:57.020 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.012+0000 7fb68f7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6900f7ad0 0x7fb690107da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:57.020 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.012+0000 7fb694df9700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb690109800 con 0x7fb6900f96c0 2021-01-28T03:57:57.021 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.012+0000 7fb694df9700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6901099c0 con 0x7fb6900f8d70 2021-01-28T03:57:57.021 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.012+0000 7fb68f7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6900f7ad0 0x7fb690107da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59930/0 (socket says 172.21.15.100:59930) 2021-01-28T03:57:57.021 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.012+0000 7fb68f7fe700 1 -- 172.21.15.100:0/2688048992 learned_addr learned my addr 172.21.15.100:0/2688048992 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:57:57.021 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.012+0000 7fb68effd700 1 --2- 172.21.15.100:0/2688048992 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb6900f8d70 0x7fb690108290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:57.022 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.012+0000 7fb68ffff700 1 --2- 172.21.15.100:0/2688048992 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6900f96c0 0x7fb6901090d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:57.022 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.012+0000 7fb68effd700 1 -- 172.21.15.100:0/2688048992 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6900f96c0 msgr2=0x7fb6901090d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:57.022 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.012+0000 7fb68effd700 1 --2- 172.21.15.100:0/2688048992 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6900f96c0 0x7fb6901090d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:57.023 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.012+0000 7fb68effd700 1 -- 172.21.15.100:0/2688048992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6900f7ad0 msgr2=0x7fb690107da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:57.023 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.012+0000 7fb68effd700 1 --2- 172.21.15.100:0/2688048992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6900f7ad0 0x7fb690107da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:57.023 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.012+0000 7fb68effd700 1 -- 172.21.15.100:0/2688048992 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb690109b80 con 0x7fb6900f8d70 2021-01-28T03:57:57.023 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.012+0000 7fb68ffff700 1 --2- 172.21.15.100:0/2688048992 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6900f96c0 0x7fb6901090d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-28T03:57:57.024 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.012+0000 7fb68f7fe700 1 --2- 172.21.15.100:0/2688048992 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb6900f7ad0 0x7fb690107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-28T03:57:57.024 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.012+0000 7fb68effd700 1 --2- 172.21.15.100:0/2688048992 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb6900f8d70 0x7fb690108290 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fb68000ee90 tx=0x7fb68000b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:57:57.024 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.012+0000 7fb687fff700 1 -- 172.21.15.100:0/2688048992 <== mon.1 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68000eec0 con 0x7fb6900f8d70 2021-01-28T03:57:57.024 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.012+0000 7fb687fff700 1 -- 172.21.15.100:0/2688048992 <== mon.1 v2:172.21.15.100:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fb68000f040 con 0x7fb6900f8d70 2021-01-28T03:57:57.024 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.012+0000 7fb694df9700 1 -- 172.21.15.100:0/2688048992 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb690109dd0 con 0x7fb6900f8d70 2021-01-28T03:57:57.025 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.012+0000 7fb687fff700 1 -- 172.21.15.100:0/2688048992 <== mon.1 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68000ce60 con 0x7fb6900f8d70 2021-01-28T03:57:57.025 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.012+0000 7fb694df9700 1 -- 172.21.15.100:0/2688048992 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb690110590 con 0x7fb6900f8d70 2021-01-28T03:57:57.026 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.016+0000 7fb694df9700 1 -- 172.21.15.100:0/2688048992 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb69005d580 con 0x7fb6900f8d70 2021-01-28T03:57:57.026 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.016+0000 7fb687fff700 1 -- 172.21.15.100:0/2688048992 <== mon.1 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7fb6800078b0 con 0x7fb6900f8d70 2021-01-28T03:57:57.026 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.016+0000 7fb687fff700 1 --2- 172.21.15.100:0/2688048992 >> v2:172.21.15.100:6800/928846103 conn(0x7fb67005bc70 0x7fb67005e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:57.027 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.016+0000 7fb687fff700 1 -- 172.21.15.100:0/2688048992 <== mon.1 v2:172.21.15.100:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7fb680075fe0 con 0x7fb6900f8d70 2021-01-28T03:57:57.027 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.016+0000 7fb68f7fe700 1 --2- 172.21.15.100:0/2688048992 >> v2:172.21.15.100:6800/928846103 conn(0x7fb67005bc70 0x7fb67005e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:57.027 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.016+0000 7fb687fff700 1 --2- 172.21.15.100:0/2688048992 >> v2:172.21.15.100:6805/315903268 conn(0x7fb6700655e0 0x7fb670067a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:57:57.027 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.016+0000 7fb687fff700 1 -- 172.21.15.100:0/2688048992 --> v2:172.21.15.100:6805/315903268 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb6700680c0 con 0x7fb6700655e0 2021-01-28T03:57:57.027 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.016+0000 7fb687fff700 1 -- 172.21.15.100:0/2688048992 <== mon.1 v2:172.21.15.100:3301/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb680076390 con 0x7fb6900f8d70 2021-01-28T03:57:57.028 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.016+0000 7fb68f7fe700 1 --2- 172.21.15.100:0/2688048992 >> v2:172.21.15.100:6800/928846103 conn(0x7fb67005bc70 0x7fb67005e130 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fb678004f60 tx=0x7fb678009b30).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:57:57.028 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.016+0000 7fb68ffff700 1 --2- 172.21.15.100:0/2688048992 >> v2:172.21.15.100:6805/315903268 conn(0x7fb6700655e0 0x7fb670067a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:57:57.028 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.020+0000 7fb68ffff700 1 --2- 172.21.15.100:0/2688048992 >> v2:172.21.15.100:6805/315903268 conn(0x7fb6700655e0 0x7fb670067a80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:57:57.028 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.020+0000 7fb687fff700 1 -- 172.21.15.100:0/2688048992 <== osd.1 v2:172.21.15.100:6805/315903268 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7fb6700680c0 con 0x7fb6700655e0 2021-01-28T03:57:57.044 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.040+0000 7fb694df9700 1 -- 172.21.15.100:0/2688048992 --> v2:172.21.15.100:6805/315903268 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb690057240 con 0x7fb6700655e0 2021-01-28T03:57:57.045 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.040+0000 7fb687fff700 1 -- 172.21.15.100:0/2688048992 <== osd.1 v2:172.21.15.100:6805/315903268 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb690057240 con 0x7fb6700655e0 2021-01-28T03:57:57.045 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.040+0000 7fb694df9700 1 -- 172.21.15.100:0/2688048992 >> v2:172.21.15.100:6805/315903268 conn(0x7fb6700655e0 msgr2=0x7fb670067a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:57.045 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.040+0000 7fb694df9700 1 --2- 172.21.15.100:0/2688048992 >> v2:172.21.15.100:6805/315903268 conn(0x7fb6700655e0 0x7fb670067a80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:57:57.045 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.040+0000 7fb694df9700 1 -- 172.21.15.100:0/2688048992 >> v2:172.21.15.100:6800/928846103 conn(0x7fb67005bc70 msgr2=0x7fb67005e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:57.046 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.040+0000 7fb694df9700 1 --2- 172.21.15.100:0/2688048992 >> v2:172.21.15.100:6800/928846103 conn(0x7fb67005bc70 0x7fb67005e130 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fb678004f60 tx=0x7fb678009b30).stop 2021-01-28T03:57:57.046 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.040+0000 7fb694df9700 1 -- 172.21.15.100:0/2688048992 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb6900f8d70 msgr2=0x7fb690108290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:57:57.046 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.040+0000 7fb694df9700 1 --2- 172.21.15.100:0/2688048992 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fb6900f8d70 0x7fb690108290 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fb68000ee90 tx=0x7fb68000b040).stop 2021-01-28T03:57:57.046 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.040+0000 7fb68ffff700 1 -- 172.21.15.100:0/2688048992 reap_dead start 2021-01-28T03:57:57.046 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.040+0000 7fb694df9700 1 -- 172.21.15.100:0/2688048992 shutdown_connections 2021-01-28T03:57:57.047 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.040+0000 7fb694df9700 1 -- 172.21.15.100:0/2688048992 >> 172.21.15.100:0/2688048992 conn(0x7fb6900f3390 msgr2=0x7fb6900f67b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:57:57.047 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.040+0000 7fb694df9700 1 -- 172.21.15.100:0/2688048992 shutdown_connections 2021-01-28T03:57:57.047 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:57:57.040+0000 7fb694df9700 1 -- 172.21.15.100:0/2688048992 wait complete. 2021-01-28T03:57:57.856 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:57:57 smithi100 bash[9834]: cluster 2021-01-28T03:57:57.420628+0000 mgr.y (mgr.14138) 393 : cluster [DBG] pgmap v271: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:57.856 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:57:57 smithi100 bash[13549]: cluster 2021-01-28T03:57:57.420628+0000 mgr.y (mgr.14138) 393 : cluster [DBG] pgmap v271: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:57.857 INFO:teuthology.orchestra.run.smithi100.stdout:68719476793 2021-01-28T03:57:57.857 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph tell osd.2 flush_pg_stats 2021-01-28T03:57:58.009 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c217df96-611b-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T03:57:58.011 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:57:57 smithi162 bash[9856]: cluster 2021-01-28T03:57:57.420628+0000 mgr.y (mgr.14138) 393 : cluster [DBG] pgmap v271: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:57:59.826 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:57:59 smithi100 bash[10061]: debug 2021-01-28T03:57:59.552+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T03:58:00.012 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 03:57:59 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T03:58:00.749 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:00 smithi100 bash[9834]: cluster 2021-01-28T03:57:59.421938+0000 mgr.y (mgr.14138) 394 : cluster [DBG] pgmap v272: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:58:00.750 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:00 smithi100 bash[13549]: cluster 2021-01-28T03:57:59.421938+0000 mgr.y (mgr.14138) 394 : cluster [DBG] pgmap v272: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:58:00.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:00 smithi162 bash[9856]: cluster 2021-01-28T03:57:59.421938+0000 mgr.y (mgr.14138) 394 : cluster [DBG] pgmap v272: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:58:00.957 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.952+0000 7f90b5c35700 1 -- 172.21.15.100:0/882343499 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f90b00f6b60 msgr2=0x7f90b00f6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:00.957 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.952+0000 7f90b5c35700 1 --2- 172.21.15.100:0/882343499 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f90b00f6b60 0x7f90b00f6fc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f90a4004e30 tx=0x7f90a4009b30).stop 2021-01-28T03:58:00.958 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.952+0000 7f90b5c35700 1 -- 172.21.15.100:0/882343499 shutdown_connections 2021-01-28T03:58:00.958 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.952+0000 7f90b5c35700 1 --2- 172.21.15.100:0/882343499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90b00f74b0 0x7f90b00fddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:00.958 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.952+0000 7f90b5c35700 1 --2- 172.21.15.100:0/882343499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90b00f58c0 0x7f90b00f5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:00.958 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.952+0000 7f90b5c35700 1 --2- 172.21.15.100:0/882343499 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f90b00f6b60 0x7f90b00f6fc0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:00.959 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.952+0000 7f90b5c35700 1 -- 172.21.15.100:0/882343499 >> 172.21.15.100:0/882343499 conn(0x7f90b00f10a0 msgr2=0x7f90b00f34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:58:00.959 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.952+0000 7f90b5c35700 1 -- 172.21.15.100:0/882343499 shutdown_connections 2021-01-28T03:58:00.959 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.952+0000 7f90b5c35700 1 -- 172.21.15.100:0/882343499 wait complete. 2021-01-28T03:58:00.960 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.952+0000 7f90b5c35700 1 Processor -- start 2021-01-28T03:58:00.961 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.952+0000 7f90b5c35700 1 -- start start 2021-01-28T03:58:00.961 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.956+0000 7f90b5c35700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90b00f58c0 0x7f90b01058d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:00.961 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.956+0000 7f90b5c35700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f90b00f6b60 0x7f90b0105dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:00.961 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.956+0000 7f90b5c35700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90b00f74b0 0x7f90b0106cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:00.961 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.956+0000 7f90b5c35700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b01071e0 con 0x7f90b00f74b0 2021-01-28T03:58:00.962 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.956+0000 7f90b5c35700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b0107350 con 0x7f90b00f58c0 2021-01-28T03:58:00.962 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.956+0000 7f90b5c35700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b0107510 con 0x7f90b00f6b60 2021-01-28T03:58:00.962 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.956+0000 7f90b5434700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90b00f74b0 0x7f90b0106cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:00.962 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.956+0000 7f90affff700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f90b00f6b60 0x7f90b0105dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:00.962 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.956+0000 7f90b4c33700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90b00f58c0 0x7f90b01058d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:00.963 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.956+0000 7f90b5434700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90b00f74b0 0x7f90b0106cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59950/0 (socket says 172.21.15.100:59950) 2021-01-28T03:58:00.963 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.956+0000 7f90b5434700 1 -- 172.21.15.100:0/2888972431 learned_addr learned my addr 172.21.15.100:0/2888972431 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:58:00.963 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.956+0000 7f90b5434700 1 -- 172.21.15.100:0/2888972431 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f90b00f6b60 msgr2=0x7f90b0105dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:00.964 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.956+0000 7f90b5434700 1 --2- 172.21.15.100:0/2888972431 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f90b00f6b60 0x7f90b0105dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:00.964 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.956+0000 7f90b5434700 1 -- 172.21.15.100:0/2888972431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90b00f58c0 msgr2=0x7f90b01058d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:00.964 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.956+0000 7f90b5434700 1 --2- 172.21.15.100:0/2888972431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90b00f58c0 0x7f90b01058d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:00.964 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.956+0000 7f90b5434700 1 -- 172.21.15.100:0/2888972431 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b01076d0 con 0x7f90b00f74b0 2021-01-28T03:58:00.964 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.956+0000 7f90affff700 1 --2- 172.21.15.100:0/2888972431 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f90b00f6b60 0x7f90b0105dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-28T03:58:00.965 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.956+0000 7f90b5434700 1 --2- 172.21.15.100:0/2888972431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90b00f74b0 0x7f90b0106cb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f90a80029a0 tx=0x7f90a8009de0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:58:00.965 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.956+0000 7f90ad7fa700 1 -- 172.21.15.100:0/2888972431 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a8002de0 con 0x7f90b00f74b0 2021-01-28T03:58:00.965 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.956+0000 7f90ad7fa700 1 -- 172.21.15.100:0/2888972431 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f90a800f040 con 0x7f90b00f74b0 2021-01-28T03:58:00.965 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.956+0000 7f90b5c35700 1 -- 172.21.15.100:0/2888972431 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b0107980 con 0x7f90b00f74b0 2021-01-28T03:58:00.967 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.956+0000 7f90ad7fa700 1 -- 172.21.15.100:0/2888972431 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a800d850 con 0x7f90b00f74b0 2021-01-28T03:58:00.967 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.956+0000 7f90b5c35700 1 -- 172.21.15.100:0/2888972431 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b010e0c0 con 0x7f90b00f74b0 2021-01-28T03:58:00.967 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.956+0000 7f90b5c35700 1 -- 172.21.15.100:0/2888972431 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f90b005d6a0 con 0x7f90b00f74b0 2021-01-28T03:58:00.967 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.960+0000 7f90ad7fa700 1 -- 172.21.15.100:0/2888972431 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f90a801b060 con 0x7f90b00f74b0 2021-01-28T03:58:00.968 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.960+0000 7f90ad7fa700 1 --2- 172.21.15.100:0/2888972431 >> v2:172.21.15.100:6800/928846103 conn(0x7f909805bc70 0x7f909805e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:00.968 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.960+0000 7f90ad7fa700 1 -- 172.21.15.100:0/2888972431 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f90a80756b0 con 0x7f90b00f74b0 2021-01-28T03:58:00.968 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.960+0000 7f90b4c33700 1 --2- 172.21.15.100:0/2888972431 >> v2:172.21.15.100:6800/928846103 conn(0x7f909805bc70 0x7f909805e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:00.968 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.960+0000 7f90ad7fa700 1 --2- 172.21.15.100:0/2888972431 >> v2:172.21.15.100:6809/1600283162 conn(0x7f90980655e0 0x7f9098067a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:00.969 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.960+0000 7f90ad7fa700 1 -- 172.21.15.100:0/2888972431 --> v2:172.21.15.100:6809/1600283162 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f90980680c0 con 0x7f90980655e0 2021-01-28T03:58:00.969 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.960+0000 7f90ad7fa700 1 -- 172.21.15.100:0/2888972431 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90a8077d20 con 0x7f90b00f74b0 2021-01-28T03:58:00.969 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.960+0000 7f90affff700 1 --2- 172.21.15.100:0/2888972431 >> v2:172.21.15.100:6809/1600283162 conn(0x7f90980655e0 0x7f9098067a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:00.969 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.960+0000 7f90b4c33700 1 --2- 172.21.15.100:0/2888972431 >> v2:172.21.15.100:6800/928846103 conn(0x7f909805bc70 0x7f909805e130 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f90a0004fd0 tx=0x7f90a000b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:58:00.969 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.960+0000 7f90affff700 1 --2- 172.21.15.100:0/2888972431 >> v2:172.21.15.100:6809/1600283162 conn(0x7f90980655e0 0x7f9098067a80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:58:00.970 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.960+0000 7f90ad7fa700 1 -- 172.21.15.100:0/2888972431 <== osd.2 v2:172.21.15.100:6809/1600283162 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7f90980680c0 con 0x7f90980655e0 2021-01-28T03:58:00.985 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.980+0000 7f90b5c35700 1 -- 172.21.15.100:0/2888972431 --> v2:172.21.15.100:6809/1600283162 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f90b0057240 con 0x7f90980655e0 2021-01-28T03:58:00.986 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.980+0000 7f90ad7fa700 1 -- 172.21.15.100:0/2888972431 <== osd.2 v2:172.21.15.100:6809/1600283162 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f90b0057240 con 0x7f90980655e0 2021-01-28T03:58:00.988 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.984+0000 7f90b5c35700 1 -- 172.21.15.100:0/2888972431 >> v2:172.21.15.100:6809/1600283162 conn(0x7f90980655e0 msgr2=0x7f9098067a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:00.988 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.984+0000 7f90b5c35700 1 --2- 172.21.15.100:0/2888972431 >> v2:172.21.15.100:6809/1600283162 conn(0x7f90980655e0 0x7f9098067a80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:00.988 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.984+0000 7f90b5c35700 1 -- 172.21.15.100:0/2888972431 >> v2:172.21.15.100:6800/928846103 conn(0x7f909805bc70 msgr2=0x7f909805e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:00.988 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.984+0000 7f90b5c35700 1 --2- 172.21.15.100:0/2888972431 >> v2:172.21.15.100:6800/928846103 conn(0x7f909805bc70 0x7f909805e130 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f90a0004fd0 tx=0x7f90a000b040).stop 2021-01-28T03:58:00.989 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.984+0000 7f90b5c35700 1 -- 172.21.15.100:0/2888972431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90b00f74b0 msgr2=0x7f90b0106cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:00.989 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.984+0000 7f90b5c35700 1 --2- 172.21.15.100:0/2888972431 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90b00f74b0 0x7f90b0106cb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f90a80029a0 tx=0x7f90a8009de0).stop 2021-01-28T03:58:00.989 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.984+0000 7f90b5434700 1 -- 172.21.15.100:0/2888972431 reap_dead start 2021-01-28T03:58:00.989 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.984+0000 7f90b5c35700 1 -- 172.21.15.100:0/2888972431 shutdown_connections 2021-01-28T03:58:00.989 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.984+0000 7f90b5c35700 1 -- 172.21.15.100:0/2888972431 >> 172.21.15.100:0/2888972431 conn(0x7f90b00f10a0 msgr2=0x7f90b00f9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:58:00.990 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.984+0000 7f90b5c35700 1 -- 172.21.15.100:0/2888972431 shutdown_connections 2021-01-28T03:58:00.990 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:00.984+0000 7f90b5c35700 1 -- 172.21.15.100:0/2888972431 wait complete. 2021-01-28T03:58:01.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:01 smithi162 bash[9856]: audit 2021-01-28T03:57:59.556132+0000 mgr.y (mgr.14138) 395 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:58:01.772 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:01 smithi100 bash[13549]: audit 2021-01-28T03:57:59.556132+0000 mgr.y (mgr.14138) 395 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:58:01.772 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:01 smithi100 bash[9834]: audit 2021-01-28T03:57:59.556132+0000 mgr.y (mgr.14138) 395 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:58:01.773 INFO:teuthology.orchestra.run.smithi100.stdout:90194313270 2021-01-28T03:58:01.774 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph tell osd.3 flush_pg_stats 2021-01-28T03:58:01.929 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c217df96-611b-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T03:58:02.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:02 smithi162 bash[9856]: cluster 2021-01-28T03:58:01.422962+0000 mgr.y (mgr.14138) 396 : cluster [DBG] pgmap v273: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:02.826 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:02 smithi100 bash[9834]: cluster 2021-01-28T03:58:01.422962+0000 mgr.y (mgr.14138) 396 : cluster [DBG] pgmap v273: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:02.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:02 smithi100 bash[13549]: cluster 2021-01-28T03:58:01.422962+0000 mgr.y (mgr.14138) 396 : cluster [DBG] pgmap v273: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:03.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:03 smithi100 bash[9834]: cluster 2021-01-28T03:58:03.424185+0000 mgr.y (mgr.14138) 397 : cluster [DBG] pgmap v274: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:58:03.577 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:03 smithi100 bash[13549]: cluster 2021-01-28T03:58:03.424185+0000 mgr.y (mgr.14138) 397 : cluster [DBG] pgmap v274: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:58:03.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:03 smithi162 bash[9856]: cluster 2021-01-28T03:58:03.424185+0000 mgr.y (mgr.14138) 397 : cluster [DBG] pgmap v274: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:58:05.221 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.216+0000 7f5cddb40700 1 -- 172.21.15.100:0/4019800743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cd80694a0 msgr2=0x7f5cd8069920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:05.221 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.216+0000 7f5cddb40700 1 --2- 172.21.15.100:0/4019800743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cd80694a0 0x7f5cd8069920 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f5cc0004e00 tx=0x7f5cc0009b30).stop 2021-01-28T03:58:05.221 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.216+0000 7f5cddb40700 1 -- 172.21.15.100:0/4019800743 shutdown_connections 2021-01-28T03:58:05.222 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.216+0000 7f5cddb40700 1 --2- 172.21.15.100:0/4019800743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5cd80fd950 0x7f5cd80ffd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:05.222 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.216+0000 7f5cddb40700 1 --2- 172.21.15.100:0/4019800743 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5cd806aab0 0x7f5cd8068fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:05.222 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.216+0000 7f5cddb40700 1 --2- 172.21.15.100:0/4019800743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cd80694a0 0x7f5cd8069920 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:05.222 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.216+0000 7f5cddb40700 1 -- 172.21.15.100:0/4019800743 >> 172.21.15.100:0/4019800743 conn(0x7f5cd80f1220 msgr2=0x7f5cd80f3640 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:58:05.223 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.216+0000 7f5cddb40700 1 -- 172.21.15.100:0/4019800743 shutdown_connections 2021-01-28T03:58:05.223 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.216+0000 7f5cddb40700 1 -- 172.21.15.100:0/4019800743 wait complete. 2021-01-28T03:58:05.224 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.216+0000 7f5cddb40700 1 Processor -- start 2021-01-28T03:58:05.224 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.216+0000 7f5cddb40700 1 -- start start 2021-01-28T03:58:05.224 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.216+0000 7f5cddb40700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5cd80694a0 0x7f5cd8107ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:05.225 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.216+0000 7f5cddb40700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5cd806aab0 0x7f5cd8107fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:05.225 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.216+0000 7f5cddb40700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cd80fd950 0x7f5cd810f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:05.225 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.216+0000 7f5cddb40700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd810f570 con 0x7f5cd80fd950 2021-01-28T03:58:05.225 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.216+0000 7f5cddb40700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd810f6b0 con 0x7f5cd806aab0 2021-01-28T03:58:05.226 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.216+0000 7f5cddb40700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd810f7f0 con 0x7f5cd80694a0 2021-01-28T03:58:05.226 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.216+0000 7f5cd7fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cd80fd950 0x7f5cd810f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:05.226 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.216+0000 7f5cd77fe700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5cd80694a0 0x7f5cd8107ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:05.226 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.216+0000 7f5cd7fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cd80fd950 0x7f5cd810f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59962/0 (socket says 172.21.15.100:59962) 2021-01-28T03:58:05.227 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.216+0000 7f5cd7fff700 1 -- 172.21.15.100:0/1137106294 learned_addr learned my addr 172.21.15.100:0/1137106294 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:58:05.227 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.216+0000 7f5cd6ffd700 1 --2- 172.21.15.100:0/1137106294 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5cd806aab0 0x7f5cd8107fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:05.227 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.220+0000 7f5cd7fff700 1 -- 172.21.15.100:0/1137106294 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5cd80694a0 msgr2=0x7f5cd8107ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:05.227 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.220+0000 7f5cd7fff700 1 --2- 172.21.15.100:0/1137106294 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f5cd80694a0 0x7f5cd8107ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:05.228 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.220+0000 7f5cd7fff700 1 -- 172.21.15.100:0/1137106294 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5cd806aab0 msgr2=0x7f5cd8107fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:05.228 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.220+0000 7f5cd7fff700 1 --2- 172.21.15.100:0/1137106294 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5cd806aab0 0x7f5cd8107fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:05.228 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.220+0000 7f5cd7fff700 1 -- 172.21.15.100:0/1137106294 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd810f9b0 con 0x7f5cd80fd950 2021-01-28T03:58:05.228 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.220+0000 7f5cd7fff700 1 --2- 172.21.15.100:0/1137106294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cd80fd950 0x7f5cd810f080 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f5cc800dc20 tx=0x7f5cc8004ea0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:58:05.228 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.220+0000 7f5ccffff700 1 -- 172.21.15.100:0/1137106294 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc800b7c0 con 0x7f5cd80fd950 2021-01-28T03:58:05.230 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.220+0000 7f5ccffff700 1 -- 172.21.15.100:0/1137106294 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f5cc800f040 con 0x7f5cd80fd950 2021-01-28T03:58:05.231 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.220+0000 7f5cddb40700 1 -- 172.21.15.100:0/1137106294 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cd810fc60 con 0x7f5cd80fd950 2021-01-28T03:58:05.231 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.220+0000 7f5ccffff700 1 -- 172.21.15.100:0/1137106294 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc8013b90 con 0x7f5cd80fd950 2021-01-28T03:58:05.231 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.220+0000 7f5cddb40700 1 -- 172.21.15.100:0/1137106294 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cd8110150 con 0x7f5cd80fd950 2021-01-28T03:58:05.231 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.220+0000 7f5ccffff700 1 -- 172.21.15.100:0/1137106294 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f5cc801a030 con 0x7f5cd80fd950 2021-01-28T03:58:05.232 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.220+0000 7f5cddb40700 1 -- 172.21.15.100:0/1137106294 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5cd805e740 con 0x7f5cd80fd950 2021-01-28T03:58:05.232 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.220+0000 7f5ccffff700 1 --2- 172.21.15.100:0/1137106294 >> v2:172.21.15.100:6800/928846103 conn(0x7f5cc405bd20 0x7f5cc405e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:05.232 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.220+0000 7f5ccffff700 1 -- 172.21.15.100:0/1137106294 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f5cc8075700 con 0x7f5cd80fd950 2021-01-28T03:58:05.232 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.220+0000 7f5cd77fe700 1 --2- 172.21.15.100:0/1137106294 >> v2:172.21.15.100:6800/928846103 conn(0x7f5cc405bd20 0x7f5cc405e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:05.233 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.220+0000 7f5ccffff700 1 --2- 172.21.15.100:0/1137106294 >> v2:172.21.15.100:6813/799206422 conn(0x7f5cc4065690 0x7f5cc4067b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:05.233 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.220+0000 7f5ccffff700 1 -- 172.21.15.100:0/1137106294 --> v2:172.21.15.100:6813/799206422 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5cc4068170 con 0x7f5cc4065690 2021-01-28T03:58:05.233 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.220+0000 7f5ccffff700 1 -- 172.21.15.100:0/1137106294 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5cc8077d70 con 0x7f5cd80fd950 2021-01-28T03:58:05.233 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.220+0000 7f5cd6ffd700 1 --2- 172.21.15.100:0/1137106294 >> v2:172.21.15.100:6813/799206422 conn(0x7f5cc4065690 0x7f5cc4067b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:05.233 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.220+0000 7f5cd77fe700 1 --2- 172.21.15.100:0/1137106294 >> v2:172.21.15.100:6800/928846103 conn(0x7f5cc405bd20 0x7f5cc405e1e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f5cd0009fd0 tx=0x7f5cd000b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:58:05.234 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.220+0000 7f5cd6ffd700 1 --2- 172.21.15.100:0/1137106294 >> v2:172.21.15.100:6813/799206422 conn(0x7f5cc4065690 0x7f5cc4067b30 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:58:05.234 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.224+0000 7f5ccffff700 1 -- 172.21.15.100:0/1137106294 <== osd.3 v2:172.21.15.100:6813/799206422 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7f5cc4068170 con 0x7f5cc4065690 2021-01-28T03:58:05.245 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.240+0000 7f5cddb40700 1 -- 172.21.15.100:0/1137106294 --> v2:172.21.15.100:6813/799206422 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5cd80f3780 con 0x7f5cc4065690 2021-01-28T03:58:05.246 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.240+0000 7f5ccffff700 1 -- 172.21.15.100:0/1137106294 <== osd.3 v2:172.21.15.100:6813/799206422 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f5cd80f3780 con 0x7f5cc4065690 2021-01-28T03:58:05.246 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.240+0000 7f5cddb40700 1 -- 172.21.15.100:0/1137106294 >> v2:172.21.15.100:6813/799206422 conn(0x7f5cc4065690 msgr2=0x7f5cc4067b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:05.247 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.240+0000 7f5cddb40700 1 --2- 172.21.15.100:0/1137106294 >> v2:172.21.15.100:6813/799206422 conn(0x7f5cc4065690 0x7f5cc4067b30 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:05.247 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.240+0000 7f5cddb40700 1 -- 172.21.15.100:0/1137106294 >> v2:172.21.15.100:6800/928846103 conn(0x7f5cc405bd20 msgr2=0x7f5cc405e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:05.248 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.240+0000 7f5cddb40700 1 --2- 172.21.15.100:0/1137106294 >> v2:172.21.15.100:6800/928846103 conn(0x7f5cc405bd20 0x7f5cc405e1e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f5cd0009fd0 tx=0x7f5cd000b040).stop 2021-01-28T03:58:05.248 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.240+0000 7f5cddb40700 1 -- 172.21.15.100:0/1137106294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cd80fd950 msgr2=0x7f5cd810f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:05.248 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.240+0000 7f5cddb40700 1 --2- 172.21.15.100:0/1137106294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cd80fd950 0x7f5cd810f080 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f5cc800dc20 tx=0x7f5cc8004ea0).stop 2021-01-28T03:58:05.248 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.240+0000 7f5cd7fff700 1 -- 172.21.15.100:0/1137106294 reap_dead start 2021-01-28T03:58:05.249 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.240+0000 7f5cddb40700 1 -- 172.21.15.100:0/1137106294 shutdown_connections 2021-01-28T03:58:05.250 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.240+0000 7f5cddb40700 1 -- 172.21.15.100:0/1137106294 >> 172.21.15.100:0/1137106294 conn(0x7f5cd80f1220 msgr2=0x7f5cd80f1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:58:05.250 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.244+0000 7f5cddb40700 1 -- 172.21.15.100:0/1137106294 shutdown_connections 2021-01-28T03:58:05.250 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:05.244+0000 7f5cddb40700 1 -- 172.21.15.100:0/1137106294 wait complete. 2021-01-28T03:58:05.971 INFO:teuthology.orchestra.run.smithi100.stdout:111669149745 2021-01-28T03:58:05.971 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph tell osd.4 flush_pg_stats 2021-01-28T03:58:06.121 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c217df96-611b-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T03:58:06.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:06 smithi162 bash[9856]: cluster 2021-01-28T03:58:05.425306+0000 mgr.y (mgr.14138) 398 : cluster [DBG] pgmap v275: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-01-28T03:58:06.826 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:06 smithi100 bash[9834]: cluster 2021-01-28T03:58:05.425306+0000 mgr.y (mgr.14138) 398 : cluster [DBG] pgmap v275: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-01-28T03:58:06.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:06 smithi100 bash[13549]: cluster 2021-01-28T03:58:05.425306+0000 mgr.y (mgr.14138) 398 : cluster [DBG] pgmap v275: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-01-28T03:58:07.826 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:07 smithi100 bash[9834]: cluster 2021-01-28T03:58:07.426101+0000 mgr.y (mgr.14138) 399 : cluster [DBG] pgmap v276: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-01-28T03:58:07.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:07 smithi100 bash[13549]: cluster 2021-01-28T03:58:07.426101+0000 mgr.y (mgr.14138) 399 : cluster [DBG] pgmap v276: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-01-28T03:58:08.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:07 smithi162 bash[9856]: cluster 2021-01-28T03:58:07.426101+0000 mgr.y (mgr.14138) 399 : cluster [DBG] pgmap v276: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-01-28T03:58:09.335 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.328+0000 7f28109e1700 1 -- 172.21.15.100:0/1691169999 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f280c0fd6a0 msgr2=0x7f280c0ffb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:09.335 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.328+0000 7f28109e1700 1 --2- 172.21.15.100:0/1691169999 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f280c0fd6a0 0x7f280c0ffb30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f2804009e10 tx=0x7f2804004c50).stop 2021-01-28T03:58:09.335 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.328+0000 7f28109e1700 1 -- 172.21.15.100:0/1691169999 shutdown_connections 2021-01-28T03:58:09.336 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.328+0000 7f28109e1700 1 --2- 172.21.15.100:0/1691169999 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f280c05f7d0 0x7f280c0fa880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:09.336 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.328+0000 7f28109e1700 1 --2- 172.21.15.100:0/1691169999 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f280c0fd6a0 0x7f280c0ffb30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:09.336 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.328+0000 7f28109e1700 1 --2- 172.21.15.100:0/1691169999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f280c0fad70 0x7f280c0fd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:09.336 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.328+0000 7f28109e1700 1 -- 172.21.15.100:0/1691169999 >> 172.21.15.100:0/1691169999 conn(0x7f280c0effa0 msgr2=0x7f280c0f23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:58:09.337 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.328+0000 7f28109e1700 1 -- 172.21.15.100:0/1691169999 shutdown_connections 2021-01-28T03:58:09.337 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.328+0000 7f28109e1700 1 -- 172.21.15.100:0/1691169999 wait complete. 2021-01-28T03:58:09.338 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.332+0000 7f28109e1700 1 Processor -- start 2021-01-28T03:58:09.339 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.332+0000 7f28109e1700 1 -- start start 2021-01-28T03:58:09.339 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.332+0000 7f28109e1700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f280c05f7d0 0x7f280c107850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:09.339 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.332+0000 7f28109e1700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f280c0fad70 0x7f280c107d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:09.339 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.332+0000 7f28109e1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f280c0fd6a0 0x7f280c108c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:09.339 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.332+0000 7f28109e1700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280c109160 con 0x7f280c0fd6a0 2021-01-28T03:58:09.340 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.332+0000 7f28109e1700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280c1092d0 con 0x7f280c05f7d0 2021-01-28T03:58:09.340 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.332+0000 7f28109e1700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280c109490 con 0x7f280c0fad70 2021-01-28T03:58:09.340 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.332+0000 7f280bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f280c0fd6a0 0x7f280c108c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:09.341 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.332+0000 7f280affd700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f280c0fad70 0x7f280c107d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:09.341 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.332+0000 7f280bfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f280c0fd6a0 0x7f280c108c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59982/0 (socket says 172.21.15.100:59982) 2021-01-28T03:58:09.341 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.332+0000 7f280bfff700 1 -- 172.21.15.100:0/1533632019 learned_addr learned my addr 172.21.15.100:0/1533632019 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:58:09.341 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.332+0000 7f280b7fe700 1 --2- 172.21.15.100:0/1533632019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f280c05f7d0 0x7f280c107850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:09.341 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.332+0000 7f280bfff700 1 -- 172.21.15.100:0/1533632019 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f280c0fad70 msgr2=0x7f280c107d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:09.342 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.332+0000 7f280bfff700 1 --2- 172.21.15.100:0/1533632019 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f280c0fad70 0x7f280c107d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:09.342 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.332+0000 7f280bfff700 1 -- 172.21.15.100:0/1533632019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f280c05f7d0 msgr2=0x7f280c107850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:09.342 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.332+0000 7f280bfff700 1 --2- 172.21.15.100:0/1533632019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f280c05f7d0 0x7f280c107850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:09.342 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.332+0000 7f280bfff700 1 -- 172.21.15.100:0/1533632019 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280c109650 con 0x7f280c0fd6a0 2021-01-28T03:58:09.342 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.332+0000 7f280bfff700 1 --2- 172.21.15.100:0/1533632019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f280c0fd6a0 0x7f280c108c30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f2804007680 tx=0x7f2804007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:58:09.343 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.332+0000 7f27f3fff700 1 -- 172.21.15.100:0/1533632019 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280400e030 con 0x7f280c0fd6a0 2021-01-28T03:58:09.343 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.332+0000 7f28109e1700 1 -- 172.21.15.100:0/1533632019 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f280c1098a0 con 0x7f280c0fd6a0 2021-01-28T03:58:09.343 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.332+0000 7f27f3fff700 1 -- 172.21.15.100:0/1533632019 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f2804013b60 con 0x7f280c0fd6a0 2021-01-28T03:58:09.343 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.332+0000 7f27f3fff700 1 -- 172.21.15.100:0/1533632019 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2804018070 con 0x7f280c0fd6a0 2021-01-28T03:58:09.344 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.332+0000 7f28109e1700 1 -- 172.21.15.100:0/1533632019 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f280c110040 con 0x7f280c0fd6a0 2021-01-28T03:58:09.344 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.332+0000 7f28109e1700 1 -- 172.21.15.100:0/1533632019 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f27ec000f10 con 0x7f280c0fd6a0 2021-01-28T03:58:09.345 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.336+0000 7f27f3fff700 1 -- 172.21.15.100:0/1533632019 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f2804013cd0 con 0x7f280c0fd6a0 2021-01-28T03:58:09.345 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.336+0000 7f27f3fff700 1 --2- 172.21.15.100:0/1533632019 >> v2:172.21.15.100:6800/928846103 conn(0x7f27f405bc70 0x7f27f405e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:09.345 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.336+0000 7f27f3fff700 1 -- 172.21.15.100:0/1533632019 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f28040779a0 con 0x7f280c0fd6a0 2021-01-28T03:58:09.346 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.336+0000 7f280b7fe700 1 --2- 172.21.15.100:0/1533632019 >> v2:172.21.15.100:6800/928846103 conn(0x7f27f405bc70 0x7f27f405e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:09.346 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.336+0000 7f27f3fff700 1 --2- 172.21.15.100:0/1533632019 >> v2:172.21.15.162:6800/4274488621 conn(0x7f27f4065560 0x7f27f4067a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:09.346 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.336+0000 7f27f3fff700 1 -- 172.21.15.100:0/1533632019 --> v2:172.21.15.162:6800/4274488621 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f27f4068040 con 0x7f27f4065560 2021-01-28T03:58:09.346 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.336+0000 7f27f3fff700 1 -- 172.21.15.100:0/1533632019 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2804077da0 con 0x7f280c0fd6a0 2021-01-28T03:58:09.346 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.336+0000 7f280affd700 1 --2- 172.21.15.100:0/1533632019 >> v2:172.21.15.162:6800/4274488621 conn(0x7f27f4065560 0x7f27f4067a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:09.347 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.336+0000 7f280b7fe700 1 --2- 172.21.15.100:0/1533632019 >> v2:172.21.15.100:6800/928846103 conn(0x7f27f405bc70 0x7f27f405e130 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f27fc004ce0 tx=0x7f27fc00b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:58:09.347 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.336+0000 7f280affd700 1 --2- 172.21.15.100:0/1533632019 >> v2:172.21.15.162:6800/4274488621 conn(0x7f27f4065560 0x7f27f4067a00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:58:09.347 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.340+0000 7f27f3fff700 1 -- 172.21.15.100:0/1533632019 <== osd.4 v2:172.21.15.162:6800/4274488621 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7f27f4068040 con 0x7f27f4065560 2021-01-28T03:58:09.366 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.360+0000 7f28109e1700 1 -- 172.21.15.100:0/1533632019 --> v2:172.21.15.162:6800/4274488621 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f27ec002870 con 0x7f27f4065560 2021-01-28T03:58:09.366 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.360+0000 7f27f3fff700 1 -- 172.21.15.100:0/1533632019 <== osd.4 v2:172.21.15.162:6800/4274488621 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f27ec002870 con 0x7f27f4065560 2021-01-28T03:58:09.367 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.364+0000 7f28109e1700 1 -- 172.21.15.100:0/1533632019 >> v2:172.21.15.162:6800/4274488621 conn(0x7f27f4065560 msgr2=0x7f27f4067a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:09.367 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.364+0000 7f28109e1700 1 --2- 172.21.15.100:0/1533632019 >> v2:172.21.15.162:6800/4274488621 conn(0x7f27f4065560 0x7f27f4067a00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:09.368 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.364+0000 7f28109e1700 1 -- 172.21.15.100:0/1533632019 >> v2:172.21.15.100:6800/928846103 conn(0x7f27f405bc70 msgr2=0x7f27f405e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:09.369 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.364+0000 7f28109e1700 1 --2- 172.21.15.100:0/1533632019 >> v2:172.21.15.100:6800/928846103 conn(0x7f27f405bc70 0x7f27f405e130 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f27fc004ce0 tx=0x7f27fc00b040).stop 2021-01-28T03:58:09.369 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.364+0000 7f28109e1700 1 -- 172.21.15.100:0/1533632019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f280c0fd6a0 msgr2=0x7f280c108c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:09.369 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.364+0000 7f28109e1700 1 --2- 172.21.15.100:0/1533632019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f280c0fd6a0 0x7f280c108c30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f2804007680 tx=0x7f2804007f90).stop 2021-01-28T03:58:09.369 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.364+0000 7f280bfff700 1 -- 172.21.15.100:0/1533632019 reap_dead start 2021-01-28T03:58:09.370 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.364+0000 7f28109e1700 1 -- 172.21.15.100:0/1533632019 shutdown_connections 2021-01-28T03:58:09.370 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.364+0000 7f28109e1700 1 -- 172.21.15.100:0/1533632019 >> 172.21.15.100:0/1533632019 conn(0x7f280c0effa0 msgr2=0x7f280c0fb970 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:58:09.370 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.364+0000 7f28109e1700 1 -- 172.21.15.100:0/1533632019 shutdown_connections 2021-01-28T03:58:09.370 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:09.364+0000 7f28109e1700 1 -- 172.21.15.100:0/1533632019 wait complete. 2021-01-28T03:58:09.826 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:58:09 smithi100 bash[10061]: debug 2021-01-28T03:58:09.560+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T03:58:10.012 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 03:58:09 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T03:58:10.153 INFO:teuthology.orchestra.run.smithi100.stdout:133143986220 2021-01-28T03:58:10.154 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph tell osd.5 flush_pg_stats 2021-01-28T03:58:10.302 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c217df96-611b-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T03:58:10.486 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:10 smithi100 bash[9834]: cluster 2021-01-28T03:58:09.427467+0000 mgr.y (mgr.14138) 400 : cluster [DBG] pgmap v277: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:10.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:10 smithi162 bash[9856]: cluster 2021-01-28T03:58:09.427467+0000 mgr.y (mgr.14138) 400 : cluster [DBG] pgmap v277: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:10.826 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:10 smithi100 bash[13549]: cluster 2021-01-28T03:58:09.427467+0000 mgr.y (mgr.14138) 400 : cluster [DBG] pgmap v277: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:11.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:11 smithi162 bash[9856]: audit 2021-01-28T03:58:09.563974+0000 mgr.y (mgr.14138) 401 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:58:11.771 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:11 smithi100 bash[9834]: audit 2021-01-28T03:58:09.563974+0000 mgr.y (mgr.14138) 401 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:58:11.771 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:11 smithi100 bash[13549]: audit 2021-01-28T03:58:09.563974+0000 mgr.y (mgr.14138) 401 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:58:12.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:12 smithi162 bash[9856]: cluster 2021-01-28T03:58:11.428431+0000 mgr.y (mgr.14138) 402 : cluster [DBG] pgmap v278: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-01-28T03:58:12.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:12 smithi100 bash[9834]: cluster 2021-01-28T03:58:11.428431+0000 mgr.y (mgr.14138) 402 : cluster [DBG] pgmap v278: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-01-28T03:58:12.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:12 smithi100 bash[13549]: cluster 2021-01-28T03:58:11.428431+0000 mgr.y (mgr.14138) 402 : cluster [DBG] pgmap v278: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-01-28T03:58:13.690 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.684+0000 7f0098c9a700 1 -- 172.21.15.100:0/363341720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00940f72b0 msgr2=0x7f00940f7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:13.690 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.684+0000 7f0098c9a700 1 --2- 172.21.15.100:0/363341720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00940f72b0 0x7f00940f7730 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f008c009dc0 tx=0x7f008c004d10).stop 2021-01-28T03:58:13.690 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.684+0000 7f0098c9a700 1 -- 172.21.15.100:0/363341720 shutdown_connections 2021-01-28T03:58:13.691 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.684+0000 7f0098c9a700 1 --2- 172.21.15.100:0/363341720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00940f72b0 0x7f00940f7730 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:13.691 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.684+0000 7f0098c9a700 1 --2- 172.21.15.100:0/363341720 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f00940f3b70 0x7f00940f3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:13.691 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.684+0000 7f0098c9a700 1 --2- 172.21.15.100:0/363341720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00940f4510 0x7f00940f6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:13.691 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.684+0000 7f0098c9a700 1 -- 172.21.15.100:0/363341720 >> 172.21.15.100:0/363341720 conn(0x7f00940ef730 msgr2=0x7f00940f1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:58:13.691 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.684+0000 7f0098c9a700 1 -- 172.21.15.100:0/363341720 shutdown_connections 2021-01-28T03:58:13.692 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.684+0000 7f0098c9a700 1 -- 172.21.15.100:0/363341720 wait complete. 2021-01-28T03:58:13.693 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.684+0000 7f0098c9a700 1 Processor -- start 2021-01-28T03:58:13.693 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.684+0000 7f0098c9a700 1 -- start start 2021-01-28T03:58:13.694 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.688+0000 7f0098c9a700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00940f3b70 0x7f0094105640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:13.694 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.688+0000 7f0098c9a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00940f4510 0x7f0094105b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:13.695 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.688+0000 7f0098c9a700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f00940f72b0 0x7f0094106a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:13.695 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.688+0000 7f0098c9a700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0094106f50 con 0x7f00940f4510 2021-01-28T03:58:13.695 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.688+0000 7f0098c9a700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00941070c0 con 0x7f00940f3b70 2021-01-28T03:58:13.695 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.688+0000 7f0098c9a700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0094107280 con 0x7f00940f72b0 2021-01-28T03:58:13.695 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.688+0000 7f0093fff700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f00940f72b0 0x7f0094106a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:13.696 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.688+0000 7f0093fff700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f00940f72b0 0x7f0094106a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:40978/0 (socket says 172.21.15.100:40978) 2021-01-28T03:58:13.696 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.688+0000 7f0093fff700 1 -- 172.21.15.100:0/1876612125 learned_addr learned my addr 172.21.15.100:0/1876612125 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:58:13.696 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.688+0000 7f00937fe700 1 --2- 172.21.15.100:0/1876612125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00940f3b70 0x7f0094105640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:13.696 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.688+0000 7f008bfff700 1 --2- 172.21.15.100:0/1876612125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00940f4510 0x7f0094105b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:13.696 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.688+0000 7f0093fff700 1 -- 172.21.15.100:0/1876612125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00940f3b70 msgr2=0x7f0094105640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:13.697 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.688+0000 7f0093fff700 1 --2- 172.21.15.100:0/1876612125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00940f3b70 0x7f0094105640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:13.697 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.688+0000 7f0093fff700 1 -- 172.21.15.100:0/1876612125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00940f4510 msgr2=0x7f0094105b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:13.697 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.688+0000 7f0093fff700 1 --2- 172.21.15.100:0/1876612125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00940f4510 0x7f0094105b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:13.697 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.688+0000 7f0093fff700 1 -- 172.21.15.100:0/1876612125 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0094107440 con 0x7f00940f72b0 2021-01-28T03:58:13.698 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.688+0000 7f0093fff700 1 --2- 172.21.15.100:0/1876612125 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f00940f72b0 0x7f0094106a20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f008c00b740 tx=0x7f008c004d10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:58:13.698 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.688+0000 7f0090ff9700 1 -- 172.21.15.100:0/1876612125 <== mon.1 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c00e070 con 0x7f00940f72b0 2021-01-28T03:58:13.698 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.688+0000 7f0090ff9700 1 -- 172.21.15.100:0/1876612125 <== mon.1 v2:172.21.15.100:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f008c004e90 con 0x7f00940f72b0 2021-01-28T03:58:13.698 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.688+0000 7f0098c9a700 1 -- 172.21.15.100:0/1876612125 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0094107690 con 0x7f00940f72b0 2021-01-28T03:58:13.698 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.688+0000 7f0090ff9700 1 -- 172.21.15.100:0/1876612125 <== mon.1 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c018070 con 0x7f00940f72b0 2021-01-28T03:58:13.699 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.688+0000 7f0098c9a700 1 -- 172.21.15.100:0/1876612125 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00940f4cc0 con 0x7f00940f72b0 2021-01-28T03:58:13.700 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.688+0000 7f0098c9a700 1 -- 172.21.15.100:0/1876612125 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f009405d5a0 con 0x7f00940f72b0 2021-01-28T03:58:13.700 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.692+0000 7f0090ff9700 1 -- 172.21.15.100:0/1876612125 <== mon.1 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f008c024060 con 0x7f00940f72b0 2021-01-28T03:58:13.700 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.692+0000 7f0090ff9700 1 --2- 172.21.15.100:0/1876612125 >> v2:172.21.15.100:6800/928846103 conn(0x7f008005bc70 0x7f008005e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:13.700 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.692+0000 7f0090ff9700 1 -- 172.21.15.100:0/1876612125 <== mon.1 v2:172.21.15.100:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f008c0775f0 con 0x7f00940f72b0 2021-01-28T03:58:13.701 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.692+0000 7f00937fe700 1 --2- 172.21.15.100:0/1876612125 >> v2:172.21.15.100:6800/928846103 conn(0x7f008005bc70 0x7f008005e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:13.701 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.692+0000 7f0090ff9700 1 --2- 172.21.15.100:0/1876612125 >> v2:172.21.15.162:6804/1953061558 conn(0x7f00800655e0 0x7f0080067a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:13.701 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.692+0000 7f0090ff9700 1 -- 172.21.15.100:0/1876612125 --> v2:172.21.15.162:6804/1953061558 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f00800680c0 con 0x7f00800655e0 2021-01-28T03:58:13.701 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.692+0000 7f0090ff9700 1 -- 172.21.15.100:0/1876612125 <== mon.1 v2:172.21.15.100:3301/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f008c079c60 con 0x7f00940f72b0 2021-01-28T03:58:13.701 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.692+0000 7f00937fe700 1 --2- 172.21.15.100:0/1876612125 >> v2:172.21.15.100:6800/928846103 conn(0x7f008005bc70 0x7f008005e130 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f0084009fd0 tx=0x7f008400b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:58:13.702 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.692+0000 7f008bfff700 1 --2- 172.21.15.100:0/1876612125 >> v2:172.21.15.162:6804/1953061558 conn(0x7f00800655e0 0x7f0080067a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:13.702 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.692+0000 7f008bfff700 1 --2- 172.21.15.100:0/1876612125 >> v2:172.21.15.162:6804/1953061558 conn(0x7f00800655e0 0x7f0080067a80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:58:13.702 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.696+0000 7f0090ff9700 1 -- 172.21.15.100:0/1876612125 <== osd.5 v2:172.21.15.162:6804/1953061558 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7f00800680c0 con 0x7f00800655e0 2021-01-28T03:58:13.719 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.712+0000 7f0098c9a700 1 -- 172.21.15.100:0/1876612125 --> v2:172.21.15.162:6804/1953061558 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0094057240 con 0x7f00800655e0 2021-01-28T03:58:13.720 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.716+0000 7f0090ff9700 1 -- 172.21.15.100:0/1876612125 <== osd.5 v2:172.21.15.162:6804/1953061558 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f0094057240 con 0x7f00800655e0 2021-01-28T03:58:13.721 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.716+0000 7f0098c9a700 1 -- 172.21.15.100:0/1876612125 >> v2:172.21.15.162:6804/1953061558 conn(0x7f00800655e0 msgr2=0x7f0080067a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:13.721 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.716+0000 7f0098c9a700 1 --2- 172.21.15.100:0/1876612125 >> v2:172.21.15.162:6804/1953061558 conn(0x7f00800655e0 0x7f0080067a80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:13.721 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.716+0000 7f0098c9a700 1 -- 172.21.15.100:0/1876612125 >> v2:172.21.15.100:6800/928846103 conn(0x7f008005bc70 msgr2=0x7f008005e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:13.721 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.716+0000 7f0098c9a700 1 --2- 172.21.15.100:0/1876612125 >> v2:172.21.15.100:6800/928846103 conn(0x7f008005bc70 0x7f008005e130 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f0084009fd0 tx=0x7f008400b040).stop 2021-01-28T03:58:13.722 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.716+0000 7f0098c9a700 1 -- 172.21.15.100:0/1876612125 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f00940f72b0 msgr2=0x7f0094106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:13.722 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.716+0000 7f0098c9a700 1 --2- 172.21.15.100:0/1876612125 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f00940f72b0 0x7f0094106a20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f008c00b740 tx=0x7f008c004d10).stop 2021-01-28T03:58:13.722 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.716+0000 7f0093fff700 1 -- 172.21.15.100:0/1876612125 reap_dead start 2021-01-28T03:58:13.722 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.716+0000 7f0098c9a700 1 -- 172.21.15.100:0/1876612125 shutdown_connections 2021-01-28T03:58:13.722 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.716+0000 7f0098c9a700 1 -- 172.21.15.100:0/1876612125 >> 172.21.15.100:0/1876612125 conn(0x7f00940ef730 msgr2=0x7f00940f1450 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:58:13.723 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.716+0000 7f0098c9a700 1 -- 172.21.15.100:0/1876612125 shutdown_connections 2021-01-28T03:58:13.723 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:13.716+0000 7f0098c9a700 1 -- 172.21.15.100:0/1876612125 wait complete. 2021-01-28T03:58:13.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:13 smithi162 bash[9856]: cluster 2021-01-28T03:58:13.429582+0000 mgr.y (mgr.14138) 403 : cluster [DBG] pgmap v279: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:58:13.770 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:13 smithi100 bash[9834]: cluster 2021-01-28T03:58:13.429582+0000 mgr.y (mgr.14138) 403 : cluster [DBG] pgmap v279: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:58:13.770 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:13 smithi100 bash[13549]: cluster 2021-01-28T03:58:13.429582+0000 mgr.y (mgr.14138) 403 : cluster [DBG] pgmap v279: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:58:14.493 INFO:teuthology.orchestra.run.smithi100.stdout:154618822696 2021-01-28T03:58:14.493 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph tell osd.6 flush_pg_stats 2021-01-28T03:58:14.651 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c217df96-611b-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T03:58:16.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:16 smithi162 bash[9856]: cluster 2021-01-28T03:58:15.430785+0000 mgr.y (mgr.14138) 404 : cluster [DBG] pgmap v280: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:16.826 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:16 smithi100 bash[9834]: cluster 2021-01-28T03:58:15.430785+0000 mgr.y (mgr.14138) 404 : cluster [DBG] pgmap v280: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:16.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:16 smithi100 bash[13549]: cluster 2021-01-28T03:58:15.430785+0000 mgr.y (mgr.14138) 404 : cluster [DBG] pgmap v280: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:17.858 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.852+0000 7f0431b4d700 1 -- 172.21.15.100:0/1317741969 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f042c0f5d80 msgr2=0x7f042c0f61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:17.858 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.852+0000 7f0431b4d700 1 --2- 172.21.15.100:0/1317741969 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f042c0f5d80 0x7f042c0f61a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f0428004d40 tx=0x7f0428009b30).stop 2021-01-28T03:58:17.858 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.852+0000 7f0431b4d700 1 -- 172.21.15.100:0/1317741969 shutdown_connections 2021-01-28T03:58:17.858 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.852+0000 7f0431b4d700 1 --2- 172.21.15.100:0/1317741969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f042c0f3f80 0x7f042c0f43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:17.859 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.852+0000 7f0431b4d700 1 --2- 172.21.15.100:0/1317741969 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f042c0f5d80 0x7f042c0f61a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:17.859 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.852+0000 7f0431b4d700 1 --2- 172.21.15.100:0/1317741969 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f042c0f6720 0x7f042c0f39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:17.859 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.852+0000 7f0431b4d700 1 -- 172.21.15.100:0/1317741969 >> 172.21.15.100:0/1317741969 conn(0x7f042c0ef730 msgr2=0x7f042c0f1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:58:17.859 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.852+0000 7f0431b4d700 1 -- 172.21.15.100:0/1317741969 shutdown_connections 2021-01-28T03:58:17.860 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.852+0000 7f0431b4d700 1 -- 172.21.15.100:0/1317741969 wait complete. 2021-01-28T03:58:17.861 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.852+0000 7f0431b4d700 1 Processor -- start 2021-01-28T03:58:17.861 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.852+0000 7f0431b4d700 1 -- start start 2021-01-28T03:58:17.861 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.852+0000 7f0431b4d700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f042c0f3f80 0x7f042c107ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:17.862 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.852+0000 7f0431b4d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f042c0f5d80 0x7f042c1081d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:17.862 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.852+0000 7f0431b4d700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f042c0f6720 0x7f042c108f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:17.862 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.852+0000 7f0431b4d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042c109550 con 0x7f042c0f5d80 2021-01-28T03:58:17.862 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.852+0000 7f0431b4d700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042c1096c0 con 0x7f042c0f6720 2021-01-28T03:58:17.862 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.852+0000 7f0431b4d700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042c109880 con 0x7f042c0f3f80 2021-01-28T03:58:17.863 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.852+0000 7f0430b4b700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f042c0f3f80 0x7f042c107ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:17.863 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.856+0000 7f0430b4b700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f042c0f3f80 0x7f042c107ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:40992/0 (socket says 172.21.15.100:40992) 2021-01-28T03:58:17.863 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.856+0000 7f0430b4b700 1 -- 172.21.15.100:0/500993552 learned_addr learned my addr 172.21.15.100:0/500993552 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:58:17.863 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.856+0000 7f0423fff700 1 --2- 172.21.15.100:0/500993552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f042c0f5d80 0x7f042c1081d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:17.863 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.856+0000 7f043134c700 1 --2- 172.21.15.100:0/500993552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f042c0f6720 0x7f042c108f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:17.864 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.856+0000 7f0430b4b700 1 -- 172.21.15.100:0/500993552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f042c0f6720 msgr2=0x7f042c108f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:17.864 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.856+0000 7f0430b4b700 1 --2- 172.21.15.100:0/500993552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f042c0f6720 0x7f042c108f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:17.864 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.856+0000 7f0430b4b700 1 -- 172.21.15.100:0/500993552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f042c0f5d80 msgr2=0x7f042c1081d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:17.864 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.856+0000 7f0430b4b700 1 --2- 172.21.15.100:0/500993552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f042c0f5d80 0x7f042c1081d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:17.865 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.856+0000 7f0430b4b700 1 -- 172.21.15.100:0/500993552 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042c109a40 con 0x7f042c0f3f80 2021-01-28T03:58:17.865 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.856+0000 7f0430b4b700 1 --2- 172.21.15.100:0/500993552 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f042c0f3f80 0x7f042c107ce0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f042800c010 tx=0x7f0428009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:58:17.865 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.856+0000 7f04217fa700 1 -- 172.21.15.100:0/500993552 <== mon.1 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042800e030 con 0x7f042c0f3f80 2021-01-28T03:58:17.865 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.856+0000 7f04217fa700 1 -- 172.21.15.100:0/500993552 <== mon.1 v2:172.21.15.100:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f0428004160 con 0x7f042c0f3f80 2021-01-28T03:58:17.866 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.856+0000 7f0431b4d700 1 -- 172.21.15.100:0/500993552 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f042c109c90 con 0x7f042c0f3f80 2021-01-28T03:58:17.866 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.856+0000 7f0431b4d700 1 -- 172.21.15.100:0/500993552 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f042c110390 con 0x7f042c0f3f80 2021-01-28T03:58:17.866 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.856+0000 7f04217fa700 1 -- 172.21.15.100:0/500993552 <== mon.1 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0428018070 con 0x7f042c0f3f80 2021-01-28T03:58:17.868 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.856+0000 7f0431b4d700 1 -- 172.21.15.100:0/500993552 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f040c000f10 con 0x7f042c0f3f80 2021-01-28T03:58:17.868 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.860+0000 7f04217fa700 1 -- 172.21.15.100:0/500993552 <== mon.1 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f042801d420 con 0x7f042c0f3f80 2021-01-28T03:58:17.868 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.860+0000 7f04217fa700 1 --2- 172.21.15.100:0/500993552 >> v2:172.21.15.100:6800/928846103 conn(0x7f041405bcc0 0x7f041405e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:17.868 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.860+0000 7f04217fa700 1 -- 172.21.15.100:0/500993552 <== mon.1 v2:172.21.15.100:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f0428077aa0 con 0x7f042c0f3f80 2021-01-28T03:58:17.869 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.860+0000 7f0423fff700 1 --2- 172.21.15.100:0/500993552 >> v2:172.21.15.100:6800/928846103 conn(0x7f041405bcc0 0x7f041405e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:17.869 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.860+0000 7f04217fa700 1 --2- 172.21.15.100:0/500993552 >> v2:172.21.15.162:6808/3682466023 conn(0x7f04140656b0 0x7f0414067b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:17.869 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.860+0000 7f04217fa700 1 -- 172.21.15.100:0/500993552 --> v2:172.21.15.162:6808/3682466023 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0414068190 con 0x7f04140656b0 2021-01-28T03:58:17.870 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.860+0000 7f04217fa700 1 -- 172.21.15.100:0/500993552 <== mon.1 v2:172.21.15.100:3301/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0428077e20 con 0x7f042c0f3f80 2021-01-28T03:58:17.870 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.860+0000 7f0423fff700 1 --2- 172.21.15.100:0/500993552 >> v2:172.21.15.100:6800/928846103 conn(0x7f041405bcc0 0x7f041405e180 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f041c009fd0 tx=0x7f041c00b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:58:17.870 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.860+0000 7f043134c700 1 --2- 172.21.15.100:0/500993552 >> v2:172.21.15.162:6808/3682466023 conn(0x7f04140656b0 0x7f0414067b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:17.870 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.860+0000 7f043134c700 1 --2- 172.21.15.100:0/500993552 >> v2:172.21.15.162:6808/3682466023 conn(0x7f04140656b0 0x7f0414067b50 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:58:17.871 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.864+0000 7f04217fa700 1 -- 172.21.15.100:0/500993552 <== osd.6 v2:172.21.15.162:6808/3682466023 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7f0414068190 con 0x7f04140656b0 2021-01-28T03:58:17.884 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.880+0000 7f0431b4d700 1 -- 172.21.15.100:0/500993552 --> v2:172.21.15.162:6808/3682466023 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f040c002870 con 0x7f04140656b0 2021-01-28T03:58:17.885 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.880+0000 7f04217fa700 1 -- 172.21.15.100:0/500993552 <== osd.6 v2:172.21.15.162:6808/3682466023 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f040c002870 con 0x7f04140656b0 2021-01-28T03:58:17.886 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.880+0000 7f0431b4d700 1 -- 172.21.15.100:0/500993552 >> v2:172.21.15.162:6808/3682466023 conn(0x7f04140656b0 msgr2=0x7f0414067b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:17.887 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.880+0000 7f0431b4d700 1 --2- 172.21.15.100:0/500993552 >> v2:172.21.15.162:6808/3682466023 conn(0x7f04140656b0 0x7f0414067b50 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:17.887 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.880+0000 7f0431b4d700 1 -- 172.21.15.100:0/500993552 >> v2:172.21.15.100:6800/928846103 conn(0x7f041405bcc0 msgr2=0x7f041405e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:17.887 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.880+0000 7f0431b4d700 1 --2- 172.21.15.100:0/500993552 >> v2:172.21.15.100:6800/928846103 conn(0x7f041405bcc0 0x7f041405e180 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f041c009fd0 tx=0x7f041c00b040).stop 2021-01-28T03:58:17.887 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.880+0000 7f0431b4d700 1 -- 172.21.15.100:0/500993552 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f042c0f3f80 msgr2=0x7f042c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:17.887 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.880+0000 7f0431b4d700 1 --2- 172.21.15.100:0/500993552 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f042c0f3f80 0x7f042c107ce0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f042800c010 tx=0x7f0428009b30).stop 2021-01-28T03:58:17.888 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.880+0000 7f043134c700 1 -- 172.21.15.100:0/500993552 reap_dead start 2021-01-28T03:58:17.888 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.880+0000 7f0431b4d700 1 -- 172.21.15.100:0/500993552 shutdown_connections 2021-01-28T03:58:17.888 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.880+0000 7f0431b4d700 1 -- 172.21.15.100:0/500993552 >> 172.21.15.100:0/500993552 conn(0x7f042c0ef730 msgr2=0x7f042c0f1880 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:58:17.888 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.880+0000 7f0431b4d700 1 -- 172.21.15.100:0/500993552 shutdown_connections 2021-01-28T03:58:17.888 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:17.880+0000 7f0431b4d700 1 -- 172.21.15.100:0/500993552 wait complete. 2021-01-28T03:58:17.941 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:17 smithi100 bash[9834]: cluster 2021-01-28T03:58:17.431757+0000 mgr.y (mgr.14138) 405 : cluster [DBG] pgmap v281: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:17.942 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:17 smithi100 bash[13549]: cluster 2021-01-28T03:58:17.431757+0000 mgr.y (mgr.14138) 405 : cluster [DBG] pgmap v281: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:18.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:17 smithi162 bash[9856]: cluster 2021-01-28T03:58:17.431757+0000 mgr.y (mgr.14138) 405 : cluster [DBG] pgmap v281: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:18.665 INFO:teuthology.orchestra.run.smithi100.stdout:176093659171 2021-01-28T03:58:18.666 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph tell osd.7 flush_pg_stats 2021-01-28T03:58:18.822 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c217df96-611b-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T03:58:19.826 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:58:19 smithi100 bash[10061]: debug 2021-01-28T03:58:19.568+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T03:58:20.012 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 03:58:19 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T03:58:20.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:20 smithi162 bash[9856]: cluster 2021-01-28T03:58:19.433167+0000 mgr.y (mgr.14138) 406 : cluster [DBG] pgmap v282: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:58:20.826 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:20 smithi100 bash[9834]: cluster 2021-01-28T03:58:19.433167+0000 mgr.y (mgr.14138) 406 : cluster [DBG] pgmap v282: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:58:20.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:20 smithi100 bash[13549]: cluster 2021-01-28T03:58:19.433167+0000 mgr.y (mgr.14138) 406 : cluster [DBG] pgmap v282: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:58:21.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:21 smithi162 bash[9856]: audit 2021-01-28T03:58:19.571830+0000 mgr.y (mgr.14138) 407 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:58:21.797 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.792+0000 7f3c98923700 1 -- 172.21.15.100:0/3749621965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c940f47a0 msgr2=0x7f3c940f4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:21.797 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.792+0000 7f3c98923700 1 --2- 172.21.15.100:0/3749621965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c940f47a0 0x7f3c940f4bc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f3c84004e00 tx=0x7f3c84009b30).stop 2021-01-28T03:58:21.797 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.792+0000 7f3c98923700 1 -- 172.21.15.100:0/3749621965 shutdown_connections 2021-01-28T03:58:21.797 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.792+0000 7f3c98923700 1 --2- 172.21.15.100:0/3749621965 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3c940f6390 0x7f3c940fcc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:21.798 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.792+0000 7f3c98923700 1 --2- 172.21.15.100:0/3749621965 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c940f47a0 0x7f3c940f4bc0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:21.798 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.792+0000 7f3c98923700 1 --2- 172.21.15.100:0/3749621965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c940f5a40 0x7f3c940f5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:21.798 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.792+0000 7f3c98923700 1 -- 172.21.15.100:0/3749621965 >> 172.21.15.100:0/3749621965 conn(0x7f3c940effa0 msgr2=0x7f3c940f23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:58:21.798 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.792+0000 7f3c98923700 1 -- 172.21.15.100:0/3749621965 shutdown_connections 2021-01-28T03:58:21.799 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.792+0000 7f3c98923700 1 -- 172.21.15.100:0/3749621965 wait complete. 2021-01-28T03:58:21.800 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.792+0000 7f3c98923700 1 Processor -- start 2021-01-28T03:58:21.801 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.792+0000 7f3c98923700 1 -- start start 2021-01-28T03:58:21.801 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.792+0000 7f3c98923700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c940f47a0 0x7f3c94104810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:21.801 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.792+0000 7f3c98923700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3c940f5a40 0x7f3c94104d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:21.802 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.792+0000 7f3c98923700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c940f6390 0x7f3c94105bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:21.802 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.792+0000 7f3c98923700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c94106120 con 0x7f3c940f6390 2021-01-28T03:58:21.802 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.792+0000 7f3c98923700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c94106290 con 0x7f3c940f47a0 2021-01-28T03:58:21.802 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.792+0000 7f3c98923700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c94106450 con 0x7f3c940f5a40 2021-01-28T03:58:21.803 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.792+0000 7f3c8a59c700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3c940f5a40 0x7f3c94104d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:21.803 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.792+0000 7f3c9359e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c940f6390 0x7f3c94105bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:21.803 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.792+0000 7f3c8a59c700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3c940f5a40 0x7f3c94104d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:41010/0 (socket says 172.21.15.100:41010) 2021-01-28T03:58:21.803 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.792+0000 7f3c8a59c700 1 -- 172.21.15.100:0/1469225319 learned_addr learned my addr 172.21.15.100:0/1469225319 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:58:21.804 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.792+0000 7f3c9359e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c940f6390 0x7f3c94105bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60030/0 (socket says 172.21.15.100:60030) 2021-01-28T03:58:21.804 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.792+0000 7f3c92d9d700 1 --2- 172.21.15.100:0/1469225319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c940f47a0 0x7f3c94104810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:21.804 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.796+0000 7f3c8a59c700 1 -- 172.21.15.100:0/1469225319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c940f47a0 msgr2=0x7f3c94104810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:21.804 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.796+0000 7f3c8a59c700 1 --2- 172.21.15.100:0/1469225319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c940f47a0 0x7f3c94104810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:21.805 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.796+0000 7f3c8a59c700 1 -- 172.21.15.100:0/1469225319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c940f6390 msgr2=0x7f3c94105bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:21.805 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.796+0000 7f3c8a59c700 1 --2- 172.21.15.100:0/1469225319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c940f6390 0x7f3c94105bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:21.805 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.796+0000 7f3c8a59c700 1 -- 172.21.15.100:0/1469225319 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c94106610 con 0x7f3c940f5a40 2021-01-28T03:58:21.806 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.796+0000 7f3c9359e700 1 --2- 172.21.15.100:0/1469225319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c940f6390 0x7f3c94105bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-28T03:58:21.806 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.796+0000 7f3c8a59c700 1 --2- 172.21.15.100:0/1469225319 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3c940f5a40 0x7f3c94104d00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f3c7c00fcb0 tx=0x7f3c7c009de0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:58:21.806 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.796+0000 7f3c8bfff700 1 -- 172.21.15.100:0/1469225319 <== mon.1 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c009320 con 0x7f3c940f5a40 2021-01-28T03:58:21.806 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.796+0000 7f3c8bfff700 1 -- 172.21.15.100:0/1469225319 <== mon.1 v2:172.21.15.100:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f3c7c009480 con 0x7f3c940f5a40 2021-01-28T03:58:21.807 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.796+0000 7f3c98923700 1 -- 172.21.15.100:0/1469225319 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c941068c0 con 0x7f3c940f5a40 2021-01-28T03:58:21.807 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.796+0000 7f3c8bfff700 1 -- 172.21.15.100:0/1469225319 <== mon.1 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c002a80 con 0x7f3c940f5a40 2021-01-28T03:58:21.807 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.796+0000 7f3c98923700 1 -- 172.21.15.100:0/1469225319 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c9405ec20 con 0x7f3c940f5a40 2021-01-28T03:58:21.809 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.796+0000 7f3c98923700 1 -- 172.21.15.100:0/1469225319 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3c9405d6e0 con 0x7f3c940f5a40 2021-01-28T03:58:21.809 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.796+0000 7f3c8bfff700 1 -- 172.21.15.100:0/1469225319 <== mon.1 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f3c7c0077b0 con 0x7f3c940f5a40 2021-01-28T03:58:21.810 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.796+0000 7f3c8bfff700 1 --2- 172.21.15.100:0/1469225319 >> v2:172.21.15.100:6800/928846103 conn(0x7f3c8005bc70 0x7f3c8005e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:21.810 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.796+0000 7f3c8bfff700 1 -- 172.21.15.100:0/1469225319 <== mon.1 v2:172.21.15.100:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f3c7c078150 con 0x7f3c940f5a40 2021-01-28T03:58:21.810 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.796+0000 7f3c92d9d700 1 --2- 172.21.15.100:0/1469225319 >> v2:172.21.15.100:6800/928846103 conn(0x7f3c8005bc70 0x7f3c8005e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:21.811 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.800+0000 7f3c8bfff700 1 --2- 172.21.15.100:0/1469225319 >> v2:172.21.15.162:6812/2319408968 conn(0x7f3c80065560 0x7f3c80067a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:21.811 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.800+0000 7f3c8bfff700 1 -- 172.21.15.100:0/1469225319 --> v2:172.21.15.162:6812/2319408968 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3c80068040 con 0x7f3c80065560 2021-01-28T03:58:21.811 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.800+0000 7f3c8bfff700 1 -- 172.21.15.100:0/1469225319 <== mon.1 v2:172.21.15.100:3301/0 6 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c7c07a7c0 con 0x7f3c940f5a40 2021-01-28T03:58:21.811 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.800+0000 7f3c92d9d700 1 --2- 172.21.15.100:0/1469225319 >> v2:172.21.15.100:6800/928846103 conn(0x7f3c8005bc70 0x7f3c8005e130 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f3c84009c20 tx=0x7f3c84009b30).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:58:21.812 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.800+0000 7f3c9359e700 1 --2- 172.21.15.100:0/1469225319 >> v2:172.21.15.162:6812/2319408968 conn(0x7f3c80065560 0x7f3c80067a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:21.812 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.800+0000 7f3c9359e700 1 --2- 172.21.15.100:0/1469225319 >> v2:172.21.15.162:6812/2319408968 conn(0x7f3c80065560 0x7f3c80067a00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:58:21.812 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.800+0000 7f3c8bfff700 1 -- 172.21.15.100:0/1469225319 <== osd.7 v2:172.21.15.162:6812/2319408968 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22884 (crc 0 0 0) 0x7f3c80068040 con 0x7f3c80065560 2021-01-28T03:58:21.825 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.820+0000 7f3c98923700 1 -- 172.21.15.100:0/1469225319 --> v2:172.21.15.162:6812/2319408968 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3c9405f080 con 0x7f3c80065560 2021-01-28T03:58:21.827 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.820+0000 7f3c8bfff700 1 -- 172.21.15.100:0/1469225319 <== osd.7 v2:172.21.15.162:6812/2319408968 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f3c9405f080 con 0x7f3c80065560 2021-01-28T03:58:21.827 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.820+0000 7f3c98923700 1 -- 172.21.15.100:0/1469225319 >> v2:172.21.15.162:6812/2319408968 conn(0x7f3c80065560 msgr2=0x7f3c80067a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:21.828 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.820+0000 7f3c98923700 1 --2- 172.21.15.100:0/1469225319 >> v2:172.21.15.162:6812/2319408968 conn(0x7f3c80065560 0x7f3c80067a00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:21.828 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.820+0000 7f3c98923700 1 -- 172.21.15.100:0/1469225319 >> v2:172.21.15.100:6800/928846103 conn(0x7f3c8005bc70 msgr2=0x7f3c8005e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:21.828 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.820+0000 7f3c98923700 1 --2- 172.21.15.100:0/1469225319 >> v2:172.21.15.100:6800/928846103 conn(0x7f3c8005bc70 0x7f3c8005e130 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f3c84009c20 tx=0x7f3c84009b30).stop 2021-01-28T03:58:21.828 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.820+0000 7f3c98923700 1 -- 172.21.15.100:0/1469225319 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3c940f5a40 msgr2=0x7f3c94104d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:21.829 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.820+0000 7f3c98923700 1 --2- 172.21.15.100:0/1469225319 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f3c940f5a40 0x7f3c94104d00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f3c7c00fcb0 tx=0x7f3c7c009de0).stop 2021-01-28T03:58:21.829 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.824+0000 7f3c9359e700 1 -- 172.21.15.100:0/1469225319 reap_dead start 2021-01-28T03:58:21.829 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.824+0000 7f3c98923700 1 -- 172.21.15.100:0/1469225319 shutdown_connections 2021-01-28T03:58:21.829 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.824+0000 7f3c98923700 1 -- 172.21.15.100:0/1469225319 >> 172.21.15.100:0/1469225319 conn(0x7f3c940effa0 msgr2=0x7f3c940f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:58:21.830 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.824+0000 7f3c98923700 1 -- 172.21.15.100:0/1469225319 shutdown_connections 2021-01-28T03:58:21.830 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:21.824+0000 7f3c98923700 1 -- 172.21.15.100:0/1469225319 wait complete. 2021-01-28T03:58:21.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:21 smithi100 bash[9834]: audit 2021-01-28T03:58:19.571830+0000 mgr.y (mgr.14138) 407 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:58:21.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:21 smithi100 bash[13549]: audit 2021-01-28T03:58:19.571830+0000 mgr.y (mgr.14138) 407 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:58:22.627 INFO:teuthology.orchestra.run.smithi100.stdout:201863462943 2021-01-28T03:58:22.628 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph osd last-stat-seq osd.0 2021-01-28T03:58:22.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:22 smithi162 bash[9856]: cluster 2021-01-28T03:58:21.434150+0000 mgr.y (mgr.14138) 408 : cluster [DBG] pgmap v283: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:22.782 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c217df96-611b-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T03:58:22.826 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:22 smithi100 bash[9834]: cluster 2021-01-28T03:58:21.434150+0000 mgr.y (mgr.14138) 408 : cluster [DBG] pgmap v283: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:22.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:22 smithi100 bash[13549]: cluster 2021-01-28T03:58:21.434150+0000 mgr.y (mgr.14138) 408 : cluster [DBG] pgmap v283: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:23.826 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:23 smithi100 bash[9834]: cluster 2021-01-28T03:58:23.435465+0000 mgr.y (mgr.14138) 409 : cluster [DBG] pgmap v284: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:58:23.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:23 smithi100 bash[13549]: cluster 2021-01-28T03:58:23.435465+0000 mgr.y (mgr.14138) 409 : cluster [DBG] pgmap v284: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:58:24.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:23 smithi162 bash[9856]: cluster 2021-01-28T03:58:23.435465+0000 mgr.y (mgr.14138) 409 : cluster [DBG] pgmap v284: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:58:26.003 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:25.995+0000 7fa7edb57700 1 -- 172.21.15.100:0/3949686604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7e80f96c0 msgr2=0x7fa7e80fffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:26.003 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:25.995+0000 7fa7edb57700 1 --2- 172.21.15.100:0/3949686604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7e80f96c0 0x7fa7e80fffc0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fa7e0004d40 tx=0x7fa7e0009b30).stop 2021-01-28T03:58:26.003 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:25.995+0000 7fa7edb57700 1 -- 172.21.15.100:0/3949686604 shutdown_connections 2021-01-28T03:58:26.004 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:25.995+0000 7fa7edb57700 1 --2- 172.21.15.100:0/3949686604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7e80f96c0 0x7fa7e80fffc0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:26.004 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:25.995+0000 7fa7edb57700 1 --2- 172.21.15.100:0/3949686604 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa7e80f7ad0 0x7fa7e80f7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:26.004 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:25.995+0000 7fa7edb57700 1 --2- 172.21.15.100:0/3949686604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7e80f8d70 0x7fa7e80f91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:26.004 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:25.995+0000 7fa7edb57700 1 -- 172.21.15.100:0/3949686604 >> 172.21.15.100:0/3949686604 conn(0x7fa7e80f3550 msgr2=0x7fa7e80f5940 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:58:26.004 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:25.995+0000 7fa7edb57700 1 -- 172.21.15.100:0/3949686604 shutdown_connections 2021-01-28T03:58:26.005 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:25.995+0000 7fa7edb57700 1 -- 172.21.15.100:0/3949686604 wait complete. 2021-01-28T03:58:26.006 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:25.999+0000 7fa7edb57700 1 Processor -- start 2021-01-28T03:58:26.006 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:25.999+0000 7fa7edb57700 1 -- start start 2021-01-28T03:58:26.007 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:25.999+0000 7fa7edb57700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa7e80f7ad0 0x7fa7e8107a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:26.007 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:25.999+0000 7fa7edb57700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7e80f8d70 0x7fa7e8107f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:26.007 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:25.999+0000 7fa7edb57700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7e80f96c0 0x7fa7e8108e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:26.007 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:25.999+0000 7fa7edb57700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e8109350 con 0x7fa7e80f96c0 2021-01-28T03:58:26.008 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:25.999+0000 7fa7edb57700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e81094c0 con 0x7fa7e80f8d70 2021-01-28T03:58:26.008 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:25.999+0000 7fa7edb57700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e8109680 con 0x7fa7e80f7ad0 2021-01-28T03:58:26.008 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:25.999+0000 7fa7ecb55700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa7e80f7ad0 0x7fa7e8107a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:26.008 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:25.999+0000 7fa7ed356700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7e80f96c0 0x7fa7e8108e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:26.009 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:25.999+0000 7fa7ecb55700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa7e80f7ad0 0x7fa7e8107a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:41026/0 (socket says 172.21.15.100:41026) 2021-01-28T03:58:26.009 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:25.999+0000 7fa7ed356700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7e80f96c0 0x7fa7e8108e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60046/0 (socket says 172.21.15.100:60046) 2021-01-28T03:58:26.009 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:25.999+0000 7fa7ecb55700 1 -- 172.21.15.100:0/1970450995 learned_addr learned my addr 172.21.15.100:0/1970450995 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:58:26.009 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:25.999+0000 7fa7e7fff700 1 --2- 172.21.15.100:0/1970450995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7e80f8d70 0x7fa7e8107f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:26.010 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:25.999+0000 7fa7ed356700 1 -- 172.21.15.100:0/1970450995 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa7e80f7ad0 msgr2=0x7fa7e8107a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:26.010 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:25.999+0000 7fa7ed356700 1 --2- 172.21.15.100:0/1970450995 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa7e80f7ad0 0x7fa7e8107a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:26.010 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:25.999+0000 7fa7ed356700 1 -- 172.21.15.100:0/1970450995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7e80f8d70 msgr2=0x7fa7e8107f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:26.010 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:25.999+0000 7fa7ed356700 1 --2- 172.21.15.100:0/1970450995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7e80f8d70 0x7fa7e8107f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:26.010 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:25.999+0000 7fa7ed356700 1 -- 172.21.15.100:0/1970450995 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e8109840 con 0x7fa7e80f96c0 2021-01-28T03:58:26.011 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:25.999+0000 7fa7ecb55700 1 --2- 172.21.15.100:0/1970450995 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa7e80f7ad0 0x7fa7e8107a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-28T03:58:26.011 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:25.999+0000 7fa7ed356700 1 --2- 172.21.15.100:0/1970450995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7e80f96c0 0x7fa7e8108e20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fa7e0011000 tx=0x7fa7e0009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:58:26.011 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:25.999+0000 7fa7e57fa700 1 -- 172.21.15.100:0/1970450995 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e000e030 con 0x7fa7e80f96c0 2021-01-28T03:58:26.011 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:25.999+0000 7fa7e57fa700 1 -- 172.21.15.100:0/1970450995 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fa7e0004160 con 0x7fa7e80f96c0 2021-01-28T03:58:26.012 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:25.999+0000 7fa7edb57700 1 -- 172.21.15.100:0/1970450995 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e8109a90 con 0x7fa7e80f96c0 2021-01-28T03:58:26.012 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:25.999+0000 7fa7e57fa700 1 -- 172.21.15.100:0/1970450995 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e0018070 con 0x7fa7e80f96c0 2021-01-28T03:58:26.012 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:25.999+0000 7fa7edb57700 1 -- 172.21.15.100:0/1970450995 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e8110230 con 0x7fa7e80f96c0 2021-01-28T03:58:26.013 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:25.999+0000 7fa7e57fa700 1 -- 172.21.15.100:0/1970450995 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7fa7e0013970 con 0x7fa7e80f96c0 2021-01-28T03:58:26.014 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:26.003+0000 7fa7edb57700 1 -- 172.21.15.100:0/1970450995 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e80f7060 con 0x7fa7e80f96c0 2021-01-28T03:58:26.014 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:26.003+0000 7fa7e57fa700 1 --2- 172.21.15.100:0/1970450995 >> v2:172.21.15.100:6800/928846103 conn(0x7fa7d005bc70 0x7fa7d005e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:26.014 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:26.003+0000 7fa7e57fa700 1 -- 172.21.15.100:0/1970450995 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7fa7e00771d0 con 0x7fa7e80f96c0 2021-01-28T03:58:26.014 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:26.003+0000 7fa7ecb55700 1 --2- 172.21.15.100:0/1970450995 >> v2:172.21.15.100:6800/928846103 conn(0x7fa7d005bc70 0x7fa7d005e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:26.014 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:26.003+0000 7fa7ecb55700 1 --2- 172.21.15.100:0/1970450995 >> v2:172.21.15.100:6800/928846103 conn(0x7fa7d005bc70 0x7fa7d005e130 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fa7dc009fd0 tx=0x7fa7dc00b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:58:26.015 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:26.007+0000 7fa7e57fa700 1 -- 172.21.15.100:0/1970450995 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fa7e0049ec0 con 0x7fa7e80f96c0 2021-01-28T03:58:26.173 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:26.167+0000 7fa7edb57700 1 -- 172.21.15.100:0/1970450995 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa7e81027f0 con 0x7fa7e80f96c0 2021-01-28T03:58:26.174 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:26.167+0000 7fa7e57fa700 1 -- 172.21.15.100:0/1970450995 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa7e0009db0 con 0x7fa7e80f96c0 2021-01-28T03:58:26.174 INFO:teuthology.orchestra.run.smithi100.stdout:42949673030 2021-01-28T03:58:26.175 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:26.171+0000 7fa7edb57700 1 -- 172.21.15.100:0/1970450995 >> v2:172.21.15.100:6800/928846103 conn(0x7fa7d005bc70 msgr2=0x7fa7d005e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:26.176 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:26.171+0000 7fa7edb57700 1 --2- 172.21.15.100:0/1970450995 >> v2:172.21.15.100:6800/928846103 conn(0x7fa7d005bc70 0x7fa7d005e130 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fa7dc009fd0 tx=0x7fa7dc00b040).stop 2021-01-28T03:58:26.176 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:26.171+0000 7fa7edb57700 1 -- 172.21.15.100:0/1970450995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7e80f96c0 msgr2=0x7fa7e8108e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:26.176 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:26.171+0000 7fa7edb57700 1 --2- 172.21.15.100:0/1970450995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7e80f96c0 0x7fa7e8108e20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fa7e0011000 tx=0x7fa7e0009b30).stop 2021-01-28T03:58:26.177 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:26.171+0000 7fa7edb57700 1 -- 172.21.15.100:0/1970450995 shutdown_connections 2021-01-28T03:58:26.177 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:26.171+0000 7fa7edb57700 1 --2- 172.21.15.100:0/1970450995 >> v2:172.21.15.100:6800/928846103 conn(0x7fa7d005bc70 0x7fa7d005e130 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:26.177 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:26.171+0000 7fa7edb57700 1 --2- 172.21.15.100:0/1970450995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa7e80f96c0 0x7fa7e8108e20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:26.177 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:26.171+0000 7fa7edb57700 1 --2- 172.21.15.100:0/1970450995 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fa7e80f7ad0 0x7fa7e8107a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:26.178 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:26.171+0000 7fa7edb57700 1 --2- 172.21.15.100:0/1970450995 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7e80f8d70 0x7fa7e8107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:26.178 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:26.171+0000 7fa7edb57700 1 -- 172.21.15.100:0/1970450995 >> 172.21.15.100:0/1970450995 conn(0x7fa7e80f3550 msgr2=0x7fa7e80fbfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:58:26.178 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:26.171+0000 7fa7edb57700 1 -- 172.21.15.100:0/1970450995 shutdown_connections 2021-01-28T03:58:26.178 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:26.171+0000 7fa7edb57700 1 -- 172.21.15.100:0/1970450995 wait complete. 2021-01-28T03:58:26.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:26 smithi162 bash[9856]: cluster 2021-01-28T03:58:25.436588+0000 mgr.y (mgr.14138) 410 : cluster [DBG] pgmap v285: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:26.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:26 smithi162 bash[9856]: audit 2021-01-28T03:58:26.173737+0000 mon.a (mon.0) 653 : audit [DBG] from='client.? 172.21.15.100:0/1970450995' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-01-28T03:58:26.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:26 smithi100 bash[9834]: cluster 2021-01-28T03:58:25.436588+0000 mgr.y (mgr.14138) 410 : cluster [DBG] pgmap v285: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:26.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:26 smithi100 bash[9834]: audit 2021-01-28T03:58:26.173737+0000 mon.a (mon.0) 653 : audit [DBG] from='client.? 172.21.15.100:0/1970450995' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-01-28T03:58:26.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:26 smithi100 bash[13549]: cluster 2021-01-28T03:58:25.436588+0000 mgr.y (mgr.14138) 410 : cluster [DBG] pgmap v285: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:26.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:26 smithi100 bash[13549]: audit 2021-01-28T03:58:26.173737+0000 mon.a (mon.0) 653 : audit [DBG] from='client.? 172.21.15.100:0/1970450995' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-01-28T03:58:27.020 INFO:tasks.cephadm.ceph_manager.ceph:need seq 42949673023 got 42949673030 for osd.0 2021-01-28T03:58:27.020 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph osd last-stat-seq osd.1 2021-01-28T03:58:27.174 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c217df96-611b-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T03:58:28.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:27 smithi162 bash[9856]: cluster 2021-01-28T03:58:27.437540+0000 mgr.y (mgr.14138) 411 : cluster [DBG] pgmap v286: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:28.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:27 smithi100 bash[9834]: cluster 2021-01-28T03:58:27.437540+0000 mgr.y (mgr.14138) 411 : cluster [DBG] pgmap v286: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:28.077 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:27 smithi100 bash[13549]: cluster 2021-01-28T03:58:27.437540+0000 mgr.y (mgr.14138) 411 : cluster [DBG] pgmap v286: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:30.012 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 03:58:29 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T03:58:30.076 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:58:29 smithi100 bash[10061]: debug 2021-01-28T03:58:29.575+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T03:58:30.376 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.371+0000 7f1d3f59e700 1 -- 172.21.15.100:0/3780841505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d400f8d70 msgr2=0x7f1d400f91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:30.376 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.371+0000 7f1d3f59e700 1 --2- 172.21.15.100:0/3780841505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d400f8d70 0x7f1d400f91d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f1d30004e00 tx=0x7f1d30009b30).stop 2021-01-28T03:58:30.376 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.371+0000 7f1d3f59e700 1 -- 172.21.15.100:0/3780841505 shutdown_connections 2021-01-28T03:58:30.377 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.371+0000 7f1d3f59e700 1 --2- 172.21.15.100:0/3780841505 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d400f7ad0 0x7f1d400f7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:30.377 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.371+0000 7f1d3f59e700 1 --2- 172.21.15.100:0/3780841505 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1d400f96c0 0x7f1d400fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:30.377 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.371+0000 7f1d3f59e700 1 --2- 172.21.15.100:0/3780841505 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d400f8d70 0x7f1d400f91d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:30.377 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.371+0000 7f1d3f59e700 1 -- 172.21.15.100:0/3780841505 >> 172.21.15.100:0/3780841505 conn(0x7f1d400f3390 msgr2=0x7f1d400f5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:58:30.378 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.371+0000 7f1d3f59e700 1 -- 172.21.15.100:0/3780841505 shutdown_connections 2021-01-28T03:58:30.378 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.371+0000 7f1d3f59e700 1 -- 172.21.15.100:0/3780841505 wait complete. 2021-01-28T03:58:30.379 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.371+0000 7f1d3f59e700 1 Processor -- start 2021-01-28T03:58:30.379 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.371+0000 7f1d3f59e700 1 -- start start 2021-01-28T03:58:30.380 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.371+0000 7f1d3f59e700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d400f7ad0 0x7f1d40107d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:30.380 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.371+0000 7f1d3f59e700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d400f8d70 0x7f1d40108240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:30.380 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.371+0000 7f1d3f59e700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1d400f96c0 0x7f1d40108ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:30.380 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.371+0000 7f1d3f59e700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d401095c0 con 0x7f1d400f8d70 2021-01-28T03:58:30.380 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.371+0000 7f1d3f59e700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d40109730 con 0x7f1d400f7ad0 2021-01-28T03:58:30.381 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.371+0000 7f1d3f59e700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d401098f0 con 0x7f1d400f96c0 2021-01-28T03:58:30.381 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.371+0000 7f1d3dd9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d400f8d70 0x7f1d40108240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:30.381 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.371+0000 7f1d3dd9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d400f8d70 0x7f1d40108240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60058/0 (socket says 172.21.15.100:60058) 2021-01-28T03:58:30.381 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.371+0000 7f1d3dd9b700 1 -- 172.21.15.100:0/2715798177 learned_addr learned my addr 172.21.15.100:0/2715798177 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:58:30.382 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.371+0000 7f1d3e59c700 1 --2- 172.21.15.100:0/2715798177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d400f7ad0 0x7f1d40107d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:30.382 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.371+0000 7f1d3ed9d700 1 --2- 172.21.15.100:0/2715798177 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1d400f96c0 0x7f1d40108ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:30.382 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.371+0000 7f1d3dd9b700 1 -- 172.21.15.100:0/2715798177 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1d400f96c0 msgr2=0x7f1d40108ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:30.383 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.371+0000 7f1d3dd9b700 1 --2- 172.21.15.100:0/2715798177 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1d400f96c0 0x7f1d40108ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:30.383 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.371+0000 7f1d3dd9b700 1 -- 172.21.15.100:0/2715798177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d400f7ad0 msgr2=0x7f1d40107d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:30.383 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.371+0000 7f1d3dd9b700 1 --2- 172.21.15.100:0/2715798177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d400f7ad0 0x7f1d40107d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:30.383 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.371+0000 7f1d3dd9b700 1 -- 172.21.15.100:0/2715798177 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d40109ab0 con 0x7f1d400f8d70 2021-01-28T03:58:30.384 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.371+0000 7f1d3e59c700 1 --2- 172.21.15.100:0/2715798177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d400f7ad0 0x7f1d40107d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-28T03:58:30.384 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.371+0000 7f1d3dd9b700 1 --2- 172.21.15.100:0/2715798177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d400f8d70 0x7f1d40108240 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f1d30009c20 tx=0x7f1d30009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:58:30.384 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.371+0000 7f1d2effd700 1 -- 172.21.15.100:0/2715798177 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3000e030 con 0x7f1d400f8d70 2021-01-28T03:58:30.384 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.371+0000 7f1d2effd700 1 -- 172.21.15.100:0/2715798177 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f1d300093b0 con 0x7f1d400f8d70 2021-01-28T03:58:30.384 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.371+0000 7f1d2effd700 1 -- 172.21.15.100:0/2715798177 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d30018070 con 0x7f1d400f8d70 2021-01-28T03:58:30.385 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.371+0000 7f1d3f59e700 1 -- 172.21.15.100:0/2715798177 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d40109d00 con 0x7f1d400f8d70 2021-01-28T03:58:30.385 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.371+0000 7f1d3f59e700 1 -- 172.21.15.100:0/2715798177 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d40110400 con 0x7f1d400f8d70 2021-01-28T03:58:30.386 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.375+0000 7f1d3f59e700 1 -- 172.21.15.100:0/2715798177 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d4005d560 con 0x7f1d400f8d70 2021-01-28T03:58:30.386 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.375+0000 7f1d2effd700 1 -- 172.21.15.100:0/2715798177 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f1d3001d420 con 0x7f1d400f8d70 2021-01-28T03:58:30.387 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.375+0000 7f1d2effd700 1 --2- 172.21.15.100:0/2715798177 >> v2:172.21.15.100:6800/928846103 conn(0x7f1d2805bc70 0x7f1d2805e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:30.387 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.375+0000 7f1d2effd700 1 -- 172.21.15.100:0/2715798177 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f1d30077370 con 0x7f1d400f8d70 2021-01-28T03:58:30.387 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.375+0000 7f1d3e59c700 1 --2- 172.21.15.100:0/2715798177 >> v2:172.21.15.100:6800/928846103 conn(0x7f1d2805bc70 0x7f1d2805e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:30.387 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.375+0000 7f1d3e59c700 1 --2- 172.21.15.100:0/2715798177 >> v2:172.21.15.100:6800/928846103 conn(0x7f1d2805bc70 0x7f1d2805e130 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f1d400f8bd0 tx=0x7f1d34009c00).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:58:30.389 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.383+0000 7f1d2effd700 1 -- 172.21.15.100:0/2715798177 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f1d4005d560 con 0x7f1d400f8d70 2021-01-28T03:58:30.497 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:30 smithi100 bash[9834]: cluster 2021-01-28T03:58:29.438866+0000 mgr.y (mgr.14138) 412 : cluster [DBG] pgmap v287: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:58:30.498 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:30 smithi100 bash[13549]: cluster 2021-01-28T03:58:29.438866+0000 mgr.y (mgr.14138) 412 : cluster [DBG] pgmap v287: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:58:30.555 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.547+0000 7f1d3f59e700 1 -- 172.21.15.100:0/2715798177 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1d4005d560 con 0x7f1d400f8d70 2021-01-28T03:58:30.556 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.551+0000 7f1d2effd700 1 -- 172.21.15.100:0/2715798177 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1d4005d560 con 0x7f1d400f8d70 2021-01-28T03:58:30.556 INFO:teuthology.orchestra.run.smithi100.stdout:68719476800 2021-01-28T03:58:30.557 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.551+0000 7f1d3f59e700 1 -- 172.21.15.100:0/2715798177 >> v2:172.21.15.100:6800/928846103 conn(0x7f1d2805bc70 msgr2=0x7f1d2805e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:30.558 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.551+0000 7f1d3f59e700 1 --2- 172.21.15.100:0/2715798177 >> v2:172.21.15.100:6800/928846103 conn(0x7f1d2805bc70 0x7f1d2805e130 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f1d400f8bd0 tx=0x7f1d34009c00).stop 2021-01-28T03:58:30.558 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.551+0000 7f1d3f59e700 1 -- 172.21.15.100:0/2715798177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d400f8d70 msgr2=0x7f1d40108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:30.558 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.551+0000 7f1d3f59e700 1 --2- 172.21.15.100:0/2715798177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d400f8d70 0x7f1d40108240 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f1d30009c20 tx=0x7f1d30009b30).stop 2021-01-28T03:58:30.558 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.551+0000 7f1d3f59e700 1 -- 172.21.15.100:0/2715798177 shutdown_connections 2021-01-28T03:58:30.559 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.551+0000 7f1d3f59e700 1 --2- 172.21.15.100:0/2715798177 >> v2:172.21.15.100:6800/928846103 conn(0x7f1d2805bc70 0x7f1d2805e130 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:30.559 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.551+0000 7f1d3f59e700 1 --2- 172.21.15.100:0/2715798177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d400f7ad0 0x7f1d40107d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:30.559 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.551+0000 7f1d3f59e700 1 --2- 172.21.15.100:0/2715798177 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1d400f96c0 0x7f1d40108ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:30.559 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.551+0000 7f1d3f59e700 1 --2- 172.21.15.100:0/2715798177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d400f8d70 0x7f1d40108240 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:30.560 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.551+0000 7f1d3f59e700 1 -- 172.21.15.100:0/2715798177 >> 172.21.15.100:0/2715798177 conn(0x7f1d400f3390 msgr2=0x7f1d400f6710 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:58:30.560 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.551+0000 7f1d3f59e700 1 -- 172.21.15.100:0/2715798177 shutdown_connections 2021-01-28T03:58:30.560 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:30.551+0000 7f1d3f59e700 1 -- 172.21.15.100:0/2715798177 wait complete. 2021-01-28T03:58:30.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:30 smithi162 bash[9856]: cluster 2021-01-28T03:58:29.438866+0000 mgr.y (mgr.14138) 412 : cluster [DBG] pgmap v287: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:58:31.394 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476793 got 68719476800 for osd.1 2021-01-28T03:58:31.395 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph osd last-stat-seq osd.2 2021-01-28T03:58:31.558 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c217df96-611b-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T03:58:31.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:31 smithi162 bash[9856]: audit 2021-01-28T03:58:29.579820+0000 mgr.y (mgr.14138) 413 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:58:31.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:31 smithi162 bash[9856]: audit 2021-01-28T03:58:30.555262+0000 mon.a (mon.0) 654 : audit [DBG] from='client.? 172.21.15.100:0/2715798177' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-01-28T03:58:31.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:31 smithi162 bash[9856]: cluster 2021-01-28T03:58:31.439862+0000 mgr.y (mgr.14138) 414 : cluster [DBG] pgmap v288: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:31.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:31 smithi100 bash[9834]: audit 2021-01-28T03:58:29.579820+0000 mgr.y (mgr.14138) 413 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:58:31.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:31 smithi100 bash[9834]: audit 2021-01-28T03:58:30.555262+0000 mon.a (mon.0) 654 : audit [DBG] from='client.? 172.21.15.100:0/2715798177' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-01-28T03:58:31.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:31 smithi100 bash[9834]: cluster 2021-01-28T03:58:31.439862+0000 mgr.y (mgr.14138) 414 : cluster [DBG] pgmap v288: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:31.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:31 smithi100 bash[13549]: audit 2021-01-28T03:58:29.579820+0000 mgr.y (mgr.14138) 413 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:58:31.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:31 smithi100 bash[13549]: audit 2021-01-28T03:58:30.555262+0000 mon.a (mon.0) 654 : audit [DBG] from='client.? 172.21.15.100:0/2715798177' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-01-28T03:58:31.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:31 smithi100 bash[13549]: cluster 2021-01-28T03:58:31.439862+0000 mgr.y (mgr.14138) 414 : cluster [DBG] pgmap v288: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:33.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:33 smithi100 bash[9834]: cluster 2021-01-28T03:58:33.441071+0000 mgr.y (mgr.14138) 415 : cluster [DBG] pgmap v289: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:58:33.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:33 smithi100 bash[13549]: cluster 2021-01-28T03:58:33.441071+0000 mgr.y (mgr.14138) 415 : cluster [DBG] pgmap v289: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:58:34.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:33 smithi162 bash[9856]: cluster 2021-01-28T03:58:33.441071+0000 mgr.y (mgr.14138) 415 : cluster [DBG] pgmap v289: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:58:34.870 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.863+0000 7fe7e107c700 1 -- 172.21.15.100:0/3560569152 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7dc0f8c00 msgr2=0x7fe7dc0fb030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:34.870 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.863+0000 7fe7e107c700 1 --2- 172.21.15.100:0/3560569152 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7dc0f8c00 0x7fe7dc0fb030 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fe7c4004e00 tx=0x7fe7c4009b30).stop 2021-01-28T03:58:34.871 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.863+0000 7fe7e107c700 1 -- 172.21.15.100:0/3560569152 shutdown_connections 2021-01-28T03:58:34.871 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.863+0000 7fe7e107c700 1 --2- 172.21.15.100:0/3560569152 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7dc0fb670 0x7fe7dc0fdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:34.871 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.863+0000 7fe7e107c700 1 --2- 172.21.15.100:0/3560569152 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe7dc05fae0 0x7fe7dc0f8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:34.871 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.863+0000 7fe7e107c700 1 --2- 172.21.15.100:0/3560569152 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7dc0f8c00 0x7fe7dc0fb030 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:34.872 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.863+0000 7fe7e107c700 1 -- 172.21.15.100:0/3560569152 >> 172.21.15.100:0/3560569152 conn(0x7fe7dc0f0150 msgr2=0x7fe7dc0f2590 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:58:34.872 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.863+0000 7fe7e107c700 1 -- 172.21.15.100:0/3560569152 shutdown_connections 2021-01-28T03:58:34.872 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.863+0000 7fe7e107c700 1 -- 172.21.15.100:0/3560569152 wait complete. 2021-01-28T03:58:34.874 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.863+0000 7fe7e107c700 1 Processor -- start 2021-01-28T03:58:34.874 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.863+0000 7fe7e107c700 1 -- start start 2021-01-28T03:58:34.874 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.863+0000 7fe7e107c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7dc05fae0 0x7fe7dc0f5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:34.875 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.863+0000 7fe7e107c700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe7dc0f8c00 0x7fe7dc0f4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:34.875 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.863+0000 7fe7e107c700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7dc0fb670 0x7fe7dc0f4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:34.875 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.863+0000 7fe7e107c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc0f5120 con 0x7fe7dc05fae0 2021-01-28T03:58:34.876 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.867+0000 7fe7e107c700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc0f5290 con 0x7fe7dc0fb670 2021-01-28T03:58:34.876 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.867+0000 7fe7e107c700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc0f5450 con 0x7fe7dc0f8c00 2021-01-28T03:58:34.876 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.867+0000 7fe7dad9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7dc05fae0 0x7fe7dc0f5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:34.876 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.867+0000 7fe7dad9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7dc05fae0 0x7fe7dc0f5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60070/0 (socket says 172.21.15.100:60070) 2021-01-28T03:58:34.877 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.867+0000 7fe7dad9d700 1 -- 172.21.15.100:0/11637174 learned_addr learned my addr 172.21.15.100:0/11637174 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:58:34.877 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.867+0000 7fe7da59c700 1 --2- 172.21.15.100:0/11637174 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe7dc0f8c00 0x7fe7dc0f4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:34.877 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.867+0000 7fe7db59e700 1 --2- 172.21.15.100:0/11637174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7dc0fb670 0x7fe7dc0f4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:34.877 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.867+0000 7fe7dad9d700 1 -- 172.21.15.100:0/11637174 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe7dc0f8c00 msgr2=0x7fe7dc0f4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:34.878 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.867+0000 7fe7dad9d700 1 --2- 172.21.15.100:0/11637174 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe7dc0f8c00 0x7fe7dc0f4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:34.878 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.867+0000 7fe7dad9d700 1 -- 172.21.15.100:0/11637174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7dc0fb670 msgr2=0x7fe7dc0f4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:34.878 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.867+0000 7fe7dad9d700 1 --2- 172.21.15.100:0/11637174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7dc0fb670 0x7fe7dc0f4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:34.878 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.867+0000 7fe7dad9d700 1 -- 172.21.15.100:0/11637174 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7dc10fa30 con 0x7fe7dc05fae0 2021-01-28T03:58:34.879 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.867+0000 7fe7dad9d700 1 --2- 172.21.15.100:0/11637174 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7dc05fae0 0x7fe7dc0f5fb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fe7cc00eef0 tx=0x7fe7cc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:58:34.879 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.867+0000 7fe7d37fe700 1 -- 172.21.15.100:0/11637174 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc0092e0 con 0x7fe7dc05fae0 2021-01-28T03:58:34.879 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.867+0000 7fe7d37fe700 1 -- 172.21.15.100:0/11637174 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fe7cc00f040 con 0x7fe7dc05fae0 2021-01-28T03:58:34.880 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.867+0000 7fe7e107c700 1 -- 172.21.15.100:0/11637174 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7dc10fce0 con 0x7fe7dc05fae0 2021-01-28T03:58:34.880 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.867+0000 7fe7e107c700 1 -- 172.21.15.100:0/11637174 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7dc110170 con 0x7fe7dc05fae0 2021-01-28T03:58:34.880 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.867+0000 7fe7d37fe700 1 -- 172.21.15.100:0/11637174 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc007a60 con 0x7fe7dc05fae0 2021-01-28T03:58:34.880 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.867+0000 7fe7e107c700 1 -- 172.21.15.100:0/11637174 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7dc027100 con 0x7fe7dc05fae0 2021-01-28T03:58:34.881 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.871+0000 7fe7d37fe700 1 -- 172.21.15.100:0/11637174 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7fe7cc01b030 con 0x7fe7dc05fae0 2021-01-28T03:58:34.882 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.871+0000 7fe7d37fe700 1 --2- 172.21.15.100:0/11637174 >> v2:172.21.15.100:6800/928846103 conn(0x7fe7c805bd20 0x7fe7c805e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:34.882 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.871+0000 7fe7d37fe700 1 -- 172.21.15.100:0/11637174 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7fe7cc075b10 con 0x7fe7dc05fae0 2021-01-28T03:58:34.882 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.871+0000 7fe7da59c700 1 --2- 172.21.15.100:0/11637174 >> v2:172.21.15.100:6800/928846103 conn(0x7fe7c805bd20 0x7fe7c805e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:34.882 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.871+0000 7fe7da59c700 1 --2- 172.21.15.100:0/11637174 >> v2:172.21.15.100:6800/928846103 conn(0x7fe7c805bd20 0x7fe7c805e1e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fe7c40094e0 tx=0x7fe7c4009b30).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:58:34.883 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:34.875+0000 7fe7d37fe700 1 -- 172.21.15.100:0/11637174 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fe7cc0487a0 con 0x7fe7dc05fae0 2021-01-28T03:58:35.048 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:35.043+0000 7fe7e107c700 1 -- 172.21.15.100:0/11637174 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe7dc1006f0 con 0x7fe7dc05fae0 2021-01-28T03:58:35.048 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:35.043+0000 7fe7d37fe700 1 -- 172.21.15.100:0/11637174 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe7cc019020 con 0x7fe7dc05fae0 2021-01-28T03:58:35.049 INFO:teuthology.orchestra.run.smithi100.stdout:90194313277 2021-01-28T03:58:35.050 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:35.043+0000 7fe7e107c700 1 -- 172.21.15.100:0/11637174 >> v2:172.21.15.100:6800/928846103 conn(0x7fe7c805bd20 msgr2=0x7fe7c805e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:35.050 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:35.043+0000 7fe7e107c700 1 --2- 172.21.15.100:0/11637174 >> v2:172.21.15.100:6800/928846103 conn(0x7fe7c805bd20 0x7fe7c805e1e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7fe7c40094e0 tx=0x7fe7c4009b30).stop 2021-01-28T03:58:35.051 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:35.043+0000 7fe7e107c700 1 -- 172.21.15.100:0/11637174 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7dc05fae0 msgr2=0x7fe7dc0f5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:35.051 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:35.043+0000 7fe7e107c700 1 --2- 172.21.15.100:0/11637174 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7dc05fae0 0x7fe7dc0f5fb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fe7cc00eef0 tx=0x7fe7cc00b040).stop 2021-01-28T03:58:35.052 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:35.043+0000 7fe7e107c700 1 -- 172.21.15.100:0/11637174 shutdown_connections 2021-01-28T03:58:35.052 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:35.043+0000 7fe7e107c700 1 --2- 172.21.15.100:0/11637174 >> v2:172.21.15.100:6800/928846103 conn(0x7fe7c805bd20 0x7fe7c805e1e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:35.052 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:35.043+0000 7fe7e107c700 1 --2- 172.21.15.100:0/11637174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7dc0fb670 0x7fe7dc0f4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:35.052 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:35.043+0000 7fe7e107c700 1 --2- 172.21.15.100:0/11637174 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe7dc05fae0 0x7fe7dc0f5fb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:35.052 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:35.043+0000 7fe7e107c700 1 --2- 172.21.15.100:0/11637174 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe7dc0f8c00 0x7fe7dc0f4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:35.053 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:35.043+0000 7fe7e107c700 1 -- 172.21.15.100:0/11637174 >> 172.21.15.100:0/11637174 conn(0x7fe7dc0f0150 msgr2=0x7fe7dc0f9820 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:58:35.053 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:35.043+0000 7fe7e107c700 1 -- 172.21.15.100:0/11637174 shutdown_connections 2021-01-28T03:58:35.053 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:35.043+0000 7fe7e107c700 1 -- 172.21.15.100:0/11637174 wait complete. 2021-01-28T03:58:35.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:35 smithi162 bash[9856]: audit 2021-01-28T03:58:35.048219+0000 mon.a (mon.0) 655 : audit [DBG] from='client.? 172.21.15.100:0/11637174' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-01-28T03:58:35.588 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:35 smithi100 bash[9834]: audit 2021-01-28T03:58:35.048219+0000 mon.a (mon.0) 655 : audit [DBG] from='client.? 172.21.15.100:0/11637174' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-01-28T03:58:35.589 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:35 smithi100 bash[13549]: audit 2021-01-28T03:58:35.048219+0000 mon.a (mon.0) 655 : audit [DBG] from='client.? 172.21.15.100:0/11637174' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-01-28T03:58:35.902 INFO:tasks.cephadm.ceph_manager.ceph:need seq 90194313270 got 90194313277 for osd.2 2021-01-28T03:58:35.905 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph osd last-stat-seq osd.3 2021-01-28T03:58:36.056 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c217df96-611b-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T03:58:36.327 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:36 smithi100 bash[9834]: cluster 2021-01-28T03:58:35.442203+0000 mgr.y (mgr.14138) 416 : cluster [DBG] pgmap v290: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:36.327 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:36 smithi100 bash[9834]: audit 2021-01-28T03:58:35.496426+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T03:58:36.327 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:36 smithi100 bash[9834]: audit 2021-01-28T03:58:35.500856+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T03:58:36.328 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:36 smithi100 bash[13549]: cluster 2021-01-28T03:58:35.442203+0000 mgr.y (mgr.14138) 416 : cluster [DBG] pgmap v290: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:36.328 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:36 smithi100 bash[13549]: audit 2021-01-28T03:58:35.496426+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T03:58:36.328 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:36 smithi100 bash[13549]: audit 2021-01-28T03:58:35.500856+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T03:58:36.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:36 smithi162 bash[9856]: cluster 2021-01-28T03:58:35.442203+0000 mgr.y (mgr.14138) 416 : cluster [DBG] pgmap v290: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:36.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:36 smithi162 bash[9856]: audit 2021-01-28T03:58:35.496426+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T03:58:36.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:36 smithi162 bash[9856]: audit 2021-01-28T03:58:35.500856+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T03:58:37.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:37 smithi100 bash[9834]: cluster 2021-01-28T03:58:37.443186+0000 mgr.y (mgr.14138) 417 : cluster [DBG] pgmap v291: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:37.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:37 smithi100 bash[13549]: cluster 2021-01-28T03:58:37.443186+0000 mgr.y (mgr.14138) 417 : cluster [DBG] pgmap v291: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:38.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:37 smithi162 bash[9856]: cluster 2021-01-28T03:58:37.443186+0000 mgr.y (mgr.14138) 417 : cluster [DBG] pgmap v291: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:39.653 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.647+0000 7f2a16224700 1 -- 172.21.15.100:0/534266375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a1005f7d0 msgr2=0x7f2a100f8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:39.653 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.647+0000 7f2a16224700 1 --2- 172.21.15.100:0/534266375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a1005f7d0 0x7f2a100f8480 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f2a04004e00 tx=0x7f2a04009b30).stop 2021-01-28T03:58:39.654 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.647+0000 7f2a16224700 1 -- 172.21.15.100:0/534266375 shutdown_connections 2021-01-28T03:58:39.654 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.647+0000 7f2a16224700 1 --2- 172.21.15.100:0/534266375 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2a100fb490 0x7f2a100fd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:39.654 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.647+0000 7f2a16224700 1 --2- 172.21.15.100:0/534266375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a1005f7d0 0x7f2a100f8480 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:39.655 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.647+0000 7f2a16224700 1 --2- 172.21.15.100:0/534266375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a100f8a00 0x7f2a100fae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:39.655 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.647+0000 7f2a16224700 1 -- 172.21.15.100:0/534266375 >> 172.21.15.100:0/534266375 conn(0x7f2a100effa0 msgr2=0x7f2a100f23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:58:39.655 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.647+0000 7f2a16224700 1 -- 172.21.15.100:0/534266375 shutdown_connections 2021-01-28T03:58:39.655 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.647+0000 7f2a16224700 1 -- 172.21.15.100:0/534266375 wait complete. 2021-01-28T03:58:39.657 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.647+0000 7f2a16224700 1 Processor -- start 2021-01-28T03:58:39.657 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.647+0000 7f2a16224700 1 -- start start 2021-01-28T03:58:39.657 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.647+0000 7f2a16224700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2a100f8a00 0x7f2a100f5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:39.658 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.647+0000 7f2a16224700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a100fb490 0x7f2a100f4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:39.658 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.647+0000 7f2a16224700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a100f4930 0x7f2a100f4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:39.658 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.647+0000 7f2a16224700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1010fb60 con 0x7f2a100fb490 2021-01-28T03:58:39.658 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.647+0000 7f2a16224700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1010fcd0 con 0x7f2a100f4930 2021-01-28T03:58:39.659 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.647+0000 7f2a16224700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1010fe90 con 0x7f2a100f8a00 2021-01-28T03:58:39.659 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.647+0000 7f2a15222700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2a100f8a00 0x7f2a100f5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:39.659 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.647+0000 7f2a15222700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2a100f8a00 0x7f2a100f5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:41066/0 (socket says 172.21.15.100:41066) 2021-01-28T03:58:39.659 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.647+0000 7f2a14a21700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a100fb490 0x7f2a100f4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:39.660 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.647+0000 7f2a15222700 1 -- 172.21.15.100:0/232333909 learned_addr learned my addr 172.21.15.100:0/232333909 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:58:39.660 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.647+0000 7f2a15a23700 1 --2- 172.21.15.100:0/232333909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a100f4930 0x7f2a100f4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:39.660 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.647+0000 7f2a14a21700 1 -- 172.21.15.100:0/232333909 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2a100f8a00 msgr2=0x7f2a100f5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:39.661 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.647+0000 7f2a14a21700 1 --2- 172.21.15.100:0/232333909 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2a100f8a00 0x7f2a100f5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:39.661 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.647+0000 7f2a14a21700 1 -- 172.21.15.100:0/232333909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a100f4930 msgr2=0x7f2a100f4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:39.661 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.647+0000 7f2a14a21700 1 --2- 172.21.15.100:0/232333909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a100f4930 0x7f2a100f4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:39.661 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.647+0000 7f2a14a21700 1 -- 172.21.15.100:0/232333909 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a10110050 con 0x7f2a100fb490 2021-01-28T03:58:39.662 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.647+0000 7f2a15222700 1 --2- 172.21.15.100:0/232333909 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2a100f8a00 0x7f2a100f5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-28T03:58:39.662 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.651+0000 7f2a14a21700 1 --2- 172.21.15.100:0/232333909 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a100fb490 0x7f2a100f4380 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f2a0c002a20 tx=0x7f2a0c009d40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:58:39.662 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.651+0000 7f2a01ffb700 1 -- 172.21.15.100:0/232333909 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c009320 con 0x7f2a100fb490 2021-01-28T03:58:39.662 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.651+0000 7f2a01ffb700 1 -- 172.21.15.100:0/232333909 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f2a0c00f040 con 0x7f2a100fb490 2021-01-28T03:58:39.663 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.651+0000 7f2a16224700 1 -- 172.21.15.100:0/232333909 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a10110300 con 0x7f2a100fb490 2021-01-28T03:58:39.663 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.651+0000 7f2a01ffb700 1 -- 172.21.15.100:0/232333909 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c00d850 con 0x7f2a100fb490 2021-01-28T03:58:39.663 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.651+0000 7f2a16224700 1 -- 172.21.15.100:0/232333909 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a10110840 con 0x7f2a100fb490 2021-01-28T03:58:39.664 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.651+0000 7f2a16224700 1 -- 172.21.15.100:0/232333909 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a100f3b90 con 0x7f2a100fb490 2021-01-28T03:58:39.664 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.651+0000 7f2a01ffb700 1 -- 172.21.15.100:0/232333909 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f2a0c00dc80 con 0x7f2a100fb490 2021-01-28T03:58:39.665 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.651+0000 7f2a01ffb700 1 --2- 172.21.15.100:0/232333909 >> v2:172.21.15.100:6800/928846103 conn(0x7f29fc05bc70 0x7f29fc05e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:39.665 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.651+0000 7f2a01ffb700 1 -- 172.21.15.100:0/232333909 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f2a0c075b00 con 0x7f2a100fb490 2021-01-28T03:58:39.665 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.651+0000 7f2a15222700 1 --2- 172.21.15.100:0/232333909 >> v2:172.21.15.100:6800/928846103 conn(0x7f29fc05bc70 0x7f29fc05e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:39.666 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.651+0000 7f2a15222700 1 --2- 172.21.15.100:0/232333909 >> v2:172.21.15.100:6800/928846103 conn(0x7f29fc05bc70 0x7f29fc05e130 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f2a04009c20 tx=0x7f2a04009b30).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:58:39.666 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.659+0000 7f2a01ffb700 1 -- 172.21.15.100:0/232333909 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f2a0c0487f0 con 0x7f2a100fb490 2021-01-28T03:58:39.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:39 smithi100 bash[9834]: cluster 2021-01-28T03:58:39.444749+0000 mgr.y (mgr.14138) 418 : cluster [DBG] pgmap v292: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:58:39.827 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:58:39 smithi100 bash[10061]: debug 2021-01-28T03:58:39.583+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T03:58:39.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:39 smithi100 bash[13549]: cluster 2021-01-28T03:58:39.444749+0000 mgr.y (mgr.14138) 418 : cluster [DBG] pgmap v292: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:58:39.828 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.823+0000 7f2a16224700 1 -- 172.21.15.100:0/232333909 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2a101005f0 con 0x7f2a100fb490 2021-01-28T03:58:39.829 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.823+0000 7f2a01ffb700 1 -- 172.21.15.100:0/232333909 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2a0c009db0 con 0x7f2a100fb490 2021-01-28T03:58:39.829 INFO:teuthology.orchestra.run.smithi100.stdout:111669149752 2021-01-28T03:58:39.830 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.823+0000 7f2a16224700 1 -- 172.21.15.100:0/232333909 >> v2:172.21.15.100:6800/928846103 conn(0x7f29fc05bc70 msgr2=0x7f29fc05e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:39.831 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.823+0000 7f2a16224700 1 --2- 172.21.15.100:0/232333909 >> v2:172.21.15.100:6800/928846103 conn(0x7f29fc05bc70 0x7f29fc05e130 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f2a04009c20 tx=0x7f2a04009b30).stop 2021-01-28T03:58:39.831 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.823+0000 7f2a16224700 1 -- 172.21.15.100:0/232333909 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a100fb490 msgr2=0x7f2a100f4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:39.831 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.823+0000 7f2a16224700 1 --2- 172.21.15.100:0/232333909 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a100fb490 0x7f2a100f4380 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f2a0c002a20 tx=0x7f2a0c009d40).stop 2021-01-28T03:58:39.832 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.823+0000 7f2a16224700 1 -- 172.21.15.100:0/232333909 shutdown_connections 2021-01-28T03:58:39.832 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.823+0000 7f2a16224700 1 --2- 172.21.15.100:0/232333909 >> v2:172.21.15.100:6800/928846103 conn(0x7f29fc05bc70 0x7f29fc05e130 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:39.832 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.823+0000 7f2a16224700 1 --2- 172.21.15.100:0/232333909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a100f4930 0x7f2a100f4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:39.833 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.823+0000 7f2a16224700 1 --2- 172.21.15.100:0/232333909 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f2a100f8a00 0x7f2a100f5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:39.833 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.823+0000 7f2a16224700 1 --2- 172.21.15.100:0/232333909 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a100fb490 0x7f2a100f4380 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:39.833 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.823+0000 7f2a16224700 1 -- 172.21.15.100:0/232333909 >> 172.21.15.100:0/232333909 conn(0x7f2a100effa0 msgr2=0x7f2a100fc130 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:58:39.833 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.827+0000 7f2a16224700 1 -- 172.21.15.100:0/232333909 shutdown_connections 2021-01-28T03:58:39.833 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:39.827+0000 7f2a16224700 1 -- 172.21.15.100:0/232333909 wait complete. 2021-01-28T03:58:40.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:39 smithi162 bash[9856]: cluster 2021-01-28T03:58:39.444749+0000 mgr.y (mgr.14138) 418 : cluster [DBG] pgmap v292: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:58:40.012 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 03:58:39 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T03:58:40.624 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149745 got 111669149752 for osd.3 2021-01-28T03:58:40.625 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph osd last-stat-seq osd.4 2021-01-28T03:58:40.781 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c217df96-611b-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T03:58:40.826 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:40 smithi100 bash[9834]: audit 2021-01-28T03:58:39.590529+0000 mgr.y (mgr.14138) 419 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:58:40.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:40 smithi100 bash[9834]: audit 2021-01-28T03:58:39.828886+0000 mon.a (mon.0) 658 : audit [DBG] from='client.? 172.21.15.100:0/232333909' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-01-28T03:58:40.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:40 smithi100 bash[13549]: audit 2021-01-28T03:58:39.590529+0000 mgr.y (mgr.14138) 419 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:58:40.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:40 smithi100 bash[13549]: audit 2021-01-28T03:58:39.828886+0000 mon.a (mon.0) 658 : audit [DBG] from='client.? 172.21.15.100:0/232333909' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-01-28T03:58:41.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:40 smithi162 bash[9856]: audit 2021-01-28T03:58:39.590529+0000 mgr.y (mgr.14138) 419 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:58:41.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:40 smithi162 bash[9856]: audit 2021-01-28T03:58:39.828886+0000 mon.a (mon.0) 658 : audit [DBG] from='client.? 172.21.15.100:0/232333909' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-01-28T03:58:41.817 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:41 smithi100 bash[9834]: cluster 2021-01-28T03:58:41.445606+0000 mgr.y (mgr.14138) 420 : cluster [DBG] pgmap v293: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:41.818 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:41 smithi100 bash[13549]: cluster 2021-01-28T03:58:41.445606+0000 mgr.y (mgr.14138) 420 : cluster [DBG] pgmap v293: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:42.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:41 smithi162 bash[9856]: cluster 2021-01-28T03:58:41.445606+0000 mgr.y (mgr.14138) 420 : cluster [DBG] pgmap v293: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:43.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:43 smithi100 bash[9834]: cluster 2021-01-28T03:58:43.446781+0000 mgr.y (mgr.14138) 421 : cluster [DBG] pgmap v294: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:58:43.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:43 smithi100 bash[13549]: cluster 2021-01-28T03:58:43.446781+0000 mgr.y (mgr.14138) 421 : cluster [DBG] pgmap v294: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:58:43.975 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.967+0000 7f225b057700 1 -- 172.21.15.100:0/2876468378 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f22540f8d70 msgr2=0x7f22540f91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:43.976 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.967+0000 7f225b057700 1 --2- 172.21.15.100:0/2876468378 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f22540f8d70 0x7f22540f91d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f2244004d70 tx=0x7f2244009b30).stop 2021-01-28T03:58:43.976 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.971+0000 7f225b057700 1 -- 172.21.15.100:0/2876468378 shutdown_connections 2021-01-28T03:58:43.976 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.971+0000 7f225b057700 1 --2- 172.21.15.100:0/2876468378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22540f7ad0 0x7f22540f7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:43.977 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.971+0000 7f225b057700 1 --2- 172.21.15.100:0/2876468378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22540f96c0 0x7f22540fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:43.977 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.971+0000 7f225b057700 1 --2- 172.21.15.100:0/2876468378 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f22540f8d70 0x7f22540f91d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:43.977 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.971+0000 7f225b057700 1 -- 172.21.15.100:0/2876468378 >> 172.21.15.100:0/2876468378 conn(0x7f22540f3390 msgr2=0x7f22540f5780 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:58:43.977 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.971+0000 7f225b057700 1 -- 172.21.15.100:0/2876468378 shutdown_connections 2021-01-28T03:58:43.978 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.971+0000 7f225b057700 1 -- 172.21.15.100:0/2876468378 wait complete. 2021-01-28T03:58:43.979 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.971+0000 7f225b057700 1 Processor -- start 2021-01-28T03:58:43.979 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.971+0000 7f225b057700 1 -- start start 2021-01-28T03:58:43.979 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.971+0000 7f225b057700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f22540f7ad0 0x7f2254107d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:43.980 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.971+0000 7f225b057700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22540f8d70 0x7f2254108200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:43.980 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.971+0000 7f225b057700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22540f96c0 0x7f2254108fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:43.980 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.971+0000 7f225b057700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2254109580 con 0x7f22540f8d70 2021-01-28T03:58:43.980 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.971+0000 7f225b057700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22541096f0 con 0x7f22540f96c0 2021-01-28T03:58:43.980 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.971+0000 7f225b057700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22541098b0 con 0x7f22540f7ad0 2021-01-28T03:58:43.981 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.971+0000 7f2259854700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22540f8d70 0x7f2254108200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:43.981 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.971+0000 7f225a055700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f22540f7ad0 0x7f2254107d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:43.981 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.971+0000 7f2259854700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22540f8d70 0x7f2254108200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60098/0 (socket says 172.21.15.100:60098) 2021-01-28T03:58:43.981 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.971+0000 7f2259854700 1 -- 172.21.15.100:0/495759668 learned_addr learned my addr 172.21.15.100:0/495759668 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:58:43.982 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.971+0000 7f225a856700 1 --2- 172.21.15.100:0/495759668 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22540f96c0 0x7f2254108fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:43.982 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.971+0000 7f2259854700 1 -- 172.21.15.100:0/495759668 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f22540f7ad0 msgr2=0x7f2254107d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:43.982 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.971+0000 7f2259854700 1 --2- 172.21.15.100:0/495759668 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f22540f7ad0 0x7f2254107d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:43.982 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.971+0000 7f2259854700 1 -- 172.21.15.100:0/495759668 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22540f96c0 msgr2=0x7f2254108fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:43.982 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.971+0000 7f2259854700 1 --2- 172.21.15.100:0/495759668 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22540f96c0 0x7f2254108fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:43.983 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.971+0000 7f2259854700 1 -- 172.21.15.100:0/495759668 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2254109a70 con 0x7f22540f8d70 2021-01-28T03:58:43.983 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.971+0000 7f225a856700 1 --2- 172.21.15.100:0/495759668 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22540f96c0 0x7f2254108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-28T03:58:43.983 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.971+0000 7f225a055700 1 --2- 172.21.15.100:0/495759668 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f22540f7ad0 0x7f2254107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-28T03:58:43.983 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.971+0000 7f2259854700 1 --2- 172.21.15.100:0/495759668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22540f8d70 0x7f2254108200 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f2244009c20 tx=0x7f2244009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:58:43.984 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.971+0000 7f224affd700 1 -- 172.21.15.100:0/495759668 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224400e030 con 0x7f22540f8d70 2021-01-28T03:58:43.984 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.971+0000 7f224affd700 1 -- 172.21.15.100:0/495759668 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f2244007e40 con 0x7f22540f8d70 2021-01-28T03:58:43.984 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.971+0000 7f225b057700 1 -- 172.21.15.100:0/495759668 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2254109cc0 con 0x7f22540f8d70 2021-01-28T03:58:43.984 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.971+0000 7f224affd700 1 -- 172.21.15.100:0/495759668 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2244018070 con 0x7f22540f8d70 2021-01-28T03:58:43.984 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.971+0000 7f225b057700 1 -- 172.21.15.100:0/495759668 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22541103c0 con 0x7f22540f8d70 2021-01-28T03:58:43.985 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.975+0000 7f224affd700 1 -- 172.21.15.100:0/495759668 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f224401d420 con 0x7f22540f8d70 2021-01-28T03:58:43.986 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.975+0000 7f225b057700 1 -- 172.21.15.100:0/495759668 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22540f6ec0 con 0x7f22540f8d70 2021-01-28T03:58:43.986 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.975+0000 7f224affd700 1 --2- 172.21.15.100:0/495759668 >> v2:172.21.15.100:6800/928846103 conn(0x7f224005bc60 0x7f224005e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:43.986 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.975+0000 7f225a055700 1 --2- 172.21.15.100:0/495759668 >> v2:172.21.15.100:6800/928846103 conn(0x7f224005bc60 0x7f224005e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:43.986 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.975+0000 7f224affd700 1 -- 172.21.15.100:0/495759668 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f2244077360 con 0x7f22540f8d70 2021-01-28T03:58:43.987 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.975+0000 7f225a055700 1 --2- 172.21.15.100:0/495759668 >> v2:172.21.15.100:6800/928846103 conn(0x7f224005bc60 0x7f224005e120 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f2250004fd0 tx=0x7f225000b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:58:43.992 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:43.987+0000 7f224affd700 1 -- 172.21.15.100:0/495759668 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f2244049fd0 con 0x7f22540f8d70 2021-01-28T03:58:44.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:43 smithi162 bash[9856]: cluster 2021-01-28T03:58:43.446781+0000 mgr.y (mgr.14138) 421 : cluster [DBG] pgmap v294: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:58:44.150 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:44.143+0000 7f225b057700 1 -- 172.21.15.100:0/495759668 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f22541027c0 con 0x7f22540f8d70 2021-01-28T03:58:44.151 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:44.143+0000 7f224affd700 1 -- 172.21.15.100:0/495759668 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f224404d5f0 con 0x7f22540f8d70 2021-01-28T03:58:44.151 INFO:teuthology.orchestra.run.smithi100.stdout:133143986227 2021-01-28T03:58:44.154 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:44.147+0000 7f225b057700 1 -- 172.21.15.100:0/495759668 >> v2:172.21.15.100:6800/928846103 conn(0x7f224005bc60 msgr2=0x7f224005e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:44.154 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:44.147+0000 7f225b057700 1 --2- 172.21.15.100:0/495759668 >> v2:172.21.15.100:6800/928846103 conn(0x7f224005bc60 0x7f224005e120 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f2250004fd0 tx=0x7f225000b040).stop 2021-01-28T03:58:44.155 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:44.147+0000 7f225b057700 1 -- 172.21.15.100:0/495759668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22540f8d70 msgr2=0x7f2254108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:44.155 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:44.147+0000 7f225b057700 1 --2- 172.21.15.100:0/495759668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22540f8d70 0x7f2254108200 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f2244009c20 tx=0x7f2244009b30).stop 2021-01-28T03:58:44.156 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:44.147+0000 7f225b057700 1 -- 172.21.15.100:0/495759668 shutdown_connections 2021-01-28T03:58:44.156 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:44.147+0000 7f225b057700 1 --2- 172.21.15.100:0/495759668 >> v2:172.21.15.100:6800/928846103 conn(0x7f224005bc60 0x7f224005e120 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:44.156 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:44.147+0000 7f225b057700 1 --2- 172.21.15.100:0/495759668 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22540f96c0 0x7f2254108fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:44.156 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:44.147+0000 7f225b057700 1 --2- 172.21.15.100:0/495759668 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f22540f7ad0 0x7f2254107d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:44.156 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:44.147+0000 7f225b057700 1 --2- 172.21.15.100:0/495759668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22540f8d70 0x7f2254108200 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:44.157 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:44.147+0000 7f225b057700 1 -- 172.21.15.100:0/495759668 >> 172.21.15.100:0/495759668 conn(0x7f22540f3390 msgr2=0x7f22540f6730 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:58:44.157 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:44.147+0000 7f225b057700 1 -- 172.21.15.100:0/495759668 shutdown_connections 2021-01-28T03:58:44.157 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:44.147+0000 7f225b057700 1 -- 172.21.15.100:0/495759668 wait complete. 2021-01-28T03:58:44.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:44 smithi100 bash[9834]: audit 2021-01-28T03:58:44.150556+0000 mon.a (mon.0) 659 : audit [DBG] from='client.? 172.21.15.100:0/495759668' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-01-28T03:58:44.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:44 smithi100 bash[13549]: audit 2021-01-28T03:58:44.150556+0000 mon.a (mon.0) 659 : audit [DBG] from='client.? 172.21.15.100:0/495759668' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-01-28T03:58:45.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:44 smithi162 bash[9856]: audit 2021-01-28T03:58:44.150556+0000 mon.a (mon.0) 659 : audit [DBG] from='client.? 172.21.15.100:0/495759668' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-01-28T03:58:45.025 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986220 got 133143986227 for osd.4 2021-01-28T03:58:45.025 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph osd last-stat-seq osd.5 2021-01-28T03:58:45.177 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c217df96-611b-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T03:58:45.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:45 smithi100 bash[9834]: cluster 2021-01-28T03:58:45.447962+0000 mgr.y (mgr.14138) 422 : cluster [DBG] pgmap v295: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:45.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:45 smithi100 bash[13549]: cluster 2021-01-28T03:58:45.447962+0000 mgr.y (mgr.14138) 422 : cluster [DBG] pgmap v295: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:46.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:45 smithi162 bash[9856]: cluster 2021-01-28T03:58:45.447962+0000 mgr.y (mgr.14138) 422 : cluster [DBG] pgmap v295: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:48.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:47 smithi162 bash[9856]: cluster 2021-01-28T03:58:47.448906+0000 mgr.y (mgr.14138) 423 : cluster [DBG] pgmap v296: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:48.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:47 smithi100 bash[9834]: cluster 2021-01-28T03:58:47.448906+0000 mgr.y (mgr.14138) 423 : cluster [DBG] pgmap v296: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:48.077 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:47 smithi100 bash[13549]: cluster 2021-01-28T03:58:47.448906+0000 mgr.y (mgr.14138) 423 : cluster [DBG] pgmap v296: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:48.524 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.523+0000 7f4e92882700 1 -- 172.21.15.100:0/603472075 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4e8c0f46b0 msgr2=0x7f4e8c0f6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:48.525 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.523+0000 7f4e92882700 1 --2- 172.21.15.100:0/603472075 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4e8c0f46b0 0x7f4e8c0f6e30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f4e74004e00 tx=0x7f4e74009b30).stop 2021-01-28T03:58:48.525 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.523+0000 7f4e92882700 1 -- 172.21.15.100:0/603472075 shutdown_connections 2021-01-28T03:58:48.526 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.523+0000 7f4e92882700 1 --2- 172.21.15.100:0/603472075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e8c0f3d10 0x7f4e8c0f4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:48.526 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.523+0000 7f4e92882700 1 --2- 172.21.15.100:0/603472075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e8c0f7450 0x7f4e8c0f78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:48.526 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.523+0000 7f4e92882700 1 --2- 172.21.15.100:0/603472075 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4e8c0f46b0 0x7f4e8c0f6e30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:48.527 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.523+0000 7f4e92882700 1 -- 172.21.15.100:0/603472075 >> 172.21.15.100:0/603472075 conn(0x7f4e8c0ef8d0 msgr2=0x7f4e8c0f1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:58:48.527 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.523+0000 7f4e92882700 1 -- 172.21.15.100:0/603472075 shutdown_connections 2021-01-28T03:58:48.528 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.523+0000 7f4e92882700 1 -- 172.21.15.100:0/603472075 wait complete. 2021-01-28T03:58:48.531 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.523+0000 7f4e92882700 1 Processor -- start 2021-01-28T03:58:48.531 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.523+0000 7f4e92882700 1 -- start start 2021-01-28T03:58:48.532 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.523+0000 7f4e92882700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4e8c0f3d10 0x7f4e8c1058d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:48.532 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.523+0000 7f4e92882700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e8c0f46b0 0x7f4e8c105dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:48.532 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.523+0000 7f4e92882700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e8c0f7450 0x7f4e8c10cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:48.532 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.523+0000 7f4e92882700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c10d390 con 0x7f4e8c0f7450 2021-01-28T03:58:48.533 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.523+0000 7f4e92882700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c10d4d0 con 0x7f4e8c0f46b0 2021-01-28T03:58:48.533 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.523+0000 7f4e92882700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8c10d610 con 0x7f4e8c0f3d10 2021-01-28T03:58:48.533 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.523+0000 7f4e90e1f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e8c0f7450 0x7f4e8c10cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:48.533 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.523+0000 7f4e90e1f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e8c0f7450 0x7f4e8c10cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60116/0 (socket says 172.21.15.100:60116) 2021-01-28T03:58:48.533 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.523+0000 7f4e90e1f700 1 -- 172.21.15.100:0/984050580 learned_addr learned my addr 172.21.15.100:0/984050580 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:58:48.534 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.523+0000 7f4e8bfff700 1 --2- 172.21.15.100:0/984050580 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4e8c0f3d10 0x7f4e8c1058d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:48.534 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.523+0000 7f4e8b7fe700 1 --2- 172.21.15.100:0/984050580 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e8c0f46b0 0x7f4e8c105dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:48.534 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.523+0000 7f4e90e1f700 1 -- 172.21.15.100:0/984050580 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4e8c0f3d10 msgr2=0x7f4e8c1058d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:48.535 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.523+0000 7f4e90e1f700 1 --2- 172.21.15.100:0/984050580 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4e8c0f3d10 0x7f4e8c1058d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:48.535 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.523+0000 7f4e90e1f700 1 -- 172.21.15.100:0/984050580 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e8c0f46b0 msgr2=0x7f4e8c105dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:48.535 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.523+0000 7f4e90e1f700 1 --2- 172.21.15.100:0/984050580 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e8c0f46b0 0x7f4e8c105dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:48.536 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.523+0000 7f4e90e1f700 1 -- 172.21.15.100:0/984050580 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8c10d7d0 con 0x7f4e8c0f7450 2021-01-28T03:58:48.536 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.523+0000 7f4e90e1f700 1 --2- 172.21.15.100:0/984050580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e8c0f7450 0x7f4e8c10cea0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f4e840096d0 tx=0x7f4e84009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:58:48.536 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.523+0000 7f4e88ff9700 1 -- 172.21.15.100:0/984050580 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e84007e30 con 0x7f4e8c0f7450 2021-01-28T03:58:48.536 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.523+0000 7f4e88ff9700 1 -- 172.21.15.100:0/984050580 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f4e8401a7f0 con 0x7f4e8c0f7450 2021-01-28T03:58:48.537 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.523+0000 7f4e92882700 1 -- 172.21.15.100:0/984050580 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e8c0f4c80 con 0x7f4e8c0f7450 2021-01-28T03:58:48.537 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.523+0000 7f4e88ff9700 1 -- 172.21.15.100:0/984050580 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e840195d0 con 0x7f4e8c0f7450 2021-01-28T03:58:48.537 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.523+0000 7f4e92882700 1 -- 172.21.15.100:0/984050580 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e8c0f51f0 con 0x7f4e8c0f7450 2021-01-28T03:58:48.537 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.527+0000 7f4e92882700 1 -- 172.21.15.100:0/984050580 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e8c027100 con 0x7f4e8c0f7450 2021-01-28T03:58:48.538 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.527+0000 7f4e88ff9700 1 -- 172.21.15.100:0/984050580 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f4e84022070 con 0x7f4e8c0f7450 2021-01-28T03:58:48.538 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.527+0000 7f4e88ff9700 1 --2- 172.21.15.100:0/984050580 >> v2:172.21.15.100:6800/928846103 conn(0x7f4e7805bd20 0x7f4e7805e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:48.538 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.527+0000 7f4e88ff9700 1 -- 172.21.15.100:0/984050580 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f4e84079d20 con 0x7f4e8c0f7450 2021-01-28T03:58:48.539 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.527+0000 7f4e8bfff700 1 --2- 172.21.15.100:0/984050580 >> v2:172.21.15.100:6800/928846103 conn(0x7f4e7805bd20 0x7f4e7805e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:48.539 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.527+0000 7f4e8bfff700 1 --2- 172.21.15.100:0/984050580 >> v2:172.21.15.100:6800/928846103 conn(0x7f4e7805bd20 0x7f4e7805e1e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f4e8c05ec30 tx=0x7f4e7c009040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:58:48.539 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.535+0000 7f4e88ff9700 1 -- 172.21.15.100:0/984050580 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f4e8404ca10 con 0x7f4e8c0f7450 2021-01-28T03:58:48.700 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.695+0000 7f4e92882700 1 -- 172.21.15.100:0/984050580 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f4e8c1006e0 con 0x7f4e8c0f7450 2021-01-28T03:58:48.700 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.699+0000 7f4e88ff9700 1 -- 172.21.15.100:0/984050580 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4e84050030 con 0x7f4e8c0f7450 2021-01-28T03:58:48.700 INFO:teuthology.orchestra.run.smithi100.stdout:154618822703 2021-01-28T03:58:48.702 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.699+0000 7f4e92882700 1 -- 172.21.15.100:0/984050580 >> v2:172.21.15.100:6800/928846103 conn(0x7f4e7805bd20 msgr2=0x7f4e7805e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:48.702 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.699+0000 7f4e92882700 1 --2- 172.21.15.100:0/984050580 >> v2:172.21.15.100:6800/928846103 conn(0x7f4e7805bd20 0x7f4e7805e1e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f4e8c05ec30 tx=0x7f4e7c009040).stop 2021-01-28T03:58:48.703 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.699+0000 7f4e92882700 1 -- 172.21.15.100:0/984050580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e8c0f7450 msgr2=0x7f4e8c10cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:48.703 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.699+0000 7f4e92882700 1 --2- 172.21.15.100:0/984050580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e8c0f7450 0x7f4e8c10cea0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f4e840096d0 tx=0x7f4e84009b30).stop 2021-01-28T03:58:48.703 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.699+0000 7f4e92882700 1 -- 172.21.15.100:0/984050580 shutdown_connections 2021-01-28T03:58:48.703 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.699+0000 7f4e92882700 1 --2- 172.21.15.100:0/984050580 >> v2:172.21.15.100:6800/928846103 conn(0x7f4e7805bd20 0x7f4e7805e1e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:48.703 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.699+0000 7f4e92882700 1 --2- 172.21.15.100:0/984050580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e8c0f7450 0x7f4e8c10cea0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:48.704 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.699+0000 7f4e92882700 1 --2- 172.21.15.100:0/984050580 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f4e8c0f3d10 0x7f4e8c1058d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:48.704 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.699+0000 7f4e92882700 1 --2- 172.21.15.100:0/984050580 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e8c0f46b0 0x7f4e8c105dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:48.704 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.699+0000 7f4e92882700 1 -- 172.21.15.100:0/984050580 >> 172.21.15.100:0/984050580 conn(0x7f4e8c0ef8d0 msgr2=0x7f4e8c0f1990 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:58:48.704 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.699+0000 7f4e92882700 1 -- 172.21.15.100:0/984050580 shutdown_connections 2021-01-28T03:58:48.704 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:48.699+0000 7f4e92882700 1 -- 172.21.15.100:0/984050580 wait complete. 2021-01-28T03:58:49.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:48 smithi162 bash[9856]: audit 2021-01-28T03:58:48.699750+0000 mon.a (mon.0) 660 : audit [DBG] from='client.? 172.21.15.100:0/984050580' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-01-28T03:58:49.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:48 smithi100 bash[9834]: audit 2021-01-28T03:58:48.699750+0000 mon.a (mon.0) 660 : audit [DBG] from='client.? 172.21.15.100:0/984050580' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-01-28T03:58:49.077 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:48 smithi100 bash[13549]: audit 2021-01-28T03:58:48.699750+0000 mon.a (mon.0) 660 : audit [DBG] from='client.? 172.21.15.100:0/984050580' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-01-28T03:58:49.491 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822696 got 154618822703 for osd.5 2021-01-28T03:58:49.493 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph osd last-stat-seq osd.6 2021-01-28T03:58:49.644 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c217df96-611b-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T03:58:49.764 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:58:49 smithi100 bash[10061]: debug 2021-01-28T03:58:49.599+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T03:58:50.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:49 smithi162 bash[9856]: cluster 2021-01-28T03:58:49.450378+0000 mgr.y (mgr.14138) 424 : cluster [DBG] pgmap v297: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:58:50.012 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 03:58:49 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T03:58:50.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:49 smithi100 bash[9834]: cluster 2021-01-28T03:58:49.450378+0000 mgr.y (mgr.14138) 424 : cluster [DBG] pgmap v297: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:58:50.077 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:49 smithi100 bash[13549]: cluster 2021-01-28T03:58:49.450378+0000 mgr.y (mgr.14138) 424 : cluster [DBG] pgmap v297: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:58:51.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:50 smithi100 bash[9834]: audit 2021-01-28T03:58:49.601838+0000 mgr.y (mgr.14138) 425 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:58:51.077 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:50 smithi100 bash[13549]: audit 2021-01-28T03:58:49.601838+0000 mgr.y (mgr.14138) 425 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:58:51.262 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:50 smithi162 bash[9856]: audit 2021-01-28T03:58:49.601838+0000 mgr.y (mgr.14138) 425 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:58:52.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:51 smithi100 bash[9834]: cluster 2021-01-28T03:58:51.451339+0000 mgr.y (mgr.14138) 426 : cluster [DBG] pgmap v298: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:52.077 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:51 smithi100 bash[13549]: cluster 2021-01-28T03:58:51.451339+0000 mgr.y (mgr.14138) 426 : cluster [DBG] pgmap v298: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:52.262 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:51 smithi162 bash[9856]: cluster 2021-01-28T03:58:51.451339+0000 mgr.y (mgr.14138) 426 : cluster [DBG] pgmap v298: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:52.962 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.959+0000 7f686969c700 1 -- 172.21.15.100:0/77293994 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f68640f4940 msgr2=0x7f68640f4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:52.963 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.959+0000 7f686969c700 1 --2- 172.21.15.100:0/77293994 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f68640f4940 0x7f68640f4d60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f6854004e30 tx=0x7f6854009b30).stop 2021-01-28T03:58:52.963 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.959+0000 7f686969c700 1 -- 172.21.15.100:0/77293994 shutdown_connections 2021-01-28T03:58:52.963 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.959+0000 7f686969c700 1 --2- 172.21.15.100:0/77293994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68640f6530 0x7f68640fce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:52.963 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.959+0000 7f686969c700 1 --2- 172.21.15.100:0/77293994 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f68640f4940 0x7f68640f4d60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:52.963 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.959+0000 7f686969c700 1 --2- 172.21.15.100:0/77293994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68640f5be0 0x7f68640f6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:52.964 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.959+0000 7f686969c700 1 -- 172.21.15.100:0/77293994 >> 172.21.15.100:0/77293994 conn(0x7f68640f0160 msgr2=0x7f68640f2580 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:58:52.964 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.959+0000 7f686969c700 1 -- 172.21.15.100:0/77293994 shutdown_connections 2021-01-28T03:58:52.964 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.959+0000 7f686969c700 1 -- 172.21.15.100:0/77293994 wait complete. 2021-01-28T03:58:52.965 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.963+0000 7f686969c700 1 Processor -- start 2021-01-28T03:58:52.966 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.963+0000 7f686969c700 1 -- start start 2021-01-28T03:58:52.966 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.963+0000 7f686969c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68640f4940 0x7f68640f88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:52.966 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.963+0000 7f686969c700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f68640f5be0 0x7f68640f6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:52.966 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.963+0000 7f686969c700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68640f6530 0x7f68640f7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:52.966 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.963+0000 7f686969c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68640f7a30 con 0x7f68640f4940 2021-01-28T03:58:52.967 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.963+0000 7f686969c700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68640f7ba0 con 0x7f68640f6530 2021-01-28T03:58:52.967 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.963+0000 7f686969c700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68640f7d60 con 0x7f68640f5be0 2021-01-28T03:58:52.967 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.963+0000 7f6862ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68640f4940 0x7f68640f88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:52.967 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.963+0000 7f6862ffd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68640f4940 0x7f68640f88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60124/0 (socket says 172.21.15.100:60124) 2021-01-28T03:58:52.967 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.963+0000 7f6862ffd700 1 -- 172.21.15.100:0/1040467954 learned_addr learned my addr 172.21.15.100:0/1040467954 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:58:52.968 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.963+0000 7f685a7fc700 1 --2- 172.21.15.100:0/1040467954 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f68640f5be0 0x7f68640f6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:52.968 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.963+0000 7f68637fe700 1 --2- 172.21.15.100:0/1040467954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68640f6530 0x7f68640f7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:52.968 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.963+0000 7f6862ffd700 1 -- 172.21.15.100:0/1040467954 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f68640f5be0 msgr2=0x7f68640f6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:52.968 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.963+0000 7f6862ffd700 1 --2- 172.21.15.100:0/1040467954 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f68640f5be0 0x7f68640f6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:52.968 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.963+0000 7f6862ffd700 1 -- 172.21.15.100:0/1040467954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68640f6530 msgr2=0x7f68640f7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:52.969 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.963+0000 7f6862ffd700 1 --2- 172.21.15.100:0/1040467954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68640f6530 0x7f68640f7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:52.969 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.963+0000 7f6862ffd700 1 -- 172.21.15.100:0/1040467954 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f686410fa30 con 0x7f68640f4940 2021-01-28T03:58:52.969 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.963+0000 7f68637fe700 1 --2- 172.21.15.100:0/1040467954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68640f6530 0x7f68640f7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-28T03:58:52.969 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.963+0000 7f6862ffd700 1 --2- 172.21.15.100:0/1040467954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68640f4940 0x7f68640f88c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f685400b650 tx=0x7f6854009b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:58:52.970 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.963+0000 7f685bfff700 1 -- 172.21.15.100:0/1040467954 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685400e030 con 0x7f68640f4940 2021-01-28T03:58:52.970 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.963+0000 7f685bfff700 1 -- 172.21.15.100:0/1040467954 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f68540092e0 con 0x7f68640f4940 2021-01-28T03:58:52.970 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.963+0000 7f686969c700 1 -- 172.21.15.100:0/1040467954 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f686410fc80 con 0x7f68640f4940 2021-01-28T03:58:52.970 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.963+0000 7f685bfff700 1 -- 172.21.15.100:0/1040467954 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6854018070 con 0x7f68640f4940 2021-01-28T03:58:52.970 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.963+0000 7f686969c700 1 -- 172.21.15.100:0/1040467954 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6864110080 con 0x7f68640f4940 2021-01-28T03:58:52.971 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.967+0000 7f685bfff700 1 -- 172.21.15.100:0/1040467954 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f685401d420 con 0x7f68640f4940 2021-01-28T03:58:52.972 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.967+0000 7f686969c700 1 -- 172.21.15.100:0/1040467954 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6864045420 con 0x7f68640f4940 2021-01-28T03:58:52.972 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.967+0000 7f685bfff700 1 --2- 172.21.15.100:0/1040467954 >> v2:172.21.15.100:6800/928846103 conn(0x7f685005bd20 0x7f685005e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:52.972 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.967+0000 7f685bfff700 1 -- 172.21.15.100:0/1040467954 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f68540775a0 con 0x7f68640f4940 2021-01-28T03:58:52.972 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.967+0000 7f685a7fc700 1 --2- 172.21.15.100:0/1040467954 >> v2:172.21.15.100:6800/928846103 conn(0x7f685005bd20 0x7f685005e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:52.972 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.967+0000 7f685a7fc700 1 --2- 172.21.15.100:0/1040467954 >> v2:172.21.15.100:6800/928846103 conn(0x7f685005bd20 0x7f685005e1e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f684c009fd0 tx=0x7f684c00b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:58:52.973 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:52.971+0000 7f685bfff700 1 -- 172.21.15.100:0/1040467954 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f685404a290 con 0x7f68640f4940 2021-01-28T03:58:53.134 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:53.131+0000 7f686969c700 1 -- 172.21.15.100:0/1040467954 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f68641107b0 con 0x7f68640f4940 2021-01-28T03:58:53.134 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:53.131+0000 7f685bfff700 1 -- 172.21.15.100:0/1040467954 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f685404d8b0 con 0x7f68640f4940 2021-01-28T03:58:53.135 INFO:teuthology.orchestra.run.smithi100.stdout:176093659178 2021-01-28T03:58:53.136 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:53.135+0000 7f686969c700 1 -- 172.21.15.100:0/1040467954 >> v2:172.21.15.100:6800/928846103 conn(0x7f685005bd20 msgr2=0x7f685005e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:53.137 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:53.135+0000 7f686969c700 1 --2- 172.21.15.100:0/1040467954 >> v2:172.21.15.100:6800/928846103 conn(0x7f685005bd20 0x7f685005e1e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f684c009fd0 tx=0x7f684c00b040).stop 2021-01-28T03:58:53.137 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:53.135+0000 7f686969c700 1 -- 172.21.15.100:0/1040467954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68640f4940 msgr2=0x7f68640f88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:53.137 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:53.135+0000 7f686969c700 1 --2- 172.21.15.100:0/1040467954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68640f4940 0x7f68640f88c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f685400b650 tx=0x7f6854009b30).stop 2021-01-28T03:58:53.137 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:53.135+0000 7f686969c700 1 -- 172.21.15.100:0/1040467954 shutdown_connections 2021-01-28T03:58:53.138 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:53.135+0000 7f686969c700 1 --2- 172.21.15.100:0/1040467954 >> v2:172.21.15.100:6800/928846103 conn(0x7f685005bd20 0x7f685005e1e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:53.138 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:53.135+0000 7f686969c700 1 --2- 172.21.15.100:0/1040467954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68640f6530 0x7f68640f7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:53.138 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:53.135+0000 7f686969c700 1 --2- 172.21.15.100:0/1040467954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68640f4940 0x7f68640f88c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:53.138 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:53.135+0000 7f686969c700 1 --2- 172.21.15.100:0/1040467954 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f68640f5be0 0x7f68640f6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:53.138 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:53.135+0000 7f686969c700 1 -- 172.21.15.100:0/1040467954 >> 172.21.15.100:0/1040467954 conn(0x7f68640f0160 msgr2=0x7f68640f1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:58:53.139 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:53.135+0000 7f686969c700 1 -- 172.21.15.100:0/1040467954 shutdown_connections 2021-01-28T03:58:53.139 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:53.135+0000 7f686969c700 1 -- 172.21.15.100:0/1040467954 wait complete. 2021-01-28T03:58:53.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:53 smithi162 bash[9856]: audit 2021-01-28T03:58:53.134254+0000 mon.a (mon.0) 661 : audit [DBG] from='client.? 172.21.15.100:0/1040467954' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-01-28T03:58:53.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:53 smithi100 bash[9834]: audit 2021-01-28T03:58:53.134254+0000 mon.a (mon.0) 661 : audit [DBG] from='client.? 172.21.15.100:0/1040467954' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-01-28T03:58:53.739 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:53 smithi100 bash[13549]: audit 2021-01-28T03:58:53.134254+0000 mon.a (mon.0) 661 : audit [DBG] from='client.? 172.21.15.100:0/1040467954' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-01-28T03:58:53.935 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659171 got 176093659178 for osd.6 2021-01-28T03:58:53.936 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph osd last-stat-seq osd.7 2021-01-28T03:58:54.091 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c217df96-611b-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T03:58:54.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:54 smithi162 bash[9856]: cluster 2021-01-28T03:58:53.452605+0000 mgr.y (mgr.14138) 427 : cluster [DBG] pgmap v299: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:58:54.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:54 smithi100 bash[9834]: cluster 2021-01-28T03:58:53.452605+0000 mgr.y (mgr.14138) 427 : cluster [DBG] pgmap v299: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:58:54.577 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:54 smithi100 bash[13549]: cluster 2021-01-28T03:58:53.452605+0000 mgr.y (mgr.14138) 427 : cluster [DBG] pgmap v299: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:58:55.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:55 smithi100 bash[9834]: cluster 2021-01-28T03:58:55.453609+0000 mgr.y (mgr.14138) 428 : cluster [DBG] pgmap v300: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:55.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:55 smithi100 bash[13549]: cluster 2021-01-28T03:58:55.453609+0000 mgr.y (mgr.14138) 428 : cluster [DBG] pgmap v300: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:56.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:55 smithi162 bash[9856]: cluster 2021-01-28T03:58:55.453609+0000 mgr.y (mgr.14138) 428 : cluster [DBG] pgmap v300: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:57.351 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.346+0000 7f1cb3fff700 1 -- 172.21.15.100:0/3671309552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cb40fbe70 msgr2=0x7f1cb40fc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:57.351 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.346+0000 7f1cb3fff700 1 --2- 172.21.15.100:0/3671309552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cb40fbe70 0x7f1cb40fc2b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f1ca8004e00 tx=0x7f1ca8009b30).stop 2021-01-28T03:58:57.352 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.346+0000 7f1cb3fff700 1 -- 172.21.15.100:0/3671309552 shutdown_connections 2021-01-28T03:58:57.352 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.346+0000 7f1cb3fff700 1 --2- 172.21.15.100:0/3671309552 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cb40fd810 0x7f1cb41043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:57.352 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.346+0000 7f1cb3fff700 1 --2- 172.21.15.100:0/3671309552 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cb40fbe70 0x7f1cb40fc2b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:57.352 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.346+0000 7f1cb3fff700 1 --2- 172.21.15.100:0/3671309552 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1cb40fc7a0 0x7f1cb40fd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:57.353 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.346+0000 7f1cb3fff700 1 -- 172.21.15.100:0/3671309552 >> 172.21.15.100:0/3671309552 conn(0x7f1cb406b0e0 msgr2=0x7f1cb406d500 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:58:57.353 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.346+0000 7f1cb3fff700 1 -- 172.21.15.100:0/3671309552 shutdown_connections 2021-01-28T03:58:57.353 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.346+0000 7f1cb3fff700 1 -- 172.21.15.100:0/3671309552 wait complete. 2021-01-28T03:58:57.354 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.350+0000 7f1cb3fff700 1 Processor -- start 2021-01-28T03:58:57.355 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.350+0000 7f1cb3fff700 1 -- start start 2021-01-28T03:58:57.355 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.350+0000 7f1cb3fff700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1cb40fbe70 0x7f1cb410bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:57.355 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.350+0000 7f1cb3fff700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cb40fd810 0x7f1cb410c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:57.355 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.350+0000 7f1cb3fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cb410d2a0 0x7f1cb410d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:57.356 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.350+0000 7f1cb3fff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb410dc10 con 0x7f1cb410d2a0 2021-01-28T03:58:57.356 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.350+0000 7f1cb3fff700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb410dd80 con 0x7f1cb40fd810 2021-01-28T03:58:57.356 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.350+0000 7f1cb3fff700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb410df40 con 0x7f1cb40fbe70 2021-01-28T03:58:57.356 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.350+0000 7f1cb2ffd700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1cb40fbe70 0x7f1cb410bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:57.357 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.350+0000 7f1cb2ffd700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1cb40fbe70 0x7f1cb410bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:41120/0 (socket says 172.21.15.100:41120) 2021-01-28T03:58:57.357 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.350+0000 7f1cb2ffd700 1 -- 172.21.15.100:0/3494870383 learned_addr learned my addr 172.21.15.100:0/3494870383 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:58:57.357 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.350+0000 7f1cb37fe700 1 --2- 172.21.15.100:0/3494870383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cb410d2a0 0x7f1cb410d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:57.357 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.350+0000 7f1cb27fc700 1 --2- 172.21.15.100:0/3494870383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cb40fd810 0x7f1cb410c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:57.357 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.350+0000 7f1cb2ffd700 1 -- 172.21.15.100:0/3494870383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cb40fd810 msgr2=0x7f1cb410c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:57.358 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.350+0000 7f1cb2ffd700 1 --2- 172.21.15.100:0/3494870383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cb40fd810 0x7f1cb410c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:57.358 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.350+0000 7f1cb2ffd700 1 -- 172.21.15.100:0/3494870383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cb410d2a0 msgr2=0x7f1cb410d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:57.358 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.350+0000 7f1cb2ffd700 1 --2- 172.21.15.100:0/3494870383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cb410d2a0 0x7f1cb410d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:57.358 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.350+0000 7f1cb2ffd700 1 -- 172.21.15.100:0/3494870383 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb410e100 con 0x7f1cb40fbe70 2021-01-28T03:58:57.358 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.350+0000 7f1cb37fe700 1 --2- 172.21.15.100:0/3494870383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cb410d2a0 0x7f1cb410d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-28T03:58:57.359 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.350+0000 7f1cb27fc700 1 --2- 172.21.15.100:0/3494870383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cb40fd810 0x7f1cb410c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-28T03:58:57.359 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.350+0000 7f1cb2ffd700 1 --2- 172.21.15.100:0/3494870383 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1cb40fbe70 0x7f1cb410bec0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f1ca8009c20 tx=0x7f1ca8009b30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:58:57.359 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.350+0000 7f1c9b7fe700 1 -- 172.21.15.100:0/3494870383 <== mon.1 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca800e030 con 0x7f1cb40fbe70 2021-01-28T03:58:57.359 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.350+0000 7f1cb3fff700 1 -- 172.21.15.100:0/3494870383 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cb4114550 con 0x7f1cb40fbe70 2021-01-28T03:58:57.360 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.350+0000 7f1c9b7fe700 1 -- 172.21.15.100:0/3494870383 <== mon.1 v2:172.21.15.100:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f1ca8013a80 con 0x7f1cb40fbe70 2021-01-28T03:58:57.360 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.350+0000 7f1c9b7fe700 1 -- 172.21.15.100:0/3494870383 <== mon.1 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca8018070 con 0x7f1cb40fbe70 2021-01-28T03:58:57.360 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.350+0000 7f1cb3fff700 1 -- 172.21.15.100:0/3494870383 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb4114ac0 con 0x7f1cb40fbe70 2021-01-28T03:58:57.360 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.350+0000 7f1cb3fff700 1 -- 172.21.15.100:0/3494870383 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c94004da0 con 0x7f1cb40fbe70 2021-01-28T03:58:57.361 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.354+0000 7f1c9b7fe700 1 -- 172.21.15.100:0/3494870383 <== mon.1 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f1ca801d940 con 0x7f1cb40fbe70 2021-01-28T03:58:57.361 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.354+0000 7f1c9b7fe700 1 --2- 172.21.15.100:0/3494870383 >> v2:172.21.15.100:6800/928846103 conn(0x7f1c9c05bc70 0x7f1c9c05e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:58:57.361 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.354+0000 7f1c9b7fe700 1 -- 172.21.15.100:0/3494870383 <== mon.1 v2:172.21.15.100:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f1ca8077580 con 0x7f1cb40fbe70 2021-01-28T03:58:57.362 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.354+0000 7f1cb27fc700 1 --2- 172.21.15.100:0/3494870383 >> v2:172.21.15.100:6800/928846103 conn(0x7f1c9c05bc70 0x7f1c9c05e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:58:57.362 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.354+0000 7f1cb27fc700 1 --2- 172.21.15.100:0/3494870383 >> v2:172.21.15.100:6800/928846103 conn(0x7f1c9c05bc70 0x7f1c9c05e130 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f1cb40fce80 tx=0x7f1ca400b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:58:57.364 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.362+0000 7f1c9b7fe700 1 -- 172.21.15.100:0/3494870383 <== mon.1 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f1ca804a1f0 con 0x7f1cb40fbe70 2021-01-28T03:58:57.530 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.526+0000 7f1cb3fff700 1 -- 172.21.15.100:0/3494870383 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f1c94005470 con 0x7f1cb40fbe70 2021-01-28T03:58:57.531 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.526+0000 7f1c9b7fe700 1 -- 172.21.15.100:0/3494870383 <== mon.1 v2:172.21.15.100:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1ca804d810 con 0x7f1cb40fbe70 2021-01-28T03:58:57.531 INFO:teuthology.orchestra.run.smithi100.stdout:201863462950 2021-01-28T03:58:57.534 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.530+0000 7f1cb3fff700 1 -- 172.21.15.100:0/3494870383 >> v2:172.21.15.100:6800/928846103 conn(0x7f1c9c05bc70 msgr2=0x7f1c9c05e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:57.534 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.530+0000 7f1cb3fff700 1 --2- 172.21.15.100:0/3494870383 >> v2:172.21.15.100:6800/928846103 conn(0x7f1c9c05bc70 0x7f1c9c05e130 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f1cb40fce80 tx=0x7f1ca400b040).stop 2021-01-28T03:58:57.535 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.530+0000 7f1cb3fff700 1 -- 172.21.15.100:0/3494870383 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1cb40fbe70 msgr2=0x7f1cb410bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:58:57.535 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.530+0000 7f1cb3fff700 1 --2- 172.21.15.100:0/3494870383 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1cb40fbe70 0x7f1cb410bec0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f1ca8009c20 tx=0x7f1ca8009b30).stop 2021-01-28T03:58:57.535 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.530+0000 7f1cb3fff700 1 -- 172.21.15.100:0/3494870383 shutdown_connections 2021-01-28T03:58:57.535 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.530+0000 7f1cb3fff700 1 --2- 172.21.15.100:0/3494870383 >> v2:172.21.15.100:6800/928846103 conn(0x7f1c9c05bc70 0x7f1c9c05e130 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:57.536 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.530+0000 7f1cb3fff700 1 --2- 172.21.15.100:0/3494870383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1cb410d2a0 0x7f1cb410d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:57.536 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.530+0000 7f1cb3fff700 1 --2- 172.21.15.100:0/3494870383 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f1cb40fbe70 0x7f1cb410bec0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:57.536 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.530+0000 7f1cb3fff700 1 --2- 172.21.15.100:0/3494870383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1cb40fd810 0x7f1cb410c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:58:57.536 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.530+0000 7f1cb3fff700 1 -- 172.21.15.100:0/3494870383 >> 172.21.15.100:0/3494870383 conn(0x7f1cb406b0e0 msgr2=0x7f1cb41003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:58:57.537 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.530+0000 7f1cb3fff700 1 -- 172.21.15.100:0/3494870383 shutdown_connections 2021-01-28T03:58:57.537 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:58:57.530+0000 7f1cb3fff700 1 -- 172.21.15.100:0/3494870383 wait complete. 2021-01-28T03:58:58.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:57 smithi162 bash[9856]: cluster 2021-01-28T03:58:57.454528+0000 mgr.y (mgr.14138) 429 : cluster [DBG] pgmap v301: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:58.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:57 smithi162 bash[9856]: audit 2021-01-28T03:58:57.530425+0000 mon.c (mon.1) 25 : audit [DBG] from='client.? 172.21.15.100:0/3494870383' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-01-28T03:58:58.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:57 smithi100 bash[9834]: cluster 2021-01-28T03:58:57.454528+0000 mgr.y (mgr.14138) 429 : cluster [DBG] pgmap v301: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:58.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:57 smithi100 bash[9834]: audit 2021-01-28T03:58:57.530425+0000 mon.c (mon.1) 25 : audit [DBG] from='client.? 172.21.15.100:0/3494870383' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-01-28T03:58:58.077 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:57 smithi100 bash[13549]: cluster 2021-01-28T03:58:57.454528+0000 mgr.y (mgr.14138) 429 : cluster [DBG] pgmap v301: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:58:58.078 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:57 smithi100 bash[13549]: audit 2021-01-28T03:58:57.530425+0000 mon.c (mon.1) 25 : audit [DBG] from='client.? 172.21.15.100:0/3494870383' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-01-28T03:58:58.325 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462943 got 201863462950 for osd.7 2021-01-28T03:58:58.325 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2021-01-28T03:58:58.326 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph pg dump --format=json 2021-01-28T03:58:58.476 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c217df96-611b-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T03:58:59.827 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:58:59 smithi100 bash[10061]: debug 2021-01-28T03:58:59.610+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T03:58:59.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:58:59 smithi100 bash[9834]: cluster 2021-01-28T03:58:59.455919+0000 mgr.y (mgr.14138) 430 : cluster [DBG] pgmap v302: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:58:59.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:58:59 smithi100 bash[13549]: cluster 2021-01-28T03:58:59.455919+0000 mgr.y (mgr.14138) 430 : cluster [DBG] pgmap v302: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:00.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:58:59 smithi162 bash[9856]: cluster 2021-01-28T03:58:59.455919+0000 mgr.y (mgr.14138) 430 : cluster [DBG] pgmap v302: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:00.012 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 03:58:59 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T03:59:00.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:00 smithi100 bash[9834]: audit 2021-01-28T03:58:59.611656+0000 mgr.y (mgr.14138) 431 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:59:00.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:00 smithi100 bash[13549]: audit 2021-01-28T03:58:59.611656+0000 mgr.y (mgr.14138) 431 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:59:01.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:00 smithi162 bash[9856]: audit 2021-01-28T03:58:59.611656+0000 mgr.y (mgr.14138) 431 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:59:01.582 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.578+0000 7fe1d4550700 1 -- 172.21.15.100:0/4129687520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1cc0f5340 msgr2=0x7fe1cc0f57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:59:01.583 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.578+0000 7fe1d4550700 1 --2- 172.21.15.100:0/4129687520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1cc0f5340 0x7fe1cc0f57c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7fe1c4009dc0 tx=0x7fe1c4004d10).stop 2021-01-28T03:59:01.583 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.578+0000 7fe1d4550700 1 -- 172.21.15.100:0/4129687520 shutdown_connections 2021-01-28T03:59:01.583 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.578+0000 7fe1d4550700 1 --2- 172.21.15.100:0/4129687520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1cc0f5f30 0x7fe1cc0f6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:59:01.583 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.578+0000 7fe1d4550700 1 --2- 172.21.15.100:0/4129687520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1cc0f5340 0x7fe1cc0f57c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:59:01.583 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.578+0000 7fe1d4550700 1 --2- 172.21.15.100:0/4129687520 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe1cc0f68d0 0x7fe1cc0f4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:59:01.584 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.578+0000 7fe1d4550700 1 -- 172.21.15.100:0/4129687520 >> 172.21.15.100:0/4129687520 conn(0x7fe1cc0ef8d0 msgr2=0x7fe1cc0f1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:59:01.584 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.578+0000 7fe1d4550700 1 -- 172.21.15.100:0/4129687520 shutdown_connections 2021-01-28T03:59:01.584 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.578+0000 7fe1d4550700 1 -- 172.21.15.100:0/4129687520 wait complete. 2021-01-28T03:59:01.586 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.578+0000 7fe1d4550700 1 Processor -- start 2021-01-28T03:59:01.586 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.578+0000 7fe1d4550700 1 -- start start 2021-01-28T03:59:01.586 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.582+0000 7fe1d4550700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1cc0f5340 0x7fe1cc1078b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:59:01.587 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.582+0000 7fe1d4550700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe1cc0f5f30 0x7fe1cc107da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:59:01.587 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.582+0000 7fe1d4550700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1cc0f68d0 0x7fe1cc10ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:59:01.587 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.582+0000 7fe1d4550700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc10f370 con 0x7fe1cc0f5340 2021-01-28T03:59:01.587 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.582+0000 7fe1d4550700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc10f4b0 con 0x7fe1cc0f68d0 2021-01-28T03:59:01.588 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.582+0000 7fe1d4550700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc10f5f0 con 0x7fe1cc0f5f30 2021-01-28T03:59:01.588 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.582+0000 7fe1d1aeb700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe1cc0f5f30 0x7fe1cc107da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:59:01.588 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.582+0000 7fe1d22ec700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1cc0f5340 0x7fe1cc1078b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:59:01.588 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.582+0000 7fe1d1aeb700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe1cc0f5f30 0x7fe1cc107da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:41136/0 (socket says 172.21.15.100:41136) 2021-01-28T03:59:01.589 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.582+0000 7fe1d1aeb700 1 -- 172.21.15.100:0/1820189453 learned_addr learned my addr 172.21.15.100:0/1820189453 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:59:01.589 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.582+0000 7fe1d2aed700 1 --2- 172.21.15.100:0/1820189453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1cc0f68d0 0x7fe1cc10ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:59:01.589 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.582+0000 7fe1d22ec700 1 -- 172.21.15.100:0/1820189453 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe1cc0f5f30 msgr2=0x7fe1cc107da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:59:01.589 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.582+0000 7fe1d22ec700 1 --2- 172.21.15.100:0/1820189453 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe1cc0f5f30 0x7fe1cc107da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:59:01.589 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.582+0000 7fe1d22ec700 1 -- 172.21.15.100:0/1820189453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1cc0f68d0 msgr2=0x7fe1cc10ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:59:01.590 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.582+0000 7fe1d22ec700 1 --2- 172.21.15.100:0/1820189453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1cc0f68d0 0x7fe1cc10ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:59:01.590 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.582+0000 7fe1d22ec700 1 -- 172.21.15.100:0/1820189453 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1cc10f7b0 con 0x7fe1cc0f5340 2021-01-28T03:59:01.590 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.582+0000 7fe1d2aed700 1 --2- 172.21.15.100:0/1820189453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1cc0f68d0 0x7fe1cc10ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2021-01-28T03:59:01.590 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.582+0000 7fe1d1aeb700 1 --2- 172.21.15.100:0/1820189453 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe1cc0f5f30 0x7fe1cc107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2021-01-28T03:59:01.591 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.582+0000 7fe1d22ec700 1 --2- 172.21.15.100:0/1820189453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1cc0f5340 0x7fe1cc1078b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fe1c8002a20 tx=0x7fe1c8009ce0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:59:01.591 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.582+0000 7fe1c2ffd700 1 -- 172.21.15.100:0/1820189453 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8009320 con 0x7fe1cc0f5340 2021-01-28T03:59:01.591 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.582+0000 7fe1c2ffd700 1 -- 172.21.15.100:0/1820189453 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fe1c800f040 con 0x7fe1cc0f5340 2021-01-28T03:59:01.591 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.582+0000 7fe1c2ffd700 1 -- 172.21.15.100:0/1820189453 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c800d850 con 0x7fe1cc0f5340 2021-01-28T03:59:01.591 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.582+0000 7fe1d4550700 1 -- 172.21.15.100:0/1820189453 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1cc10fa60 con 0x7fe1cc0f5340 2021-01-28T03:59:01.592 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.582+0000 7fe1d4550700 1 -- 172.21.15.100:0/1820189453 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1cc10ff80 con 0x7fe1cc0f5340 2021-01-28T03:59:01.592 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.582+0000 7fe1d4550700 1 -- 172.21.15.100:0/1820189453 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1cc0f49f0 con 0x7fe1cc0f5340 2021-01-28T03:59:01.593 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.582+0000 7fe1c2ffd700 1 -- 172.21.15.100:0/1820189453 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7fe1c800dc40 con 0x7fe1cc0f5340 2021-01-28T03:59:01.593 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.582+0000 7fe1c2ffd700 1 --2- 172.21.15.100:0/1820189453 >> v2:172.21.15.100:6800/928846103 conn(0x7fe1b805bd20 0x7fe1b805e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:59:01.593 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.586+0000 7fe1c2ffd700 1 -- 172.21.15.100:0/1820189453 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7fe1c8075ab0 con 0x7fe1cc0f5340 2021-01-28T03:59:01.594 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.586+0000 7fe1d1aeb700 1 --2- 172.21.15.100:0/1820189453 >> v2:172.21.15.100:6800/928846103 conn(0x7fe1b805bd20 0x7fe1b805e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:59:01.594 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.586+0000 7fe1d1aeb700 1 --2- 172.21.15.100:0/1820189453 >> v2:172.21.15.100:6800/928846103 conn(0x7fe1b805bd20 0x7fe1b805e1e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fe1bc004fd0 tx=0x7fe1bc00b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:59:01.594 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.590+0000 7fe1c2ffd700 1 -- 172.21.15.100:0/1820189453 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fe1c8048720 con 0x7fe1cc0f5340 2021-01-28T03:59:01.759 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.758+0000 7fe1d4550700 1 -- 172.21.15.100:0/1820189453 --> v2:172.21.15.100:6800/928846103 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe1cc0f14e0 con 0x7fe1b805bd20 2021-01-28T03:59:01.776 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.774+0000 7fe1c2ffd700 1 -- 172.21.15.100:0/1820189453 <== mgr.14138 v2:172.21.15.100:6800/928846103 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345750 (secure 0 0 0) 0x7fe1cc0f14e0 con 0x7fe1b805bd20 2021-01-28T03:59:01.781 INFO:teuthology.orchestra.run.smithi100.stdout: 2021-01-28T03:59:01.783 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.778+0000 7fe1d4550700 1 -- 172.21.15.100:0/1820189453 >> v2:172.21.15.100:6800/928846103 conn(0x7fe1b805bd20 msgr2=0x7fe1b805e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:59:01.784 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.778+0000 7fe1d4550700 1 --2- 172.21.15.100:0/1820189453 >> v2:172.21.15.100:6800/928846103 conn(0x7fe1b805bd20 0x7fe1b805e1e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fe1bc004fd0 tx=0x7fe1bc00b040).stop 2021-01-28T03:59:01.784 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.778+0000 7fe1d4550700 1 -- 172.21.15.100:0/1820189453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1cc0f5340 msgr2=0x7fe1cc1078b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:59:01.784 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.778+0000 7fe1d4550700 1 --2- 172.21.15.100:0/1820189453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1cc0f5340 0x7fe1cc1078b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fe1c8002a20 tx=0x7fe1c8009ce0).stop 2021-01-28T03:59:01.784 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.778+0000 7fe1d4550700 1 -- 172.21.15.100:0/1820189453 shutdown_connections 2021-01-28T03:59:01.785 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.778+0000 7fe1d4550700 1 --2- 172.21.15.100:0/1820189453 >> v2:172.21.15.100:6800/928846103 conn(0x7fe1b805bd20 0x7fe1b805e1e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:59:01.785 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.778+0000 7fe1d4550700 1 --2- 172.21.15.100:0/1820189453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1cc0f68d0 0x7fe1cc10ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:59:01.785 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.778+0000 7fe1d4550700 1 --2- 172.21.15.100:0/1820189453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe1cc0f5340 0x7fe1cc1078b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:59:01.785 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.778+0000 7fe1d4550700 1 --2- 172.21.15.100:0/1820189453 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fe1cc0f5f30 0x7fe1cc107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:59:01.785 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.778+0000 7fe1d4550700 1 -- 172.21.15.100:0/1820189453 >> 172.21.15.100:0/1820189453 conn(0x7fe1cc0ef8d0 msgr2=0x7fe1cc1003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:59:01.786 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.778+0000 7fe1d4550700 1 -- 172.21.15.100:0/1820189453 shutdown_connections 2021-01-28T03:59:01.786 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:01.778+0000 7fe1d4550700 1 -- 172.21.15.100:0/1820189453 wait complete. 2021-01-28T03:59:01.787 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2021-01-28T03:59:01.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:01 smithi100 bash[9834]: cluster 2021-01-28T03:59:01.456496+0000 mgr.y (mgr.14138) 432 : cluster [DBG] pgmap v303: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:01.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:01 smithi100 bash[13549]: cluster 2021-01-28T03:59:01.456496+0000 mgr.y (mgr.14138) 432 : cluster [DBG] pgmap v303: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:02.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:01 smithi162 bash[9856]: cluster 2021-01-28T03:59:01.456496+0000 mgr.y (mgr.14138) 432 : cluster [DBG] pgmap v303: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:02.592 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2021-01-28T03:59:01.456188+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":25858,"num_objects":357,"num_object_clones":0,"num_object_copies":1071,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":357,"num_whiteouts":0,"num_read":1633,"num_read_kb":1101,"num_write":759,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":2317,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":743,"ondisk_log_size":743,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":51324,"kb_used_data":6524,"kb_used_omap":0,"kb_used_meta":44736,"kb_avail":749909892,"statfs":{"total":767960285184,"available":767907729408,"internally_reserved":0,"allocated":6680576,"data_stored":1921662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":45809664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006944"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.460948+0000","last_change":"2021-01-28T03:56:19.828450+0000","last_active":"2021-01-28T03:56:35.460948+0000","last_peered":"2021-01-28T03:56:35.460948+0000","last_clean":"2021-01-28T03:56:35.460948+0000","last_became_active":"2021-01-28T03:56:19.828096+0000","last_became_peered":"2021-01-28T03:56:19.828096+0000","last_unstale":"2021-01-28T03:56:35.460948+0000","last_undegraded":"2021-01-28T03:56:35.460948+0000","last_fullsized":"2021-01-28T03:56:35.460948+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.452025+0000","last_change":"2021-01-28T03:56:16.780844+0000","last_active":"2021-01-28T03:56:35.452025+0000","last_peered":"2021-01-28T03:56:35.452025+0000","last_clean":"2021-01-28T03:56:35.452025+0000","last_became_active":"2021-01-28T03:56:16.780447+0000","last_became_peered":"2021-01-28T03:56:16.780447+0000","last_unstale":"2021-01-28T03:56:35.452025+0000","last_undegraded":"2021-01-28T03:56:35.452025+0000","last_fullsized":"2021-01-28T03:56:35.452025+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"45'1","reported_seq":"41","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456670+0000","last_change":"2021-01-28T03:55:58.630393+0000","last_active":"2021-01-28T03:56:35.456670+0000","last_peered":"2021-01-28T03:56:35.456670+0000","last_clean":"2021-01-28T03:56:35.456670+0000","last_became_active":"2021-01-28T03:55:58.574929+0000","last_became_peered":"2021-01-28T03:55:58.574929+0000","last_unstale":"2021-01-28T03:56:35.456670+0000","last_undegraded":"2021-01-28T03:56:35.456670+0000","last_fullsized":"2021-01-28T03:56:35.456670+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":10,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"58'44","reported_seq":"113","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.460975+0000","last_change":"2021-01-28T03:56:14.750867+0000","last_active":"2021-01-28T03:56:35.460975+0000","last_peered":"2021-01-28T03:56:35.460975+0000","last_clean":"2021-01-28T03:56:35.460975+0000","last_became_active":"2021-01-28T03:56:14.750208+0000","last_became_peered":"2021-01-28T03:56:14.750208+0000","last_unstale":"2021-01-28T03:56:35.460975+0000","last_undegraded":"2021-01-28T03:56:35.460975+0000","last_fullsized":"2021-01-28T03:56:35.460975+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":890,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":89,"num_read_kb":66,"num_write":45,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.452413+0000","last_change":"2021-01-28T03:56:19.821875+0000","last_active":"2021-01-28T03:56:35.452413+0000","last_peered":"2021-01-28T03:56:35.452413+0000","last_clean":"2021-01-28T03:56:35.452413+0000","last_became_active":"2021-01-28T03:56:19.821493+0000","last_became_peered":"2021-01-28T03:56:19.821493+0000","last_unstale":"2021-01-28T03:56:35.452413+0000","last_undegraded":"2021-01-28T03:56:35.452413+0000","last_fullsized":"2021-01-28T03:56:35.452413+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.450185+0000","last_change":"2021-01-28T03:56:16.791387+0000","last_active":"2021-01-28T03:56:35.450185+0000","last_peered":"2021-01-28T03:56:35.450185+0000","last_clean":"2021-01-28T03:56:35.450185+0000","last_became_active":"2021-01-28T03:56:16.791004+0000","last_became_peered":"2021-01-28T03:56:16.791004+0000","last_unstale":"2021-01-28T03:56:35.450185+0000","last_undegraded":"2021-01-28T03:56:35.450185+0000","last_fullsized":"2021-01-28T03:56:35.450185+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.461945+0000","last_change":"2021-01-28T03:55:55.556668+0000","last_active":"2021-01-28T03:56:35.461945+0000","last_peered":"2021-01-28T03:56:35.461945+0000","last_clean":"2021-01-28T03:56:35.461945+0000","last_became_active":"2021-01-28T03:55:55.556205+0000","last_became_peered":"2021-01-28T03:55:55.556205+0000","last_unstale":"2021-01-28T03:56:35.461945+0000","last_undegraded":"2021-01-28T03:56:35.461945+0000","last_fullsized":"2021-01-28T03:56:35.461945+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"58'21","reported_seq":"61","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.452186+0000","last_change":"2021-01-28T03:56:14.753418+0000","last_active":"2021-01-28T03:56:35.452186+0000","last_peered":"2021-01-28T03:56:35.452186+0000","last_clean":"2021-01-28T03:56:35.452186+0000","last_became_active":"2021-01-28T03:56:14.753023+0000","last_became_peered":"2021-01-28T03:56:14.753023+0000","last_unstale":"2021-01-28T03:56:35.452186+0000","last_undegraded":"2021-01-28T03:56:35.452186+0000","last_fullsized":"2021-01-28T03:56:35.452186+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1038,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":47,"num_read_kb":28,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.449766+0000","last_change":"2021-01-28T03:56:19.827959+0000","last_active":"2021-01-28T03:56:35.449766+0000","last_peered":"2021-01-28T03:56:35.449766+0000","last_clean":"2021-01-28T03:56:35.449766+0000","last_became_active":"2021-01-28T03:56:19.827598+0000","last_became_peered":"2021-01-28T03:56:19.827598+0000","last_unstale":"2021-01-28T03:56:35.449766+0000","last_undegraded":"2021-01-28T03:56:35.449766+0000","last_fullsized":"2021-01-28T03:56:35.449766+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.455699+0000","last_change":"2021-01-28T03:56:16.794407+0000","last_active":"2021-01-28T03:56:35.455699+0000","last_peered":"2021-01-28T03:56:35.455699+0000","last_clean":"2021-01-28T03:56:35.455699+0000","last_became_active":"2021-01-28T03:56:16.793999+0000","last_became_peered":"2021-01-28T03:56:16.793999+0000","last_unstale":"2021-01-28T03:56:35.455699+0000","last_undegraded":"2021-01-28T03:56:35.455699+0000","last_fullsized":"2021-01-28T03:56:35.455699+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"45'1","reported_seq":"26","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456721+0000","last_change":"2021-01-28T03:55:58.775266+0000","last_active":"2021-01-28T03:56:35.456721+0000","last_peered":"2021-01-28T03:56:35.456721+0000","last_clean":"2021-01-28T03:56:35.456721+0000","last_became_active":"2021-01-28T03:55:58.578028+0000","last_became_peered":"2021-01-28T03:55:58.578028+0000","last_unstale":"2021-01-28T03:56:35.456721+0000","last_undegraded":"2021-01-28T03:56:35.456721+0000","last_fullsized":"2021-01-28T03:56:35.456721+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"58'12","reported_seq":"45","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.452395+0000","last_change":"2021-01-28T03:56:14.761718+0000","last_active":"2021-01-28T03:56:35.452395+0000","last_peered":"2021-01-28T03:56:35.452395+0000","last_clean":"2021-01-28T03:56:35.452395+0000","last_became_active":"2021-01-28T03:56:14.761338+0000","last_became_peered":"2021-01-28T03:56:14.761338+0000","last_unstale":"2021-01-28T03:56:35.452395+0000","last_undegraded":"2021-01-28T03:56:35.452395+0000","last_fullsized":"2021-01-28T03:56:35.452395+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":264,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":13,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.455235+0000","last_change":"2021-01-28T03:56:19.837024+0000","last_active":"2021-01-28T03:56:35.455235+0000","last_peered":"2021-01-28T03:56:35.455235+0000","last_clean":"2021-01-28T03:56:35.455235+0000","last_became_active":"2021-01-28T03:56:19.836635+0000","last_became_peered":"2021-01-28T03:56:19.836635+0000","last_unstale":"2021-01-28T03:56:35.455235+0000","last_undegraded":"2021-01-28T03:56:35.455235+0000","last_fullsized":"2021-01-28T03:56:35.455235+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.450175+0000","last_change":"2021-01-28T03:56:16.785282+0000","last_active":"2021-01-28T03:56:35.450175+0000","last_peered":"2021-01-28T03:56:35.450175+0000","last_clean":"2021-01-28T03:56:35.450175+0000","last_became_active":"2021-01-28T03:56:16.784912+0000","last_became_peered":"2021-01-28T03:56:16.784912+0000","last_unstale":"2021-01-28T03:56:35.450175+0000","last_undegraded":"2021-01-28T03:56:35.450175+0000","last_fullsized":"2021-01-28T03:56:35.450175+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":"22","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.455968+0000","last_change":"2021-01-28T03:55:58.570675+0000","last_active":"2021-01-28T03:56:35.455968+0000","last_peered":"2021-01-28T03:56:35.455968+0000","last_clean":"2021-01-28T03:56:35.455968+0000","last_became_active":"2021-01-28T03:55:58.570180+0000","last_became_peered":"2021-01-28T03:55:58.570180+0000","last_unstale":"2021-01-28T03:56:35.455968+0000","last_undegraded":"2021-01-28T03:56:35.455968+0000","last_fullsized":"2021-01-28T03:56:35.455968+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"58'25","reported_seq":"72","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.452545+0000","last_change":"2021-01-28T03:56:14.757162+0000","last_active":"2021-01-28T03:56:35.452545+0000","last_peered":"2021-01-28T03:56:35.452545+0000","last_clean":"2021-01-28T03:56:35.452545+0000","last_became_active":"2021-01-28T03:56:14.756802+0000","last_became_peered":"2021-01-28T03:56:14.756802+0000","last_unstale":"2021-01-28T03:56:35.452545+0000","last_undegraded":"2021-01-28T03:56:35.452545+0000","last_fullsized":"2021-01-28T03:56:35.452545+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":734,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":37,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.462116+0000","last_change":"2021-01-28T03:56:19.835783+0000","last_active":"2021-01-28T03:56:35.462116+0000","last_peered":"2021-01-28T03:56:35.462116+0000","last_clean":"2021-01-28T03:56:35.462116+0000","last_became_active":"2021-01-28T03:56:19.835352+0000","last_became_peered":"2021-01-28T03:56:19.835352+0000","last_unstale":"2021-01-28T03:56:35.462116+0000","last_undegraded":"2021-01-28T03:56:35.462116+0000","last_fullsized":"2021-01-28T03:56:35.462116+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.452490+0000","last_change":"2021-01-28T03:56:16.780051+0000","last_active":"2021-01-28T03:56:35.452490+0000","last_peered":"2021-01-28T03:56:35.452490+0000","last_clean":"2021-01-28T03:56:35.452490+0000","last_became_active":"2021-01-28T03:56:16.779629+0000","last_became_peered":"2021-01-28T03:56:16.779629+0000","last_unstale":"2021-01-28T03:56:35.452490+0000","last_undegraded":"2021-01-28T03:56:35.452490+0000","last_fullsized":"2021-01-28T03:56:35.452490+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":"33","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.460973+0000","last_change":"2021-01-28T03:55:58.570120+0000","last_active":"2021-01-28T03:56:35.460973+0000","last_peered":"2021-01-28T03:56:35.460973+0000","last_clean":"2021-01-28T03:56:35.460973+0000","last_became_active":"2021-01-28T03:55:58.569777+0000","last_became_peered":"2021-01-28T03:55:58.569777+0000","last_unstale":"2021-01-28T03:56:35.460973+0000","last_undegraded":"2021-01-28T03:56:35.460973+0000","last_fullsized":"2021-01-28T03:56:35.460973+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"58'22","reported_seq":"64","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.461566+0000","last_change":"2021-01-28T03:56:14.757886+0000","last_active":"2021-01-28T03:56:35.461566+0000","last_peered":"2021-01-28T03:56:35.461566+0000","last_clean":"2021-01-28T03:56:35.461566+0000","last_became_active":"2021-01-28T03:56:14.757508+0000","last_became_peered":"2021-01-28T03:56:14.757508+0000","last_unstale":"2021-01-28T03:56:35.461566+0000","last_undegraded":"2021-01-28T03:56:35.461566+0000","last_fullsized":"2021-01-28T03:56:35.461566+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":844,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":49,"num_read_kb":31,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.453760+0000","last_change":"2021-01-28T03:56:19.816523+0000","last_active":"2021-01-28T03:56:35.453760+0000","last_peered":"2021-01-28T03:56:35.453760+0000","last_clean":"2021-01-28T03:56:35.453760+0000","last_became_active":"2021-01-28T03:56:19.815574+0000","last_became_peered":"2021-01-28T03:56:19.815574+0000","last_unstale":"2021-01-28T03:56:35.453760+0000","last_undegraded":"2021-01-28T03:56:35.453760+0000","last_fullsized":"2021-01-28T03:56:35.453760+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456810+0000","last_change":"2021-01-28T03:56:16.789988+0000","last_active":"2021-01-28T03:56:35.456810+0000","last_peered":"2021-01-28T03:56:35.456810+0000","last_clean":"2021-01-28T03:56:35.456810+0000","last_became_active":"2021-01-28T03:56:16.789528+0000","last_became_peered":"2021-01-28T03:56:16.789528+0000","last_unstale":"2021-01-28T03:56:35.456810+0000","last_undegraded":"2021-01-28T03:56:35.456810+0000","last_fullsized":"2021-01-28T03:56:35.456810+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":"34","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.459281+0000","last_change":"2021-01-28T03:55:58.564347+0000","last_active":"2021-01-28T03:56:35.459281+0000","last_peered":"2021-01-28T03:56:35.459281+0000","last_clean":"2021-01-28T03:56:35.459281+0000","last_became_active":"2021-01-28T03:55:58.563231+0000","last_became_peered":"2021-01-28T03:55:58.563231+0000","last_unstale":"2021-01-28T03:56:35.459281+0000","last_undegraded":"2021-01-28T03:56:35.459281+0000","last_fullsized":"2021-01-28T03:56:35.459281+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"58'15","reported_seq":"68","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-28T03:56:36.482241+0000","last_change":"2021-01-28T03:56:36.482241+0000","last_active":"2021-01-28T03:56:36.482241+0000","last_peered":"2021-01-28T03:56:36.482241+0000","last_clean":"2021-01-28T03:56:36.482241+0000","last_became_active":"2021-01-28T03:56:36.466100+0000","last_became_peered":"2021-01-28T03:56:36.466100+0000","last_unstale":"2021-01-28T03:56:36.482241+0000","last_undegraded":"2021-01-28T03:56:36.482241+0000","last_fullsized":"2021-01-28T03:56:36.482241+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.455390+0000","last_change":"2021-01-28T03:56:19.819204+0000","last_active":"2021-01-28T03:56:35.455390+0000","last_peered":"2021-01-28T03:56:35.455390+0000","last_clean":"2021-01-28T03:56:35.455390+0000","last_became_active":"2021-01-28T03:56:19.818835+0000","last_became_peered":"2021-01-28T03:56:19.818835+0000","last_unstale":"2021-01-28T03:56:35.455390+0000","last_undegraded":"2021-01-28T03:56:35.455390+0000","last_fullsized":"2021-01-28T03:56:35.455390+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456493+0000","last_change":"2021-01-28T03:56:16.786784+0000","last_active":"2021-01-28T03:56:35.456493+0000","last_peered":"2021-01-28T03:56:35.456493+0000","last_clean":"2021-01-28T03:56:35.456493+0000","last_became_active":"2021-01-28T03:56:16.786354+0000","last_became_peered":"2021-01-28T03:56:16.786354+0000","last_unstale":"2021-01-28T03:56:35.456493+0000","last_undegraded":"2021-01-28T03:56:35.456493+0000","last_fullsized":"2021-01-28T03:56:35.456493+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"45'2","reported_seq":"33","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.460691+0000","last_change":"2021-01-28T03:55:55.556735+0000","last_active":"2021-01-28T03:56:35.460691+0000","last_peered":"2021-01-28T03:56:35.460691+0000","last_clean":"2021-01-28T03:56:35.460691+0000","last_became_active":"2021-01-28T03:55:55.556358+0000","last_became_peered":"2021-01-28T03:55:55.556358+0000","last_unstale":"2021-01-28T03:56:35.460691+0000","last_undegraded":"2021-01-28T03:56:35.460691+0000","last_fullsized":"2021-01-28T03:56:35.460691+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":105,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"58'23","reported_seq":"64","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.459293+0000","last_change":"2021-01-28T03:56:14.754717+0000","last_active":"2021-01-28T03:56:35.459293+0000","last_peered":"2021-01-28T03:56:35.459293+0000","last_clean":"2021-01-28T03:56:35.459293+0000","last_became_active":"2021-01-28T03:56:14.754321+0000","last_became_peered":"2021-01-28T03:56:14.754321+0000","last_unstale":"2021-01-28T03:56:35.459293+0000","last_undegraded":"2021-01-28T03:56:35.459293+0000","last_fullsized":"2021-01-28T03:56:35.459293+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1050,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":50,"num_read_kb":30,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456607+0000","last_change":"2021-01-28T03:56:19.826097+0000","last_active":"2021-01-28T03:56:35.456607+0000","last_peered":"2021-01-28T03:56:35.456607+0000","last_clean":"2021-01-28T03:56:35.456607+0000","last_became_active":"2021-01-28T03:56:19.825691+0000","last_became_peered":"2021-01-28T03:56:19.825691+0000","last_unstale":"2021-01-28T03:56:35.456607+0000","last_undegraded":"2021-01-28T03:56:35.456607+0000","last_fullsized":"2021-01-28T03:56:35.456607+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"53'2","reported_seq":"51","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-28T03:58:53.289334+0000","last_change":"2021-01-28T03:56:16.783964+0000","last_active":"2021-01-28T03:58:53.289334+0000","last_peered":"2021-01-28T03:58:53.289334+0000","last_clean":"2021-01-28T03:58:53.289334+0000","last_became_active":"2021-01-28T03:56:16.782967+0000","last_became_peered":"2021-01-28T03:56:16.782967+0000","last_unstale":"2021-01-28T03:58:53.289334+0000","last_undegraded":"2021-01-28T03:58:53.289334+0000","last_fullsized":"2021-01-28T03:58:53.289334+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"45'1","reported_seq":"40","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.449718+0000","last_change":"2021-01-28T03:55:58.580638+0000","last_active":"2021-01-28T03:56:35.449718+0000","last_peered":"2021-01-28T03:56:35.449718+0000","last_clean":"2021-01-28T03:56:35.449718+0000","last_became_active":"2021-01-28T03:55:58.563214+0000","last_became_peered":"2021-01-28T03:55:58.563214+0000","last_unstale":"2021-01-28T03:56:35.449718+0000","last_undegraded":"2021-01-28T03:56:35.449718+0000","last_fullsized":"2021-01-28T03:56:35.449718+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":247,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":247,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"58'22","reported_seq":"60","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456470+0000","last_change":"2021-01-28T03:56:15.155770+0000","last_active":"2021-01-28T03:56:35.456470+0000","last_peered":"2021-01-28T03:56:35.456470+0000","last_clean":"2021-01-28T03:56:35.456470+0000","last_became_active":"2021-01-28T03:56:15.154623+0000","last_became_peered":"2021-01-28T03:56:15.154623+0000","last_unstale":"2021-01-28T03:56:35.456470+0000","last_undegraded":"2021-01-28T03:56:35.456470+0000","last_fullsized":"2021-01-28T03:56:35.456470+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":934,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":45,"num_read_kb":27,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.461466+0000","last_change":"2021-01-28T03:56:19.825642+0000","last_active":"2021-01-28T03:56:35.461466+0000","last_peered":"2021-01-28T03:56:35.461466+0000","last_clean":"2021-01-28T03:56:35.461466+0000","last_became_active":"2021-01-28T03:56:19.825248+0000","last_became_peered":"2021-01-28T03:56:19.825248+0000","last_unstale":"2021-01-28T03:56:35.461466+0000","last_undegraded":"2021-01-28T03:56:35.461466+0000","last_fullsized":"2021-01-28T03:56:35.461466+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.455642+0000","last_change":"2021-01-28T03:56:16.793919+0000","last_active":"2021-01-28T03:56:35.455642+0000","last_peered":"2021-01-28T03:56:35.455642+0000","last_clean":"2021-01-28T03:56:35.455642+0000","last_became_active":"2021-01-28T03:56:16.793569+0000","last_became_peered":"2021-01-28T03:56:16.793569+0000","last_unstale":"2021-01-28T03:56:35.455642+0000","last_undegraded":"2021-01-28T03:56:35.455642+0000","last_fullsized":"2021-01-28T03:56:35.455642+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"45'1","reported_seq":"30","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.459377+0000","last_change":"2021-01-28T03:55:57.661137+0000","last_active":"2021-01-28T03:56:35.459377+0000","last_peered":"2021-01-28T03:56:35.459377+0000","last_clean":"2021-01-28T03:56:35.459377+0000","last_became_active":"2021-01-28T03:55:57.563002+0000","last_became_peered":"2021-01-28T03:55:57.563002+0000","last_unstale":"2021-01-28T03:56:35.459377+0000","last_undegraded":"2021-01-28T03:56:35.459377+0000","last_fullsized":"2021-01-28T03:56:35.459377+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"58'20","reported_seq":"58","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.460947+0000","last_change":"2021-01-28T03:56:15.153269+0000","last_active":"2021-01-28T03:56:35.460947+0000","last_peered":"2021-01-28T03:56:35.460947+0000","last_clean":"2021-01-28T03:56:35.460947+0000","last_became_active":"2021-01-28T03:56:15.151996+0000","last_became_peered":"2021-01-28T03:56:15.151996+0000","last_unstale":"2021-01-28T03:56:35.460947+0000","last_undegraded":"2021-01-28T03:56:35.460947+0000","last_fullsized":"2021-01-28T03:56:35.460947+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":580,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":41,"num_read_kb":27,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.454656+0000","last_change":"2021-01-28T03:56:19.826563+0000","last_active":"2021-01-28T03:56:35.454656+0000","last_peered":"2021-01-28T03:56:35.454656+0000","last_clean":"2021-01-28T03:56:35.454656+0000","last_became_active":"2021-01-28T03:56:19.826222+0000","last_became_peered":"2021-01-28T03:56:19.826222+0000","last_unstale":"2021-01-28T03:56:35.454656+0000","last_undegraded":"2021-01-28T03:56:35.454656+0000","last_fullsized":"2021-01-28T03:56:35.454656+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.455038+0000","last_change":"2021-01-28T03:56:16.783092+0000","last_active":"2021-01-28T03:56:35.455038+0000","last_peered":"2021-01-28T03:56:35.455038+0000","last_clean":"2021-01-28T03:56:35.455038+0000","last_became_active":"2021-01-28T03:56:16.782620+0000","last_became_peered":"2021-01-28T03:56:16.782620+0000","last_unstale":"2021-01-28T03:56:35.455038+0000","last_undegraded":"2021-01-28T03:56:35.455038+0000","last_fullsized":"2021-01-28T03:56:35.455038+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.451066+0000","last_change":"2021-01-28T03:55:55.543694+0000","last_active":"2021-01-28T03:56:35.451066+0000","last_peered":"2021-01-28T03:56:35.451066+0000","last_clean":"2021-01-28T03:56:35.451066+0000","last_became_active":"2021-01-28T03:55:55.542261+0000","last_became_peered":"2021-01-28T03:55:55.542261+0000","last_unstale":"2021-01-28T03:56:35.451066+0000","last_undegraded":"2021-01-28T03:56:35.451066+0000","last_fullsized":"2021-01-28T03:56:35.451066+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"58'12","reported_seq":"40","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.460637+0000","last_change":"2021-01-28T03:56:14.756411+0000","last_active":"2021-01-28T03:56:35.460637+0000","last_peered":"2021-01-28T03:56:35.460637+0000","last_clean":"2021-01-28T03:56:35.460637+0000","last_became_active":"2021-01-28T03:56:14.756049+0000","last_became_peered":"2021-01-28T03:56:14.756049+0000","last_unstale":"2021-01-28T03:56:35.460637+0000","last_undegraded":"2021-01-28T03:56:35.460637+0000","last_fullsized":"2021-01-28T03:56:35.460637+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1252,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":30,"num_read_kb":12,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.460572+0000","last_change":"2021-01-28T03:56:19.831977+0000","last_active":"2021-01-28T03:56:35.460572+0000","last_peered":"2021-01-28T03:56:35.460572+0000","last_clean":"2021-01-28T03:56:35.460572+0000","last_became_active":"2021-01-28T03:56:19.831582+0000","last_became_peered":"2021-01-28T03:56:19.831582+0000","last_unstale":"2021-01-28T03:56:35.460572+0000","last_undegraded":"2021-01-28T03:56:35.460572+0000","last_fullsized":"2021-01-28T03:56:35.460572+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.449634+0000","last_change":"2021-01-28T03:56:16.787817+0000","last_active":"2021-01-28T03:56:35.449634+0000","last_peered":"2021-01-28T03:56:35.449634+0000","last_clean":"2021-01-28T03:56:35.449634+0000","last_became_active":"2021-01-28T03:56:16.787371+0000","last_became_peered":"2021-01-28T03:56:16.787371+0000","last_unstale":"2021-01-28T03:56:35.449634+0000","last_undegraded":"2021-01-28T03:56:35.449634+0000","last_fullsized":"2021-01-28T03:56:35.449634+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456708+0000","last_change":"2021-01-28T03:55:55.547287+0000","last_active":"2021-01-28T03:56:35.456708+0000","last_peered":"2021-01-28T03:56:35.456708+0000","last_clean":"2021-01-28T03:56:35.456708+0000","last_became_active":"2021-01-28T03:55:55.546816+0000","last_became_peered":"2021-01-28T03:55:55.546816+0000","last_unstale":"2021-01-28T03:56:35.456708+0000","last_undegraded":"2021-01-28T03:56:35.456708+0000","last_fullsized":"2021-01-28T03:56:35.456708+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"58'15","reported_seq":"45","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.452557+0000","last_change":"2021-01-28T03:56:14.753594+0000","last_active":"2021-01-28T03:56:35.452557+0000","last_peered":"2021-01-28T03:56:35.452557+0000","last_clean":"2021-01-28T03:56:35.452557+0000","last_became_active":"2021-01-28T03:56:14.753222+0000","last_became_peered":"2021-01-28T03:56:14.753222+0000","last_unstale":"2021-01-28T03:56:35.452557+0000","last_undegraded":"2021-01-28T03:56:35.452557+0000","last_fullsized":"2021-01-28T03:56:35.452557+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":736,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":17,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.454407+0000","last_change":"2021-01-28T03:56:19.836277+0000","last_active":"2021-01-28T03:56:35.454407+0000","last_peered":"2021-01-28T03:56:35.454407+0000","last_clean":"2021-01-28T03:56:35.454407+0000","last_became_active":"2021-01-28T03:56:19.835858+0000","last_became_peered":"2021-01-28T03:56:19.835858+0000","last_unstale":"2021-01-28T03:56:35.454407+0000","last_undegraded":"2021-01-28T03:56:35.454407+0000","last_fullsized":"2021-01-28T03:56:35.454407+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.461355+0000","last_change":"2021-01-28T03:56:16.784298+0000","last_active":"2021-01-28T03:56:35.461355+0000","last_peered":"2021-01-28T03:56:35.461355+0000","last_clean":"2021-01-28T03:56:35.461355+0000","last_became_active":"2021-01-28T03:56:16.783961+0000","last_became_peered":"2021-01-28T03:56:16.783961+0000","last_unstale":"2021-01-28T03:56:35.461355+0000","last_undegraded":"2021-01-28T03:56:35.461355+0000","last_fullsized":"2021-01-28T03:56:35.461355+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456026+0000","last_change":"2021-01-28T03:55:55.551511+0000","last_active":"2021-01-28T03:56:35.456026+0000","last_peered":"2021-01-28T03:56:35.456026+0000","last_clean":"2021-01-28T03:56:35.456026+0000","last_became_active":"2021-01-28T03:55:55.551035+0000","last_became_peered":"2021-01-28T03:55:55.551035+0000","last_unstale":"2021-01-28T03:56:35.456026+0000","last_undegraded":"2021-01-28T03:56:35.456026+0000","last_fullsized":"2021-01-28T03:56:35.456026+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"58'15","reported_seq":"32","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-28T03:56:36.489698+0000","last_change":"2021-01-28T03:56:36.489698+0000","last_active":"2021-01-28T03:56:36.489698+0000","last_peered":"2021-01-28T03:56:36.489698+0000","last_clean":"2021-01-28T03:56:36.489698+0000","last_became_active":"2021-01-28T03:56:36.468161+0000","last_became_peered":"2021-01-28T03:56:36.468161+0000","last_unstale":"2021-01-28T03:56:36.489698+0000","last_undegraded":"2021-01-28T03:56:36.489698+0000","last_fullsized":"2021-01-28T03:56:36.489698+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1050,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":35,"num_read_kb":17,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1050,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.452969+0000","last_change":"2021-01-28T03:56:19.825052+0000","last_active":"2021-01-28T03:56:35.452969+0000","last_peered":"2021-01-28T03:56:35.452969+0000","last_clean":"2021-01-28T03:56:35.452969+0000","last_became_active":"2021-01-28T03:56:19.824683+0000","last_became_peered":"2021-01-28T03:56:19.824683+0000","last_unstale":"2021-01-28T03:56:35.452969+0000","last_undegraded":"2021-01-28T03:56:35.452969+0000","last_fullsized":"2021-01-28T03:56:35.452969+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"53'2","reported_seq":"51","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-28T03:58:53.288982+0000","last_change":"2021-01-28T03:56:16.779379+0000","last_active":"2021-01-28T03:58:53.288982+0000","last_peered":"2021-01-28T03:58:53.288982+0000","last_clean":"2021-01-28T03:58:53.288982+0000","last_became_active":"2021-01-28T03:56:16.779013+0000","last_became_peered":"2021-01-28T03:56:16.779013+0000","last_unstale":"2021-01-28T03:58:53.288982+0000","last_undegraded":"2021-01-28T03:58:53.288982+0000","last_fullsized":"2021-01-28T03:58:53.288982+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456947+0000","last_change":"2021-01-28T03:55:55.550746+0000","last_active":"2021-01-28T03:56:35.456947+0000","last_peered":"2021-01-28T03:56:35.456947+0000","last_clean":"2021-01-28T03:56:35.456947+0000","last_became_active":"2021-01-28T03:55:55.550330+0000","last_became_peered":"2021-01-28T03:55:55.550330+0000","last_unstale":"2021-01-28T03:56:35.456947+0000","last_undegraded":"2021-01-28T03:56:35.456947+0000","last_fullsized":"2021-01-28T03:56:35.456947+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"58'19","reported_seq":"57","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.450766+0000","last_change":"2021-01-28T03:56:15.151801+0000","last_active":"2021-01-28T03:56:35.450766+0000","last_peered":"2021-01-28T03:56:35.450766+0000","last_clean":"2021-01-28T03:56:35.450766+0000","last_became_active":"2021-01-28T03:56:15.151187+0000","last_became_peered":"2021-01-28T03:56:15.151187+0000","last_unstale":"2021-01-28T03:56:35.450766+0000","last_undegraded":"2021-01-28T03:56:35.450766+0000","last_fullsized":"2021-01-28T03:56:35.450766+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":734,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":41,"num_read_kb":26,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456140+0000","last_change":"2021-01-28T03:56:19.828334+0000","last_active":"2021-01-28T03:56:35.456140+0000","last_peered":"2021-01-28T03:56:35.456140+0000","last_clean":"2021-01-28T03:56:35.456140+0000","last_became_active":"2021-01-28T03:56:19.827824+0000","last_became_peered":"2021-01-28T03:56:19.827824+0000","last_unstale":"2021-01-28T03:56:35.456140+0000","last_undegraded":"2021-01-28T03:56:35.456140+0000","last_fullsized":"2021-01-28T03:56:35.456140+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"53'2","reported_seq":"50","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-28T03:58:48.285833+0000","last_change":"2021-01-28T03:56:16.784560+0000","last_active":"2021-01-28T03:58:48.285833+0000","last_peered":"2021-01-28T03:58:48.285833+0000","last_clean":"2021-01-28T03:58:48.285833+0000","last_became_active":"2021-01-28T03:56:16.784236+0000","last_became_peered":"2021-01-28T03:56:16.784236+0000","last_unstale":"2021-01-28T03:58:48.285833+0000","last_undegraded":"2021-01-28T03:58:48.285833+0000","last_fullsized":"2021-01-28T03:58:48.285833+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"45'2","reported_seq":"43","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.450029+0000","last_change":"2021-01-28T03:55:58.634920+0000","last_active":"2021-01-28T03:56:35.450029+0000","last_peered":"2021-01-28T03:56:35.450029+0000","last_clean":"2021-01-28T03:56:35.450029+0000","last_became_active":"2021-01-28T03:55:58.565624+0000","last_became_peered":"2021-01-28T03:55:58.565624+0000","last_unstale":"2021-01-28T03:56:35.450029+0000","last_undegraded":"2021-01-28T03:56:35.450029+0000","last_fullsized":"2021-01-28T03:56:35.450029+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"58'26","reported_seq":"71","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.461512+0000","last_change":"2021-01-28T03:56:15.152759+0000","last_active":"2021-01-28T03:56:35.461512+0000","last_peered":"2021-01-28T03:56:35.461512+0000","last_clean":"2021-01-28T03:56:35.461512+0000","last_became_active":"2021-01-28T03:56:15.151790+0000","last_became_peered":"2021-01-28T03:56:15.151790+0000","last_unstale":"2021-01-28T03:56:35.461512+0000","last_undegraded":"2021-01-28T03:56:35.461512+0000","last_fullsized":"2021-01-28T03:56:35.461512+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":26,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":624,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456514+0000","last_change":"2021-01-28T03:56:19.831858+0000","last_active":"2021-01-28T03:56:35.456514+0000","last_peered":"2021-01-28T03:56:35.456514+0000","last_clean":"2021-01-28T03:56:35.456514+0000","last_became_active":"2021-01-28T03:56:19.831556+0000","last_became_peered":"2021-01-28T03:56:19.831556+0000","last_unstale":"2021-01-28T03:56:35.456514+0000","last_undegraded":"2021-01-28T03:56:35.456514+0000","last_fullsized":"2021-01-28T03:56:35.456514+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.451003+0000","last_change":"2021-01-28T03:56:16.783214+0000","last_active":"2021-01-28T03:56:35.451003+0000","last_peered":"2021-01-28T03:56:35.451003+0000","last_clean":"2021-01-28T03:56:35.451003+0000","last_became_active":"2021-01-28T03:56:16.782839+0000","last_became_peered":"2021-01-28T03:56:16.782839+0000","last_unstale":"2021-01-28T03:56:35.451003+0000","last_undegraded":"2021-01-28T03:56:35.451003+0000","last_fullsized":"2021-01-28T03:56:35.451003+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"48'1","reported_seq":"26","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.455097+0000","last_change":"2021-01-28T03:55:55.548393+0000","last_active":"2021-01-28T03:56:35.455097+0000","last_peered":"2021-01-28T03:56:35.455097+0000","last_clean":"2021-01-28T03:56:35.455097+0000","last_became_active":"2021-01-28T03:55:55.547995+0000","last_became_peered":"2021-01-28T03:55:55.547995+0000","last_unstale":"2021-01-28T03:56:35.455097+0000","last_undegraded":"2021-01-28T03:56:35.455097+0000","last_fullsized":"2021-01-28T03:56:35.455097+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"58'13","reported_seq":"44","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.462031+0000","last_change":"2021-01-28T03:56:15.151515+0000","last_active":"2021-01-28T03:56:35.462031+0000","last_peered":"2021-01-28T03:56:35.462031+0000","last_clean":"2021-01-28T03:56:35.462031+0000","last_became_active":"2021-01-28T03:56:15.150837+0000","last_became_peered":"2021-01-28T03:56:15.150837+0000","last_unstale":"2021-01-28T03:56:35.462031+0000","last_undegraded":"2021-01-28T03:56:35.462031+0000","last_fullsized":"2021-01-28T03:56:35.462031+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":158,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.454718+0000","last_change":"2021-01-28T03:56:19.823244+0000","last_active":"2021-01-28T03:56:35.454718+0000","last_peered":"2021-01-28T03:56:35.454718+0000","last_clean":"2021-01-28T03:56:35.454718+0000","last_became_active":"2021-01-28T03:56:19.822914+0000","last_became_peered":"2021-01-28T03:56:19.822914+0000","last_unstale":"2021-01-28T03:56:35.454718+0000","last_undegraded":"2021-01-28T03:56:35.454718+0000","last_fullsized":"2021-01-28T03:56:35.454718+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.462223+0000","last_change":"2021-01-28T03:56:16.781039+0000","last_active":"2021-01-28T03:56:35.462223+0000","last_peered":"2021-01-28T03:56:35.462223+0000","last_clean":"2021-01-28T03:56:35.462223+0000","last_became_active":"2021-01-28T03:56:16.780638+0000","last_became_peered":"2021-01-28T03:56:16.780638+0000","last_unstale":"2021-01-28T03:56:35.462223+0000","last_undegraded":"2021-01-28T03:56:35.462223+0000","last_fullsized":"2021-01-28T03:56:35.462223+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.452015+0000","last_change":"2021-01-28T03:55:55.559428+0000","last_active":"2021-01-28T03:56:35.452015+0000","last_peered":"2021-01-28T03:56:35.452015+0000","last_clean":"2021-01-28T03:56:35.452015+0000","last_became_active":"2021-01-28T03:55:55.559052+0000","last_became_peered":"2021-01-28T03:55:55.559052+0000","last_unstale":"2021-01-28T03:56:35.452015+0000","last_undegraded":"2021-01-28T03:56:35.452015+0000","last_fullsized":"2021-01-28T03:56:35.452015+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"58'28","reported_seq":"78","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456307+0000","last_change":"2021-01-28T03:56:15.154421+0000","last_active":"2021-01-28T03:56:35.456307+0000","last_peered":"2021-01-28T03:56:35.456307+0000","last_clean":"2021-01-28T03:56:35.456307+0000","last_became_active":"2021-01-28T03:56:15.153142+0000","last_became_peered":"2021-01-28T03:56:15.153142+0000","last_unstale":"2021-01-28T03:56:35.456307+0000","last_undegraded":"2021-01-28T03:56:35.456307+0000","last_fullsized":"2021-01-28T03:56:35.456307+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1206,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":62,"num_read_kb":40,"num_write":29,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.461422+0000","last_change":"2021-01-28T03:56:19.832832+0000","last_active":"2021-01-28T03:56:35.461422+0000","last_peered":"2021-01-28T03:56:35.461422+0000","last_clean":"2021-01-28T03:56:35.461422+0000","last_became_active":"2021-01-28T03:56:19.831106+0000","last_became_peered":"2021-01-28T03:56:19.831106+0000","last_unstale":"2021-01-28T03:56:35.461422+0000","last_undegraded":"2021-01-28T03:56:35.461422+0000","last_fullsized":"2021-01-28T03:56:35.461422+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"48'1","reported_seq":"36","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.452837+0000","last_change":"2021-01-28T03:55:58.574724+0000","last_active":"2021-01-28T03:56:35.452837+0000","last_peered":"2021-01-28T03:56:35.452837+0000","last_clean":"2021-01-28T03:56:35.452837+0000","last_became_active":"2021-01-28T03:55:58.574408+0000","last_became_peered":"2021-01-28T03:55:58.574408+0000","last_unstale":"2021-01-28T03:56:35.452837+0000","last_undegraded":"2021-01-28T03:56:35.452837+0000","last_fullsized":"2021-01-28T03:56:35.452837+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"58'28","reported_seq":"78","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.452245+0000","last_change":"2021-01-28T03:56:14.761991+0000","last_active":"2021-01-28T03:56:35.452245+0000","last_peered":"2021-01-28T03:56:35.452245+0000","last_clean":"2021-01-28T03:56:35.452245+0000","last_became_active":"2021-01-28T03:56:14.761522+0000","last_became_peered":"2021-01-28T03:56:14.761522+0000","last_unstale":"2021-01-28T03:56:35.452245+0000","last_undegraded":"2021-01-28T03:56:35.452245+0000","last_fullsized":"2021-01-28T03:56:35.452245+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":692,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":58,"num_read_kb":41,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.451971+0000","last_change":"2021-01-28T03:56:16.784338+0000","last_active":"2021-01-28T03:56:35.451971+0000","last_peered":"2021-01-28T03:56:35.451971+0000","last_clean":"2021-01-28T03:56:35.451971+0000","last_became_active":"2021-01-28T03:56:16.783954+0000","last_became_peered":"2021-01-28T03:56:16.783954+0000","last_unstale":"2021-01-28T03:56:35.451971+0000","last_undegraded":"2021-01-28T03:56:35.451971+0000","last_fullsized":"2021-01-28T03:56:35.451971+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.454468+0000","last_change":"2021-01-28T03:56:19.825785+0000","last_active":"2021-01-28T03:56:35.454468+0000","last_peered":"2021-01-28T03:56:35.454468+0000","last_clean":"2021-01-28T03:56:35.454468+0000","last_became_active":"2021-01-28T03:56:19.825390+0000","last_became_peered":"2021-01-28T03:56:19.825390+0000","last_unstale":"2021-01-28T03:56:35.454468+0000","last_undegraded":"2021-01-28T03:56:35.454468+0000","last_fullsized":"2021-01-28T03:56:35.454468+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"33","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456113+0000","last_change":"2021-01-28T03:55:58.573472+0000","last_active":"2021-01-28T03:56:35.456113+0000","last_peered":"2021-01-28T03:56:35.456113+0000","last_clean":"2021-01-28T03:56:35.456113+0000","last_became_active":"2021-01-28T03:55:58.572831+0000","last_became_peered":"2021-01-28T03:55:58.572831+0000","last_unstale":"2021-01-28T03:56:35.456113+0000","last_undegraded":"2021-01-28T03:56:35.456113+0000","last_fullsized":"2021-01-28T03:56:35.456113+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"58'22","reported_seq":"60","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.449469+0000","last_change":"2021-01-28T03:56:14.758598+0000","last_active":"2021-01-28T03:56:35.449469+0000","last_peered":"2021-01-28T03:56:35.449469+0000","last_clean":"2021-01-28T03:56:35.449469+0000","last_became_active":"2021-01-28T03:56:14.756851+0000","last_became_peered":"2021-01-28T03:56:14.756851+0000","last_unstale":"2021-01-28T03:56:35.449469+0000","last_undegraded":"2021-01-28T03:56:35.449469+0000","last_fullsized":"2021-01-28T03:56:35.449469+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":940,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":45,"num_read_kb":27,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"53'2","reported_seq":"51","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-28T03:58:53.288680+0000","last_change":"2021-01-28T03:56:16.787368+0000","last_active":"2021-01-28T03:58:53.288680+0000","last_peered":"2021-01-28T03:58:53.288680+0000","last_clean":"2021-01-28T03:58:53.288680+0000","last_became_active":"2021-01-28T03:56:16.786950+0000","last_became_peered":"2021-01-28T03:56:16.786950+0000","last_unstale":"2021-01-28T03:58:53.288680+0000","last_undegraded":"2021-01-28T03:58:53.288680+0000","last_fullsized":"2021-01-28T03:58:53.288680+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.462030+0000","last_change":"2021-01-28T03:56:19.828198+0000","last_active":"2021-01-28T03:56:35.462030+0000","last_peered":"2021-01-28T03:56:35.462030+0000","last_clean":"2021-01-28T03:56:35.462030+0000","last_became_active":"2021-01-28T03:56:19.827773+0000","last_became_peered":"2021-01-28T03:56:19.827773+0000","last_unstale":"2021-01-28T03:56:35.462030+0000","last_undegraded":"2021-01-28T03:56:35.462030+0000","last_fullsized":"2021-01-28T03:56:35.462030+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.450143+0000","last_change":"2021-01-28T03:55:55.544863+0000","last_active":"2021-01-28T03:56:35.450143+0000","last_peered":"2021-01-28T03:56:35.450143+0000","last_clean":"2021-01-28T03:56:35.450143+0000","last_became_active":"2021-01-28T03:55:55.544376+0000","last_became_peered":"2021-01-28T03:55:55.544376+0000","last_unstale":"2021-01-28T03:56:35.450143+0000","last_undegraded":"2021-01-28T03:56:35.450143+0000","last_fullsized":"2021-01-28T03:56:35.450143+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"58'31","reported_seq":"80","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456209+0000","last_change":"2021-01-28T03:56:14.749365+0000","last_active":"2021-01-28T03:56:35.456209+0000","last_peered":"2021-01-28T03:56:35.456209+0000","last_clean":"2021-01-28T03:56:35.456209+0000","last_became_active":"2021-01-28T03:56:14.748983+0000","last_became_peered":"2021-01-28T03:56:14.748983+0000","last_unstale":"2021-01-28T03:56:35.456209+0000","last_undegraded":"2021-01-28T03:56:35.456209+0000","last_fullsized":"2021-01-28T03:56:35.456209+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":954,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":66,"num_read_kb":42,"num_write":34,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456260+0000","last_change":"2021-01-28T03:56:16.795009+0000","last_active":"2021-01-28T03:56:35.456260+0000","last_peered":"2021-01-28T03:56:35.456260+0000","last_clean":"2021-01-28T03:56:35.456260+0000","last_became_active":"2021-01-28T03:56:16.794642+0000","last_became_peered":"2021-01-28T03:56:16.794642+0000","last_unstale":"2021-01-28T03:56:35.456260+0000","last_undegraded":"2021-01-28T03:56:35.456260+0000","last_fullsized":"2021-01-28T03:56:35.456260+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456789+0000","last_change":"2021-01-28T03:56:19.833929+0000","last_active":"2021-01-28T03:56:35.456789+0000","last_peered":"2021-01-28T03:56:35.456789+0000","last_clean":"2021-01-28T03:56:35.456789+0000","last_became_active":"2021-01-28T03:56:19.833476+0000","last_became_peered":"2021-01-28T03:56:19.833476+0000","last_unstale":"2021-01-28T03:56:35.456789+0000","last_undegraded":"2021-01-28T03:56:35.456789+0000","last_fullsized":"2021-01-28T03:56:35.456789+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"58'5","reported_seq":"175","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-28T03:58:55.844093+0000","last_change":"2021-01-28T03:56:13.744444+0000","last_active":"2021-01-28T03:58:55.844093+0000","last_peered":"2021-01-28T03:58:55.844093+0000","last_clean":"2021-01-28T03:58:55.844093+0000","last_became_active":"2021-01-28T03:56:13.744099+0000","last_became_peered":"2021-01-28T03:56:13.744099+0000","last_unstale":"2021-01-28T03:58:55.844093+0000","last_undegraded":"2021-01-28T03:58:55.844093+0000","last_fullsized":"2021-01-28T03:58:55.844093+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:12.703742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:12.703742+0000","last_clean_scrub_stamp":"2021-01-28T03:56:12.703742+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":153,"num_read_kb":148,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.451296+0000","last_change":"2021-01-28T03:55:55.550152+0000","last_active":"2021-01-28T03:56:35.451296+0000","last_peered":"2021-01-28T03:56:35.451296+0000","last_clean":"2021-01-28T03:56:35.451296+0000","last_became_active":"2021-01-28T03:55:55.549402+0000","last_became_peered":"2021-01-28T03:55:55.549402+0000","last_unstale":"2021-01-28T03:56:35.451296+0000","last_undegraded":"2021-01-28T03:56:35.451296+0000","last_fullsized":"2021-01-28T03:56:35.451296+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"58'21","reported_seq":"64","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456015+0000","last_change":"2021-01-28T03:56:14.751626+0000","last_active":"2021-01-28T03:56:35.456015+0000","last_peered":"2021-01-28T03:56:35.456015+0000","last_clean":"2021-01-28T03:56:35.456015+0000","last_became_active":"2021-01-28T03:56:14.751103+0000","last_became_peered":"2021-01-28T03:56:14.751103+0000","last_unstale":"2021-01-28T03:56:35.456015+0000","last_undegraded":"2021-01-28T03:56:35.456015+0000","last_fullsized":"2021-01-28T03:56:35.456015+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.455268+0000","last_change":"2021-01-28T03:56:16.783376+0000","last_active":"2021-01-28T03:56:35.455268+0000","last_peered":"2021-01-28T03:56:35.455268+0000","last_clean":"2021-01-28T03:56:35.455268+0000","last_became_active":"2021-01-28T03:56:16.782951+0000","last_became_peered":"2021-01-28T03:56:16.782951+0000","last_unstale":"2021-01-28T03:56:35.455268+0000","last_undegraded":"2021-01-28T03:56:35.455268+0000","last_fullsized":"2021-01-28T03:56:35.455268+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.451432+0000","last_change":"2021-01-28T03:56:19.833759+0000","last_active":"2021-01-28T03:56:35.451432+0000","last_peered":"2021-01-28T03:56:35.451432+0000","last_clean":"2021-01-28T03:56:35.451432+0000","last_became_active":"2021-01-28T03:56:19.833411+0000","last_became_peered":"2021-01-28T03:56:19.833411+0000","last_unstale":"2021-01-28T03:56:35.451432+0000","last_undegraded":"2021-01-28T03:56:35.451432+0000","last_fullsized":"2021-01-28T03:56:35.451432+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"19","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.461007+0000","last_change":"2021-01-28T03:56:13.743882+0000","last_active":"2021-01-28T03:56:35.461007+0000","last_peered":"2021-01-28T03:56:35.461007+0000","last_clean":"2021-01-28T03:56:35.461007+0000","last_became_active":"2021-01-28T03:56:13.743498+0000","last_became_peered":"2021-01-28T03:56:13.743498+0000","last_unstale":"2021-01-28T03:56:35.461007+0000","last_undegraded":"2021-01-28T03:56:35.461007+0000","last_fullsized":"2021-01-28T03:56:35.461007+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:12.703742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:12.703742+0000","last_clean_scrub_stamp":"2021-01-28T03:56:12.703742+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"34","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.449980+0000","last_change":"2021-01-28T03:55:58.564836+0000","last_active":"2021-01-28T03:56:35.449980+0000","last_peered":"2021-01-28T03:56:35.449980+0000","last_clean":"2021-01-28T03:56:35.449980+0000","last_became_active":"2021-01-28T03:55:58.564292+0000","last_became_peered":"2021-01-28T03:55:58.564292+0000","last_unstale":"2021-01-28T03:56:35.449980+0000","last_undegraded":"2021-01-28T03:56:35.449980+0000","last_fullsized":"2021-01-28T03:56:35.449980+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"22","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.455610+0000","last_change":"2021-01-28T03:55:58.570710+0000","last_active":"2021-01-28T03:56:35.455610+0000","last_peered":"2021-01-28T03:56:35.455610+0000","last_clean":"2021-01-28T03:56:35.455610+0000","last_became_active":"2021-01-28T03:55:58.568608+0000","last_became_peered":"2021-01-28T03:55:58.568608+0000","last_unstale":"2021-01-28T03:56:35.455610+0000","last_undegraded":"2021-01-28T03:56:35.455610+0000","last_fullsized":"2021-01-28T03:56:35.455610+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":5,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:51:28.488605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:51:28.488605+0000","last_clean_scrub_stamp":"2021-01-28T03:51:28.488605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"58'15","reported_seq":"42","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.459134+0000","last_change":"2021-01-28T03:56:15.151881+0000","last_active":"2021-01-28T03:56:35.459134+0000","last_peered":"2021-01-28T03:56:35.459134+0000","last_clean":"2021-01-28T03:56:35.459134+0000","last_became_active":"2021-01-28T03:56:15.151201+0000","last_became_peered":"2021-01-28T03:56:15.151201+0000","last_unstale":"2021-01-28T03:56:35.459134+0000","last_undegraded":"2021-01-28T03:56:35.459134+0000","last_fullsized":"2021-01-28T03:56:35.459134+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":466,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":15,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456506+0000","last_change":"2021-01-28T03:56:16.780118+0000","last_active":"2021-01-28T03:56:35.456506+0000","last_peered":"2021-01-28T03:56:35.456506+0000","last_clean":"2021-01-28T03:56:35.456506+0000","last_became_active":"2021-01-28T03:56:16.779740+0000","last_became_peered":"2021-01-28T03:56:16.779740+0000","last_unstale":"2021-01-28T03:56:35.456506+0000","last_undegraded":"2021-01-28T03:56:35.456506+0000","last_fullsized":"2021-01-28T03:56:35.456506+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456462+0000","last_change":"2021-01-28T03:56:19.826459+0000","last_active":"2021-01-28T03:56:35.456462+0000","last_peered":"2021-01-28T03:56:35.456462+0000","last_clean":"2021-01-28T03:56:35.456462+0000","last_became_active":"2021-01-28T03:56:19.826153+0000","last_became_peered":"2021-01-28T03:56:19.826153+0000","last_unstale":"2021-01-28T03:56:35.456462+0000","last_undegraded":"2021-01-28T03:56:35.456462+0000","last_fullsized":"2021-01-28T03:56:35.456462+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"19","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456652+0000","last_change":"2021-01-28T03:56:13.744775+0000","last_active":"2021-01-28T03:56:35.456652+0000","last_peered":"2021-01-28T03:56:35.456652+0000","last_clean":"2021-01-28T03:56:35.456652+0000","last_became_active":"2021-01-28T03:56:13.744248+0000","last_became_peered":"2021-01-28T03:56:13.744248+0000","last_unstale":"2021-01-28T03:56:35.456652+0000","last_undegraded":"2021-01-28T03:56:35.456652+0000","last_fullsized":"2021-01-28T03:56:35.456652+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:12.703742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:12.703742+0000","last_clean_scrub_stamp":"2021-01-28T03:56:12.703742+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"60'3","reported_seq":"44","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-28T03:58:52.128608+0000","last_change":"2021-01-28T03:56:36.519203+0000","last_active":"2021-01-28T03:58:52.128608+0000","last_peered":"2021-01-28T03:58:52.128608+0000","last_clean":"2021-01-28T03:58:52.128608+0000","last_became_active":"2021-01-28T03:56:36.467735+0000","last_became_peered":"2021-01-28T03:56:36.467735+0000","last_unstale":"2021-01-28T03:58:52.128608+0000","last_undegraded":"2021-01-28T03:58:52.128608+0000","last_fullsized":"2021-01-28T03:58:52.128608+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"58'16","reported_seq":"44","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456225+0000","last_change":"2021-01-28T03:56:14.754652+0000","last_active":"2021-01-28T03:56:35.456225+0000","last_peered":"2021-01-28T03:56:35.456225+0000","last_clean":"2021-01-28T03:56:35.456225+0000","last_became_active":"2021-01-28T03:56:14.754264+0000","last_became_peered":"2021-01-28T03:56:14.754264+0000","last_unstale":"2021-01-28T03:56:35.456225+0000","last_undegraded":"2021-01-28T03:56:35.456225+0000","last_fullsized":"2021-01-28T03:56:35.456225+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":630,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":30,"num_read_kb":16,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.451335+0000","last_change":"2021-01-28T03:56:16.784874+0000","last_active":"2021-01-28T03:56:35.451335+0000","last_peered":"2021-01-28T03:56:35.451335+0000","last_clean":"2021-01-28T03:56:35.451335+0000","last_became_active":"2021-01-28T03:56:16.784433+0000","last_became_peered":"2021-01-28T03:56:16.784433+0000","last_unstale":"2021-01-28T03:56:35.451335+0000","last_undegraded":"2021-01-28T03:56:35.451335+0000","last_fullsized":"2021-01-28T03:56:35.451335+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.449985+0000","last_change":"2021-01-28T03:56:19.818126+0000","last_active":"2021-01-28T03:56:35.449985+0000","last_peered":"2021-01-28T03:56:35.449985+0000","last_clean":"2021-01-28T03:56:35.449985+0000","last_became_active":"2021-01-28T03:56:19.817602+0000","last_became_peered":"2021-01-28T03:56:19.817602+0000","last_unstale":"2021-01-28T03:56:35.449985+0000","last_undegraded":"2021-01-28T03:56:35.449985+0000","last_fullsized":"2021-01-28T03:56:35.449985+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"48'2","reported_seq":"27","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456609+0000","last_change":"2021-01-28T03:55:58.578578+0000","last_active":"2021-01-28T03:56:35.456609+0000","last_peered":"2021-01-28T03:56:35.456609+0000","last_clean":"2021-01-28T03:56:35.456609+0000","last_became_active":"2021-01-28T03:55:58.577681+0000","last_became_peered":"2021-01-28T03:55:58.577681+0000","last_unstale":"2021-01-28T03:56:35.456609+0000","last_undegraded":"2021-01-28T03:56:35.456609+0000","last_fullsized":"2021-01-28T03:56:35.456609+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":391,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"58'27","reported_seq":"73","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456896+0000","last_change":"2021-01-28T03:56:15.152262+0000","last_active":"2021-01-28T03:56:35.456896+0000","last_peered":"2021-01-28T03:56:35.456896+0000","last_clean":"2021-01-28T03:56:35.456896+0000","last_became_active":"2021-01-28T03:56:15.151324+0000","last_became_peered":"2021-01-28T03:56:15.151324+0000","last_unstale":"2021-01-28T03:56:35.456896+0000","last_undegraded":"2021-01-28T03:56:35.456896+0000","last_fullsized":"2021-01-28T03:56:35.456896+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":642,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":57,"num_read_kb":38,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.459395+0000","last_change":"2021-01-28T03:56:16.786637+0000","last_active":"2021-01-28T03:56:35.459395+0000","last_peered":"2021-01-28T03:56:35.459395+0000","last_clean":"2021-01-28T03:56:35.459395+0000","last_became_active":"2021-01-28T03:56:16.786321+0000","last_became_peered":"2021-01-28T03:56:16.786321+0000","last_unstale":"2021-01-28T03:56:35.459395+0000","last_undegraded":"2021-01-28T03:56:35.459395+0000","last_fullsized":"2021-01-28T03:56:35.459395+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.453022+0000","last_change":"2021-01-28T03:56:19.819731+0000","last_active":"2021-01-28T03:56:35.453022+0000","last_peered":"2021-01-28T03:56:35.453022+0000","last_clean":"2021-01-28T03:56:35.453022+0000","last_became_active":"2021-01-28T03:56:19.816153+0000","last_became_peered":"2021-01-28T03:56:19.816153+0000","last_unstale":"2021-01-28T03:56:35.453022+0000","last_undegraded":"2021-01-28T03:56:35.453022+0000","last_fullsized":"2021-01-28T03:56:35.453022+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"48'2","reported_seq":"36","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456616+0000","last_change":"2021-01-28T03:55:57.569866+0000","last_active":"2021-01-28T03:56:35.456616+0000","last_peered":"2021-01-28T03:56:35.456616+0000","last_clean":"2021-01-28T03:56:35.456616+0000","last_became_active":"2021-01-28T03:55:57.569399+0000","last_became_peered":"2021-01-28T03:55:57.569399+0000","last_unstale":"2021-01-28T03:56:35.456616+0000","last_undegraded":"2021-01-28T03:56:35.456616+0000","last_fullsized":"2021-01-28T03:56:35.456616+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"58'34","reported_seq":"88","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.460517+0000","last_change":"2021-01-28T03:56:15.154000+0000","last_active":"2021-01-28T03:56:35.460517+0000","last_peered":"2021-01-28T03:56:35.460517+0000","last_clean":"2021-01-28T03:56:35.460517+0000","last_became_active":"2021-01-28T03:56:15.152959+0000","last_became_peered":"2021-01-28T03:56:15.152959+0000","last_unstale":"2021-01-28T03:56:35.460517+0000","last_undegraded":"2021-01-28T03:56:35.460517+0000","last_fullsized":"2021-01-28T03:56:35.460517+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":846,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":70,"num_read_kb":48,"num_write":36,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.452744+0000","last_change":"2021-01-28T03:56:16.789811+0000","last_active":"2021-01-28T03:56:35.452744+0000","last_peered":"2021-01-28T03:56:35.452744+0000","last_clean":"2021-01-28T03:56:35.452744+0000","last_became_active":"2021-01-28T03:56:16.789536+0000","last_became_peered":"2021-01-28T03:56:16.789536+0000","last_unstale":"2021-01-28T03:56:35.452744+0000","last_undegraded":"2021-01-28T03:56:35.452744+0000","last_fullsized":"2021-01-28T03:56:35.452744+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.455539+0000","last_change":"2021-01-28T03:56:19.824952+0000","last_active":"2021-01-28T03:56:35.455539+0000","last_peered":"2021-01-28T03:56:35.455539+0000","last_clean":"2021-01-28T03:56:35.455539+0000","last_became_active":"2021-01-28T03:56:19.824479+0000","last_became_peered":"2021-01-28T03:56:19.824479+0000","last_unstale":"2021-01-28T03:56:35.455539+0000","last_undegraded":"2021-01-28T03:56:35.455539+0000","last_fullsized":"2021-01-28T03:56:35.455539+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"48'1","reported_seq":"36","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.459554+0000","last_change":"2021-01-28T03:55:58.573079+0000","last_active":"2021-01-28T03:56:35.459554+0000","last_peered":"2021-01-28T03:56:35.459554+0000","last_clean":"2021-01-28T03:56:35.459554+0000","last_became_active":"2021-01-28T03:55:58.572704+0000","last_became_peered":"2021-01-28T03:55:58.572704+0000","last_unstale":"2021-01-28T03:56:35.459554+0000","last_undegraded":"2021-01-28T03:56:35.459554+0000","last_fullsized":"2021-01-28T03:56:35.459554+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":846,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"58'26","reported_seq":"66","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.452194+0000","last_change":"2021-01-28T03:56:14.751368+0000","last_active":"2021-01-28T03:56:35.452194+0000","last_peered":"2021-01-28T03:56:35.452194+0000","last_clean":"2021-01-28T03:56:35.452194+0000","last_became_active":"2021-01-28T03:56:14.750897+0000","last_became_peered":"2021-01-28T03:56:14.750897+0000","last_unstale":"2021-01-28T03:56:35.452194+0000","last_undegraded":"2021-01-28T03:56:35.452194+0000","last_fullsized":"2021-01-28T03:56:35.452194+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":26,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":940,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":51,"num_read_kb":31,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"53'2","reported_seq":"51","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-28T03:58:53.288791+0000","last_change":"2021-01-28T03:56:16.781125+0000","last_active":"2021-01-28T03:58:53.288791+0000","last_peered":"2021-01-28T03:58:53.288791+0000","last_clean":"2021-01-28T03:58:53.288791+0000","last_became_active":"2021-01-28T03:56:16.780779+0000","last_became_peered":"2021-01-28T03:56:16.780779+0000","last_unstale":"2021-01-28T03:58:53.288791+0000","last_undegraded":"2021-01-28T03:58:53.288791+0000","last_fullsized":"2021-01-28T03:58:53.288791+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.461433+0000","last_change":"2021-01-28T03:56:19.830930+0000","last_active":"2021-01-28T03:56:35.461433+0000","last_peered":"2021-01-28T03:56:35.461433+0000","last_clean":"2021-01-28T03:56:35.461433+0000","last_became_active":"2021-01-28T03:56:19.830476+0000","last_became_peered":"2021-01-28T03:56:19.830476+0000","last_unstale":"2021-01-28T03:56:35.461433+0000","last_undegraded":"2021-01-28T03:56:35.461433+0000","last_fullsized":"2021-01-28T03:56:35.461433+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.451212+0000","last_change":"2021-01-28T03:56:16.776526+0000","last_active":"2021-01-28T03:56:35.451212+0000","last_peered":"2021-01-28T03:56:35.451212+0000","last_clean":"2021-01-28T03:56:35.451212+0000","last_became_active":"2021-01-28T03:56:16.776183+0000","last_became_peered":"2021-01-28T03:56:16.776183+0000","last_unstale":"2021-01-28T03:56:35.451212+0000","last_undegraded":"2021-01-28T03:56:35.451212+0000","last_fullsized":"2021-01-28T03:56:35.451212+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"22","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.454741+0000","last_change":"2021-01-28T03:55:58.573268+0000","last_active":"2021-01-28T03:56:35.454741+0000","last_peered":"2021-01-28T03:56:35.454741+0000","last_clean":"2021-01-28T03:56:35.454741+0000","last_became_active":"2021-01-28T03:55:58.571358+0000","last_became_peered":"2021-01-28T03:55:58.571358+0000","last_unstale":"2021-01-28T03:56:35.454741+0000","last_undegraded":"2021-01-28T03:56:35.454741+0000","last_fullsized":"2021-01-28T03:56:35.454741+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"58'21","reported_seq":"91","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-28T03:56:36.967378+0000","last_change":"2021-01-28T03:56:36.967378+0000","last_active":"2021-01-28T03:56:36.967378+0000","last_peered":"2021-01-28T03:56:36.967378+0000","last_clean":"2021-01-28T03:56:36.967378+0000","last_became_active":"2021-01-28T03:56:36.473440+0000","last_became_peered":"2021-01-28T03:56:36.473440+0000","last_unstale":"2021-01-28T03:56:36.967378+0000","last_undegraded":"2021-01-28T03:56:36.967378+0000","last_fullsized":"2021-01-28T03:56:36.967378+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":738,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":44,"num_read_kb":28,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":738,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.450529+0000","last_change":"2021-01-28T03:56:19.830212+0000","last_active":"2021-01-28T03:56:35.450529+0000","last_peered":"2021-01-28T03:56:35.450529+0000","last_clean":"2021-01-28T03:56:35.450529+0000","last_became_active":"2021-01-28T03:56:19.829853+0000","last_became_peered":"2021-01-28T03:56:19.829853+0000","last_unstale":"2021-01-28T03:56:35.450529+0000","last_undegraded":"2021-01-28T03:56:35.450529+0000","last_fullsized":"2021-01-28T03:56:35.450529+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"53'2","reported_seq":"50","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-28T03:58:48.285823+0000","last_change":"2021-01-28T03:56:16.792340+0000","last_active":"2021-01-28T03:58:48.285823+0000","last_peered":"2021-01-28T03:58:48.285823+0000","last_clean":"2021-01-28T03:58:48.285823+0000","last_became_active":"2021-01-28T03:56:16.791925+0000","last_became_peered":"2021-01-28T03:56:16.791925+0000","last_unstale":"2021-01-28T03:58:48.285823+0000","last_undegraded":"2021-01-28T03:58:48.285823+0000","last_fullsized":"2021-01-28T03:58:48.285823+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"34","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.450504+0000","last_change":"2021-01-28T03:55:58.574772+0000","last_active":"2021-01-28T03:56:35.450504+0000","last_peered":"2021-01-28T03:56:35.450504+0000","last_clean":"2021-01-28T03:56:35.450504+0000","last_became_active":"2021-01-28T03:55:58.572648+0000","last_became_peered":"2021-01-28T03:55:58.572648+0000","last_unstale":"2021-01-28T03:56:35.450504+0000","last_undegraded":"2021-01-28T03:56:35.450504+0000","last_fullsized":"2021-01-28T03:56:35.450504+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"58'17","reported_seq":"47","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.458313+0000","last_change":"2021-01-28T03:56:14.759897+0000","last_active":"2021-01-28T03:56:35.458313+0000","last_peered":"2021-01-28T03:56:35.458313+0000","last_clean":"2021-01-28T03:56:35.458313+0000","last_became_active":"2021-01-28T03:56:14.759455+0000","last_became_peered":"2021-01-28T03:56:14.759455+0000","last_unstale":"2021-01-28T03:56:35.458313+0000","last_undegraded":"2021-01-28T03:56:35.458313+0000","last_fullsized":"2021-01-28T03:56:35.458313+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":422,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.453474+0000","last_change":"2021-01-28T03:56:19.823818+0000","last_active":"2021-01-28T03:56:35.453474+0000","last_peered":"2021-01-28T03:56:35.453474+0000","last_clean":"2021-01-28T03:56:35.453474+0000","last_became_active":"2021-01-28T03:56:19.816222+0000","last_became_peered":"2021-01-28T03:56:19.816222+0000","last_unstale":"2021-01-28T03:56:35.453474+0000","last_undegraded":"2021-01-28T03:56:35.453474+0000","last_fullsized":"2021-01-28T03:56:35.453474+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"53'2","reported_seq":"50","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-28T03:58:48.285228+0000","last_change":"2021-01-28T03:56:16.782614+0000","last_active":"2021-01-28T03:58:48.285228+0000","last_peered":"2021-01-28T03:58:48.285228+0000","last_clean":"2021-01-28T03:58:48.285228+0000","last_became_active":"2021-01-28T03:56:16.782247+0000","last_became_peered":"2021-01-28T03:56:16.782247+0000","last_unstale":"2021-01-28T03:58:48.285228+0000","last_undegraded":"2021-01-28T03:58:48.285228+0000","last_fullsized":"2021-01-28T03:58:48.285228+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"34","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.447873+0000","last_change":"2021-01-28T03:55:58.573317+0000","last_active":"2021-01-28T03:56:35.447873+0000","last_peered":"2021-01-28T03:56:35.447873+0000","last_clean":"2021-01-28T03:56:35.447873+0000","last_became_active":"2021-01-28T03:55:58.572753+0000","last_became_peered":"2021-01-28T03:55:58.572753+0000","last_unstale":"2021-01-28T03:56:35.447873+0000","last_undegraded":"2021-01-28T03:56:35.447873+0000","last_fullsized":"2021-01-28T03:56:35.447873+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"58'13","reported_seq":"39","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.452332+0000","last_change":"2021-01-28T03:56:14.757453+0000","last_active":"2021-01-28T03:56:35.452332+0000","last_peered":"2021-01-28T03:56:35.452332+0000","last_clean":"2021-01-28T03:56:35.452332+0000","last_became_active":"2021-01-28T03:56:14.757058+0000","last_became_peered":"2021-01-28T03:56:14.757058+0000","last_unstale":"2021-01-28T03:56:35.452332+0000","last_undegraded":"2021-01-28T03:56:35.452332+0000","last_fullsized":"2021-01-28T03:56:35.452332+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":468,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":24,"num_read_kb":13,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.455700+0000","last_change":"2021-01-28T03:56:19.821622+0000","last_active":"2021-01-28T03:56:35.455700+0000","last_peered":"2021-01-28T03:56:35.455700+0000","last_clean":"2021-01-28T03:56:35.455700+0000","last_became_active":"2021-01-28T03:56:19.821249+0000","last_became_peered":"2021-01-28T03:56:19.821249+0000","last_unstale":"2021-01-28T03:56:35.455700+0000","last_undegraded":"2021-01-28T03:56:35.455700+0000","last_fullsized":"2021-01-28T03:56:35.455700+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.451143+0000","last_change":"2021-01-28T03:56:16.779885+0000","last_active":"2021-01-28T03:56:35.451143+0000","last_peered":"2021-01-28T03:56:35.451143+0000","last_clean":"2021-01-28T03:56:35.451143+0000","last_became_active":"2021-01-28T03:56:16.779477+0000","last_became_peered":"2021-01-28T03:56:16.779477+0000","last_unstale":"2021-01-28T03:56:35.451143+0000","last_undegraded":"2021-01-28T03:56:35.451143+0000","last_fullsized":"2021-01-28T03:56:35.451143+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":"22","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.455109+0000","last_change":"2021-01-28T03:55:58.568358+0000","last_active":"2021-01-28T03:56:35.455109+0000","last_peered":"2021-01-28T03:56:35.455109+0000","last_clean":"2021-01-28T03:56:35.455109+0000","last_became_active":"2021-01-28T03:55:58.567597+0000","last_became_peered":"2021-01-28T03:55:58.567597+0000","last_unstale":"2021-01-28T03:56:35.455109+0000","last_undegraded":"2021-01-28T03:56:35.455109+0000","last_fullsized":"2021-01-28T03:56:35.455109+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"58'21","reported_seq":"54","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.453049+0000","last_change":"2021-01-28T03:56:14.762746+0000","last_active":"2021-01-28T03:56:35.453049+0000","last_peered":"2021-01-28T03:56:35.453049+0000","last_clean":"2021-01-28T03:56:35.453049+0000","last_became_active":"2021-01-28T03:56:14.762459+0000","last_became_peered":"2021-01-28T03:56:14.762459+0000","last_unstale":"2021-01-28T03:56:35.453049+0000","last_undegraded":"2021-01-28T03:56:35.453049+0000","last_fullsized":"2021-01-28T03:56:35.453049+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":734,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":41,"num_read_kb":23,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.454621+0000","last_change":"2021-01-28T03:56:19.827885+0000","last_active":"2021-01-28T03:56:35.454621+0000","last_peered":"2021-01-28T03:56:35.454621+0000","last_clean":"2021-01-28T03:56:35.454621+0000","last_became_active":"2021-01-28T03:56:19.825583+0000","last_became_peered":"2021-01-28T03:56:19.825583+0000","last_unstale":"2021-01-28T03:56:35.454621+0000","last_undegraded":"2021-01-28T03:56:35.454621+0000","last_fullsized":"2021-01-28T03:56:35.454621+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.454517+0000","last_change":"2021-01-28T03:56:16.785298+0000","last_active":"2021-01-28T03:56:35.454517+0000","last_peered":"2021-01-28T03:56:35.454517+0000","last_clean":"2021-01-28T03:56:35.454517+0000","last_became_active":"2021-01-28T03:56:16.784415+0000","last_became_peered":"2021-01-28T03:56:16.784415+0000","last_unstale":"2021-01-28T03:56:35.454517+0000","last_undegraded":"2021-01-28T03:56:35.454517+0000","last_fullsized":"2021-01-28T03:56:35.454517+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.454854+0000","last_change":"2021-01-28T03:55:55.549900+0000","last_active":"2021-01-28T03:56:35.454854+0000","last_peered":"2021-01-28T03:56:35.454854+0000","last_clean":"2021-01-28T03:56:35.454854+0000","last_became_active":"2021-01-28T03:55:55.549472+0000","last_became_peered":"2021-01-28T03:55:55.549472+0000","last_unstale":"2021-01-28T03:56:35.454854+0000","last_undegraded":"2021-01-28T03:56:35.454854+0000","last_fullsized":"2021-01-28T03:56:35.454854+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"58'29","reported_seq":"72","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.459185+0000","last_change":"2021-01-28T03:56:15.152056+0000","last_active":"2021-01-28T03:56:35.459185+0000","last_peered":"2021-01-28T03:56:35.459185+0000","last_clean":"2021-01-28T03:56:35.459185+0000","last_became_active":"2021-01-28T03:56:15.151413+0000","last_became_peered":"2021-01-28T03:56:15.151413+0000","last_unstale":"2021-01-28T03:56:35.459185+0000","last_undegraded":"2021-01-28T03:56:35.459185+0000","last_fullsized":"2021-01-28T03:56:35.459185+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":732,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":56,"num_read_kb":36,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.454226+0000","last_change":"2021-01-28T03:56:19.828317+0000","last_active":"2021-01-28T03:56:35.454226+0000","last_peered":"2021-01-28T03:56:35.454226+0000","last_clean":"2021-01-28T03:56:35.454226+0000","last_became_active":"2021-01-28T03:56:19.827940+0000","last_became_peered":"2021-01-28T03:56:19.827940+0000","last_unstale":"2021-01-28T03:56:35.454226+0000","last_undegraded":"2021-01-28T03:56:35.454226+0000","last_fullsized":"2021-01-28T03:56:35.454226+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.454308+0000","last_change":"2021-01-28T03:56:16.789858+0000","last_active":"2021-01-28T03:56:35.454308+0000","last_peered":"2021-01-28T03:56:35.454308+0000","last_clean":"2021-01-28T03:56:35.454308+0000","last_became_active":"2021-01-28T03:56:16.789379+0000","last_became_peered":"2021-01-28T03:56:16.789379+0000","last_unstale":"2021-01-28T03:56:35.454308+0000","last_undegraded":"2021-01-28T03:56:35.454308+0000","last_fullsized":"2021-01-28T03:56:35.454308+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456748+0000","last_change":"2021-01-28T03:55:55.552349+0000","last_active":"2021-01-28T03:56:35.456748+0000","last_peered":"2021-01-28T03:56:35.456748+0000","last_clean":"2021-01-28T03:56:35.456748+0000","last_became_active":"2021-01-28T03:55:55.552027+0000","last_became_peered":"2021-01-28T03:55:55.552027+0000","last_unstale":"2021-01-28T03:56:35.456748+0000","last_undegraded":"2021-01-28T03:56:35.456748+0000","last_fullsized":"2021-01-28T03:56:35.456748+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"58'20","reported_seq":"59","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.457008+0000","last_change":"2021-01-28T03:56:14.754772+0000","last_active":"2021-01-28T03:56:35.457008+0000","last_peered":"2021-01-28T03:56:35.457008+0000","last_clean":"2021-01-28T03:56:35.457008+0000","last_became_active":"2021-01-28T03:56:14.754430+0000","last_became_peered":"2021-01-28T03:56:14.754430+0000","last_unstale":"2021-01-28T03:56:35.457008+0000","last_undegraded":"2021-01-28T03:56:35.457008+0000","last_fullsized":"2021-01-28T03:56:35.457008+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":894,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":44,"num_read_kb":27,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.449943+0000","last_change":"2021-01-28T03:56:19.825514+0000","last_active":"2021-01-28T03:56:35.449943+0000","last_peered":"2021-01-28T03:56:35.449943+0000","last_clean":"2021-01-28T03:56:35.449943+0000","last_became_active":"2021-01-28T03:56:19.825129+0000","last_became_peered":"2021-01-28T03:56:19.825129+0000","last_unstale":"2021-01-28T03:56:35.449943+0000","last_undegraded":"2021-01-28T03:56:35.449943+0000","last_fullsized":"2021-01-28T03:56:35.449943+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"48'1","reported_seq":"35","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.455550+0000","last_change":"2021-01-28T03:55:58.576123+0000","last_active":"2021-01-28T03:56:35.455550+0000","last_peered":"2021-01-28T03:56:35.455550+0000","last_clean":"2021-01-28T03:56:35.455550+0000","last_became_active":"2021-01-28T03:55:58.575689+0000","last_became_peered":"2021-01-28T03:55:58.575689+0000","last_unstale":"2021-01-28T03:56:35.455550+0000","last_undegraded":"2021-01-28T03:56:35.455550+0000","last_fullsized":"2021-01-28T03:56:35.455550+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"58'30","reported_seq":"79","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.449717+0000","last_change":"2021-01-28T03:56:15.152510+0000","last_active":"2021-01-28T03:56:35.449717+0000","last_peered":"2021-01-28T03:56:35.449717+0000","last_clean":"2021-01-28T03:56:35.449717+0000","last_became_active":"2021-01-28T03:56:15.151979+0000","last_became_peered":"2021-01-28T03:56:15.151979+0000","last_unstale":"2021-01-28T03:56:35.449717+0000","last_undegraded":"2021-01-28T03:56:35.449717+0000","last_fullsized":"2021-01-28T03:56:35.449717+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":578,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":59,"num_read_kb":42,"num_write":31,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"53'2","reported_seq":"51","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-28T03:58:53.289812+0000","last_change":"2021-01-28T03:56:16.792128+0000","last_active":"2021-01-28T03:58:53.289812+0000","last_peered":"2021-01-28T03:58:53.289812+0000","last_clean":"2021-01-28T03:58:53.289812+0000","last_became_active":"2021-01-28T03:56:16.791793+0000","last_became_peered":"2021-01-28T03:56:16.791793+0000","last_unstale":"2021-01-28T03:58:53.289812+0000","last_undegraded":"2021-01-28T03:58:53.289812+0000","last_fullsized":"2021-01-28T03:58:53.289812+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":23524,"num_objects":335,"num_object_clones":0,"num_object_copies":1005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":335,"num_whiteouts":0,"num_read":1453,"num_read_kb":926,"num_write":734,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":1898,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1966080,"data_stored":70572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":703,"ondisk_log_size":703,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":153,"num_read_kb":148,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1945,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":21,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":419,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":5835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":47,"seq":201863462951,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6240,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738912,"statfs":{"total":95995035648,"available":95988645888,"internally_reserved":0,"allocated":811008,"data_stored":239713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 28 03:58:02 2021","interfaces":[{"interface":"back","average":{"1min":2.0910000000000002,"5min":1.883,"15min":1.8480000000000001},"min":{"1min":1.1930000000000001,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":4.5410000000000004,"5min":4.5410000000000004,"15min":4.5410000000000004},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.9990000000000001,"5min":1.8460000000000001,"15min":1.8200000000000001},"min":{"1min":1.198,"5min":1.198,"15min":1.198},"max":{"1min":2.9350000000000001,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":1.2789999999999999}]},{"osd":1,"last update":"Thu Jan 28 03:58:02 2021","interfaces":[{"interface":"back","average":{"1min":2.177,"5min":2.02,"15min":1.994},"min":{"1min":1.3149999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":4.3700000000000001,"5min":4.3700000000000001,"15min":4.3700000000000001},"last":2.161},{"interface":"front","average":{"1min":2.383,"5min":2.2679999999999998,"15min":2.2490000000000001},"min":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"max":{"1min":3.2040000000000002,"5min":4.7859999999999996,"15min":4.7859999999999996},"last":2.0830000000000002}]},{"osd":2,"last update":"Thu Jan 28 03:58:02 2021","interfaces":[{"interface":"back","average":{"1min":2.1000000000000001,"5min":2.0640000000000001,"15min":2.0579999999999998},"min":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"max":{"1min":2.923,"5min":3.5379999999999998,"15min":3.5379999999999998},"last":1.7030000000000001},{"interface":"front","average":{"1min":2.6699999999999999,"5min":2.4889999999999999,"15min":2.4590000000000001},"min":{"1min":1.978,"5min":1.339,"15min":1.339},"max":{"1min":4.6870000000000003,"5min":4.6870000000000003,"15min":4.6870000000000003},"last":1.802}]},{"osd":3,"last update":"Thu Jan 28 03:58:02 2021","interfaces":[{"interface":"back","average":{"1min":2.343,"5min":2.3370000000000002,"15min":2.3359999999999999},"min":{"1min":1.9059999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"max":{"1min":2.9809999999999999,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":2.2669999999999999},{"interface":"front","average":{"1min":2.948,"5min":2.6640000000000001,"15min":2.6160000000000001},"min":{"1min":1.73,"5min":1.508,"15min":1.508},"max":{"1min":5.4880000000000004,"5min":5.4880000000000004,"15min":5.4880000000000004},"last":2.4900000000000002}]},{"osd":4,"last update":"Thu Jan 28 03:58:02 2021","interfaces":[{"interface":"back","average":{"1min":2.774,"5min":2.4449999999999998,"15min":2.3900000000000001},"min":{"1min":1.9710000000000001,"5min":1.0309999999999999,"15min":1.0309999999999999},"max":{"1min":3.9140000000000001,"5min":3.9140000000000001,"15min":3.9140000000000001},"last":2.5630000000000002},{"interface":"front","average":{"1min":2.6309999999999998,"5min":2.4750000000000001,"15min":2.4489999999999998},"min":{"1min":1.7749999999999999,"5min":1.208,"15min":1.208},"max":{"1min":3.411,"5min":3.411,"15min":3.411},"last":2.6579999999999999}]},{"osd":5,"last update":"Thu Jan 28 03:58:02 2021","interfaces":[{"interface":"back","average":{"1min":3.2850000000000001,"5min":2.8170000000000002,"15min":2.7389999999999999},"min":{"1min":1.911,"5min":1.163,"15min":1.163},"max":{"1min":5.6340000000000003,"5min":5.6340000000000003,"15min":5.6340000000000003},"last":2.9300000000000002},{"interface":"front","average":{"1min":3.1509999999999998,"5min":2.8620000000000001,"15min":2.8140000000000001},"min":{"1min":1.8280000000000001,"5min":1.4259999999999999,"15min":1.4259999999999999},"max":{"1min":4.2830000000000004,"5min":4.2830000000000004,"15min":4.2830000000000004},"last":3.4009999999999998}]},{"osd":6,"last update":"Thu Jan 28 03:58:02 2021","interfaces":[{"interface":"back","average":{"1min":3.3839999999999999,"5min":3.0459999999999998,"15min":2.9900000000000002},"min":{"1min":2.8180000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"max":{"1min":4.6130000000000004,"5min":4.6130000000000004,"15min":4.6130000000000004},"last":3.0539999999999998},{"interface":"front","average":{"1min":3,"5min":2.8980000000000001,"15min":2.8809999999999998},"min":{"1min":1.8600000000000001,"5min":1.5509999999999999,"15min":1.5509999999999999},"max":{"1min":4.0039999999999996,"5min":4.0389999999999997,"15min":4.0389999999999997},"last":3.0089999999999999}]}]},{"osd":6,"up_from":41,"seq":176093659180,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6352,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738800,"statfs":{"total":95995035648,"available":95988531200,"internally_reserved":0,"allocated":860160,"data_stored":241687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 28 03:58:40 2021","interfaces":[{"interface":"back","average":{"1min":2.2679999999999998,"5min":2.0579999999999998,"15min":2.0230000000000001},"min":{"1min":1.444,"5min":1.2190000000000001,"15min":1.2190000000000001},"max":{"1min":3.3119999999999998,"5min":3.4279999999999999,"15min":3.4279999999999999},"last":2.6619999999999999},{"interface":"front","average":{"1min":2.1739999999999999,"5min":2.0099999999999998,"15min":1.9790000000000001},"min":{"1min":1.4370000000000001,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":3.4289999999999998,"5min":3.4289999999999998,"15min":3.4289999999999998},"last":1.5429999999999999}]},{"osd":1,"last update":"Thu Jan 28 03:58:40 2021","interfaces":[{"interface":"back","average":{"1min":2.1800000000000002,"5min":2.1749999999999998,"15min":2.1760000000000002},"min":{"1min":1.3029999999999999,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":2.9260000000000002,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":1.6319999999999999},{"interface":"front","average":{"1min":2.222,"5min":2.1579999999999999,"15min":2.109},"min":{"1min":1.641,"5min":1.363,"15min":1.363},"max":{"1min":3.3180000000000001,"5min":3.3180000000000001,"15min":3.3180000000000001},"last":2.3679999999999999}]},{"osd":2,"last update":"Thu Jan 28 03:58:40 2021","interfaces":[{"interface":"back","average":{"1min":2.649,"5min":2.4060000000000001,"15min":2.3140000000000001},"min":{"1min":1.833,"5min":1.385,"15min":1.385},"max":{"1min":3.8170000000000002,"5min":3.8170000000000002,"15min":3.8170000000000002},"last":2.2989999999999999},{"interface":"front","average":{"1min":2.5600000000000001,"5min":2.4369999999999998,"15min":2.4049999999999998},"min":{"1min":1.3999999999999999,"5min":1.306,"15min":1.306},"max":{"1min":3.1869999999999998,"5min":3.5129999999999999,"15min":3.5129999999999999},"last":2.613}]},{"osd":3,"last update":"Thu Jan 28 03:58:40 2021","interfaces":[{"interface":"back","average":{"1min":2.117,"5min":2.1779999999999999,"15min":2.2189999999999999},"min":{"1min":1.607,"5min":1.2729999999999999,"15min":1.2729999999999999},"max":{"1min":3.1880000000000002,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.8560000000000001},{"interface":"front","average":{"1min":3.117,"5min":2.8719999999999999,"15min":2.8100000000000001},"min":{"1min":2.194,"5min":1.7110000000000001,"15min":1.7110000000000001},"max":{"1min":3.8239999999999998,"5min":4.2300000000000004,"15min":4.2300000000000004},"last":3.0019999999999998}]},{"osd":4,"last update":"Thu Jan 28 03:58:40 2021","interfaces":[{"interface":"back","average":{"1min":2.8940000000000001,"5min":2.7490000000000001,"15min":2.6909999999999998},"min":{"1min":2.2469999999999999,"5min":1.179,"15min":1.179},"max":{"1min":3.6589999999999998,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":2.1000000000000001},{"interface":"front","average":{"1min":2.4609999999999999,"5min":2.3340000000000001,"15min":2.3130000000000002},"min":{"1min":1.492,"5min":1.2210000000000001,"15min":1.2210000000000001},"max":{"1min":3.7280000000000002,"5min":3.7280000000000002,"15min":3.7280000000000002},"last":2.202}]},{"osd":5,"last update":"Thu Jan 28 03:58:40 2021","interfaces":[{"interface":"back","average":{"1min":3.3730000000000002,"5min":3.117,"15min":3.069},"min":{"1min":2.476,"5min":1.3819999999999999,"15min":1.3819999999999999},"max":{"1min":4.3040000000000003,"5min":4.3040000000000003,"15min":4.3040000000000003},"last":3.331},{"interface":"front","average":{"1min":2.7549999999999999,"5min":2.734,"15min":2.75},"min":{"1min":1.9550000000000001,"5min":1.5629999999999999,"15min":1.5629999999999999},"max":{"1min":3.5459999999999998,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":2.5750000000000002}]},{"osd":7,"last update":"Thu Jan 28 03:58:00 2021","interfaces":[{"interface":"back","average":{"1min":3.5299999999999998,"5min":3.48,"15min":3.472},"min":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"max":{"1min":4.7329999999999997,"5min":4.7329999999999997,"15min":4.7329999999999997},"last":3.6520000000000001},{"interface":"front","average":{"1min":3.282,"5min":3.1699999999999999,"15min":3.1509999999999998},"min":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"max":{"1min":4.1970000000000001,"5min":4.5650000000000004,"15min":4.5650000000000004},"last":2.8050000000000002}]}]},{"osd":1,"up_from":16,"seq":68719476806,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6808,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":5888,"kb_avail":93738344,"statfs":{"total":95995035648,"available":95988064256,"internally_reserved":0,"allocated":933888,"data_stored":243600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6029312},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 28 03:58:27 2021","interfaces":[{"interface":"back","average":{"1min":1.8200000000000001,"5min":1.702,"15min":1.419},"min":{"1min":1.3169999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.9470000000000001,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":1.722},{"interface":"front","average":{"1min":2.0099999999999998,"5min":1.806,"15min":1.464},"min":{"1min":0.86699999999999999,"5min":0.749,"15min":0.749},"max":{"1min":3.016,"5min":3.2869999999999999,"15min":3.2869999999999999},"last":3.194}]},{"osd":2,"last update":"Thu Jan 28 03:57:56 2021","interfaces":[{"interface":"back","average":{"1min":1.9370000000000001,"5min":1.8420000000000001,"15min":1.744},"min":{"1min":1.145,"5min":1.133,"15min":1.133},"max":{"1min":2.4620000000000002,"5min":3.1549999999999998,"15min":3.1549999999999998},"last":2.7210000000000001},{"interface":"front","average":{"1min":2.2280000000000002,"5min":2.04,"15min":1.9399999999999999},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":3.1309999999999998,"5min":3.1309999999999998,"15min":3.1309999999999998},"last":3.0059999999999998}]},{"osd":3,"last update":"Thu Jan 28 03:58:20 2021","interfaces":[{"interface":"back","average":{"1min":2.23,"5min":2.246,"15min":2.1899999999999999},"min":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"max":{"1min":3.0960000000000001,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":2.5750000000000002},{"interface":"front","average":{"1min":1.911,"5min":1.966,"15min":2.0019999999999998},"min":{"1min":1.0529999999999999,"5min":0.875,"15min":0.875},"max":{"1min":2.4990000000000001,"5min":3.1000000000000001,"15min":3.1000000000000001},"last":2.1259999999999999}]},{"osd":4,"last update":"Thu Jan 28 03:58:44 2021","interfaces":[{"interface":"back","average":{"1min":2.8279999999999998,"5min":2.6160000000000001,"15min":2.4660000000000002},"min":{"1min":1.8220000000000001,"5min":1.331,"15min":1.331},"max":{"1min":3.843,"5min":4.4400000000000004,"15min":4.4400000000000004},"last":2.4790000000000001},{"interface":"front","average":{"1min":2.984,"5min":2.843,"15min":2.6930000000000001},"min":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"max":{"1min":4.2720000000000002,"5min":4.2720000000000002,"15min":4.2720000000000002},"last":2.2879999999999998}]},{"osd":5,"last update":"Thu Jan 28 03:58:10 2021","interfaces":[{"interface":"back","average":{"1min":2.8940000000000001,"5min":2.8479999999999999,"15min":2.7850000000000001},"min":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"max":{"1min":3.798,"5min":4.25,"15min":4.25},"last":2.903},{"interface":"front","average":{"1min":3.101,"5min":3.0720000000000001,"15min":3.0230000000000001},"min":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"max":{"1min":4.2519999999999998,"5min":4.2519999999999998,"15min":4.2519999999999998},"last":2.798}]},{"osd":6,"last update":"Thu Jan 28 03:58:36 2021","interfaces":[{"interface":"back","average":{"1min":2.5699999999999998,"5min":2.532,"15min":2.5190000000000001},"min":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"max":{"1min":3.786,"5min":3.786,"15min":3.786},"last":2.444},{"interface":"front","average":{"1min":3.073,"5min":3.1419999999999999,"15min":3.1240000000000001},"min":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"max":{"1min":4.2530000000000001,"5min":4.6100000000000003,"15min":4.6100000000000003},"last":3.089}]},{"osd":7,"last update":"Thu Jan 28 03:58:00 2021","interfaces":[{"interface":"back","average":{"1min":3.3540000000000001,"5min":3.4409999999999998,"15min":3.4550000000000001},"min":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"max":{"1min":4.601,"5min":4.601,"15min":4.601},"last":3.4049999999999998},{"interface":"front","average":{"1min":2.8620000000000001,"5min":2.9580000000000002,"15min":2.9740000000000002},"min":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"max":{"1min":4.2039999999999997,"5min":4.2039999999999997,"15min":4.2039999999999997},"last":2.6339999999999999}]}]},{"osd":0,"up_from":10,"seq":42949673037,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6484,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738668,"statfs":{"total":95995035648,"available":95988396032,"internally_reserved":0,"allocated":798720,"data_stored":238553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 28 03:58:28 2021","interfaces":[{"interface":"back","average":{"1min":1.6879999999999999,"5min":1.5920000000000001,"15min":1.3300000000000001},"min":{"1min":1.218,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":2.8090000000000002,"5min":2.8090000000000002,"15min":2.8090000000000002},"last":2.0579999999999998},{"interface":"front","average":{"1min":1.7350000000000001,"5min":1.6579999999999999,"15min":1.4370000000000001},"min":{"1min":0.96699999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.9649999999999999,"5min":3.8069999999999999,"15min":3.8069999999999999},"last":1.5740000000000001}]},{"osd":2,"last update":"Thu Jan 28 03:58:54 2021","interfaces":[{"interface":"back","average":{"1min":1.988,"5min":1.752,"15min":1.6679999999999999},"min":{"1min":1.302,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":4.1970000000000001,"5min":4.1970000000000001,"15min":4.1970000000000001},"last":1.633},{"interface":"front","average":{"1min":2.1509999999999998,"5min":2.0670000000000002,"15min":1.891},"min":{"1min":1.4219999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":3.0600000000000001,"5min":3.367,"15min":3.367},"last":1.681}]},{"osd":3,"last update":"Thu Jan 28 03:58:19 2021","interfaces":[{"interface":"back","average":{"1min":2.258,"5min":2.1469999999999998,"15min":2.0190000000000001},"min":{"1min":1.355,"5min":1.0880000000000001,"15min":1.0880000000000001},"max":{"1min":3.1680000000000001,"5min":3.5790000000000002,"15min":3.5790000000000002},"last":2.016},{"interface":"front","average":{"1min":2.1899999999999999,"5min":2.2080000000000002,"15min":2.1989999999999998},"min":{"1min":1.4139999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":2.948,"5min":3.3879999999999999,"15min":3.3879999999999999},"last":2.4780000000000002}]},{"osd":4,"last update":"Thu Jan 28 03:58:46 2021","interfaces":[{"interface":"back","average":{"1min":2.6579999999999999,"5min":2.5960000000000001,"15min":2.516},"min":{"1min":1.778,"5min":1.4710000000000001,"15min":1.4710000000000001},"max":{"1min":3.3690000000000002,"5min":3.9260000000000002,"15min":3.9260000000000002},"last":2.6480000000000001},{"interface":"front","average":{"1min":2.794,"5min":2.7130000000000001,"15min":2.6339999999999999},"min":{"1min":2.0270000000000001,"5min":1.0409999999999999,"15min":1.0409999999999999},"max":{"1min":4.3179999999999996,"5min":4.3179999999999996,"15min":4.3179999999999996},"last":2.7799999999999998}]},{"osd":5,"last update":"Thu Jan 28 03:58:14 2021","interfaces":[{"interface":"back","average":{"1min":2.7410000000000001,"5min":2.8849999999999998,"15min":2.9780000000000002},"min":{"1min":2.073,"5min":1.383,"15min":1.383},"max":{"1min":3.6680000000000001,"5min":3.8620000000000001,"15min":3.8620000000000001},"last":3.181},{"interface":"front","average":{"1min":3.0910000000000002,"5min":2.9990000000000001,"15min":3.0049999999999999},"min":{"1min":2.3700000000000001,"5min":1.8,"15min":1.8},"max":{"1min":3.8500000000000001,"5min":3.8500000000000001,"15min":3.8500000000000001},"last":3.6000000000000001}]},{"osd":6,"last update":"Thu Jan 28 03:58:36 2021","interfaces":[{"interface":"back","average":{"1min":3.1419999999999999,"5min":3.036,"15min":3.0419999999999998},"min":{"1min":1.548,"5min":1.548,"15min":1.548},"max":{"1min":4.931,"5min":4.931,"15min":4.931},"last":2.6099999999999999},{"interface":"front","average":{"1min":3.089,"5min":2.956,"15min":2.9430000000000001},"min":{"1min":1.956,"5min":1.3220000000000001,"15min":1.3220000000000001},"max":{"1min":4.7770000000000001,"5min":4.7770000000000001,"15min":4.7770000000000001},"last":2.9409999999999998}]},{"osd":7,"last update":"Thu Jan 28 03:58:01 2021","interfaces":[{"interface":"back","average":{"1min":3.3029999999999999,"5min":3.1640000000000001,"15min":3.141},"min":{"1min":2.7349999999999999,"5min":1.6120000000000001,"15min":1.6120000000000001},"max":{"1min":4.2619999999999996,"5min":4.2619999999999996,"15min":4.2619999999999996},"last":3.4049999999999998},{"interface":"front","average":{"1min":3.23,"5min":3.363,"15min":3.3849999999999998},"min":{"1min":1.986,"5min":1.986,"15min":1.986},"max":{"1min":4.2080000000000002,"5min":4.351,"15min":4.351},"last":2.9929999999999999}]}]},{"osd":2,"up_from":21,"seq":90194313282,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6160,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738992,"statfs":{"total":95995035648,"available":95988727808,"internally_reserved":0,"allocated":729088,"data_stored":236944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 28 03:58:55 2021","interfaces":[{"interface":"back","average":{"1min":1.831,"5min":1.712,"15min":1.486},"min":{"1min":1.161,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.641,"5min":2.8220000000000001,"15min":2.8220000000000001},"last":1.722},{"interface":"front","average":{"1min":1.7929999999999999,"5min":1.782,"15min":1.599},"min":{"1min":1.393,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.2320000000000002,"5min":3.7250000000000001,"15min":3.7250000000000001},"last":1.665}]},{"osd":1,"last update":"Thu Jan 28 03:58:55 2021","interfaces":[{"interface":"back","average":{"1min":2.1309999999999998,"5min":1.9410000000000001,"15min":1.6899999999999999},"min":{"1min":1.329,"5min":1.1859999999999999,"15min":1.1859999999999999},"max":{"1min":3.2069999999999999,"5min":3.2069999999999999,"15min":3.2069999999999999},"last":2.4239999999999999},{"interface":"front","average":{"1min":1.897,"5min":1.9019999999999999,"15min":1.782},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":2.3839999999999999,"5min":4.0229999999999997,"15min":4.0229999999999997},"last":1.855}]},{"osd":3,"last update":"Thu Jan 28 03:58:22 2021","interfaces":[{"interface":"back","average":{"1min":2.2879999999999998,"5min":2.1030000000000002,"15min":2.0430000000000001},"min":{"1min":1.296,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":3.6309999999999998,"5min":3.6309999999999998,"15min":3.6309999999999998},"last":2.3239999999999998},{"interface":"front","average":{"1min":2.4710000000000001,"5min":2.3500000000000001,"15min":2.298},"min":{"1min":1.6000000000000001,"5min":1,"15min":1},"max":{"1min":3.589,"5min":3.589,"15min":3.589},"last":2.1309999999999998}]},{"osd":4,"last update":"Thu Jan 28 03:58:45 2021","interfaces":[{"interface":"back","average":{"1min":2.673,"5min":2.5139999999999998,"15min":2.4940000000000002},"min":{"1min":1.978,"5min":1.2490000000000001,"15min":1.2490000000000001},"max":{"1min":3.9809999999999999,"5min":3.9809999999999999,"15min":3.9809999999999999},"last":2.9790000000000001},{"interface":"front","average":{"1min":2.6019999999999999,"5min":2.5569999999999999,"15min":2.5310000000000001},"min":{"1min":1.6459999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":3.4729999999999999,"5min":4.3070000000000004,"15min":4.3070000000000004},"last":2.6800000000000002}]},{"osd":5,"last update":"Thu Jan 28 03:58:10 2021","interfaces":[{"interface":"back","average":{"1min":2.8180000000000001,"5min":2.9100000000000001,"15min":2.9500000000000002},"min":{"1min":1.6950000000000001,"5min":1.488,"15min":1.488},"max":{"1min":4.0949999999999998,"5min":4.0949999999999998,"15min":4.0949999999999998},"last":2.5510000000000002},{"interface":"front","average":{"1min":2.8050000000000002,"5min":2.7429999999999999,"15min":2.7240000000000002},"min":{"1min":1.502,"5min":1.3300000000000001,"15min":1.3300000000000001},"max":{"1min":3.6139999999999999,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":3.165}]},{"osd":6,"last update":"Thu Jan 28 03:58:36 2021","interfaces":[{"interface":"back","average":{"1min":3.2490000000000001,"5min":3.1760000000000002,"15min":3.1640000000000001},"min":{"1min":2.4089999999999998,"5min":1.51,"15min":1.51},"max":{"1min":4.2809999999999997,"5min":4.351,"15min":4.351},"last":3.2730000000000001},{"interface":"front","average":{"1min":3.1800000000000002,"5min":3.0590000000000002,"15min":3.0329999999999999},"min":{"1min":2.4910000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"max":{"1min":3.9500000000000002,"5min":4.0650000000000004,"15min":4.0650000000000004},"last":2.9249999999999998}]},{"osd":7,"last update":"Thu Jan 28 03:58:04 2021","interfaces":[{"interface":"back","average":{"1min":3.1339999999999999,"5min":3.2509999999999999,"15min":3.2709999999999999},"min":{"1min":1.647,"5min":1.647,"15min":1.647},"max":{"1min":4.1639999999999997,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":3.5150000000000001},{"interface":"front","average":{"1min":2.9660000000000002,"5min":3.1899999999999999,"15min":3.2269999999999999},"min":{"1min":1.9239999999999999,"5min":1.506,"15min":1.506},"max":{"1min":4.4939999999999998,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":3.073}]}]},{"osd":3,"up_from":26,"seq":111669149756,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6592,"kb_used_data":888,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738560,"statfs":{"total":95995035648,"available":95988285440,"internally_reserved":0,"allocated":909312,"data_stored":242420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 28 03:58:20 2021","interfaces":[{"interface":"back","average":{"1min":1.698,"5min":1.635,"15min":1.534},"min":{"1min":1.2989999999999999,"5min":0.499,"15min":0.499},"max":{"1min":2.177,"5min":3.3959999999999999,"15min":3.3959999999999999},"last":1.7230000000000001},{"interface":"front","average":{"1min":2.0819999999999999,"5min":1.911,"15min":1.798},"min":{"1min":1.5249999999999999,"5min":1.165,"15min":1.165},"max":{"1min":2.9540000000000002,"5min":8.7159999999999993,"15min":8.7159999999999993},"last":2.419}]},{"osd":1,"last update":"Thu Jan 28 03:58:20 2021","interfaces":[{"interface":"back","average":{"1min":1.95,"5min":2.0449999999999999,"15min":1.8819999999999999},"min":{"1min":1.387,"5min":1.387,"15min":1.387},"max":{"1min":2.4580000000000002,"5min":8.3079999999999998,"15min":8.3079999999999998},"last":1.798},{"interface":"front","average":{"1min":2.101,"5min":2.0529999999999999,"15min":1.9570000000000001},"min":{"1min":1.5369999999999999,"5min":1.202,"15min":1.202},"max":{"1min":2.8999999999999999,"5min":10.022,"15min":10.022},"last":2.75}]},{"osd":2,"last update":"Thu Jan 28 03:58:20 2021","interfaces":[{"interface":"back","average":{"1min":2.2290000000000001,"5min":2.1459999999999999,"15min":2.0499999999999998},"min":{"1min":1.427,"5min":1.427,"15min":1.427},"max":{"1min":3.5990000000000002,"5min":3.5990000000000002,"15min":3.5990000000000002},"last":2.2629999999999999},{"interface":"front","average":{"1min":2.3959999999999999,"5min":2.206,"15min":2.1139999999999999},"min":{"1min":1.853,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":3.1309999999999998,"5min":3.1309999999999998,"15min":3.1309999999999998},"last":2.3370000000000002}]},{"osd":4,"last update":"Thu Jan 28 03:58:47 2021","interfaces":[{"interface":"back","average":{"1min":2.6669999999999998,"5min":2.4849999999999999,"15min":2.379},"min":{"1min":1.661,"5min":1.496,"15min":1.496},"max":{"1min":3.9140000000000001,"5min":3.9809999999999999,"15min":3.9809999999999999},"last":2.0230000000000001},{"interface":"front","average":{"1min":2.734,"5min":2.6019999999999999,"15min":2.4830000000000001},"min":{"1min":1.897,"5min":1.5800000000000001,"15min":1.5800000000000001},"max":{"1min":3.8519999999999999,"5min":3.8940000000000001,"15min":3.8940000000000001},"last":3.4620000000000002}]},{"osd":5,"last update":"Thu Jan 28 03:58:11 2021","interfaces":[{"interface":"back","average":{"1min":3.0630000000000002,"5min":2.8410000000000002,"15min":2.7010000000000001},"min":{"1min":1.984,"5min":1.9550000000000001,"15min":1.9550000000000001},"max":{"1min":4.4420000000000002,"5min":8.5600000000000005,"15min":8.5600000000000005},"last":2.6579999999999999},{"interface":"front","average":{"1min":2.9670000000000001,"5min":3.04,"15min":2.9940000000000002},"min":{"1min":2.1720000000000002,"5min":2.0569999999999999,"15min":2.0569999999999999},"max":{"1min":3.8079999999999998,"5min":7.7009999999999996,"15min":7.7009999999999996},"last":3.145}]},{"osd":6,"last update":"Thu Jan 28 03:58:33 2021","interfaces":[{"interface":"back","average":{"1min":3.1459999999999999,"5min":3.246,"15min":3.3029999999999999},"min":{"1min":1.696,"5min":1.696,"15min":1.696},"max":{"1min":4,"5min":8.4239999999999995,"15min":8.4239999999999995},"last":2.8460000000000001},{"interface":"front","average":{"1min":3.2959999999999998,"5min":3.2200000000000002,"15min":3.2050000000000001},"min":{"1min":2.5899999999999999,"5min":2.0299999999999998,"15min":2.0299999999999998},"max":{"1min":4.6310000000000002,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":3.7690000000000001}]},{"osd":7,"last update":"Thu Jan 28 03:58:00 2021","interfaces":[{"interface":"back","average":{"1min":3.3639999999999999,"5min":3.7160000000000002,"15min":3.774},"min":{"1min":2.5539999999999998,"5min":2.5539999999999998,"15min":2.5539999999999998},"max":{"1min":4.5590000000000002,"5min":10.752000000000001,"15min":10.752000000000001},"last":3.02},{"interface":"front","average":{"1min":3.4100000000000001,"5min":3.4700000000000002,"15min":3.48},"min":{"1min":2.4540000000000002,"5min":2.403,"15min":2.403},"max":{"1min":4.5039999999999996,"5min":4.6980000000000004,"15min":4.6980000000000004},"last":4.0430000000000001}]}]},{"osd":4,"up_from":31,"seq":133143986230,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6488,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738664,"statfs":{"total":95995035648,"available":95988391936,"internally_reserved":0,"allocated":868352,"data_stored":241207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 28 03:58:51 2021","interfaces":[{"interface":"back","average":{"1min":1.893,"5min":1.675,"15min":1.5700000000000001},"min":{"1min":1.3720000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":2.6720000000000002,"5min":2.96,"15min":2.96},"last":2.23},{"interface":"front","average":{"1min":1.895,"5min":1.7470000000000001,"15min":1.669},"min":{"1min":1.3260000000000001,"5min":1.1879999999999999,"15min":1.1879999999999999},"max":{"1min":2.7189999999999999,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.448}]},{"osd":1,"last update":"Thu Jan 28 03:58:51 2021","interfaces":[{"interface":"back","average":{"1min":2.0009999999999999,"5min":1.8999999999999999,"15min":1.7450000000000001},"min":{"1min":1.55,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":3.048,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":1.6100000000000001},{"interface":"front","average":{"1min":2.4220000000000002,"5min":2.1070000000000002,"15min":1.9770000000000001},"min":{"1min":1.24,"5min":1.109,"15min":1.109},"max":{"1min":4.0730000000000004,"5min":4.0730000000000004,"15min":4.0730000000000004},"last":2.4790000000000001}]},{"osd":2,"last update":"Thu Jan 28 03:58:51 2021","interfaces":[{"interface":"back","average":{"1min":2.593,"5min":2.2320000000000002,"15min":2.0539999999999998},"min":{"1min":1.357,"5min":1.101,"15min":1.101},"max":{"1min":3.7330000000000001,"5min":3.7330000000000001,"15min":3.7330000000000001},"last":1.8100000000000001},{"interface":"front","average":{"1min":2.835,"5min":2.4990000000000001,"15min":2.3029999999999999},"min":{"1min":2.165,"5min":1.3440000000000001,"15min":1.3440000000000001},"max":{"1min":3.9900000000000002,"5min":4.3550000000000004,"15min":4.3550000000000004},"last":2.75}]},{"osd":3,"last update":"Thu Jan 28 03:58:51 2021","interfaces":[{"interface":"back","average":{"1min":2.3399999999999999,"5min":2.1459999999999999,"15min":1.982},"min":{"1min":1.7070000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":3.6869999999999998,"5min":3.6869999999999998,"15min":3.6869999999999998},"last":1.871},{"interface":"front","average":{"1min":2.7349999999999999,"5min":2.391,"15min":2.1549999999999998},"min":{"1min":1.53,"5min":1.2090000000000001,"15min":1.2090000000000001},"max":{"1min":4.0499999999999998,"5min":4.5229999999999997,"15min":4.5229999999999997},"last":2.1389999999999998}]},{"osd":5,"last update":"Thu Jan 28 03:58:10 2021","interfaces":[{"interface":"back","average":{"1min":2.6779999999999999,"5min":2.2959999999999998,"15min":2.177},"min":{"1min":1.419,"5min":1.1870000000000001,"15min":1.1870000000000001},"max":{"1min":3.9769999999999999,"5min":3.9769999999999999,"15min":3.9769999999999999},"last":3.1299999999999999},{"interface":"front","average":{"1min":2.8959999999999999,"5min":2.681,"15min":2.6190000000000002},"min":{"1min":1.3320000000000001,"5min":1.242,"15min":1.242},"max":{"1min":3.9079999999999999,"5min":3.9079999999999999,"15min":3.9079999999999999},"last":2.7120000000000002}]},{"osd":6,"last update":"Thu Jan 28 03:58:35 2021","interfaces":[{"interface":"back","average":{"1min":2.956,"5min":2.7559999999999998,"15min":2.7679999999999998},"min":{"1min":1.907,"5min":1.3200000000000001,"15min":1.3200000000000001},"max":{"1min":4.3460000000000001,"5min":4.3460000000000001,"15min":4.3460000000000001},"last":2.319},{"interface":"front","average":{"1min":3.218,"5min":3.0659999999999998,"15min":3.081},"min":{"1min":1.962,"5min":1.7410000000000001,"15min":1.7410000000000001},"max":{"1min":4.3550000000000004,"5min":4.9349999999999996,"15min":4.9349999999999996},"last":2.5659999999999998}]},{"osd":7,"last update":"Thu Jan 28 03:58:01 2021","interfaces":[{"interface":"back","average":{"1min":3.3370000000000002,"5min":3.3319999999999999,"15min":3.331},"min":{"1min":2.0840000000000001,"5min":2.024,"15min":2.024},"max":{"1min":5.3179999999999996,"5min":5.3179999999999996,"15min":5.3179999999999996},"last":2.9350000000000001},{"interface":"front","average":{"1min":3.1230000000000002,"5min":3.1339999999999999,"15min":3.1360000000000001},"min":{"1min":1.8169999999999999,"5min":1.129,"15min":1.129},"max":{"1min":4.0780000000000003,"5min":4.0780000000000003,"15min":4.0780000000000003},"last":2.895}]}]},{"osd":5,"up_from":36,"seq":154618822705,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6200,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738952,"statfs":{"total":95995035648,"available":95988686848,"internally_reserved":0,"allocated":770048,"data_stored":237538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 28 03:58:10 2021","interfaces":[{"interface":"back","average":{"1min":2.0289999999999999,"5min":1.8979999999999999,"15min":1.8560000000000001},"min":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"max":{"1min":2.9060000000000001,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":1.8999999999999999},{"interface":"front","average":{"1min":1.9119999999999999,"5min":1.849,"15min":1.859},"min":{"1min":1.264,"5min":1.1910000000000001,"15min":1.1910000000000001},"max":{"1min":2.669,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":1.998}]},{"osd":1,"last update":"Thu Jan 28 03:58:10 2021","interfaces":[{"interface":"back","average":{"1min":2.2069999999999999,"5min":1.95,"15min":1.8819999999999999},"min":{"1min":1.2170000000000001,"5min":1.109,"15min":1.109},"max":{"1min":3.3210000000000002,"5min":3.508,"15min":3.508},"last":2.5459999999999998},{"interface":"front","average":{"1min":2.1850000000000001,"5min":1.9299999999999999,"15min":1.8440000000000001},"min":{"1min":1.6679999999999999,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":3.0230000000000001,"5min":3.3500000000000001,"15min":3.3500000000000001},"last":3.2210000000000001}]},{"osd":2,"last update":"Thu Jan 28 03:58:10 2021","interfaces":[{"interface":"back","average":{"1min":1.9710000000000001,"5min":1.913,"15min":1.885},"min":{"1min":1.27,"5min":1.097,"15min":1.097},"max":{"1min":2.952,"5min":3.1440000000000001,"15min":3.1440000000000001},"last":2.157},{"interface":"front","average":{"1min":2.5859999999999999,"5min":2.363,"15min":2.2890000000000001},"min":{"1min":1.595,"5min":1.5800000000000001,"15min":1.5800000000000001},"max":{"1min":3.141,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":3.0070000000000001}]},{"osd":3,"last update":"Thu Jan 28 03:58:10 2021","interfaces":[{"interface":"back","average":{"1min":2.2799999999999998,"5min":2.161,"15min":2.121},"min":{"1min":1.365,"5min":1.3140000000000001,"15min":1.3140000000000001},"max":{"1min":2.782,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":2.6469999999999998},{"interface":"front","average":{"1min":2.7400000000000002,"5min":2.4340000000000002,"15min":2.3290000000000002},"min":{"1min":2.1309999999999998,"5min":1.319,"15min":1.319},"max":{"1min":3.5019999999999998,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":3.7530000000000001}]},{"osd":4,"last update":"Thu Jan 28 03:58:10 2021","interfaces":[{"interface":"back","average":{"1min":2.6480000000000001,"5min":2.2029999999999998,"15min":2.0840000000000001},"min":{"1min":1.706,"5min":1.095,"15min":1.095},"max":{"1min":3.427,"5min":3.427,"15min":3.427},"last":3.8879999999999999},{"interface":"front","average":{"1min":2.6909999999999998,"5min":2.3210000000000002,"15min":2.2250000000000001},"min":{"1min":1.528,"5min":1.1910000000000001,"15min":1.1910000000000001},"max":{"1min":3.375,"5min":3.6360000000000001,"15min":3.6360000000000001},"last":3.113}]},{"osd":6,"last update":"Thu Jan 28 03:58:37 2021","interfaces":[{"interface":"back","average":{"1min":3.0049999999999999,"5min":2.5030000000000001,"15min":2.355},"min":{"1min":2.339,"5min":1.171,"15min":1.171},"max":{"1min":4.0910000000000002,"5min":4.0910000000000002,"15min":4.0910000000000002},"last":3.3399999999999999},{"interface":"front","average":{"1min":3.1840000000000002,"5min":2.851,"15min":2.7309999999999999},"min":{"1min":2.4409999999999998,"5min":1.1000000000000001,"15min":1.1000000000000001},"max":{"1min":3.8220000000000001,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":3.395}]},{"osd":7,"last update":"Thu Jan 28 03:58:02 2021","interfaces":[{"interface":"back","average":{"1min":3.0470000000000002,"5min":2.8029999999999999,"15min":2.762},"min":{"1min":1.891,"5min":1.0860000000000001,"15min":1.0860000000000001},"max":{"1min":3.8029999999999999,"5min":3.8029999999999999,"15min":3.8029999999999999},"last":4.1890000000000001},{"interface":"front","average":{"1min":3.2120000000000002,"5min":2.968,"15min":2.927},"min":{"1min":2.194,"5min":1.4890000000000001,"15min":1.4890000000000001},"max":{"1min":4.0579999999999998,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":4.0460000000000003}]}]}]}} 2021-01-28T03:59:02.601 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph pg dump --format=json 2021-01-28T03:59:02.792 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c217df96-611b-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T03:59:02.844 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:02 smithi100 bash[9834]: audit 2021-01-28T03:59:01.759871+0000 mgr.y (mgr.14138) 433 : audit [DBG] from='client.14733 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-01-28T03:59:02.845 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:02 smithi100 bash[13549]: audit 2021-01-28T03:59:01.759871+0000 mgr.y (mgr.14138) 433 : audit [DBG] from='client.14733 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-01-28T03:59:03.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:02 smithi162 bash[9856]: audit 2021-01-28T03:59:01.759871+0000 mgr.y (mgr.14138) 433 : audit [DBG] from='client.14733 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-01-28T03:59:03.964 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:03 smithi100 bash[9834]: cluster 2021-01-28T03:59:03.457785+0000 mgr.y (mgr.14138) 434 : cluster [DBG] pgmap v304: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:03.965 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:03 smithi100 bash[13549]: cluster 2021-01-28T03:59:03.457785+0000 mgr.y (mgr.14138) 434 : cluster [DBG] pgmap v304: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:04.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:03 smithi162 bash[9856]: cluster 2021-01-28T03:59:03.457785+0000 mgr.y (mgr.14138) 434 : cluster [DBG] pgmap v304: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:05.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:05 smithi100 bash[9834]: cluster 2021-01-28T03:59:05.458825+0000 mgr.y (mgr.14138) 435 : cluster [DBG] pgmap v305: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:05.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:05 smithi100 bash[13549]: cluster 2021-01-28T03:59:05.458825+0000 mgr.y (mgr.14138) 435 : cluster [DBG] pgmap v305: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:06.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:05 smithi162 bash[9856]: cluster 2021-01-28T03:59:05.458825+0000 mgr.y (mgr.14138) 435 : cluster [DBG] pgmap v305: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:06.023 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.022+0000 7f1515ee0700 1 -- 172.21.15.100:0/3956617334 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15100f72b0 msgr2=0x7f15100f7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:59:06.024 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.022+0000 7f1515ee0700 1 --2- 172.21.15.100:0/3956617334 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15100f72b0 0x7f15100f7730 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f1508009dc0 tx=0x7f1508004d10).stop 2021-01-28T03:59:06.024 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.022+0000 7f1515ee0700 1 -- 172.21.15.100:0/3956617334 shutdown_connections 2021-01-28T03:59:06.024 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.022+0000 7f1515ee0700 1 --2- 172.21.15.100:0/3956617334 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15100f72b0 0x7f15100f7730 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:59:06.024 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.022+0000 7f1515ee0700 1 --2- 172.21.15.100:0/3956617334 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15100f3b70 0x7f15100f3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:59:06.025 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.022+0000 7f1515ee0700 1 --2- 172.21.15.100:0/3956617334 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15100f4510 0x7f15100f6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:59:06.025 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.022+0000 7f1515ee0700 1 -- 172.21.15.100:0/3956617334 >> 172.21.15.100:0/3956617334 conn(0x7f15100ef730 msgr2=0x7f15100f1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:59:06.025 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.022+0000 7f1515ee0700 1 -- 172.21.15.100:0/3956617334 shutdown_connections 2021-01-28T03:59:06.025 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.022+0000 7f1515ee0700 1 -- 172.21.15.100:0/3956617334 wait complete. 2021-01-28T03:59:06.027 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.022+0000 7f1515ee0700 1 Processor -- start 2021-01-28T03:59:06.027 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.022+0000 7f1515ee0700 1 -- start start 2021-01-28T03:59:06.027 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.022+0000 7f1515ee0700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15100f3b70 0x7f15101056b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:59:06.028 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.022+0000 7f1515ee0700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15100f4510 0x7f1510105ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:59:06.028 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.022+0000 7f1515ee0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15100f72b0 0x7f1510106a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:59:06.028 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.022+0000 7f1515ee0700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1510106fc0 con 0x7f15100f72b0 2021-01-28T03:59:06.028 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.022+0000 7f1515ee0700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1510107130 con 0x7f15100f4510 2021-01-28T03:59:06.029 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.022+0000 7f1515ee0700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15101072f0 con 0x7f15100f3b70 2021-01-28T03:59:06.029 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.022+0000 7f1514ede700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15100f3b70 0x7f15101056b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:59:06.029 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.022+0000 7f1514ede700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15100f3b70 0x7f15101056b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3301/0 says I am v2:172.21.15.100:41148/0 (socket says 172.21.15.100:41148) 2021-01-28T03:59:06.029 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.022+0000 7f1514ede700 1 -- 172.21.15.100:0/890520285 learned_addr learned my addr 172.21.15.100:0/890520285 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:59:06.029 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.022+0000 7f15156df700 1 --2- 172.21.15.100:0/890520285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15100f72b0 0x7f1510106a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:59:06.030 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.022+0000 7f150ffff700 1 --2- 172.21.15.100:0/890520285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15100f4510 0x7f1510105ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:59:06.030 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.022+0000 7f1514ede700 1 -- 172.21.15.100:0/890520285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15100f4510 msgr2=0x7f1510105ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:59:06.030 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.022+0000 7f1514ede700 1 --2- 172.21.15.100:0/890520285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15100f4510 0x7f1510105ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:59:06.031 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.022+0000 7f1514ede700 1 -- 172.21.15.100:0/890520285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15100f72b0 msgr2=0x7f1510106a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:59:06.031 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.022+0000 7f1514ede700 1 --2- 172.21.15.100:0/890520285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15100f72b0 0x7f1510106a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:59:06.031 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.022+0000 7f1514ede700 1 -- 172.21.15.100:0/890520285 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15101074b0 con 0x7f15100f3b70 2021-01-28T03:59:06.031 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.022+0000 7f1514ede700 1 --2- 172.21.15.100:0/890520285 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15100f3b70 0x7f15101056b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f150400eb90 tx=0x7f150400b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:59:06.032 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.022+0000 7f150d7fa700 1 -- 172.21.15.100:0/890520285 <== mon.1 v2:172.21.15.100:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15040092e0 con 0x7f15100f3b70 2021-01-28T03:59:06.032 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.022+0000 7f150d7fa700 1 -- 172.21.15.100:0/890520285 <== mon.1 v2:172.21.15.100:3301/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7f150400f040 con 0x7f15100f3b70 2021-01-28T03:59:06.032 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.022+0000 7f1515ee0700 1 -- 172.21.15.100:0/890520285 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1510107760 con 0x7f15100f3b70 2021-01-28T03:59:06.032 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.022+0000 7f150d7fa700 1 -- 172.21.15.100:0/890520285 <== mon.1 v2:172.21.15.100:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150400c910 con 0x7f15100f3b70 2021-01-28T03:59:06.032 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.022+0000 7f1515ee0700 1 -- 172.21.15.100:0/890520285 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f151010def0 con 0x7f15100f3b70 2021-01-28T03:59:06.033 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.026+0000 7f1515ee0700 1 -- 172.21.15.100:0/890520285 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15100f3320 con 0x7f15100f3b70 2021-01-28T03:59:06.033 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.026+0000 7f150d7fa700 1 -- 172.21.15.100:0/890520285 <== mon.1 v2:172.21.15.100:3301/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7f150401b030 con 0x7f15100f3b70 2021-01-28T03:59:06.034 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.026+0000 7f150d7fa700 1 --2- 172.21.15.100:0/890520285 >> v2:172.21.15.100:6800/928846103 conn(0x7f14f805bc70 0x7f14f805e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:59:06.034 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.026+0000 7f150ffff700 1 --2- 172.21.15.100:0/890520285 >> v2:172.21.15.100:6800/928846103 conn(0x7f14f805bc70 0x7f14f805e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:59:06.034 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.026+0000 7f150d7fa700 1 -- 172.21.15.100:0/890520285 <== mon.1 v2:172.21.15.100:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7f15040757a0 con 0x7f15100f3b70 2021-01-28T03:59:06.035 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.026+0000 7f150ffff700 1 --2- 172.21.15.100:0/890520285 >> v2:172.21.15.100:6800/928846103 conn(0x7f14f805bc70 0x7f14f805e130 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f15100f4950 tx=0x7f150000b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:59:06.036 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.034+0000 7f150d7fa700 1 -- 172.21.15.100:0/890520285 <== mon.1 v2:172.21.15.100:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7f1504048430 con 0x7f15100f3b70 2021-01-28T03:59:06.196 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.194+0000 7f1515ee0700 1 -- 172.21.15.100:0/890520285 --> v2:172.21.15.100:6800/928846103 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1510027170 con 0x7f14f805bc70 2021-01-28T03:59:06.217 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.214+0000 7f150d7fa700 1 -- 172.21.15.100:0/890520285 <== mgr.14138 v2:172.21.15.100:6800/928846103 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345857 (secure 0 0 0) 0x7f1510027170 con 0x7f14f805bc70 2021-01-28T03:59:06.225 INFO:teuthology.orchestra.run.smithi100.stdout: 2021-01-28T03:59:06.227 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.218+0000 7f1515ee0700 1 -- 172.21.15.100:0/890520285 >> v2:172.21.15.100:6800/928846103 conn(0x7f14f805bc70 msgr2=0x7f14f805e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:59:06.228 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.218+0000 7f1515ee0700 1 --2- 172.21.15.100:0/890520285 >> v2:172.21.15.100:6800/928846103 conn(0x7f14f805bc70 0x7f14f805e130 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f15100f4950 tx=0x7f150000b040).stop 2021-01-28T03:59:06.228 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.218+0000 7f1515ee0700 1 -- 172.21.15.100:0/890520285 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15100f3b70 msgr2=0x7f15101056b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:59:06.229 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.218+0000 7f1515ee0700 1 --2- 172.21.15.100:0/890520285 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15100f3b70 0x7f15101056b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f150400eb90 tx=0x7f150400b040).stop 2021-01-28T03:59:06.229 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.222+0000 7f1515ee0700 1 -- 172.21.15.100:0/890520285 shutdown_connections 2021-01-28T03:59:06.230 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.222+0000 7f1515ee0700 1 --2- 172.21.15.100:0/890520285 >> v2:172.21.15.100:6800/928846103 conn(0x7f14f805bc70 0x7f14f805e130 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:59:06.230 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.222+0000 7f1515ee0700 1 --2- 172.21.15.100:0/890520285 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15100f72b0 0x7f1510106a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:59:06.230 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.222+0000 7f1515ee0700 1 --2- 172.21.15.100:0/890520285 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7f15100f3b70 0x7f15101056b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:59:06.230 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.222+0000 7f1515ee0700 1 --2- 172.21.15.100:0/890520285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15100f4510 0x7f1510105ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:59:06.231 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.222+0000 7f1515ee0700 1 -- 172.21.15.100:0/890520285 >> 172.21.15.100:0/890520285 conn(0x7f15100ef730 msgr2=0x7f15100f14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:59:06.231 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.222+0000 7f1515ee0700 1 -- 172.21.15.100:0/890520285 shutdown_connections 2021-01-28T03:59:06.231 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:06.222+0000 7f1515ee0700 1 -- 172.21.15.100:0/890520285 wait complete. 2021-01-28T03:59:06.231 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2021-01-28T03:59:06.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:06 smithi100 bash[9834]: audit 2021-01-28T03:59:06.196564+0000 mgr.y (mgr.14138) 436 : audit [DBG] from='client.24655 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-01-28T03:59:06.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:06 smithi100 bash[13549]: audit 2021-01-28T03:59:06.196564+0000 mgr.y (mgr.14138) 436 : audit [DBG] from='client.24655 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-01-28T03:59:06.994 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":305,"stamp":"2021-01-28T03:59:05.458149+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":25858,"num_objects":357,"num_object_clones":0,"num_object_copies":1071,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":357,"num_whiteouts":0,"num_read":1638,"num_read_kb":1106,"num_write":759,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":34,"num_bytes_recovered":2317,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":743,"ondisk_log_size":743,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":51324,"kb_used_data":6524,"kb_used_omap":0,"kb_used_meta":44736,"kb_avail":749909892,"statfs":{"total":767960285184,"available":767907729408,"internally_reserved":0,"allocated":6680576,"data_stored":1921662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":45809664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006513"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.460948+0000","last_change":"2021-01-28T03:56:19.828450+0000","last_active":"2021-01-28T03:56:35.460948+0000","last_peered":"2021-01-28T03:56:35.460948+0000","last_clean":"2021-01-28T03:56:35.460948+0000","last_became_active":"2021-01-28T03:56:19.828096+0000","last_became_peered":"2021-01-28T03:56:19.828096+0000","last_unstale":"2021-01-28T03:56:35.460948+0000","last_undegraded":"2021-01-28T03:56:35.460948+0000","last_fullsized":"2021-01-28T03:56:35.460948+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.452025+0000","last_change":"2021-01-28T03:56:16.780844+0000","last_active":"2021-01-28T03:56:35.452025+0000","last_peered":"2021-01-28T03:56:35.452025+0000","last_clean":"2021-01-28T03:56:35.452025+0000","last_became_active":"2021-01-28T03:56:16.780447+0000","last_became_peered":"2021-01-28T03:56:16.780447+0000","last_unstale":"2021-01-28T03:56:35.452025+0000","last_undegraded":"2021-01-28T03:56:35.452025+0000","last_fullsized":"2021-01-28T03:56:35.452025+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"45'1","reported_seq":"41","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456670+0000","last_change":"2021-01-28T03:55:58.630393+0000","last_active":"2021-01-28T03:56:35.456670+0000","last_peered":"2021-01-28T03:56:35.456670+0000","last_clean":"2021-01-28T03:56:35.456670+0000","last_became_active":"2021-01-28T03:55:58.574929+0000","last_became_peered":"2021-01-28T03:55:58.574929+0000","last_unstale":"2021-01-28T03:56:35.456670+0000","last_undegraded":"2021-01-28T03:56:35.456670+0000","last_fullsized":"2021-01-28T03:56:35.456670+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":10,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":10,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"58'44","reported_seq":"113","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.460975+0000","last_change":"2021-01-28T03:56:14.750867+0000","last_active":"2021-01-28T03:56:35.460975+0000","last_peered":"2021-01-28T03:56:35.460975+0000","last_clean":"2021-01-28T03:56:35.460975+0000","last_became_active":"2021-01-28T03:56:14.750208+0000","last_became_peered":"2021-01-28T03:56:14.750208+0000","last_unstale":"2021-01-28T03:56:35.460975+0000","last_undegraded":"2021-01-28T03:56:35.460975+0000","last_fullsized":"2021-01-28T03:56:35.460975+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":890,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":89,"num_read_kb":66,"num_write":45,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.452413+0000","last_change":"2021-01-28T03:56:19.821875+0000","last_active":"2021-01-28T03:56:35.452413+0000","last_peered":"2021-01-28T03:56:35.452413+0000","last_clean":"2021-01-28T03:56:35.452413+0000","last_became_active":"2021-01-28T03:56:19.821493+0000","last_became_peered":"2021-01-28T03:56:19.821493+0000","last_unstale":"2021-01-28T03:56:35.452413+0000","last_undegraded":"2021-01-28T03:56:35.452413+0000","last_fullsized":"2021-01-28T03:56:35.452413+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.450185+0000","last_change":"2021-01-28T03:56:16.791387+0000","last_active":"2021-01-28T03:56:35.450185+0000","last_peered":"2021-01-28T03:56:35.450185+0000","last_clean":"2021-01-28T03:56:35.450185+0000","last_became_active":"2021-01-28T03:56:16.791004+0000","last_became_peered":"2021-01-28T03:56:16.791004+0000","last_unstale":"2021-01-28T03:56:35.450185+0000","last_undegraded":"2021-01-28T03:56:35.450185+0000","last_fullsized":"2021-01-28T03:56:35.450185+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.461945+0000","last_change":"2021-01-28T03:55:55.556668+0000","last_active":"2021-01-28T03:56:35.461945+0000","last_peered":"2021-01-28T03:56:35.461945+0000","last_clean":"2021-01-28T03:56:35.461945+0000","last_became_active":"2021-01-28T03:55:55.556205+0000","last_became_peered":"2021-01-28T03:55:55.556205+0000","last_unstale":"2021-01-28T03:56:35.461945+0000","last_undegraded":"2021-01-28T03:56:35.461945+0000","last_fullsized":"2021-01-28T03:56:35.461945+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"58'21","reported_seq":"61","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.452186+0000","last_change":"2021-01-28T03:56:14.753418+0000","last_active":"2021-01-28T03:56:35.452186+0000","last_peered":"2021-01-28T03:56:35.452186+0000","last_clean":"2021-01-28T03:56:35.452186+0000","last_became_active":"2021-01-28T03:56:14.753023+0000","last_became_peered":"2021-01-28T03:56:14.753023+0000","last_unstale":"2021-01-28T03:56:35.452186+0000","last_undegraded":"2021-01-28T03:56:35.452186+0000","last_fullsized":"2021-01-28T03:56:35.452186+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1038,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":47,"num_read_kb":28,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.449766+0000","last_change":"2021-01-28T03:56:19.827959+0000","last_active":"2021-01-28T03:56:35.449766+0000","last_peered":"2021-01-28T03:56:35.449766+0000","last_clean":"2021-01-28T03:56:35.449766+0000","last_became_active":"2021-01-28T03:56:19.827598+0000","last_became_peered":"2021-01-28T03:56:19.827598+0000","last_unstale":"2021-01-28T03:56:35.449766+0000","last_undegraded":"2021-01-28T03:56:35.449766+0000","last_fullsized":"2021-01-28T03:56:35.449766+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.455699+0000","last_change":"2021-01-28T03:56:16.794407+0000","last_active":"2021-01-28T03:56:35.455699+0000","last_peered":"2021-01-28T03:56:35.455699+0000","last_clean":"2021-01-28T03:56:35.455699+0000","last_became_active":"2021-01-28T03:56:16.793999+0000","last_became_peered":"2021-01-28T03:56:16.793999+0000","last_unstale":"2021-01-28T03:56:35.455699+0000","last_undegraded":"2021-01-28T03:56:35.455699+0000","last_fullsized":"2021-01-28T03:56:35.455699+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"45'1","reported_seq":"26","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456721+0000","last_change":"2021-01-28T03:55:58.775266+0000","last_active":"2021-01-28T03:56:35.456721+0000","last_peered":"2021-01-28T03:56:35.456721+0000","last_clean":"2021-01-28T03:56:35.456721+0000","last_became_active":"2021-01-28T03:55:58.578028+0000","last_became_peered":"2021-01-28T03:55:58.578028+0000","last_unstale":"2021-01-28T03:56:35.456721+0000","last_undegraded":"2021-01-28T03:56:35.456721+0000","last_fullsized":"2021-01-28T03:56:35.456721+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"58'12","reported_seq":"45","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.452395+0000","last_change":"2021-01-28T03:56:14.761718+0000","last_active":"2021-01-28T03:56:35.452395+0000","last_peered":"2021-01-28T03:56:35.452395+0000","last_clean":"2021-01-28T03:56:35.452395+0000","last_became_active":"2021-01-28T03:56:14.761338+0000","last_became_peered":"2021-01-28T03:56:14.761338+0000","last_unstale":"2021-01-28T03:56:35.452395+0000","last_undegraded":"2021-01-28T03:56:35.452395+0000","last_fullsized":"2021-01-28T03:56:35.452395+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":264,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":13,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.455235+0000","last_change":"2021-01-28T03:56:19.837024+0000","last_active":"2021-01-28T03:56:35.455235+0000","last_peered":"2021-01-28T03:56:35.455235+0000","last_clean":"2021-01-28T03:56:35.455235+0000","last_became_active":"2021-01-28T03:56:19.836635+0000","last_became_peered":"2021-01-28T03:56:19.836635+0000","last_unstale":"2021-01-28T03:56:35.455235+0000","last_undegraded":"2021-01-28T03:56:35.455235+0000","last_fullsized":"2021-01-28T03:56:35.455235+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.450175+0000","last_change":"2021-01-28T03:56:16.785282+0000","last_active":"2021-01-28T03:56:35.450175+0000","last_peered":"2021-01-28T03:56:35.450175+0000","last_clean":"2021-01-28T03:56:35.450175+0000","last_became_active":"2021-01-28T03:56:16.784912+0000","last_became_peered":"2021-01-28T03:56:16.784912+0000","last_unstale":"2021-01-28T03:56:35.450175+0000","last_undegraded":"2021-01-28T03:56:35.450175+0000","last_fullsized":"2021-01-28T03:56:35.450175+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":"22","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.455968+0000","last_change":"2021-01-28T03:55:58.570675+0000","last_active":"2021-01-28T03:56:35.455968+0000","last_peered":"2021-01-28T03:56:35.455968+0000","last_clean":"2021-01-28T03:56:35.455968+0000","last_became_active":"2021-01-28T03:55:58.570180+0000","last_became_peered":"2021-01-28T03:55:58.570180+0000","last_unstale":"2021-01-28T03:56:35.455968+0000","last_undegraded":"2021-01-28T03:56:35.455968+0000","last_fullsized":"2021-01-28T03:56:35.455968+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"58'25","reported_seq":"72","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.452545+0000","last_change":"2021-01-28T03:56:14.757162+0000","last_active":"2021-01-28T03:56:35.452545+0000","last_peered":"2021-01-28T03:56:35.452545+0000","last_clean":"2021-01-28T03:56:35.452545+0000","last_became_active":"2021-01-28T03:56:14.756802+0000","last_became_peered":"2021-01-28T03:56:14.756802+0000","last_unstale":"2021-01-28T03:56:35.452545+0000","last_undegraded":"2021-01-28T03:56:35.452545+0000","last_fullsized":"2021-01-28T03:56:35.452545+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":734,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":37,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.462116+0000","last_change":"2021-01-28T03:56:19.835783+0000","last_active":"2021-01-28T03:56:35.462116+0000","last_peered":"2021-01-28T03:56:35.462116+0000","last_clean":"2021-01-28T03:56:35.462116+0000","last_became_active":"2021-01-28T03:56:19.835352+0000","last_became_peered":"2021-01-28T03:56:19.835352+0000","last_unstale":"2021-01-28T03:56:35.462116+0000","last_undegraded":"2021-01-28T03:56:35.462116+0000","last_fullsized":"2021-01-28T03:56:35.462116+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.452490+0000","last_change":"2021-01-28T03:56:16.780051+0000","last_active":"2021-01-28T03:56:35.452490+0000","last_peered":"2021-01-28T03:56:35.452490+0000","last_clean":"2021-01-28T03:56:35.452490+0000","last_became_active":"2021-01-28T03:56:16.779629+0000","last_became_peered":"2021-01-28T03:56:16.779629+0000","last_unstale":"2021-01-28T03:56:35.452490+0000","last_undegraded":"2021-01-28T03:56:35.452490+0000","last_fullsized":"2021-01-28T03:56:35.452490+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":"33","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.460973+0000","last_change":"2021-01-28T03:55:58.570120+0000","last_active":"2021-01-28T03:56:35.460973+0000","last_peered":"2021-01-28T03:56:35.460973+0000","last_clean":"2021-01-28T03:56:35.460973+0000","last_became_active":"2021-01-28T03:55:58.569777+0000","last_became_peered":"2021-01-28T03:55:58.569777+0000","last_unstale":"2021-01-28T03:56:35.460973+0000","last_undegraded":"2021-01-28T03:56:35.460973+0000","last_fullsized":"2021-01-28T03:56:35.460973+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"58'22","reported_seq":"64","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.461566+0000","last_change":"2021-01-28T03:56:14.757886+0000","last_active":"2021-01-28T03:56:35.461566+0000","last_peered":"2021-01-28T03:56:35.461566+0000","last_clean":"2021-01-28T03:56:35.461566+0000","last_became_active":"2021-01-28T03:56:14.757508+0000","last_became_peered":"2021-01-28T03:56:14.757508+0000","last_unstale":"2021-01-28T03:56:35.461566+0000","last_undegraded":"2021-01-28T03:56:35.461566+0000","last_fullsized":"2021-01-28T03:56:35.461566+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":844,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":49,"num_read_kb":31,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.453760+0000","last_change":"2021-01-28T03:56:19.816523+0000","last_active":"2021-01-28T03:56:35.453760+0000","last_peered":"2021-01-28T03:56:35.453760+0000","last_clean":"2021-01-28T03:56:35.453760+0000","last_became_active":"2021-01-28T03:56:19.815574+0000","last_became_peered":"2021-01-28T03:56:19.815574+0000","last_unstale":"2021-01-28T03:56:35.453760+0000","last_undegraded":"2021-01-28T03:56:35.453760+0000","last_fullsized":"2021-01-28T03:56:35.453760+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456810+0000","last_change":"2021-01-28T03:56:16.789988+0000","last_active":"2021-01-28T03:56:35.456810+0000","last_peered":"2021-01-28T03:56:35.456810+0000","last_clean":"2021-01-28T03:56:35.456810+0000","last_became_active":"2021-01-28T03:56:16.789528+0000","last_became_peered":"2021-01-28T03:56:16.789528+0000","last_unstale":"2021-01-28T03:56:35.456810+0000","last_undegraded":"2021-01-28T03:56:35.456810+0000","last_fullsized":"2021-01-28T03:56:35.456810+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":"34","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.459281+0000","last_change":"2021-01-28T03:55:58.564347+0000","last_active":"2021-01-28T03:56:35.459281+0000","last_peered":"2021-01-28T03:56:35.459281+0000","last_clean":"2021-01-28T03:56:35.459281+0000","last_became_active":"2021-01-28T03:55:58.563231+0000","last_became_peered":"2021-01-28T03:55:58.563231+0000","last_unstale":"2021-01-28T03:56:35.459281+0000","last_undegraded":"2021-01-28T03:56:35.459281+0000","last_fullsized":"2021-01-28T03:56:35.459281+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"58'15","reported_seq":"68","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-28T03:56:36.482241+0000","last_change":"2021-01-28T03:56:36.482241+0000","last_active":"2021-01-28T03:56:36.482241+0000","last_peered":"2021-01-28T03:56:36.482241+0000","last_clean":"2021-01-28T03:56:36.482241+0000","last_became_active":"2021-01-28T03:56:36.466100+0000","last_became_peered":"2021-01-28T03:56:36.466100+0000","last_unstale":"2021-01-28T03:56:36.482241+0000","last_undegraded":"2021-01-28T03:56:36.482241+0000","last_fullsized":"2021-01-28T03:56:36.482241+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3],"acting":[2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.455390+0000","last_change":"2021-01-28T03:56:19.819204+0000","last_active":"2021-01-28T03:56:35.455390+0000","last_peered":"2021-01-28T03:56:35.455390+0000","last_clean":"2021-01-28T03:56:35.455390+0000","last_became_active":"2021-01-28T03:56:19.818835+0000","last_became_peered":"2021-01-28T03:56:19.818835+0000","last_unstale":"2021-01-28T03:56:35.455390+0000","last_undegraded":"2021-01-28T03:56:35.455390+0000","last_fullsized":"2021-01-28T03:56:35.455390+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456493+0000","last_change":"2021-01-28T03:56:16.786784+0000","last_active":"2021-01-28T03:56:35.456493+0000","last_peered":"2021-01-28T03:56:35.456493+0000","last_clean":"2021-01-28T03:56:35.456493+0000","last_became_active":"2021-01-28T03:56:16.786354+0000","last_became_peered":"2021-01-28T03:56:16.786354+0000","last_unstale":"2021-01-28T03:56:35.456493+0000","last_undegraded":"2021-01-28T03:56:35.456493+0000","last_fullsized":"2021-01-28T03:56:35.456493+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"45'2","reported_seq":"33","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.460691+0000","last_change":"2021-01-28T03:55:55.556735+0000","last_active":"2021-01-28T03:56:35.460691+0000","last_peered":"2021-01-28T03:56:35.460691+0000","last_clean":"2021-01-28T03:56:35.460691+0000","last_became_active":"2021-01-28T03:55:55.556358+0000","last_became_peered":"2021-01-28T03:55:55.556358+0000","last_unstale":"2021-01-28T03:56:35.460691+0000","last_undegraded":"2021-01-28T03:56:35.460691+0000","last_fullsized":"2021-01-28T03:56:35.460691+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":105,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"58'23","reported_seq":"64","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.459293+0000","last_change":"2021-01-28T03:56:14.754717+0000","last_active":"2021-01-28T03:56:35.459293+0000","last_peered":"2021-01-28T03:56:35.459293+0000","last_clean":"2021-01-28T03:56:35.459293+0000","last_became_active":"2021-01-28T03:56:14.754321+0000","last_became_peered":"2021-01-28T03:56:14.754321+0000","last_unstale":"2021-01-28T03:56:35.459293+0000","last_undegraded":"2021-01-28T03:56:35.459293+0000","last_fullsized":"2021-01-28T03:56:35.459293+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1050,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":50,"num_read_kb":30,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456607+0000","last_change":"2021-01-28T03:56:19.826097+0000","last_active":"2021-01-28T03:56:35.456607+0000","last_peered":"2021-01-28T03:56:35.456607+0000","last_clean":"2021-01-28T03:56:35.456607+0000","last_became_active":"2021-01-28T03:56:19.825691+0000","last_became_peered":"2021-01-28T03:56:19.825691+0000","last_unstale":"2021-01-28T03:56:35.456607+0000","last_undegraded":"2021-01-28T03:56:35.456607+0000","last_fullsized":"2021-01-28T03:56:35.456607+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"53'2","reported_seq":"51","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-28T03:58:53.289334+0000","last_change":"2021-01-28T03:56:16.783964+0000","last_active":"2021-01-28T03:58:53.289334+0000","last_peered":"2021-01-28T03:58:53.289334+0000","last_clean":"2021-01-28T03:58:53.289334+0000","last_became_active":"2021-01-28T03:56:16.782967+0000","last_became_peered":"2021-01-28T03:56:16.782967+0000","last_unstale":"2021-01-28T03:58:53.289334+0000","last_undegraded":"2021-01-28T03:58:53.289334+0000","last_fullsized":"2021-01-28T03:58:53.289334+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"45'1","reported_seq":"40","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.449718+0000","last_change":"2021-01-28T03:55:58.580638+0000","last_active":"2021-01-28T03:56:35.449718+0000","last_peered":"2021-01-28T03:56:35.449718+0000","last_clean":"2021-01-28T03:56:35.449718+0000","last_became_active":"2021-01-28T03:55:58.563214+0000","last_became_peered":"2021-01-28T03:55:58.563214+0000","last_unstale":"2021-01-28T03:56:35.449718+0000","last_undegraded":"2021-01-28T03:56:35.449718+0000","last_fullsized":"2021-01-28T03:56:35.449718+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":247,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":247,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"58'22","reported_seq":"60","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456470+0000","last_change":"2021-01-28T03:56:15.155770+0000","last_active":"2021-01-28T03:56:35.456470+0000","last_peered":"2021-01-28T03:56:35.456470+0000","last_clean":"2021-01-28T03:56:35.456470+0000","last_became_active":"2021-01-28T03:56:15.154623+0000","last_became_peered":"2021-01-28T03:56:15.154623+0000","last_unstale":"2021-01-28T03:56:35.456470+0000","last_undegraded":"2021-01-28T03:56:35.456470+0000","last_fullsized":"2021-01-28T03:56:35.456470+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":934,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":45,"num_read_kb":27,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.461466+0000","last_change":"2021-01-28T03:56:19.825642+0000","last_active":"2021-01-28T03:56:35.461466+0000","last_peered":"2021-01-28T03:56:35.461466+0000","last_clean":"2021-01-28T03:56:35.461466+0000","last_became_active":"2021-01-28T03:56:19.825248+0000","last_became_peered":"2021-01-28T03:56:19.825248+0000","last_unstale":"2021-01-28T03:56:35.461466+0000","last_undegraded":"2021-01-28T03:56:35.461466+0000","last_fullsized":"2021-01-28T03:56:35.461466+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.455642+0000","last_change":"2021-01-28T03:56:16.793919+0000","last_active":"2021-01-28T03:56:35.455642+0000","last_peered":"2021-01-28T03:56:35.455642+0000","last_clean":"2021-01-28T03:56:35.455642+0000","last_became_active":"2021-01-28T03:56:16.793569+0000","last_became_peered":"2021-01-28T03:56:16.793569+0000","last_unstale":"2021-01-28T03:56:35.455642+0000","last_undegraded":"2021-01-28T03:56:35.455642+0000","last_fullsized":"2021-01-28T03:56:35.455642+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"45'1","reported_seq":"30","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.459377+0000","last_change":"2021-01-28T03:55:57.661137+0000","last_active":"2021-01-28T03:56:35.459377+0000","last_peered":"2021-01-28T03:56:35.459377+0000","last_clean":"2021-01-28T03:56:35.459377+0000","last_became_active":"2021-01-28T03:55:57.563002+0000","last_became_peered":"2021-01-28T03:55:57.563002+0000","last_unstale":"2021-01-28T03:56:35.459377+0000","last_undegraded":"2021-01-28T03:56:35.459377+0000","last_fullsized":"2021-01-28T03:56:35.459377+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"58'20","reported_seq":"58","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.460947+0000","last_change":"2021-01-28T03:56:15.153269+0000","last_active":"2021-01-28T03:56:35.460947+0000","last_peered":"2021-01-28T03:56:35.460947+0000","last_clean":"2021-01-28T03:56:35.460947+0000","last_became_active":"2021-01-28T03:56:15.151996+0000","last_became_peered":"2021-01-28T03:56:15.151996+0000","last_unstale":"2021-01-28T03:56:35.460947+0000","last_undegraded":"2021-01-28T03:56:35.460947+0000","last_fullsized":"2021-01-28T03:56:35.460947+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":580,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":41,"num_read_kb":27,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.454656+0000","last_change":"2021-01-28T03:56:19.826563+0000","last_active":"2021-01-28T03:56:35.454656+0000","last_peered":"2021-01-28T03:56:35.454656+0000","last_clean":"2021-01-28T03:56:35.454656+0000","last_became_active":"2021-01-28T03:56:19.826222+0000","last_became_peered":"2021-01-28T03:56:19.826222+0000","last_unstale":"2021-01-28T03:56:35.454656+0000","last_undegraded":"2021-01-28T03:56:35.454656+0000","last_fullsized":"2021-01-28T03:56:35.454656+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.455038+0000","last_change":"2021-01-28T03:56:16.783092+0000","last_active":"2021-01-28T03:56:35.455038+0000","last_peered":"2021-01-28T03:56:35.455038+0000","last_clean":"2021-01-28T03:56:35.455038+0000","last_became_active":"2021-01-28T03:56:16.782620+0000","last_became_peered":"2021-01-28T03:56:16.782620+0000","last_unstale":"2021-01-28T03:56:35.455038+0000","last_undegraded":"2021-01-28T03:56:35.455038+0000","last_fullsized":"2021-01-28T03:56:35.455038+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.451066+0000","last_change":"2021-01-28T03:55:55.543694+0000","last_active":"2021-01-28T03:56:35.451066+0000","last_peered":"2021-01-28T03:56:35.451066+0000","last_clean":"2021-01-28T03:56:35.451066+0000","last_became_active":"2021-01-28T03:55:55.542261+0000","last_became_peered":"2021-01-28T03:55:55.542261+0000","last_unstale":"2021-01-28T03:56:35.451066+0000","last_undegraded":"2021-01-28T03:56:35.451066+0000","last_fullsized":"2021-01-28T03:56:35.451066+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"58'12","reported_seq":"40","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.460637+0000","last_change":"2021-01-28T03:56:14.756411+0000","last_active":"2021-01-28T03:56:35.460637+0000","last_peered":"2021-01-28T03:56:35.460637+0000","last_clean":"2021-01-28T03:56:35.460637+0000","last_became_active":"2021-01-28T03:56:14.756049+0000","last_became_peered":"2021-01-28T03:56:14.756049+0000","last_unstale":"2021-01-28T03:56:35.460637+0000","last_undegraded":"2021-01-28T03:56:35.460637+0000","last_fullsized":"2021-01-28T03:56:35.460637+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1252,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":30,"num_read_kb":12,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.460572+0000","last_change":"2021-01-28T03:56:19.831977+0000","last_active":"2021-01-28T03:56:35.460572+0000","last_peered":"2021-01-28T03:56:35.460572+0000","last_clean":"2021-01-28T03:56:35.460572+0000","last_became_active":"2021-01-28T03:56:19.831582+0000","last_became_peered":"2021-01-28T03:56:19.831582+0000","last_unstale":"2021-01-28T03:56:35.460572+0000","last_undegraded":"2021-01-28T03:56:35.460572+0000","last_fullsized":"2021-01-28T03:56:35.460572+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.449634+0000","last_change":"2021-01-28T03:56:16.787817+0000","last_active":"2021-01-28T03:56:35.449634+0000","last_peered":"2021-01-28T03:56:35.449634+0000","last_clean":"2021-01-28T03:56:35.449634+0000","last_became_active":"2021-01-28T03:56:16.787371+0000","last_became_peered":"2021-01-28T03:56:16.787371+0000","last_unstale":"2021-01-28T03:56:35.449634+0000","last_undegraded":"2021-01-28T03:56:35.449634+0000","last_fullsized":"2021-01-28T03:56:35.449634+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456708+0000","last_change":"2021-01-28T03:55:55.547287+0000","last_active":"2021-01-28T03:56:35.456708+0000","last_peered":"2021-01-28T03:56:35.456708+0000","last_clean":"2021-01-28T03:56:35.456708+0000","last_became_active":"2021-01-28T03:55:55.546816+0000","last_became_peered":"2021-01-28T03:55:55.546816+0000","last_unstale":"2021-01-28T03:56:35.456708+0000","last_undegraded":"2021-01-28T03:56:35.456708+0000","last_fullsized":"2021-01-28T03:56:35.456708+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"58'15","reported_seq":"45","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.452557+0000","last_change":"2021-01-28T03:56:14.753594+0000","last_active":"2021-01-28T03:56:35.452557+0000","last_peered":"2021-01-28T03:56:35.452557+0000","last_clean":"2021-01-28T03:56:35.452557+0000","last_became_active":"2021-01-28T03:56:14.753222+0000","last_became_peered":"2021-01-28T03:56:14.753222+0000","last_unstale":"2021-01-28T03:56:35.452557+0000","last_undegraded":"2021-01-28T03:56:35.452557+0000","last_fullsized":"2021-01-28T03:56:35.452557+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":736,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":17,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.454407+0000","last_change":"2021-01-28T03:56:19.836277+0000","last_active":"2021-01-28T03:56:35.454407+0000","last_peered":"2021-01-28T03:56:35.454407+0000","last_clean":"2021-01-28T03:56:35.454407+0000","last_became_active":"2021-01-28T03:56:19.835858+0000","last_became_peered":"2021-01-28T03:56:19.835858+0000","last_unstale":"2021-01-28T03:56:35.454407+0000","last_undegraded":"2021-01-28T03:56:35.454407+0000","last_fullsized":"2021-01-28T03:56:35.454407+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.461355+0000","last_change":"2021-01-28T03:56:16.784298+0000","last_active":"2021-01-28T03:56:35.461355+0000","last_peered":"2021-01-28T03:56:35.461355+0000","last_clean":"2021-01-28T03:56:35.461355+0000","last_became_active":"2021-01-28T03:56:16.783961+0000","last_became_peered":"2021-01-28T03:56:16.783961+0000","last_unstale":"2021-01-28T03:56:35.461355+0000","last_undegraded":"2021-01-28T03:56:35.461355+0000","last_fullsized":"2021-01-28T03:56:35.461355+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456026+0000","last_change":"2021-01-28T03:55:55.551511+0000","last_active":"2021-01-28T03:56:35.456026+0000","last_peered":"2021-01-28T03:56:35.456026+0000","last_clean":"2021-01-28T03:56:35.456026+0000","last_became_active":"2021-01-28T03:55:55.551035+0000","last_became_peered":"2021-01-28T03:55:55.551035+0000","last_unstale":"2021-01-28T03:56:35.456026+0000","last_undegraded":"2021-01-28T03:56:35.456026+0000","last_fullsized":"2021-01-28T03:56:35.456026+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"58'15","reported_seq":"32","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-28T03:56:36.489698+0000","last_change":"2021-01-28T03:56:36.489698+0000","last_active":"2021-01-28T03:56:36.489698+0000","last_peered":"2021-01-28T03:56:36.489698+0000","last_clean":"2021-01-28T03:56:36.489698+0000","last_became_active":"2021-01-28T03:56:36.468161+0000","last_became_peered":"2021-01-28T03:56:36.468161+0000","last_unstale":"2021-01-28T03:56:36.489698+0000","last_undegraded":"2021-01-28T03:56:36.489698+0000","last_fullsized":"2021-01-28T03:56:36.489698+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1050,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":35,"num_read_kb":17,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1050,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.452969+0000","last_change":"2021-01-28T03:56:19.825052+0000","last_active":"2021-01-28T03:56:35.452969+0000","last_peered":"2021-01-28T03:56:35.452969+0000","last_clean":"2021-01-28T03:56:35.452969+0000","last_became_active":"2021-01-28T03:56:19.824683+0000","last_became_peered":"2021-01-28T03:56:19.824683+0000","last_unstale":"2021-01-28T03:56:35.452969+0000","last_undegraded":"2021-01-28T03:56:35.452969+0000","last_fullsized":"2021-01-28T03:56:35.452969+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"53'2","reported_seq":"52","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-28T03:58:58.293026+0000","last_change":"2021-01-28T03:56:16.779379+0000","last_active":"2021-01-28T03:58:58.293026+0000","last_peered":"2021-01-28T03:58:58.293026+0000","last_clean":"2021-01-28T03:58:58.293026+0000","last_became_active":"2021-01-28T03:56:16.779013+0000","last_became_peered":"2021-01-28T03:56:16.779013+0000","last_unstale":"2021-01-28T03:58:58.293026+0000","last_undegraded":"2021-01-28T03:58:58.293026+0000","last_fullsized":"2021-01-28T03:58:58.293026+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456947+0000","last_change":"2021-01-28T03:55:55.550746+0000","last_active":"2021-01-28T03:56:35.456947+0000","last_peered":"2021-01-28T03:56:35.456947+0000","last_clean":"2021-01-28T03:56:35.456947+0000","last_became_active":"2021-01-28T03:55:55.550330+0000","last_became_peered":"2021-01-28T03:55:55.550330+0000","last_unstale":"2021-01-28T03:56:35.456947+0000","last_undegraded":"2021-01-28T03:56:35.456947+0000","last_fullsized":"2021-01-28T03:56:35.456947+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"58'19","reported_seq":"57","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.450766+0000","last_change":"2021-01-28T03:56:15.151801+0000","last_active":"2021-01-28T03:56:35.450766+0000","last_peered":"2021-01-28T03:56:35.450766+0000","last_clean":"2021-01-28T03:56:35.450766+0000","last_became_active":"2021-01-28T03:56:15.151187+0000","last_became_peered":"2021-01-28T03:56:15.151187+0000","last_unstale":"2021-01-28T03:56:35.450766+0000","last_undegraded":"2021-01-28T03:56:35.450766+0000","last_fullsized":"2021-01-28T03:56:35.450766+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":734,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":41,"num_read_kb":26,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456140+0000","last_change":"2021-01-28T03:56:19.828334+0000","last_active":"2021-01-28T03:56:35.456140+0000","last_peered":"2021-01-28T03:56:35.456140+0000","last_clean":"2021-01-28T03:56:35.456140+0000","last_became_active":"2021-01-28T03:56:19.827824+0000","last_became_peered":"2021-01-28T03:56:19.827824+0000","last_unstale":"2021-01-28T03:56:35.456140+0000","last_undegraded":"2021-01-28T03:56:35.456140+0000","last_fullsized":"2021-01-28T03:56:35.456140+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"53'2","reported_seq":"51","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-28T03:58:53.289260+0000","last_change":"2021-01-28T03:56:16.784560+0000","last_active":"2021-01-28T03:58:53.289260+0000","last_peered":"2021-01-28T03:58:53.289260+0000","last_clean":"2021-01-28T03:58:53.289260+0000","last_became_active":"2021-01-28T03:56:16.784236+0000","last_became_peered":"2021-01-28T03:56:16.784236+0000","last_unstale":"2021-01-28T03:58:53.289260+0000","last_undegraded":"2021-01-28T03:58:53.289260+0000","last_fullsized":"2021-01-28T03:58:53.289260+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"45'2","reported_seq":"43","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.450029+0000","last_change":"2021-01-28T03:55:58.634920+0000","last_active":"2021-01-28T03:56:35.450029+0000","last_peered":"2021-01-28T03:56:35.450029+0000","last_clean":"2021-01-28T03:56:35.450029+0000","last_became_active":"2021-01-28T03:55:58.565624+0000","last_became_peered":"2021-01-28T03:55:58.565624+0000","last_unstale":"2021-01-28T03:56:35.450029+0000","last_undegraded":"2021-01-28T03:56:35.450029+0000","last_fullsized":"2021-01-28T03:56:35.450029+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"58'26","reported_seq":"71","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.461512+0000","last_change":"2021-01-28T03:56:15.152759+0000","last_active":"2021-01-28T03:56:35.461512+0000","last_peered":"2021-01-28T03:56:35.461512+0000","last_clean":"2021-01-28T03:56:35.461512+0000","last_became_active":"2021-01-28T03:56:15.151790+0000","last_became_peered":"2021-01-28T03:56:15.151790+0000","last_unstale":"2021-01-28T03:56:35.461512+0000","last_undegraded":"2021-01-28T03:56:35.461512+0000","last_fullsized":"2021-01-28T03:56:35.461512+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":26,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":624,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456514+0000","last_change":"2021-01-28T03:56:19.831858+0000","last_active":"2021-01-28T03:56:35.456514+0000","last_peered":"2021-01-28T03:56:35.456514+0000","last_clean":"2021-01-28T03:56:35.456514+0000","last_became_active":"2021-01-28T03:56:19.831556+0000","last_became_peered":"2021-01-28T03:56:19.831556+0000","last_unstale":"2021-01-28T03:56:35.456514+0000","last_undegraded":"2021-01-28T03:56:35.456514+0000","last_fullsized":"2021-01-28T03:56:35.456514+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.451003+0000","last_change":"2021-01-28T03:56:16.783214+0000","last_active":"2021-01-28T03:56:35.451003+0000","last_peered":"2021-01-28T03:56:35.451003+0000","last_clean":"2021-01-28T03:56:35.451003+0000","last_became_active":"2021-01-28T03:56:16.782839+0000","last_became_peered":"2021-01-28T03:56:16.782839+0000","last_unstale":"2021-01-28T03:56:35.451003+0000","last_undegraded":"2021-01-28T03:56:35.451003+0000","last_fullsized":"2021-01-28T03:56:35.451003+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"48'1","reported_seq":"26","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.455097+0000","last_change":"2021-01-28T03:55:55.548393+0000","last_active":"2021-01-28T03:56:35.455097+0000","last_peered":"2021-01-28T03:56:35.455097+0000","last_clean":"2021-01-28T03:56:35.455097+0000","last_became_active":"2021-01-28T03:55:55.547995+0000","last_became_peered":"2021-01-28T03:55:55.547995+0000","last_unstale":"2021-01-28T03:56:35.455097+0000","last_undegraded":"2021-01-28T03:56:35.455097+0000","last_fullsized":"2021-01-28T03:56:35.455097+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"58'13","reported_seq":"44","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.462031+0000","last_change":"2021-01-28T03:56:15.151515+0000","last_active":"2021-01-28T03:56:35.462031+0000","last_peered":"2021-01-28T03:56:35.462031+0000","last_clean":"2021-01-28T03:56:35.462031+0000","last_became_active":"2021-01-28T03:56:15.150837+0000","last_became_peered":"2021-01-28T03:56:15.150837+0000","last_unstale":"2021-01-28T03:56:35.462031+0000","last_undegraded":"2021-01-28T03:56:35.462031+0000","last_fullsized":"2021-01-28T03:56:35.462031+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":158,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.454718+0000","last_change":"2021-01-28T03:56:19.823244+0000","last_active":"2021-01-28T03:56:35.454718+0000","last_peered":"2021-01-28T03:56:35.454718+0000","last_clean":"2021-01-28T03:56:35.454718+0000","last_became_active":"2021-01-28T03:56:19.822914+0000","last_became_peered":"2021-01-28T03:56:19.822914+0000","last_unstale":"2021-01-28T03:56:35.454718+0000","last_undegraded":"2021-01-28T03:56:35.454718+0000","last_fullsized":"2021-01-28T03:56:35.454718+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.462223+0000","last_change":"2021-01-28T03:56:16.781039+0000","last_active":"2021-01-28T03:56:35.462223+0000","last_peered":"2021-01-28T03:56:35.462223+0000","last_clean":"2021-01-28T03:56:35.462223+0000","last_became_active":"2021-01-28T03:56:16.780638+0000","last_became_peered":"2021-01-28T03:56:16.780638+0000","last_unstale":"2021-01-28T03:56:35.462223+0000","last_undegraded":"2021-01-28T03:56:35.462223+0000","last_fullsized":"2021-01-28T03:56:35.462223+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.452015+0000","last_change":"2021-01-28T03:55:55.559428+0000","last_active":"2021-01-28T03:56:35.452015+0000","last_peered":"2021-01-28T03:56:35.452015+0000","last_clean":"2021-01-28T03:56:35.452015+0000","last_became_active":"2021-01-28T03:55:55.559052+0000","last_became_peered":"2021-01-28T03:55:55.559052+0000","last_unstale":"2021-01-28T03:56:35.452015+0000","last_undegraded":"2021-01-28T03:56:35.452015+0000","last_fullsized":"2021-01-28T03:56:35.452015+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"58'28","reported_seq":"78","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456307+0000","last_change":"2021-01-28T03:56:15.154421+0000","last_active":"2021-01-28T03:56:35.456307+0000","last_peered":"2021-01-28T03:56:35.456307+0000","last_clean":"2021-01-28T03:56:35.456307+0000","last_became_active":"2021-01-28T03:56:15.153142+0000","last_became_peered":"2021-01-28T03:56:15.153142+0000","last_unstale":"2021-01-28T03:56:35.456307+0000","last_undegraded":"2021-01-28T03:56:35.456307+0000","last_fullsized":"2021-01-28T03:56:35.456307+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1206,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":62,"num_read_kb":40,"num_write":29,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.461422+0000","last_change":"2021-01-28T03:56:19.832832+0000","last_active":"2021-01-28T03:56:35.461422+0000","last_peered":"2021-01-28T03:56:35.461422+0000","last_clean":"2021-01-28T03:56:35.461422+0000","last_became_active":"2021-01-28T03:56:19.831106+0000","last_became_peered":"2021-01-28T03:56:19.831106+0000","last_unstale":"2021-01-28T03:56:35.461422+0000","last_undegraded":"2021-01-28T03:56:35.461422+0000","last_fullsized":"2021-01-28T03:56:35.461422+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"48'1","reported_seq":"36","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.452837+0000","last_change":"2021-01-28T03:55:58.574724+0000","last_active":"2021-01-28T03:56:35.452837+0000","last_peered":"2021-01-28T03:56:35.452837+0000","last_clean":"2021-01-28T03:56:35.452837+0000","last_became_active":"2021-01-28T03:55:58.574408+0000","last_became_peered":"2021-01-28T03:55:58.574408+0000","last_unstale":"2021-01-28T03:56:35.452837+0000","last_undegraded":"2021-01-28T03:56:35.452837+0000","last_fullsized":"2021-01-28T03:56:35.452837+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"58'28","reported_seq":"78","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.452245+0000","last_change":"2021-01-28T03:56:14.761991+0000","last_active":"2021-01-28T03:56:35.452245+0000","last_peered":"2021-01-28T03:56:35.452245+0000","last_clean":"2021-01-28T03:56:35.452245+0000","last_became_active":"2021-01-28T03:56:14.761522+0000","last_became_peered":"2021-01-28T03:56:14.761522+0000","last_unstale":"2021-01-28T03:56:35.452245+0000","last_undegraded":"2021-01-28T03:56:35.452245+0000","last_fullsized":"2021-01-28T03:56:35.452245+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":28,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":692,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":58,"num_read_kb":41,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.451971+0000","last_change":"2021-01-28T03:56:16.784338+0000","last_active":"2021-01-28T03:56:35.451971+0000","last_peered":"2021-01-28T03:56:35.451971+0000","last_clean":"2021-01-28T03:56:35.451971+0000","last_became_active":"2021-01-28T03:56:16.783954+0000","last_became_peered":"2021-01-28T03:56:16.783954+0000","last_unstale":"2021-01-28T03:56:35.451971+0000","last_undegraded":"2021-01-28T03:56:35.451971+0000","last_fullsized":"2021-01-28T03:56:35.451971+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.454468+0000","last_change":"2021-01-28T03:56:19.825785+0000","last_active":"2021-01-28T03:56:35.454468+0000","last_peered":"2021-01-28T03:56:35.454468+0000","last_clean":"2021-01-28T03:56:35.454468+0000","last_became_active":"2021-01-28T03:56:19.825390+0000","last_became_peered":"2021-01-28T03:56:19.825390+0000","last_unstale":"2021-01-28T03:56:35.454468+0000","last_undegraded":"2021-01-28T03:56:35.454468+0000","last_fullsized":"2021-01-28T03:56:35.454468+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"33","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456113+0000","last_change":"2021-01-28T03:55:58.573472+0000","last_active":"2021-01-28T03:56:35.456113+0000","last_peered":"2021-01-28T03:56:35.456113+0000","last_clean":"2021-01-28T03:56:35.456113+0000","last_became_active":"2021-01-28T03:55:58.572831+0000","last_became_peered":"2021-01-28T03:55:58.572831+0000","last_unstale":"2021-01-28T03:56:35.456113+0000","last_undegraded":"2021-01-28T03:56:35.456113+0000","last_fullsized":"2021-01-28T03:56:35.456113+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"58'22","reported_seq":"60","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.449469+0000","last_change":"2021-01-28T03:56:14.758598+0000","last_active":"2021-01-28T03:56:35.449469+0000","last_peered":"2021-01-28T03:56:35.449469+0000","last_clean":"2021-01-28T03:56:35.449469+0000","last_became_active":"2021-01-28T03:56:14.756851+0000","last_became_peered":"2021-01-28T03:56:14.756851+0000","last_unstale":"2021-01-28T03:56:35.449469+0000","last_undegraded":"2021-01-28T03:56:35.449469+0000","last_fullsized":"2021-01-28T03:56:35.449469+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":940,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":45,"num_read_kb":27,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"53'2","reported_seq":"52","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-28T03:58:58.292991+0000","last_change":"2021-01-28T03:56:16.787368+0000","last_active":"2021-01-28T03:58:58.292991+0000","last_peered":"2021-01-28T03:58:58.292991+0000","last_clean":"2021-01-28T03:58:58.292991+0000","last_became_active":"2021-01-28T03:56:16.786950+0000","last_became_peered":"2021-01-28T03:56:16.786950+0000","last_unstale":"2021-01-28T03:58:58.292991+0000","last_undegraded":"2021-01-28T03:58:58.292991+0000","last_fullsized":"2021-01-28T03:58:58.292991+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.462030+0000","last_change":"2021-01-28T03:56:19.828198+0000","last_active":"2021-01-28T03:56:35.462030+0000","last_peered":"2021-01-28T03:56:35.462030+0000","last_clean":"2021-01-28T03:56:35.462030+0000","last_became_active":"2021-01-28T03:56:19.827773+0000","last_became_peered":"2021-01-28T03:56:19.827773+0000","last_unstale":"2021-01-28T03:56:35.462030+0000","last_undegraded":"2021-01-28T03:56:35.462030+0000","last_fullsized":"2021-01-28T03:56:35.462030+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.450143+0000","last_change":"2021-01-28T03:55:55.544863+0000","last_active":"2021-01-28T03:56:35.450143+0000","last_peered":"2021-01-28T03:56:35.450143+0000","last_clean":"2021-01-28T03:56:35.450143+0000","last_became_active":"2021-01-28T03:55:55.544376+0000","last_became_peered":"2021-01-28T03:55:55.544376+0000","last_unstale":"2021-01-28T03:56:35.450143+0000","last_undegraded":"2021-01-28T03:56:35.450143+0000","last_fullsized":"2021-01-28T03:56:35.450143+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"58'31","reported_seq":"80","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456209+0000","last_change":"2021-01-28T03:56:14.749365+0000","last_active":"2021-01-28T03:56:35.456209+0000","last_peered":"2021-01-28T03:56:35.456209+0000","last_clean":"2021-01-28T03:56:35.456209+0000","last_became_active":"2021-01-28T03:56:14.748983+0000","last_became_peered":"2021-01-28T03:56:14.748983+0000","last_unstale":"2021-01-28T03:56:35.456209+0000","last_undegraded":"2021-01-28T03:56:35.456209+0000","last_fullsized":"2021-01-28T03:56:35.456209+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":954,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":66,"num_read_kb":42,"num_write":34,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456260+0000","last_change":"2021-01-28T03:56:16.795009+0000","last_active":"2021-01-28T03:56:35.456260+0000","last_peered":"2021-01-28T03:56:35.456260+0000","last_clean":"2021-01-28T03:56:35.456260+0000","last_became_active":"2021-01-28T03:56:16.794642+0000","last_became_peered":"2021-01-28T03:56:16.794642+0000","last_unstale":"2021-01-28T03:56:35.456260+0000","last_undegraded":"2021-01-28T03:56:35.456260+0000","last_fullsized":"2021-01-28T03:56:35.456260+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456789+0000","last_change":"2021-01-28T03:56:19.833929+0000","last_active":"2021-01-28T03:56:35.456789+0000","last_peered":"2021-01-28T03:56:35.456789+0000","last_clean":"2021-01-28T03:56:35.456789+0000","last_became_active":"2021-01-28T03:56:19.833476+0000","last_became_peered":"2021-01-28T03:56:19.833476+0000","last_unstale":"2021-01-28T03:56:35.456789+0000","last_undegraded":"2021-01-28T03:56:35.456789+0000","last_fullsized":"2021-01-28T03:56:35.456789+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"58'5","reported_seq":"180","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-28T03:59:00.854804+0000","last_change":"2021-01-28T03:56:13.744444+0000","last_active":"2021-01-28T03:59:00.854804+0000","last_peered":"2021-01-28T03:59:00.854804+0000","last_clean":"2021-01-28T03:59:00.854804+0000","last_became_active":"2021-01-28T03:56:13.744099+0000","last_became_peered":"2021-01-28T03:56:13.744099+0000","last_unstale":"2021-01-28T03:59:00.854804+0000","last_undegraded":"2021-01-28T03:59:00.854804+0000","last_fullsized":"2021-01-28T03:59:00.854804+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:12.703742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:12.703742+0000","last_clean_scrub_stamp":"2021-01-28T03:56:12.703742+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":158,"num_read_kb":153,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.451296+0000","last_change":"2021-01-28T03:55:55.550152+0000","last_active":"2021-01-28T03:56:35.451296+0000","last_peered":"2021-01-28T03:56:35.451296+0000","last_clean":"2021-01-28T03:56:35.451296+0000","last_became_active":"2021-01-28T03:55:55.549402+0000","last_became_peered":"2021-01-28T03:55:55.549402+0000","last_unstale":"2021-01-28T03:56:35.451296+0000","last_undegraded":"2021-01-28T03:56:35.451296+0000","last_fullsized":"2021-01-28T03:56:35.451296+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"58'21","reported_seq":"64","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456015+0000","last_change":"2021-01-28T03:56:14.751626+0000","last_active":"2021-01-28T03:56:35.456015+0000","last_peered":"2021-01-28T03:56:35.456015+0000","last_clean":"2021-01-28T03:56:35.456015+0000","last_became_active":"2021-01-28T03:56:14.751103+0000","last_became_peered":"2021-01-28T03:56:14.751103+0000","last_unstale":"2021-01-28T03:56:35.456015+0000","last_undegraded":"2021-01-28T03:56:35.456015+0000","last_fullsized":"2021-01-28T03:56:35.456015+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":48,"num_read_kb":32,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.455268+0000","last_change":"2021-01-28T03:56:16.783376+0000","last_active":"2021-01-28T03:56:35.455268+0000","last_peered":"2021-01-28T03:56:35.455268+0000","last_clean":"2021-01-28T03:56:35.455268+0000","last_became_active":"2021-01-28T03:56:16.782951+0000","last_became_peered":"2021-01-28T03:56:16.782951+0000","last_unstale":"2021-01-28T03:56:35.455268+0000","last_undegraded":"2021-01-28T03:56:35.455268+0000","last_fullsized":"2021-01-28T03:56:35.455268+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.451432+0000","last_change":"2021-01-28T03:56:19.833759+0000","last_active":"2021-01-28T03:56:35.451432+0000","last_peered":"2021-01-28T03:56:35.451432+0000","last_clean":"2021-01-28T03:56:35.451432+0000","last_became_active":"2021-01-28T03:56:19.833411+0000","last_became_peered":"2021-01-28T03:56:19.833411+0000","last_unstale":"2021-01-28T03:56:35.451432+0000","last_undegraded":"2021-01-28T03:56:35.451432+0000","last_fullsized":"2021-01-28T03:56:35.451432+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"19","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.461007+0000","last_change":"2021-01-28T03:56:13.743882+0000","last_active":"2021-01-28T03:56:35.461007+0000","last_peered":"2021-01-28T03:56:35.461007+0000","last_clean":"2021-01-28T03:56:35.461007+0000","last_became_active":"2021-01-28T03:56:13.743498+0000","last_became_peered":"2021-01-28T03:56:13.743498+0000","last_unstale":"2021-01-28T03:56:35.461007+0000","last_undegraded":"2021-01-28T03:56:35.461007+0000","last_fullsized":"2021-01-28T03:56:35.461007+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:12.703742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:12.703742+0000","last_clean_scrub_stamp":"2021-01-28T03:56:12.703742+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"34","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.449980+0000","last_change":"2021-01-28T03:55:58.564836+0000","last_active":"2021-01-28T03:56:35.449980+0000","last_peered":"2021-01-28T03:56:35.449980+0000","last_clean":"2021-01-28T03:56:35.449980+0000","last_became_active":"2021-01-28T03:55:58.564292+0000","last_became_peered":"2021-01-28T03:55:58.564292+0000","last_unstale":"2021-01-28T03:56:35.449980+0000","last_undegraded":"2021-01-28T03:56:35.449980+0000","last_fullsized":"2021-01-28T03:56:35.449980+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"22","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.455610+0000","last_change":"2021-01-28T03:55:58.570710+0000","last_active":"2021-01-28T03:56:35.455610+0000","last_peered":"2021-01-28T03:56:35.455610+0000","last_clean":"2021-01-28T03:56:35.455610+0000","last_became_active":"2021-01-28T03:55:58.568608+0000","last_became_peered":"2021-01-28T03:55:58.568608+0000","last_unstale":"2021-01-28T03:56:35.455610+0000","last_undegraded":"2021-01-28T03:56:35.455610+0000","last_fullsized":"2021-01-28T03:56:35.455610+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":5,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:51:28.488605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:51:28.488605+0000","last_clean_scrub_stamp":"2021-01-28T03:51:28.488605+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"58'15","reported_seq":"42","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.459134+0000","last_change":"2021-01-28T03:56:15.151881+0000","last_active":"2021-01-28T03:56:35.459134+0000","last_peered":"2021-01-28T03:56:35.459134+0000","last_clean":"2021-01-28T03:56:35.459134+0000","last_became_active":"2021-01-28T03:56:15.151201+0000","last_became_peered":"2021-01-28T03:56:15.151201+0000","last_unstale":"2021-01-28T03:56:35.459134+0000","last_undegraded":"2021-01-28T03:56:35.459134+0000","last_fullsized":"2021-01-28T03:56:35.459134+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":466,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":15,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456506+0000","last_change":"2021-01-28T03:56:16.780118+0000","last_active":"2021-01-28T03:56:35.456506+0000","last_peered":"2021-01-28T03:56:35.456506+0000","last_clean":"2021-01-28T03:56:35.456506+0000","last_became_active":"2021-01-28T03:56:16.779740+0000","last_became_peered":"2021-01-28T03:56:16.779740+0000","last_unstale":"2021-01-28T03:56:35.456506+0000","last_undegraded":"2021-01-28T03:56:35.456506+0000","last_fullsized":"2021-01-28T03:56:35.456506+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456462+0000","last_change":"2021-01-28T03:56:19.826459+0000","last_active":"2021-01-28T03:56:35.456462+0000","last_peered":"2021-01-28T03:56:35.456462+0000","last_clean":"2021-01-28T03:56:35.456462+0000","last_became_active":"2021-01-28T03:56:19.826153+0000","last_became_peered":"2021-01-28T03:56:19.826153+0000","last_unstale":"2021-01-28T03:56:35.456462+0000","last_undegraded":"2021-01-28T03:56:35.456462+0000","last_fullsized":"2021-01-28T03:56:35.456462+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"19","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456652+0000","last_change":"2021-01-28T03:56:13.744775+0000","last_active":"2021-01-28T03:56:35.456652+0000","last_peered":"2021-01-28T03:56:35.456652+0000","last_clean":"2021-01-28T03:56:35.456652+0000","last_became_active":"2021-01-28T03:56:13.744248+0000","last_became_peered":"2021-01-28T03:56:13.744248+0000","last_unstale":"2021-01-28T03:56:35.456652+0000","last_undegraded":"2021-01-28T03:56:35.456652+0000","last_fullsized":"2021-01-28T03:56:35.456652+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:12.703742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:12.703742+0000","last_clean_scrub_stamp":"2021-01-28T03:56:12.703742+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"60'3","reported_seq":"45","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-28T03:58:57.132482+0000","last_change":"2021-01-28T03:56:36.519203+0000","last_active":"2021-01-28T03:58:57.132482+0000","last_peered":"2021-01-28T03:58:57.132482+0000","last_clean":"2021-01-28T03:58:57.132482+0000","last_became_active":"2021-01-28T03:56:36.467735+0000","last_became_peered":"2021-01-28T03:56:36.467735+0000","last_unstale":"2021-01-28T03:58:57.132482+0000","last_undegraded":"2021-01-28T03:58:57.132482+0000","last_fullsized":"2021-01-28T03:58:57.132482+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"58'16","reported_seq":"44","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456225+0000","last_change":"2021-01-28T03:56:14.754652+0000","last_active":"2021-01-28T03:56:35.456225+0000","last_peered":"2021-01-28T03:56:35.456225+0000","last_clean":"2021-01-28T03:56:35.456225+0000","last_became_active":"2021-01-28T03:56:14.754264+0000","last_became_peered":"2021-01-28T03:56:14.754264+0000","last_unstale":"2021-01-28T03:56:35.456225+0000","last_undegraded":"2021-01-28T03:56:35.456225+0000","last_fullsized":"2021-01-28T03:56:35.456225+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":630,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":30,"num_read_kb":16,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.451335+0000","last_change":"2021-01-28T03:56:16.784874+0000","last_active":"2021-01-28T03:56:35.451335+0000","last_peered":"2021-01-28T03:56:35.451335+0000","last_clean":"2021-01-28T03:56:35.451335+0000","last_became_active":"2021-01-28T03:56:16.784433+0000","last_became_peered":"2021-01-28T03:56:16.784433+0000","last_unstale":"2021-01-28T03:56:35.451335+0000","last_undegraded":"2021-01-28T03:56:35.451335+0000","last_fullsized":"2021-01-28T03:56:35.451335+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.449985+0000","last_change":"2021-01-28T03:56:19.818126+0000","last_active":"2021-01-28T03:56:35.449985+0000","last_peered":"2021-01-28T03:56:35.449985+0000","last_clean":"2021-01-28T03:56:35.449985+0000","last_became_active":"2021-01-28T03:56:19.817602+0000","last_became_peered":"2021-01-28T03:56:19.817602+0000","last_unstale":"2021-01-28T03:56:35.449985+0000","last_undegraded":"2021-01-28T03:56:35.449985+0000","last_fullsized":"2021-01-28T03:56:35.449985+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"48'2","reported_seq":"27","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456609+0000","last_change":"2021-01-28T03:55:58.578578+0000","last_active":"2021-01-28T03:56:35.456609+0000","last_peered":"2021-01-28T03:56:35.456609+0000","last_clean":"2021-01-28T03:56:35.456609+0000","last_became_active":"2021-01-28T03:55:58.577681+0000","last_became_peered":"2021-01-28T03:55:58.577681+0000","last_unstale":"2021-01-28T03:56:35.456609+0000","last_undegraded":"2021-01-28T03:56:35.456609+0000","last_fullsized":"2021-01-28T03:56:35.456609+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":391,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"58'27","reported_seq":"73","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456896+0000","last_change":"2021-01-28T03:56:15.152262+0000","last_active":"2021-01-28T03:56:35.456896+0000","last_peered":"2021-01-28T03:56:35.456896+0000","last_clean":"2021-01-28T03:56:35.456896+0000","last_became_active":"2021-01-28T03:56:15.151324+0000","last_became_peered":"2021-01-28T03:56:15.151324+0000","last_unstale":"2021-01-28T03:56:35.456896+0000","last_undegraded":"2021-01-28T03:56:35.456896+0000","last_fullsized":"2021-01-28T03:56:35.456896+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":642,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":57,"num_read_kb":38,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.459395+0000","last_change":"2021-01-28T03:56:16.786637+0000","last_active":"2021-01-28T03:56:35.459395+0000","last_peered":"2021-01-28T03:56:35.459395+0000","last_clean":"2021-01-28T03:56:35.459395+0000","last_became_active":"2021-01-28T03:56:16.786321+0000","last_became_peered":"2021-01-28T03:56:16.786321+0000","last_unstale":"2021-01-28T03:56:35.459395+0000","last_undegraded":"2021-01-28T03:56:35.459395+0000","last_fullsized":"2021-01-28T03:56:35.459395+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.453022+0000","last_change":"2021-01-28T03:56:19.819731+0000","last_active":"2021-01-28T03:56:35.453022+0000","last_peered":"2021-01-28T03:56:35.453022+0000","last_clean":"2021-01-28T03:56:35.453022+0000","last_became_active":"2021-01-28T03:56:19.816153+0000","last_became_peered":"2021-01-28T03:56:19.816153+0000","last_unstale":"2021-01-28T03:56:35.453022+0000","last_undegraded":"2021-01-28T03:56:35.453022+0000","last_fullsized":"2021-01-28T03:56:35.453022+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"48'2","reported_seq":"36","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456616+0000","last_change":"2021-01-28T03:55:57.569866+0000","last_active":"2021-01-28T03:56:35.456616+0000","last_peered":"2021-01-28T03:56:35.456616+0000","last_clean":"2021-01-28T03:56:35.456616+0000","last_became_active":"2021-01-28T03:55:57.569399+0000","last_became_peered":"2021-01-28T03:55:57.569399+0000","last_unstale":"2021-01-28T03:56:35.456616+0000","last_undegraded":"2021-01-28T03:56:35.456616+0000","last_fullsized":"2021-01-28T03:56:35.456616+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"58'34","reported_seq":"88","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.460517+0000","last_change":"2021-01-28T03:56:15.154000+0000","last_active":"2021-01-28T03:56:35.460517+0000","last_peered":"2021-01-28T03:56:35.460517+0000","last_clean":"2021-01-28T03:56:35.460517+0000","last_became_active":"2021-01-28T03:56:15.152959+0000","last_became_peered":"2021-01-28T03:56:15.152959+0000","last_unstale":"2021-01-28T03:56:35.460517+0000","last_undegraded":"2021-01-28T03:56:35.460517+0000","last_fullsized":"2021-01-28T03:56:35.460517+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":846,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":70,"num_read_kb":48,"num_write":36,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.452744+0000","last_change":"2021-01-28T03:56:16.789811+0000","last_active":"2021-01-28T03:56:35.452744+0000","last_peered":"2021-01-28T03:56:35.452744+0000","last_clean":"2021-01-28T03:56:35.452744+0000","last_became_active":"2021-01-28T03:56:16.789536+0000","last_became_peered":"2021-01-28T03:56:16.789536+0000","last_unstale":"2021-01-28T03:56:35.452744+0000","last_undegraded":"2021-01-28T03:56:35.452744+0000","last_fullsized":"2021-01-28T03:56:35.452744+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.455539+0000","last_change":"2021-01-28T03:56:19.824952+0000","last_active":"2021-01-28T03:56:35.455539+0000","last_peered":"2021-01-28T03:56:35.455539+0000","last_clean":"2021-01-28T03:56:35.455539+0000","last_became_active":"2021-01-28T03:56:19.824479+0000","last_became_peered":"2021-01-28T03:56:19.824479+0000","last_unstale":"2021-01-28T03:56:35.455539+0000","last_undegraded":"2021-01-28T03:56:35.455539+0000","last_fullsized":"2021-01-28T03:56:35.455539+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"48'1","reported_seq":"36","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.459554+0000","last_change":"2021-01-28T03:55:58.573079+0000","last_active":"2021-01-28T03:56:35.459554+0000","last_peered":"2021-01-28T03:56:35.459554+0000","last_clean":"2021-01-28T03:56:35.459554+0000","last_became_active":"2021-01-28T03:55:58.572704+0000","last_became_peered":"2021-01-28T03:55:58.572704+0000","last_unstale":"2021-01-28T03:56:35.459554+0000","last_undegraded":"2021-01-28T03:56:35.459554+0000","last_fullsized":"2021-01-28T03:56:35.459554+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":846,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"58'26","reported_seq":"66","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.452194+0000","last_change":"2021-01-28T03:56:14.751368+0000","last_active":"2021-01-28T03:56:35.452194+0000","last_peered":"2021-01-28T03:56:35.452194+0000","last_clean":"2021-01-28T03:56:35.452194+0000","last_became_active":"2021-01-28T03:56:14.750897+0000","last_became_peered":"2021-01-28T03:56:14.750897+0000","last_unstale":"2021-01-28T03:56:35.452194+0000","last_undegraded":"2021-01-28T03:56:35.452194+0000","last_fullsized":"2021-01-28T03:56:35.452194+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":26,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":940,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":51,"num_read_kb":31,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"53'2","reported_seq":"52","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-28T03:58:58.292779+0000","last_change":"2021-01-28T03:56:16.781125+0000","last_active":"2021-01-28T03:58:58.292779+0000","last_peered":"2021-01-28T03:58:58.292779+0000","last_clean":"2021-01-28T03:58:58.292779+0000","last_became_active":"2021-01-28T03:56:16.780779+0000","last_became_peered":"2021-01-28T03:56:16.780779+0000","last_unstale":"2021-01-28T03:58:58.292779+0000","last_undegraded":"2021-01-28T03:58:58.292779+0000","last_fullsized":"2021-01-28T03:58:58.292779+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.461433+0000","last_change":"2021-01-28T03:56:19.830930+0000","last_active":"2021-01-28T03:56:35.461433+0000","last_peered":"2021-01-28T03:56:35.461433+0000","last_clean":"2021-01-28T03:56:35.461433+0000","last_became_active":"2021-01-28T03:56:19.830476+0000","last_became_peered":"2021-01-28T03:56:19.830476+0000","last_unstale":"2021-01-28T03:56:35.461433+0000","last_undegraded":"2021-01-28T03:56:35.461433+0000","last_fullsized":"2021-01-28T03:56:35.461433+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.451212+0000","last_change":"2021-01-28T03:56:16.776526+0000","last_active":"2021-01-28T03:56:35.451212+0000","last_peered":"2021-01-28T03:56:35.451212+0000","last_clean":"2021-01-28T03:56:35.451212+0000","last_became_active":"2021-01-28T03:56:16.776183+0000","last_became_peered":"2021-01-28T03:56:16.776183+0000","last_unstale":"2021-01-28T03:56:35.451212+0000","last_undegraded":"2021-01-28T03:56:35.451212+0000","last_fullsized":"2021-01-28T03:56:35.451212+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"22","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.454741+0000","last_change":"2021-01-28T03:55:58.573268+0000","last_active":"2021-01-28T03:56:35.454741+0000","last_peered":"2021-01-28T03:56:35.454741+0000","last_clean":"2021-01-28T03:56:35.454741+0000","last_became_active":"2021-01-28T03:55:58.571358+0000","last_became_peered":"2021-01-28T03:55:58.571358+0000","last_unstale":"2021-01-28T03:56:35.454741+0000","last_undegraded":"2021-01-28T03:56:35.454741+0000","last_fullsized":"2021-01-28T03:56:35.454741+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"58'21","reported_seq":"91","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-28T03:56:36.967378+0000","last_change":"2021-01-28T03:56:36.967378+0000","last_active":"2021-01-28T03:56:36.967378+0000","last_peered":"2021-01-28T03:56:36.967378+0000","last_clean":"2021-01-28T03:56:36.967378+0000","last_became_active":"2021-01-28T03:56:36.473440+0000","last_became_peered":"2021-01-28T03:56:36.473440+0000","last_unstale":"2021-01-28T03:56:36.967378+0000","last_undegraded":"2021-01-28T03:56:36.967378+0000","last_fullsized":"2021-01-28T03:56:36.967378+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":738,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":44,"num_read_kb":28,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":738,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.450529+0000","last_change":"2021-01-28T03:56:19.830212+0000","last_active":"2021-01-28T03:56:35.450529+0000","last_peered":"2021-01-28T03:56:35.450529+0000","last_clean":"2021-01-28T03:56:35.450529+0000","last_became_active":"2021-01-28T03:56:19.829853+0000","last_became_peered":"2021-01-28T03:56:19.829853+0000","last_unstale":"2021-01-28T03:56:35.450529+0000","last_undegraded":"2021-01-28T03:56:35.450529+0000","last_fullsized":"2021-01-28T03:56:35.450529+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"53'2","reported_seq":"51","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-28T03:58:53.289214+0000","last_change":"2021-01-28T03:56:16.792340+0000","last_active":"2021-01-28T03:58:53.289214+0000","last_peered":"2021-01-28T03:58:53.289214+0000","last_clean":"2021-01-28T03:58:53.289214+0000","last_became_active":"2021-01-28T03:56:16.791925+0000","last_became_peered":"2021-01-28T03:56:16.791925+0000","last_unstale":"2021-01-28T03:58:53.289214+0000","last_undegraded":"2021-01-28T03:58:53.289214+0000","last_fullsized":"2021-01-28T03:58:53.289214+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":"34","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.450504+0000","last_change":"2021-01-28T03:55:58.574772+0000","last_active":"2021-01-28T03:56:35.450504+0000","last_peered":"2021-01-28T03:56:35.450504+0000","last_clean":"2021-01-28T03:56:35.450504+0000","last_became_active":"2021-01-28T03:55:58.572648+0000","last_became_peered":"2021-01-28T03:55:58.572648+0000","last_unstale":"2021-01-28T03:56:35.450504+0000","last_undegraded":"2021-01-28T03:56:35.450504+0000","last_fullsized":"2021-01-28T03:56:35.450504+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"58'17","reported_seq":"47","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.458313+0000","last_change":"2021-01-28T03:56:14.759897+0000","last_active":"2021-01-28T03:56:35.458313+0000","last_peered":"2021-01-28T03:56:35.458313+0000","last_clean":"2021-01-28T03:56:35.458313+0000","last_became_active":"2021-01-28T03:56:14.759455+0000","last_became_peered":"2021-01-28T03:56:14.759455+0000","last_unstale":"2021-01-28T03:56:35.458313+0000","last_undegraded":"2021-01-28T03:56:35.458313+0000","last_fullsized":"2021-01-28T03:56:35.458313+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":422,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.453474+0000","last_change":"2021-01-28T03:56:19.823818+0000","last_active":"2021-01-28T03:56:35.453474+0000","last_peered":"2021-01-28T03:56:35.453474+0000","last_clean":"2021-01-28T03:56:35.453474+0000","last_became_active":"2021-01-28T03:56:19.816222+0000","last_became_peered":"2021-01-28T03:56:19.816222+0000","last_unstale":"2021-01-28T03:56:35.453474+0000","last_undegraded":"2021-01-28T03:56:35.453474+0000","last_fullsized":"2021-01-28T03:56:35.453474+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"53'2","reported_seq":"51","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-28T03:58:53.288720+0000","last_change":"2021-01-28T03:56:16.782614+0000","last_active":"2021-01-28T03:58:53.288720+0000","last_peered":"2021-01-28T03:58:53.288720+0000","last_clean":"2021-01-28T03:58:53.288720+0000","last_became_active":"2021-01-28T03:56:16.782247+0000","last_became_peered":"2021-01-28T03:56:16.782247+0000","last_unstale":"2021-01-28T03:58:53.288720+0000","last_undegraded":"2021-01-28T03:58:53.288720+0000","last_fullsized":"2021-01-28T03:58:53.288720+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"34","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.447873+0000","last_change":"2021-01-28T03:55:58.573317+0000","last_active":"2021-01-28T03:56:35.447873+0000","last_peered":"2021-01-28T03:56:35.447873+0000","last_clean":"2021-01-28T03:56:35.447873+0000","last_became_active":"2021-01-28T03:55:58.572753+0000","last_became_peered":"2021-01-28T03:55:58.572753+0000","last_unstale":"2021-01-28T03:56:35.447873+0000","last_undegraded":"2021-01-28T03:56:35.447873+0000","last_fullsized":"2021-01-28T03:56:35.447873+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"58'13","reported_seq":"39","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.452332+0000","last_change":"2021-01-28T03:56:14.757453+0000","last_active":"2021-01-28T03:56:35.452332+0000","last_peered":"2021-01-28T03:56:35.452332+0000","last_clean":"2021-01-28T03:56:35.452332+0000","last_became_active":"2021-01-28T03:56:14.757058+0000","last_became_peered":"2021-01-28T03:56:14.757058+0000","last_unstale":"2021-01-28T03:56:35.452332+0000","last_undegraded":"2021-01-28T03:56:35.452332+0000","last_fullsized":"2021-01-28T03:56:35.452332+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":468,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":24,"num_read_kb":13,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.455700+0000","last_change":"2021-01-28T03:56:19.821622+0000","last_active":"2021-01-28T03:56:35.455700+0000","last_peered":"2021-01-28T03:56:35.455700+0000","last_clean":"2021-01-28T03:56:35.455700+0000","last_became_active":"2021-01-28T03:56:19.821249+0000","last_became_peered":"2021-01-28T03:56:19.821249+0000","last_unstale":"2021-01-28T03:56:35.455700+0000","last_undegraded":"2021-01-28T03:56:35.455700+0000","last_fullsized":"2021-01-28T03:56:35.455700+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.451143+0000","last_change":"2021-01-28T03:56:16.779885+0000","last_active":"2021-01-28T03:56:35.451143+0000","last_peered":"2021-01-28T03:56:35.451143+0000","last_clean":"2021-01-28T03:56:35.451143+0000","last_became_active":"2021-01-28T03:56:16.779477+0000","last_became_peered":"2021-01-28T03:56:16.779477+0000","last_unstale":"2021-01-28T03:56:35.451143+0000","last_undegraded":"2021-01-28T03:56:35.451143+0000","last_fullsized":"2021-01-28T03:56:35.451143+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":"22","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.455109+0000","last_change":"2021-01-28T03:55:58.568358+0000","last_active":"2021-01-28T03:56:35.455109+0000","last_peered":"2021-01-28T03:56:35.455109+0000","last_clean":"2021-01-28T03:56:35.455109+0000","last_became_active":"2021-01-28T03:55:58.567597+0000","last_became_peered":"2021-01-28T03:55:58.567597+0000","last_unstale":"2021-01-28T03:56:35.455109+0000","last_undegraded":"2021-01-28T03:56:35.455109+0000","last_fullsized":"2021-01-28T03:56:35.455109+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"58'21","reported_seq":"54","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.453049+0000","last_change":"2021-01-28T03:56:14.762746+0000","last_active":"2021-01-28T03:56:35.453049+0000","last_peered":"2021-01-28T03:56:35.453049+0000","last_clean":"2021-01-28T03:56:35.453049+0000","last_became_active":"2021-01-28T03:56:14.762459+0000","last_became_peered":"2021-01-28T03:56:14.762459+0000","last_unstale":"2021-01-28T03:56:35.453049+0000","last_undegraded":"2021-01-28T03:56:35.453049+0000","last_fullsized":"2021-01-28T03:56:35.453049+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":734,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":41,"num_read_kb":23,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.454621+0000","last_change":"2021-01-28T03:56:19.827885+0000","last_active":"2021-01-28T03:56:35.454621+0000","last_peered":"2021-01-28T03:56:35.454621+0000","last_clean":"2021-01-28T03:56:35.454621+0000","last_became_active":"2021-01-28T03:56:19.825583+0000","last_became_peered":"2021-01-28T03:56:19.825583+0000","last_unstale":"2021-01-28T03:56:35.454621+0000","last_undegraded":"2021-01-28T03:56:35.454621+0000","last_fullsized":"2021-01-28T03:56:35.454621+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.454517+0000","last_change":"2021-01-28T03:56:16.785298+0000","last_active":"2021-01-28T03:56:35.454517+0000","last_peered":"2021-01-28T03:56:35.454517+0000","last_clean":"2021-01-28T03:56:35.454517+0000","last_became_active":"2021-01-28T03:56:16.784415+0000","last_became_peered":"2021-01-28T03:56:16.784415+0000","last_unstale":"2021-01-28T03:56:35.454517+0000","last_undegraded":"2021-01-28T03:56:35.454517+0000","last_fullsized":"2021-01-28T03:56:35.454517+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.454854+0000","last_change":"2021-01-28T03:55:55.549900+0000","last_active":"2021-01-28T03:56:35.454854+0000","last_peered":"2021-01-28T03:56:35.454854+0000","last_clean":"2021-01-28T03:56:35.454854+0000","last_became_active":"2021-01-28T03:55:55.549472+0000","last_became_peered":"2021-01-28T03:55:55.549472+0000","last_unstale":"2021-01-28T03:56:35.454854+0000","last_undegraded":"2021-01-28T03:56:35.454854+0000","last_fullsized":"2021-01-28T03:56:35.454854+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"58'29","reported_seq":"72","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.459185+0000","last_change":"2021-01-28T03:56:15.152056+0000","last_active":"2021-01-28T03:56:35.459185+0000","last_peered":"2021-01-28T03:56:35.459185+0000","last_clean":"2021-01-28T03:56:35.459185+0000","last_became_active":"2021-01-28T03:56:15.151413+0000","last_became_peered":"2021-01-28T03:56:15.151413+0000","last_unstale":"2021-01-28T03:56:35.459185+0000","last_undegraded":"2021-01-28T03:56:35.459185+0000","last_fullsized":"2021-01-28T03:56:35.459185+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":732,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":56,"num_read_kb":36,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.454226+0000","last_change":"2021-01-28T03:56:19.828317+0000","last_active":"2021-01-28T03:56:35.454226+0000","last_peered":"2021-01-28T03:56:35.454226+0000","last_clean":"2021-01-28T03:56:35.454226+0000","last_became_active":"2021-01-28T03:56:19.827940+0000","last_became_peered":"2021-01-28T03:56:19.827940+0000","last_unstale":"2021-01-28T03:56:35.454226+0000","last_undegraded":"2021-01-28T03:56:35.454226+0000","last_fullsized":"2021-01-28T03:56:35.454226+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":"16","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.454308+0000","last_change":"2021-01-28T03:56:16.789858+0000","last_active":"2021-01-28T03:56:35.454308+0000","last_peered":"2021-01-28T03:56:35.454308+0000","last_clean":"2021-01-28T03:56:35.454308+0000","last_became_active":"2021-01-28T03:56:16.789379+0000","last_became_peered":"2021-01-28T03:56:16.789379+0000","last_unstale":"2021-01-28T03:56:35.454308+0000","last_undegraded":"2021-01-28T03:56:35.454308+0000","last_fullsized":"2021-01-28T03:56:35.454308+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":"24","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.456748+0000","last_change":"2021-01-28T03:55:55.552349+0000","last_active":"2021-01-28T03:56:35.456748+0000","last_peered":"2021-01-28T03:56:35.456748+0000","last_clean":"2021-01-28T03:56:35.456748+0000","last_became_active":"2021-01-28T03:55:55.552027+0000","last_became_peered":"2021-01-28T03:55:55.552027+0000","last_unstale":"2021-01-28T03:56:35.456748+0000","last_undegraded":"2021-01-28T03:56:35.456748+0000","last_fullsized":"2021-01-28T03:56:35.456748+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"58'20","reported_seq":"59","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.457008+0000","last_change":"2021-01-28T03:56:14.754772+0000","last_active":"2021-01-28T03:56:35.457008+0000","last_peered":"2021-01-28T03:56:35.457008+0000","last_clean":"2021-01-28T03:56:35.457008+0000","last_became_active":"2021-01-28T03:56:14.754430+0000","last_became_peered":"2021-01-28T03:56:14.754430+0000","last_unstale":"2021-01-28T03:56:35.457008+0000","last_undegraded":"2021-01-28T03:56:35.457008+0000","last_fullsized":"2021-01-28T03:56:35.457008+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":894,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":44,"num_read_kb":27,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":"13","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.449943+0000","last_change":"2021-01-28T03:56:19.825514+0000","last_active":"2021-01-28T03:56:35.449943+0000","last_peered":"2021-01-28T03:56:35.449943+0000","last_clean":"2021-01-28T03:56:35.449943+0000","last_became_active":"2021-01-28T03:56:19.825129+0000","last_became_peered":"2021-01-28T03:56:19.825129+0000","last_unstale":"2021-01-28T03:56:35.449943+0000","last_undegraded":"2021-01-28T03:56:35.449943+0000","last_fullsized":"2021-01-28T03:56:35.449943+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:18.781380+0000","last_clean_scrub_stamp":"2021-01-28T03:56:18.781380+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"48'1","reported_seq":"35","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.455550+0000","last_change":"2021-01-28T03:55:58.576123+0000","last_active":"2021-01-28T03:56:35.455550+0000","last_peered":"2021-01-28T03:56:35.455550+0000","last_clean":"2021-01-28T03:56:35.455550+0000","last_became_active":"2021-01-28T03:55:58.575689+0000","last_became_peered":"2021-01-28T03:55:58.575689+0000","last_unstale":"2021-01-28T03:56:35.455550+0000","last_undegraded":"2021-01-28T03:56:35.455550+0000","last_fullsized":"2021-01-28T03:56:35.455550+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:55:54.513285+0000","last_clean_scrub_stamp":"2021-01-28T03:55:54.513285+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"58'30","reported_seq":"79","reported_epoch":"59","state":"active+clean","last_fresh":"2021-01-28T03:56:35.449717+0000","last_change":"2021-01-28T03:56:15.152510+0000","last_active":"2021-01-28T03:56:35.449717+0000","last_peered":"2021-01-28T03:56:35.449717+0000","last_clean":"2021-01-28T03:56:35.449717+0000","last_became_active":"2021-01-28T03:56:15.151979+0000","last_became_peered":"2021-01-28T03:56:15.151979+0000","last_unstale":"2021-01-28T03:56:35.449717+0000","last_undegraded":"2021-01-28T03:56:35.449717+0000","last_fullsized":"2021-01-28T03:56:35.449717+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:13.718614+0000","last_clean_scrub_stamp":"2021-01-28T03:56:13.718614+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":578,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":59,"num_read_kb":42,"num_write":31,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"53'2","reported_seq":"52","reported_epoch":"60","state":"active+clean","last_fresh":"2021-01-28T03:58:58.293593+0000","last_change":"2021-01-28T03:56:16.792128+0000","last_active":"2021-01-28T03:58:58.293593+0000","last_peered":"2021-01-28T03:58:58.293593+0000","last_clean":"2021-01-28T03:58:58.293593+0000","last_became_active":"2021-01-28T03:56:16.791793+0000","last_became_peered":"2021-01-28T03:56:16.791793+0000","last_unstale":"2021-01-28T03:58:58.293593+0000","last_undegraded":"2021-01-28T03:58:58.293593+0000","last_fullsized":"2021-01-28T03:58:58.293593+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T03:56:15.745122+0000","last_clean_scrub_stamp":"2021-01-28T03:56:15.745122+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":23524,"num_objects":335,"num_object_clones":0,"num_object_copies":1005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":335,"num_whiteouts":0,"num_read":1453,"num_read_kb":926,"num_write":734,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":1898,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1966080,"data_stored":70572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":703,"ondisk_log_size":703,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":158,"num_read_kb":153,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1945,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":21,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":419,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":5835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":47,"seq":201863462952,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6240,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738912,"statfs":{"total":95995035648,"available":95988645888,"internally_reserved":0,"allocated":811008,"data_stored":239713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 28 03:58:02 2021","interfaces":[{"interface":"back","average":{"1min":2.0910000000000002,"5min":1.883,"15min":1.8480000000000001},"min":{"1min":1.1930000000000001,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":4.5410000000000004,"5min":4.5410000000000004,"15min":4.5410000000000004},"last":1.411},{"interface":"front","average":{"1min":1.9990000000000001,"5min":1.8460000000000001,"15min":1.8200000000000001},"min":{"1min":1.198,"5min":1.198,"15min":1.198},"max":{"1min":2.9350000000000001,"5min":2.9350000000000001,"15min":2.9350000000000001},"last":1.6060000000000001}]},{"osd":1,"last update":"Thu Jan 28 03:58:02 2021","interfaces":[{"interface":"back","average":{"1min":2.177,"5min":2.02,"15min":1.994},"min":{"1min":1.3149999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":4.3700000000000001,"5min":4.3700000000000001,"15min":4.3700000000000001},"last":1.7749999999999999},{"interface":"front","average":{"1min":2.383,"5min":2.2679999999999998,"15min":2.2490000000000001},"min":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"max":{"1min":3.2040000000000002,"5min":4.7859999999999996,"15min":4.7859999999999996},"last":2.145}]},{"osd":2,"last update":"Thu Jan 28 03:58:02 2021","interfaces":[{"interface":"back","average":{"1min":2.1000000000000001,"5min":2.0640000000000001,"15min":2.0579999999999998},"min":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"max":{"1min":2.923,"5min":3.5379999999999998,"15min":3.5379999999999998},"last":1.498},{"interface":"front","average":{"1min":2.6699999999999999,"5min":2.4889999999999999,"15min":2.4590000000000001},"min":{"1min":1.978,"5min":1.339,"15min":1.339},"max":{"1min":4.6870000000000003,"5min":4.6870000000000003,"15min":4.6870000000000003},"last":2.2090000000000001}]},{"osd":3,"last update":"Thu Jan 28 03:58:02 2021","interfaces":[{"interface":"back","average":{"1min":2.343,"5min":2.3370000000000002,"15min":2.3359999999999999},"min":{"1min":1.9059999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"max":{"1min":2.9809999999999999,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":2.004},{"interface":"front","average":{"1min":2.948,"5min":2.6640000000000001,"15min":2.6160000000000001},"min":{"1min":1.73,"5min":1.508,"15min":1.508},"max":{"1min":5.4880000000000004,"5min":5.4880000000000004,"15min":5.4880000000000004},"last":2.5790000000000002}]},{"osd":4,"last update":"Thu Jan 28 03:58:02 2021","interfaces":[{"interface":"back","average":{"1min":2.774,"5min":2.4449999999999998,"15min":2.3900000000000001},"min":{"1min":1.9710000000000001,"5min":1.0309999999999999,"15min":1.0309999999999999},"max":{"1min":3.9140000000000001,"5min":3.9140000000000001,"15min":3.9140000000000001},"last":2.5030000000000001},{"interface":"front","average":{"1min":2.6309999999999998,"5min":2.4750000000000001,"15min":2.4489999999999998},"min":{"1min":1.7749999999999999,"5min":1.208,"15min":1.208},"max":{"1min":3.411,"5min":3.411,"15min":3.411},"last":2.3340000000000001}]},{"osd":5,"last update":"Thu Jan 28 03:58:02 2021","interfaces":[{"interface":"back","average":{"1min":3.2850000000000001,"5min":2.8170000000000002,"15min":2.7389999999999999},"min":{"1min":1.911,"5min":1.163,"15min":1.163},"max":{"1min":5.6340000000000003,"5min":5.6340000000000003,"15min":5.6340000000000003},"last":3.1619999999999999},{"interface":"front","average":{"1min":3.1509999999999998,"5min":2.8620000000000001,"15min":2.8140000000000001},"min":{"1min":1.8280000000000001,"5min":1.4259999999999999,"15min":1.4259999999999999},"max":{"1min":4.2830000000000004,"5min":4.2830000000000004,"15min":4.2830000000000004},"last":2.8109999999999999}]},{"osd":6,"last update":"Thu Jan 28 03:58:02 2021","interfaces":[{"interface":"back","average":{"1min":3.3839999999999999,"5min":3.0459999999999998,"15min":2.9900000000000002},"min":{"1min":2.8180000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"max":{"1min":4.6130000000000004,"5min":4.6130000000000004,"15min":4.6130000000000004},"last":2.9889999999999999},{"interface":"front","average":{"1min":3,"5min":2.8980000000000001,"15min":2.8809999999999998},"min":{"1min":1.8600000000000001,"5min":1.5509999999999999,"15min":1.5509999999999999},"max":{"1min":4.0039999999999996,"5min":4.0389999999999997,"15min":4.0389999999999997},"last":2.7040000000000002}]}]},{"osd":6,"up_from":41,"seq":176093659180,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6352,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738800,"statfs":{"total":95995035648,"available":95988531200,"internally_reserved":0,"allocated":860160,"data_stored":241687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 28 03:58:40 2021","interfaces":[{"interface":"back","average":{"1min":2.2679999999999998,"5min":2.0579999999999998,"15min":2.0230000000000001},"min":{"1min":1.444,"5min":1.2190000000000001,"15min":1.2190000000000001},"max":{"1min":3.3119999999999998,"5min":3.4279999999999999,"15min":3.4279999999999999},"last":2.6619999999999999},{"interface":"front","average":{"1min":2.1739999999999999,"5min":2.0099999999999998,"15min":1.9790000000000001},"min":{"1min":1.4370000000000001,"5min":0.94799999999999995,"15min":0.94799999999999995},"max":{"1min":3.4289999999999998,"5min":3.4289999999999998,"15min":3.4289999999999998},"last":1.5429999999999999}]},{"osd":1,"last update":"Thu Jan 28 03:58:40 2021","interfaces":[{"interface":"back","average":{"1min":2.1800000000000002,"5min":2.1749999999999998,"15min":2.1760000000000002},"min":{"1min":1.3029999999999999,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":2.9260000000000002,"5min":3.7869999999999999,"15min":3.7869999999999999},"last":1.6319999999999999},{"interface":"front","average":{"1min":2.222,"5min":2.1579999999999999,"15min":2.109},"min":{"1min":1.641,"5min":1.363,"15min":1.363},"max":{"1min":3.3180000000000001,"5min":3.3180000000000001,"15min":3.3180000000000001},"last":2.3679999999999999}]},{"osd":2,"last update":"Thu Jan 28 03:58:40 2021","interfaces":[{"interface":"back","average":{"1min":2.649,"5min":2.4060000000000001,"15min":2.3140000000000001},"min":{"1min":1.833,"5min":1.385,"15min":1.385},"max":{"1min":3.8170000000000002,"5min":3.8170000000000002,"15min":3.8170000000000002},"last":2.2989999999999999},{"interface":"front","average":{"1min":2.5600000000000001,"5min":2.4369999999999998,"15min":2.4049999999999998},"min":{"1min":1.3999999999999999,"5min":1.306,"15min":1.306},"max":{"1min":3.1869999999999998,"5min":3.5129999999999999,"15min":3.5129999999999999},"last":2.613}]},{"osd":3,"last update":"Thu Jan 28 03:58:40 2021","interfaces":[{"interface":"back","average":{"1min":2.117,"5min":2.1779999999999999,"15min":2.2189999999999999},"min":{"1min":1.607,"5min":1.2729999999999999,"15min":1.2729999999999999},"max":{"1min":3.1880000000000002,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.8560000000000001},{"interface":"front","average":{"1min":3.117,"5min":2.8719999999999999,"15min":2.8100000000000001},"min":{"1min":2.194,"5min":1.7110000000000001,"15min":1.7110000000000001},"max":{"1min":3.8239999999999998,"5min":4.2300000000000004,"15min":4.2300000000000004},"last":3.0019999999999998}]},{"osd":4,"last update":"Thu Jan 28 03:58:40 2021","interfaces":[{"interface":"back","average":{"1min":2.8940000000000001,"5min":2.7490000000000001,"15min":2.6909999999999998},"min":{"1min":2.2469999999999999,"5min":1.179,"15min":1.179},"max":{"1min":3.6589999999999998,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":2.1000000000000001},{"interface":"front","average":{"1min":2.4609999999999999,"5min":2.3340000000000001,"15min":2.3130000000000002},"min":{"1min":1.492,"5min":1.2210000000000001,"15min":1.2210000000000001},"max":{"1min":3.7280000000000002,"5min":3.7280000000000002,"15min":3.7280000000000002},"last":2.202}]},{"osd":5,"last update":"Thu Jan 28 03:58:40 2021","interfaces":[{"interface":"back","average":{"1min":3.3730000000000002,"5min":3.117,"15min":3.069},"min":{"1min":2.476,"5min":1.3819999999999999,"15min":1.3819999999999999},"max":{"1min":4.3040000000000003,"5min":4.3040000000000003,"15min":4.3040000000000003},"last":3.331},{"interface":"front","average":{"1min":2.7549999999999999,"5min":2.734,"15min":2.75},"min":{"1min":1.9550000000000001,"5min":1.5629999999999999,"15min":1.5629999999999999},"max":{"1min":3.5459999999999998,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":2.5750000000000002}]},{"osd":7,"last update":"Thu Jan 28 03:58:00 2021","interfaces":[{"interface":"back","average":{"1min":3.5299999999999998,"5min":3.48,"15min":3.472},"min":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"max":{"1min":4.7329999999999997,"5min":4.7329999999999997,"15min":4.7329999999999997},"last":3.6520000000000001},{"interface":"front","average":{"1min":3.282,"5min":3.1699999999999999,"15min":3.1509999999999998},"min":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"max":{"1min":4.1970000000000001,"5min":4.5650000000000004,"15min":4.5650000000000004},"last":2.8050000000000002}]}]},{"osd":1,"up_from":16,"seq":68719476807,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6808,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":5888,"kb_avail":93738344,"statfs":{"total":95995035648,"available":95988064256,"internally_reserved":0,"allocated":933888,"data_stored":243600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6029312},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 28 03:58:27 2021","interfaces":[{"interface":"back","average":{"1min":1.8200000000000001,"5min":1.702,"15min":1.419},"min":{"1min":1.3169999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.9470000000000001,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":1.8169999999999999},{"interface":"front","average":{"1min":2.0099999999999998,"5min":1.806,"15min":1.464},"min":{"1min":0.86699999999999999,"5min":0.749,"15min":0.749},"max":{"1min":3.016,"5min":3.2869999999999999,"15min":3.2869999999999999},"last":1.901}]},{"osd":2,"last update":"Thu Jan 28 03:58:59 2021","interfaces":[{"interface":"back","average":{"1min":2.0179999999999998,"5min":1.907,"15min":1.7649999999999999},"min":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"max":{"1min":2.7330000000000001,"5min":3.1549999999999998,"15min":3.1549999999999998},"last":2.5459999999999998},{"interface":"front","average":{"1min":2.0979999999999999,"5min":2.081,"15min":1.9530000000000001},"min":{"1min":1.0680000000000001,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":3.0059999999999998,"5min":3.1309999999999998,"15min":3.1309999999999998},"last":2.4969999999999999}]},{"osd":3,"last update":"Thu Jan 28 03:58:20 2021","interfaces":[{"interface":"back","average":{"1min":2.23,"5min":2.246,"15min":2.1899999999999999},"min":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"max":{"1min":3.0960000000000001,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":2.2850000000000001},{"interface":"front","average":{"1min":1.911,"5min":1.966,"15min":2.0019999999999998},"min":{"1min":1.0529999999999999,"5min":0.875,"15min":0.875},"max":{"1min":2.4990000000000001,"5min":3.1000000000000001,"15min":3.1000000000000001},"last":2.1640000000000001}]},{"osd":4,"last update":"Thu Jan 28 03:58:44 2021","interfaces":[{"interface":"back","average":{"1min":2.8279999999999998,"5min":2.6160000000000001,"15min":2.4660000000000002},"min":{"1min":1.8220000000000001,"5min":1.331,"15min":1.331},"max":{"1min":3.843,"5min":4.4400000000000004,"15min":4.4400000000000004},"last":3.0800000000000001},{"interface":"front","average":{"1min":2.984,"5min":2.843,"15min":2.6930000000000001},"min":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"max":{"1min":4.2720000000000002,"5min":4.2720000000000002,"15min":4.2720000000000002},"last":3.6699999999999999}]},{"osd":5,"last update":"Thu Jan 28 03:58:10 2021","interfaces":[{"interface":"back","average":{"1min":2.8940000000000001,"5min":2.8479999999999999,"15min":2.7850000000000001},"min":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"max":{"1min":3.798,"5min":4.25,"15min":4.25},"last":3.2869999999999999},{"interface":"front","average":{"1min":3.101,"5min":3.0720000000000001,"15min":3.0230000000000001},"min":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"max":{"1min":4.2519999999999998,"5min":4.2519999999999998,"15min":4.2519999999999998},"last":4.1150000000000002}]},{"osd":6,"last update":"Thu Jan 28 03:58:36 2021","interfaces":[{"interface":"back","average":{"1min":2.5699999999999998,"5min":2.532,"15min":2.5190000000000001},"min":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"max":{"1min":3.786,"5min":3.786,"15min":3.786},"last":2.6320000000000001},{"interface":"front","average":{"1min":3.073,"5min":3.1419999999999999,"15min":3.1240000000000001},"min":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"max":{"1min":4.2530000000000001,"5min":4.6100000000000003,"15min":4.6100000000000003},"last":3.5099999999999998}]},{"osd":7,"last update":"Thu Jan 28 03:58:00 2021","interfaces":[{"interface":"back","average":{"1min":3.3540000000000001,"5min":3.4409999999999998,"15min":3.4550000000000001},"min":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"max":{"1min":4.601,"5min":4.601,"15min":4.601},"last":3.9079999999999999},{"interface":"front","average":{"1min":2.8620000000000001,"5min":2.9580000000000002,"15min":2.9740000000000002},"min":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"max":{"1min":4.2039999999999997,"5min":4.2039999999999997,"15min":4.2039999999999997},"last":3.012}]}]},{"osd":0,"up_from":10,"seq":42949673038,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6484,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738668,"statfs":{"total":95995035648,"available":95988396032,"internally_reserved":0,"allocated":798720,"data_stored":238553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 28 03:58:28 2021","interfaces":[{"interface":"back","average":{"1min":1.6879999999999999,"5min":1.5920000000000001,"15min":1.3300000000000001},"min":{"1min":1.218,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":2.8090000000000002,"5min":2.8090000000000002,"15min":2.8090000000000002},"last":2.0310000000000001},{"interface":"front","average":{"1min":1.7350000000000001,"5min":1.6579999999999999,"15min":1.4370000000000001},"min":{"1min":0.96699999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.9649999999999999,"5min":3.8069999999999999,"15min":3.8069999999999999},"last":1.7130000000000001}]},{"osd":2,"last update":"Thu Jan 28 03:58:54 2021","interfaces":[{"interface":"back","average":{"1min":1.988,"5min":1.752,"15min":1.6679999999999999},"min":{"1min":1.302,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":4.1970000000000001,"5min":4.1970000000000001,"15min":4.1970000000000001},"last":2.1880000000000002},{"interface":"front","average":{"1min":2.1509999999999998,"5min":2.0670000000000002,"15min":1.891},"min":{"1min":1.4219999999999999,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":3.0600000000000001,"5min":3.367,"15min":3.367},"last":3.2010000000000001}]},{"osd":3,"last update":"Thu Jan 28 03:58:19 2021","interfaces":[{"interface":"back","average":{"1min":2.258,"5min":2.1469999999999998,"15min":2.0190000000000001},"min":{"1min":1.355,"5min":1.0880000000000001,"15min":1.0880000000000001},"max":{"1min":3.1680000000000001,"5min":3.5790000000000002,"15min":3.5790000000000002},"last":2.3359999999999999},{"interface":"front","average":{"1min":2.1899999999999999,"5min":2.2080000000000002,"15min":2.1989999999999998},"min":{"1min":1.4139999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"max":{"1min":2.948,"5min":3.3879999999999999,"15min":3.3879999999999999},"last":3.4870000000000001}]},{"osd":4,"last update":"Thu Jan 28 03:58:46 2021","interfaces":[{"interface":"back","average":{"1min":2.6579999999999999,"5min":2.5960000000000001,"15min":2.516},"min":{"1min":1.778,"5min":1.4710000000000001,"15min":1.4710000000000001},"max":{"1min":3.3690000000000002,"5min":3.9260000000000002,"15min":3.9260000000000002},"last":3.738},{"interface":"front","average":{"1min":2.794,"5min":2.7130000000000001,"15min":2.6339999999999999},"min":{"1min":2.0270000000000001,"5min":1.0409999999999999,"15min":1.0409999999999999},"max":{"1min":4.3179999999999996,"5min":4.3179999999999996,"15min":4.3179999999999996},"last":2.6440000000000001}]},{"osd":5,"last update":"Thu Jan 28 03:58:14 2021","interfaces":[{"interface":"back","average":{"1min":2.7410000000000001,"5min":2.8849999999999998,"15min":2.9780000000000002},"min":{"1min":2.073,"5min":1.383,"15min":1.383},"max":{"1min":3.6680000000000001,"5min":3.8620000000000001,"15min":3.8620000000000001},"last":3.8410000000000002},{"interface":"front","average":{"1min":3.0910000000000002,"5min":2.9990000000000001,"15min":3.0049999999999999},"min":{"1min":2.3700000000000001,"5min":1.8,"15min":1.8},"max":{"1min":3.8500000000000001,"5min":3.8500000000000001,"15min":3.8500000000000001},"last":4.4580000000000002}]},{"osd":6,"last update":"Thu Jan 28 03:58:36 2021","interfaces":[{"interface":"back","average":{"1min":3.1419999999999999,"5min":3.036,"15min":3.0419999999999998},"min":{"1min":1.548,"5min":1.548,"15min":1.548},"max":{"1min":4.931,"5min":4.931,"15min":4.931},"last":2.8809999999999998},{"interface":"front","average":{"1min":3.089,"5min":2.956,"15min":2.9430000000000001},"min":{"1min":1.956,"5min":1.3220000000000001,"15min":1.3220000000000001},"max":{"1min":4.7770000000000001,"5min":4.7770000000000001,"15min":4.7770000000000001},"last":4.0389999999999997}]},{"osd":7,"last update":"Thu Jan 28 03:58:01 2021","interfaces":[{"interface":"back","average":{"1min":3.3029999999999999,"5min":3.1640000000000001,"15min":3.141},"min":{"1min":2.7349999999999999,"5min":1.6120000000000001,"15min":1.6120000000000001},"max":{"1min":4.2619999999999996,"5min":4.2619999999999996,"15min":4.2619999999999996},"last":4.2329999999999997},{"interface":"front","average":{"1min":3.23,"5min":3.363,"15min":3.3849999999999998},"min":{"1min":1.986,"5min":1.986,"15min":1.986},"max":{"1min":4.2080000000000002,"5min":4.351,"15min":4.351},"last":3.1480000000000001}]}]},{"osd":2,"up_from":21,"seq":90194313283,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6160,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738992,"statfs":{"total":95995035648,"available":95988727808,"internally_reserved":0,"allocated":729088,"data_stored":236944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 28 03:58:55 2021","interfaces":[{"interface":"back","average":{"1min":1.831,"5min":1.712,"15min":1.486},"min":{"1min":1.161,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.641,"5min":2.8220000000000001,"15min":2.8220000000000001},"last":1.5609999999999999},{"interface":"front","average":{"1min":1.7929999999999999,"5min":1.782,"15min":1.599},"min":{"1min":1.393,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":2.2320000000000002,"5min":3.7250000000000001,"15min":3.7250000000000001},"last":1.8240000000000001}]},{"osd":1,"last update":"Thu Jan 28 03:58:55 2021","interfaces":[{"interface":"back","average":{"1min":2.1309999999999998,"5min":1.9410000000000001,"15min":1.6899999999999999},"min":{"1min":1.329,"5min":1.1859999999999999,"15min":1.1859999999999999},"max":{"1min":3.2069999999999999,"5min":3.2069999999999999,"15min":3.2069999999999999},"last":2.133},{"interface":"front","average":{"1min":1.897,"5min":1.9019999999999999,"15min":1.782},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":2.3839999999999999,"5min":4.0229999999999997,"15min":4.0229999999999997},"last":1.72}]},{"osd":3,"last update":"Thu Jan 28 03:58:22 2021","interfaces":[{"interface":"back","average":{"1min":2.2879999999999998,"5min":2.1030000000000002,"15min":2.0430000000000001},"min":{"1min":1.296,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":3.6309999999999998,"5min":3.6309999999999998,"15min":3.6309999999999998},"last":2.5609999999999999},{"interface":"front","average":{"1min":2.4710000000000001,"5min":2.3500000000000001,"15min":2.298},"min":{"1min":1.6000000000000001,"5min":1,"15min":1},"max":{"1min":3.589,"5min":3.589,"15min":3.589},"last":2.206}]},{"osd":4,"last update":"Thu Jan 28 03:58:45 2021","interfaces":[{"interface":"back","average":{"1min":2.673,"5min":2.5139999999999998,"15min":2.4940000000000002},"min":{"1min":1.978,"5min":1.2490000000000001,"15min":1.2490000000000001},"max":{"1min":3.9809999999999999,"5min":3.9809999999999999,"15min":3.9809999999999999},"last":2.4060000000000001},{"interface":"front","average":{"1min":2.6019999999999999,"5min":2.5569999999999999,"15min":2.5310000000000001},"min":{"1min":1.6459999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":3.4729999999999999,"5min":4.3070000000000004,"15min":4.3070000000000004},"last":2.2639999999999998}]},{"osd":5,"last update":"Thu Jan 28 03:58:10 2021","interfaces":[{"interface":"back","average":{"1min":2.8180000000000001,"5min":2.9100000000000001,"15min":2.9500000000000002},"min":{"1min":1.6950000000000001,"5min":1.488,"15min":1.488},"max":{"1min":4.0949999999999998,"5min":4.0949999999999998,"15min":4.0949999999999998},"last":2.6600000000000001},{"interface":"front","average":{"1min":2.8050000000000002,"5min":2.7429999999999999,"15min":2.7240000000000002},"min":{"1min":1.502,"5min":1.3300000000000001,"15min":1.3300000000000001},"max":{"1min":3.6139999999999999,"5min":3.6179999999999999,"15min":3.6179999999999999},"last":2.8069999999999999}]},{"osd":6,"last update":"Thu Jan 28 03:58:36 2021","interfaces":[{"interface":"back","average":{"1min":3.2490000000000001,"5min":3.1760000000000002,"15min":3.1640000000000001},"min":{"1min":2.4089999999999998,"5min":1.51,"15min":1.51},"max":{"1min":4.2809999999999997,"5min":4.351,"15min":4.351},"last":2.8690000000000002},{"interface":"front","average":{"1min":3.1800000000000002,"5min":3.0590000000000002,"15min":3.0329999999999999},"min":{"1min":2.4910000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"max":{"1min":3.9500000000000002,"5min":4.0650000000000004,"15min":4.0650000000000004},"last":3.1829999999999998}]},{"osd":7,"last update":"Thu Jan 28 03:58:04 2021","interfaces":[{"interface":"back","average":{"1min":3.1339999999999999,"5min":3.2509999999999999,"15min":3.2709999999999999},"min":{"1min":1.647,"5min":1.647,"15min":1.647},"max":{"1min":4.1639999999999997,"5min":4.1639999999999997,"15min":4.1639999999999997},"last":3.0190000000000001},{"interface":"front","average":{"1min":2.9660000000000002,"5min":3.1899999999999999,"15min":3.2269999999999999},"min":{"1min":1.9239999999999999,"5min":1.506,"15min":1.506},"max":{"1min":4.4939999999999998,"5min":4.4939999999999998,"15min":4.4939999999999998},"last":3.0499999999999998}]}]},{"osd":3,"up_from":26,"seq":111669149757,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6592,"kb_used_data":888,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738560,"statfs":{"total":95995035648,"available":95988285440,"internally_reserved":0,"allocated":909312,"data_stored":242420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 28 03:58:20 2021","interfaces":[{"interface":"back","average":{"1min":1.698,"5min":1.635,"15min":1.534},"min":{"1min":1.2989999999999999,"5min":0.499,"15min":0.499},"max":{"1min":2.177,"5min":3.3959999999999999,"15min":3.3959999999999999},"last":1.837},{"interface":"front","average":{"1min":2.0819999999999999,"5min":1.911,"15min":1.798},"min":{"1min":1.5249999999999999,"5min":1.165,"15min":1.165},"max":{"1min":2.9540000000000002,"5min":8.7159999999999993,"15min":8.7159999999999993},"last":1.74}]},{"osd":1,"last update":"Thu Jan 28 03:58:20 2021","interfaces":[{"interface":"back","average":{"1min":1.95,"5min":2.0449999999999999,"15min":1.8819999999999999},"min":{"1min":1.387,"5min":1.387,"15min":1.387},"max":{"1min":2.4580000000000002,"5min":8.3079999999999998,"15min":8.3079999999999998},"last":2.3239999999999998},{"interface":"front","average":{"1min":2.101,"5min":2.0529999999999999,"15min":1.9570000000000001},"min":{"1min":1.5369999999999999,"5min":1.202,"15min":1.202},"max":{"1min":2.8999999999999999,"5min":10.022,"15min":10.022},"last":2.746}]},{"osd":2,"last update":"Thu Jan 28 03:58:20 2021","interfaces":[{"interface":"back","average":{"1min":2.2290000000000001,"5min":2.1459999999999999,"15min":2.0499999999999998},"min":{"1min":1.427,"5min":1.427,"15min":1.427},"max":{"1min":3.5990000000000002,"5min":3.5990000000000002,"15min":3.5990000000000002},"last":1.921},{"interface":"front","average":{"1min":2.3959999999999999,"5min":2.206,"15min":2.1139999999999999},"min":{"1min":1.853,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":3.1309999999999998,"5min":3.1309999999999998,"15min":3.1309999999999998},"last":2.089}]},{"osd":4,"last update":"Thu Jan 28 03:58:47 2021","interfaces":[{"interface":"back","average":{"1min":2.6669999999999998,"5min":2.4849999999999999,"15min":2.379},"min":{"1min":1.661,"5min":1.496,"15min":1.496},"max":{"1min":3.9140000000000001,"5min":3.9809999999999999,"15min":3.9809999999999999},"last":2.3839999999999999},{"interface":"front","average":{"1min":2.734,"5min":2.6019999999999999,"15min":2.4830000000000001},"min":{"1min":1.897,"5min":1.5800000000000001,"15min":1.5800000000000001},"max":{"1min":3.8519999999999999,"5min":3.8940000000000001,"15min":3.8940000000000001},"last":3.141}]},{"osd":5,"last update":"Thu Jan 28 03:58:11 2021","interfaces":[{"interface":"back","average":{"1min":3.0630000000000002,"5min":2.8410000000000002,"15min":2.7010000000000001},"min":{"1min":1.984,"5min":1.9550000000000001,"15min":1.9550000000000001},"max":{"1min":4.4420000000000002,"5min":8.5600000000000005,"15min":8.5600000000000005},"last":3.431},{"interface":"front","average":{"1min":2.9670000000000001,"5min":3.04,"15min":2.9940000000000002},"min":{"1min":2.1720000000000002,"5min":2.0569999999999999,"15min":2.0569999999999999},"max":{"1min":3.8079999999999998,"5min":7.7009999999999996,"15min":7.7009999999999996},"last":3.8420000000000001}]},{"osd":6,"last update":"Thu Jan 28 03:58:33 2021","interfaces":[{"interface":"back","average":{"1min":3.1459999999999999,"5min":3.246,"15min":3.3029999999999999},"min":{"1min":1.696,"5min":1.696,"15min":1.696},"max":{"1min":4,"5min":8.4239999999999995,"15min":8.4239999999999995},"last":2.9470000000000001},{"interface":"front","average":{"1min":3.2959999999999998,"5min":3.2200000000000002,"15min":3.2050000000000001},"min":{"1min":2.5899999999999999,"5min":2.0299999999999998,"15min":2.0299999999999998},"max":{"1min":4.6310000000000002,"5min":4.6310000000000002,"15min":4.6310000000000002},"last":3.5249999999999999}]},{"osd":7,"last update":"Thu Jan 28 03:58:00 2021","interfaces":[{"interface":"back","average":{"1min":3.3639999999999999,"5min":3.7160000000000002,"15min":3.774},"min":{"1min":2.5539999999999998,"5min":2.5539999999999998,"15min":2.5539999999999998},"max":{"1min":4.5590000000000002,"5min":10.752000000000001,"15min":10.752000000000001},"last":3.2589999999999999},{"interface":"front","average":{"1min":3.4100000000000001,"5min":3.4700000000000002,"15min":3.48},"min":{"1min":2.4540000000000002,"5min":2.403,"15min":2.403},"max":{"1min":4.5039999999999996,"5min":4.6980000000000004,"15min":4.6980000000000004},"last":4.1529999999999996}]}]},{"osd":4,"up_from":31,"seq":133143986231,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6488,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738664,"statfs":{"total":95995035648,"available":95988391936,"internally_reserved":0,"allocated":868352,"data_stored":241207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 28 03:58:51 2021","interfaces":[{"interface":"back","average":{"1min":1.893,"5min":1.675,"15min":1.5700000000000001},"min":{"1min":1.3720000000000001,"5min":0.93799999999999994,"15min":0.93799999999999994},"max":{"1min":2.6720000000000002,"5min":2.96,"15min":2.96},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.895,"5min":1.7470000000000001,"15min":1.669},"min":{"1min":1.3260000000000001,"5min":1.1879999999999999,"15min":1.1879999999999999},"max":{"1min":2.7189999999999999,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.5309999999999999}]},{"osd":1,"last update":"Thu Jan 28 03:58:51 2021","interfaces":[{"interface":"back","average":{"1min":2.0009999999999999,"5min":1.8999999999999999,"15min":1.7450000000000001},"min":{"1min":1.55,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":3.048,"5min":4.0999999999999996,"15min":4.0999999999999996},"last":0.88800000000000001},{"interface":"front","average":{"1min":2.4220000000000002,"5min":2.1070000000000002,"15min":1.9770000000000001},"min":{"1min":1.24,"5min":1.109,"15min":1.109},"max":{"1min":4.0730000000000004,"5min":4.0730000000000004,"15min":4.0730000000000004},"last":1.177}]},{"osd":2,"last update":"Thu Jan 28 03:58:51 2021","interfaces":[{"interface":"back","average":{"1min":2.593,"5min":2.2320000000000002,"15min":2.0539999999999998},"min":{"1min":1.357,"5min":1.101,"15min":1.101},"max":{"1min":3.7330000000000001,"5min":3.7330000000000001,"15min":3.7330000000000001},"last":1.3919999999999999},{"interface":"front","average":{"1min":2.835,"5min":2.4990000000000001,"15min":2.3029999999999999},"min":{"1min":2.165,"5min":1.3440000000000001,"15min":1.3440000000000001},"max":{"1min":3.9900000000000002,"5min":4.3550000000000004,"15min":4.3550000000000004},"last":1.698}]},{"osd":3,"last update":"Thu Jan 28 03:58:51 2021","interfaces":[{"interface":"back","average":{"1min":2.3399999999999999,"5min":2.1459999999999999,"15min":1.982},"min":{"1min":1.7070000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":3.6869999999999998,"5min":3.6869999999999998,"15min":3.6869999999999998},"last":1.7889999999999999},{"interface":"front","average":{"1min":2.7349999999999999,"5min":2.391,"15min":2.1549999999999998},"min":{"1min":1.53,"5min":1.2090000000000001,"15min":1.2090000000000001},"max":{"1min":4.0499999999999998,"5min":4.5229999999999997,"15min":4.5229999999999997},"last":1.7270000000000001}]},{"osd":5,"last update":"Thu Jan 28 03:58:10 2021","interfaces":[{"interface":"back","average":{"1min":2.6779999999999999,"5min":2.2959999999999998,"15min":2.177},"min":{"1min":1.419,"5min":1.1870000000000001,"15min":1.1870000000000001},"max":{"1min":3.9769999999999999,"5min":3.9769999999999999,"15min":3.9769999999999999},"last":1.992},{"interface":"front","average":{"1min":2.8959999999999999,"5min":2.681,"15min":2.6190000000000002},"min":{"1min":1.3320000000000001,"5min":1.242,"15min":1.242},"max":{"1min":3.9079999999999999,"5min":3.9079999999999999,"15min":3.9079999999999999},"last":1.476}]},{"osd":6,"last update":"Thu Jan 28 03:58:35 2021","interfaces":[{"interface":"back","average":{"1min":2.956,"5min":2.7559999999999998,"15min":2.7679999999999998},"min":{"1min":1.907,"5min":1.3200000000000001,"15min":1.3200000000000001},"max":{"1min":4.3460000000000001,"5min":4.3460000000000001,"15min":4.3460000000000001},"last":1.8779999999999999},{"interface":"front","average":{"1min":3.218,"5min":3.0659999999999998,"15min":3.081},"min":{"1min":1.962,"5min":1.7410000000000001,"15min":1.7410000000000001},"max":{"1min":4.3550000000000004,"5min":4.9349999999999996,"15min":4.9349999999999996},"last":1.893}]},{"osd":7,"last update":"Thu Jan 28 03:58:01 2021","interfaces":[{"interface":"back","average":{"1min":3.3370000000000002,"5min":3.3319999999999999,"15min":3.331},"min":{"1min":2.0840000000000001,"5min":2.024,"15min":2.024},"max":{"1min":5.3179999999999996,"5min":5.3179999999999996,"15min":5.3179999999999996},"last":2.0840000000000001},{"interface":"front","average":{"1min":3.1230000000000002,"5min":3.1339999999999999,"15min":3.1360000000000001},"min":{"1min":1.8169999999999999,"5min":1.129,"15min":1.129},"max":{"1min":4.0780000000000003,"5min":4.0780000000000003,"15min":4.0780000000000003},"last":1.669}]}]},{"osd":5,"up_from":36,"seq":154618822706,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6200,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738952,"statfs":{"total":95995035648,"available":95988686848,"internally_reserved":0,"allocated":770048,"data_stored":237538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 28 03:58:10 2021","interfaces":[{"interface":"back","average":{"1min":2.0289999999999999,"5min":1.8979999999999999,"15min":1.8560000000000001},"min":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"max":{"1min":2.9060000000000001,"5min":2.9769999999999999,"15min":2.9769999999999999},"last":2.1499999999999999},{"interface":"front","average":{"1min":1.9119999999999999,"5min":1.849,"15min":1.859},"min":{"1min":1.264,"5min":1.1910000000000001,"15min":1.1910000000000001},"max":{"1min":2.669,"5min":2.8519999999999999,"15min":2.8519999999999999},"last":2.0369999999999999}]},{"osd":1,"last update":"Thu Jan 28 03:58:10 2021","interfaces":[{"interface":"back","average":{"1min":2.2069999999999999,"5min":1.95,"15min":1.8819999999999999},"min":{"1min":1.2170000000000001,"5min":1.109,"15min":1.109},"max":{"1min":3.3210000000000002,"5min":3.508,"15min":3.508},"last":1.6220000000000001},{"interface":"front","average":{"1min":2.1850000000000001,"5min":1.9299999999999999,"15min":1.8440000000000001},"min":{"1min":1.6679999999999999,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":3.0230000000000001,"5min":3.3500000000000001,"15min":3.3500000000000001},"last":2.806}]},{"osd":2,"last update":"Thu Jan 28 03:58:10 2021","interfaces":[{"interface":"back","average":{"1min":1.9710000000000001,"5min":1.913,"15min":1.885},"min":{"1min":1.27,"5min":1.097,"15min":1.097},"max":{"1min":2.952,"5min":3.1440000000000001,"15min":3.1440000000000001},"last":2.2370000000000001},{"interface":"front","average":{"1min":2.5859999999999999,"5min":2.363,"15min":2.2890000000000001},"min":{"1min":1.595,"5min":1.5800000000000001,"15min":1.5800000000000001},"max":{"1min":3.141,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":2.5059999999999998}]},{"osd":3,"last update":"Thu Jan 28 03:58:10 2021","interfaces":[{"interface":"back","average":{"1min":2.2799999999999998,"5min":2.161,"15min":2.121},"min":{"1min":1.365,"5min":1.3140000000000001,"15min":1.3140000000000001},"max":{"1min":2.782,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":2.742},{"interface":"front","average":{"1min":2.7400000000000002,"5min":2.4340000000000002,"15min":2.3290000000000002},"min":{"1min":2.1309999999999998,"5min":1.319,"15min":1.319},"max":{"1min":3.5019999999999998,"5min":3.5019999999999998,"15min":3.5019999999999998},"last":2.8929999999999998}]},{"osd":4,"last update":"Thu Jan 28 03:58:10 2021","interfaces":[{"interface":"back","average":{"1min":2.6480000000000001,"5min":2.2029999999999998,"15min":2.0840000000000001},"min":{"1min":1.706,"5min":1.095,"15min":1.095},"max":{"1min":3.427,"5min":3.427,"15min":3.427},"last":2.427},{"interface":"front","average":{"1min":2.6909999999999998,"5min":2.3210000000000002,"15min":2.2250000000000001},"min":{"1min":1.528,"5min":1.1910000000000001,"15min":1.1910000000000001},"max":{"1min":3.375,"5min":3.6360000000000001,"15min":3.6360000000000001},"last":2.9900000000000002}]},{"osd":6,"last update":"Thu Jan 28 03:58:37 2021","interfaces":[{"interface":"back","average":{"1min":3.0049999999999999,"5min":2.5030000000000001,"15min":2.355},"min":{"1min":2.339,"5min":1.171,"15min":1.171},"max":{"1min":4.0910000000000002,"5min":4.0910000000000002,"15min":4.0910000000000002},"last":3.3109999999999999},{"interface":"front","average":{"1min":3.1840000000000002,"5min":2.851,"15min":2.7309999999999999},"min":{"1min":2.4409999999999998,"5min":1.1000000000000001,"15min":1.1000000000000001},"max":{"1min":3.8220000000000001,"5min":3.8220000000000001,"15min":3.8220000000000001},"last":3.25}]},{"osd":7,"last update":"Thu Jan 28 03:58:02 2021","interfaces":[{"interface":"back","average":{"1min":3.0470000000000002,"5min":2.8029999999999999,"15min":2.762},"min":{"1min":1.891,"5min":1.0860000000000001,"15min":1.0860000000000001},"max":{"1min":3.8029999999999999,"5min":3.8029999999999999,"15min":3.8029999999999999},"last":3.1899999999999999},{"interface":"front","average":{"1min":3.2120000000000002,"5min":2.968,"15min":2.927},"min":{"1min":2.194,"5min":1.4890000000000001,"15min":1.4890000000000001},"max":{"1min":4.0579999999999998,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":3.5019999999999998}]}]}]}} 2021-01-28T03:59:07.003 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2021-01-28T03:59:07.004 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2021-01-28T03:59:07.004 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2021-01-28T03:59:07.004 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid c217df96-611b-11eb-8f9e-001a4aab830c -- ceph health --format=json 2021-01-28T03:59:07.011 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:06 smithi162 bash[9856]: audit 2021-01-28T03:59:06.196564+0000 mgr.y (mgr.14138) 436 : audit [DBG] from='client.24655 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-01-28T03:59:07.161 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/c217df96-611b-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T03:59:08.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:07 smithi162 bash[9856]: cluster 2021-01-28T03:59:07.459836+0000 mgr.y (mgr.14138) 437 : cluster [DBG] pgmap v306: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:08.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:07 smithi100 bash[9834]: cluster 2021-01-28T03:59:07.459836+0000 mgr.y (mgr.14138) 437 : cluster [DBG] pgmap v306: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:08.077 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:07 smithi100 bash[13549]: cluster 2021-01-28T03:59:07.459836+0000 mgr.y (mgr.14138) 437 : cluster [DBG] pgmap v306: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:09.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:09 smithi100 bash[9834]: cluster 2021-01-28T03:59:09.461146+0000 mgr.y (mgr.14138) 438 : cluster [DBG] pgmap v307: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:09.827 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:59:09 smithi100 bash[10061]: debug 2021-01-28T03:59:09.618+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T03:59:09.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:09 smithi100 bash[13549]: cluster 2021-01-28T03:59:09.461146+0000 mgr.y (mgr.14138) 438 : cluster [DBG] pgmap v307: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:10.012 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 03:59:09 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T03:59:10.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:09 smithi162 bash[9856]: cluster 2021-01-28T03:59:09.461146+0000 mgr.y (mgr.14138) 438 : cluster [DBG] pgmap v307: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:10.456 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.454+0000 7fabccb94700 1 -- 172.21.15.100:0/519938832 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fabc80f58a0 msgr2=0x7fabc80f5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:59:10.456 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.454+0000 7fabccb94700 1 --2- 172.21.15.100:0/519938832 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fabc80f58a0 0x7fabc80f5cc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fabc0009df0 tx=0x7fabc0004d10).stop 2021-01-28T03:59:10.456 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.454+0000 7fabccb94700 1 -- 172.21.15.100:0/519938832 shutdown_connections 2021-01-28T03:59:10.457 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.454+0000 7fabccb94700 1 --2- 172.21.15.100:0/519938832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabc80f7490 0x7fabc80fdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:59:10.457 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.454+0000 7fabccb94700 1 --2- 172.21.15.100:0/519938832 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fabc80f58a0 0x7fabc80f5cc0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:59:10.457 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.454+0000 7fabccb94700 1 --2- 172.21.15.100:0/519938832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabc80f6b40 0x7fabc80f6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T03:59:10.458 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.454+0000 7fabccb94700 1 -- 172.21.15.100:0/519938832 >> 172.21.15.100:0/519938832 conn(0x7fabc80f10a0 msgr2=0x7fabc80f34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:59:10.458 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.454+0000 7fabccb94700 1 -- 172.21.15.100:0/519938832 shutdown_connections 2021-01-28T03:59:10.458 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.454+0000 7fabccb94700 1 -- 172.21.15.100:0/519938832 wait complete. 2021-01-28T03:59:10.462 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.454+0000 7fabccb94700 1 Processor -- start 2021-01-28T03:59:10.462 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.454+0000 7fabccb94700 1 -- start start 2021-01-28T03:59:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.454+0000 7fabccb94700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabc80f58a0 0x7fabc806aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:59:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.454+0000 7fabccb94700 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabc80f6b40 0x7fabc8068f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:59:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.454+0000 7fabccb94700 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fabc80f7490 0x7fabc8069560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:59:10.464 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.454+0000 7fabccb94700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc8069c50 con 0x7fabc80f58a0 2021-01-28T03:59:10.464 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.454+0000 7fabccb94700 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc8069dc0 con 0x7fabc80f6b40 2021-01-28T03:59:10.465 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.454+0000 7fabccb94700 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc810f9a0 con 0x7fabc80f7490 2021-01-28T03:59:10.465 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.454+0000 7fabc77fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabc80f58a0 0x7fabc806aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:59:10.465 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.454+0000 7fabc77fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabc80f58a0 0x7fabc806aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60180/0 (socket says 172.21.15.100:60180) 2021-01-28T03:59:10.466 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.454+0000 7fabc77fe700 1 -- 172.21.15.100:0/2403068641 learned_addr learned my addr 172.21.15.100:0/2403068641 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T03:59:10.467 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.454+0000 7fabc7fff700 1 --2- 172.21.15.100:0/2403068641 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fabc80f7490 0x7fabc8069560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:59:10.467 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.454+0000 7fabc6ffd700 1 --2- 172.21.15.100:0/2403068641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabc80f6b40 0x7fabc8068f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:59:10.467 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.454+0000 7fabc77fe700 1 -- 172.21.15.100:0/2403068641 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fabc80f7490 msgr2=0x7fabc8069560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:59:10.467 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.454+0000 7fabc77fe700 1 --2- 172.21.15.100:0/2403068641 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fabc80f7490 0x7fabc8069560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:59:10.468 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.454+0000 7fabc77fe700 1 -- 172.21.15.100:0/2403068641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabc80f6b40 msgr2=0x7fabc8068f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:59:10.468 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.454+0000 7fabc77fe700 1 --2- 172.21.15.100:0/2403068641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabc80f6b40 0x7fabc8068f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:59:10.468 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.454+0000 7fabc77fe700 1 -- 172.21.15.100:0/2403068641 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc810fb60 con 0x7fabc80f58a0 2021-01-28T03:59:10.468 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.454+0000 7fabc77fe700 1 --2- 172.21.15.100:0/2403068641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabc80f58a0 0x7fabc806aa90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fabc0007970 tx=0x7fabc0004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:59:10.469 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.454+0000 7fabbffff700 1 -- 172.21.15.100:0/2403068641 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc000e030 con 0x7fabc80f58a0 2021-01-28T03:59:10.469 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.454+0000 7fabccb94700 1 -- 172.21.15.100:0/2403068641 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc810fdb0 con 0x7fabc80f58a0 2021-01-28T03:59:10.469 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.454+0000 7fabccb94700 1 -- 172.21.15.100:0/2403068641 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc81101b0 con 0x7fabc80f58a0 2021-01-28T03:59:10.469 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.454+0000 7fabbffff700 1 -- 172.21.15.100:0/2403068641 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(24 keys) v1 ==== 1001+0+0 (secure 0 0 0) 0x7fabc00044e0 con 0x7fabc80f58a0 2021-01-28T03:59:10.469 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.454+0000 7fabbffff700 1 -- 172.21.15.100:0/2403068641 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc0018070 con 0x7fabc80f58a0 2021-01-28T03:59:10.470 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.458+0000 7fabccb94700 1 -- 172.21.15.100:0/2403068641 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabac004da0 con 0x7fabc80f58a0 2021-01-28T03:59:10.470 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.458+0000 7fabbffff700 1 -- 172.21.15.100:0/2403068641 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 15) v1 ==== 71356+0+0 (secure 0 0 0) 0x7fabc0013630 con 0x7fabc80f58a0 2021-01-28T03:59:10.470 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.458+0000 7fabbffff700 1 --2- 172.21.15.100:0/2403068641 >> v2:172.21.15.100:6800/928846103 conn(0x7fabb405bc70 0x7fabb405e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2021-01-28T03:59:10.470 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.458+0000 7fabbffff700 1 -- 172.21.15.100:0/2403068641 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5991+0+0 (secure 0 0 0) 0x7fabc00779f0 con 0x7fabc80f58a0 2021-01-28T03:59:10.470 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.458+0000 7fabc6ffd700 1 --2- 172.21.15.100:0/2403068641 >> v2:172.21.15.100:6800/928846103 conn(0x7fabb405bc70 0x7fabb405e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T03:59:10.471 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.458+0000 7fabc6ffd700 1 --2- 172.21.15.100:0/2403068641 >> v2:172.21.15.100:6800/928846103 conn(0x7fabb405bc70 0x7fabb405e130 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fabb0007fd0 tx=0x7fabb000b040).ready entity=mgr.14138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2021-01-28T03:59:10.471 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.466+0000 7fabbffff700 1 -- 172.21.15.100:0/2403068641 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+149679 (secure 0 0 0) 0x7fabc0079e60 con 0x7fabc80f58a0 2021-01-28T03:59:10.561 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:10 smithi100 bash[9834]: audit 2021-01-28T03:59:09.619655+0000 mgr.y (mgr.14138) 439 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:59:10.561 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:10 smithi100 bash[13549]: audit 2021-01-28T03:59:09.619655+0000 mgr.y (mgr.14138) 439 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:59:10.698 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.694+0000 7fabccb94700 1 -- 172.21.15.100:0/2403068641 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fabac0059f0 con 0x7fabc80f58a0 2021-01-28T03:59:10.699 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.694+0000 7fabbffff700 1 -- 172.21.15.100:0/2403068641 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7fabc004a660 con 0x7fabc80f58a0 2021-01-28T03:59:10.699 INFO:teuthology.orchestra.run.smithi100.stdout: 2021-01-28T03:59:10.701 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.698+0000 7fabccb94700 1 -- 172.21.15.100:0/2403068641 >> v2:172.21.15.100:6800/928846103 conn(0x7fabb405bc70 msgr2=0x7fabb405e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:59:10.701 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.698+0000 7fabccb94700 1 --2- 172.21.15.100:0/2403068641 >> v2:172.21.15.100:6800/928846103 conn(0x7fabb405bc70 0x7fabb405e130 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fabb0007fd0 tx=0x7fabb000b040).stop 2021-01-28T03:59:10.701 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.698+0000 7fabccb94700 1 -- 172.21.15.100:0/2403068641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabc80f58a0 msgr2=0x7fabc806aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-01-28T03:59:10.701 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.698+0000 7fabccb94700 1 --2- 172.21.15.100:0/2403068641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabc80f58a0 0x7fabc806aa90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fabc0007970 tx=0x7fabc0004d10).stop 2021-01-28T03:59:10.702 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.698+0000 7fabccb94700 1 -- 172.21.15.100:0/2403068641 shutdown_connections 2021-01-28T03:59:10.702 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.698+0000 7fabccb94700 1 --2- 172.21.15.100:0/2403068641 >> v2:172.21.15.100:6800/928846103 conn(0x7fabb405bc70 0x7fabb405e130 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:59:10.702 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.698+0000 7fabccb94700 1 --2- 172.21.15.100:0/2403068641 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x7fabc80f7490 0x7fabc8069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:59:10.703 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.698+0000 7fabccb94700 1 --2- 172.21.15.100:0/2403068641 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabc80f58a0 0x7fabc806aa90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:59:10.703 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.698+0000 7fabccb94700 1 --2- 172.21.15.100:0/2403068641 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabc80f6b40 0x7fabc8068f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2021-01-28T03:59:10.703 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.698+0000 7fabccb94700 1 -- 172.21.15.100:0/2403068641 >> 172.21.15.100:0/2403068641 conn(0x7fabc80f10a0 msgr2=0x7fabc80f9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T03:59:10.703 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.698+0000 7fabccb94700 1 -- 172.21.15.100:0/2403068641 shutdown_connections 2021-01-28T03:59:10.704 INFO:teuthology.orchestra.run.smithi100.stderr:2021-01-28T03:59:10.698+0000 7fabccb94700 1 -- 172.21.15.100:0/2403068641 wait complete. 2021-01-28T03:59:11.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:10 smithi162 bash[9856]: audit 2021-01-28T03:59:09.619655+0000 mgr.y (mgr.14138) 439 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:59:11.509 INFO:teuthology.orchestra.run.smithi100.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-01-28T03:59:11.509 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2021-01-28T03:59:11.510 INFO:tasks.cephadm:Setup complete, yielding 2021-01-28T03:59:11.510 INFO:teuthology.run_tasks:Running task workunit... 2021-01-28T03:59:11.523 INFO:tasks.workunit:Pulling workunits from ref 507028cb839c25d6666833702df6325fd8569096 2021-01-28T03:59:11.525 INFO:tasks.workunit:Making a separate scratch dir for every client... 2021-01-28T03:59:11.525 DEBUG:teuthology.orchestra.run.smithi100:> stat -- /home/ubuntu/cephtest/mnt.0 2021-01-28T03:59:11.533 INFO:teuthology.orchestra.run.smithi100.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-01-28T03:59:11.533 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-28T03:59:11.533 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -- /home/ubuntu/cephtest/mnt.0 2021-01-28T03:59:11.586 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2021-01-28T03:59:11.587 DEBUG:teuthology.orchestra.run.smithi100:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2021-01-28T03:59:11.600 INFO:tasks.workunit:timeout=3h 2021-01-28T03:59:11.602 INFO:tasks.workunit:cleanup=True 2021-01-28T03:59:11.603 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 507028cb839c25d6666833702df6325fd8569096 2021-01-28T03:59:11.660 INFO:tasks.workunit.client.0.smithi100.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2021-01-28T03:59:11.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:11 smithi100 bash[9834]: audit 2021-01-28T03:59:10.698811+0000 mon.a (mon.0) 662 : audit [DBG] from='client.? 172.21.15.100:0/2403068641' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-01-28T03:59:11.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:11 smithi100 bash[9834]: cluster 2021-01-28T03:59:11.462072+0000 mgr.y (mgr.14138) 440 : cluster [DBG] pgmap v308: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:11.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:11 smithi100 bash[13549]: audit 2021-01-28T03:59:10.698811+0000 mon.a (mon.0) 662 : audit [DBG] from='client.? 172.21.15.100:0/2403068641' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-01-28T03:59:11.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:11 smithi100 bash[13549]: cluster 2021-01-28T03:59:11.462072+0000 mgr.y (mgr.14138) 440 : cluster [DBG] pgmap v308: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:12.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:11 smithi162 bash[9856]: audit 2021-01-28T03:59:10.698811+0000 mon.a (mon.0) 662 : audit [DBG] from='client.? 172.21.15.100:0/2403068641' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-01-28T03:59:12.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:11 smithi162 bash[9856]: cluster 2021-01-28T03:59:11.462072+0000 mgr.y (mgr.14138) 440 : cluster [DBG] pgmap v308: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:13.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:13 smithi100 bash[9834]: cluster 2021-01-28T03:59:13.463505+0000 mgr.y (mgr.14138) 441 : cluster [DBG] pgmap v309: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:13.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:13 smithi100 bash[13549]: cluster 2021-01-28T03:59:13.463505+0000 mgr.y (mgr.14138) 441 : cluster [DBG] pgmap v309: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:14.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:13 smithi162 bash[9856]: cluster 2021-01-28T03:59:13.463505+0000 mgr.y (mgr.14138) 441 : cluster [DBG] pgmap v309: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:15.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:15 smithi100 bash[9834]: cluster 2021-01-28T03:59:15.464642+0000 mgr.y (mgr.14138) 442 : cluster [DBG] pgmap v310: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:15.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:15 smithi100 bash[13549]: cluster 2021-01-28T03:59:15.464642+0000 mgr.y (mgr.14138) 442 : cluster [DBG] pgmap v310: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:16.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:15 smithi162 bash[9856]: cluster 2021-01-28T03:59:15.464642+0000 mgr.y (mgr.14138) 442 : cluster [DBG] pgmap v310: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:18.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:17 smithi162 bash[9856]: cluster 2021-01-28T03:59:17.465605+0000 mgr.y (mgr.14138) 443 : cluster [DBG] pgmap v311: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:18.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:17 smithi100 bash[9834]: cluster 2021-01-28T03:59:17.465605+0000 mgr.y (mgr.14138) 443 : cluster [DBG] pgmap v311: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:18.077 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:17 smithi100 bash[13549]: cluster 2021-01-28T03:59:17.465605+0000 mgr.y (mgr.14138) 443 : cluster [DBG] pgmap v311: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:19.827 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:59:19 smithi100 bash[10061]: debug 2021-01-28T03:59:19.626+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T03:59:19.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:19 smithi100 bash[9834]: cluster 2021-01-28T03:59:19.466891+0000 mgr.y (mgr.14138) 444 : cluster [DBG] pgmap v312: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:19.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:19 smithi100 bash[13549]: cluster 2021-01-28T03:59:19.466891+0000 mgr.y (mgr.14138) 444 : cluster [DBG] pgmap v312: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:20.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:19 smithi162 bash[9856]: cluster 2021-01-28T03:59:19.466891+0000 mgr.y (mgr.14138) 444 : cluster [DBG] pgmap v312: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:20.012 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 03:59:19 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T03:59:20.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:20 smithi100 bash[9834]: audit 2021-01-28T03:59:19.630933+0000 mgr.y (mgr.14138) 445 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:59:20.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:20 smithi100 bash[13549]: audit 2021-01-28T03:59:19.630933+0000 mgr.y (mgr.14138) 445 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:59:21.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:20 smithi162 bash[9856]: audit 2021-01-28T03:59:19.630933+0000 mgr.y (mgr.14138) 445 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:59:21.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:21 smithi100 bash[9834]: cluster 2021-01-28T03:59:21.467751+0000 mgr.y (mgr.14138) 446 : cluster [DBG] pgmap v313: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:21.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:21 smithi100 bash[13549]: cluster 2021-01-28T03:59:21.467751+0000 mgr.y (mgr.14138) 446 : cluster [DBG] pgmap v313: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:22.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:21 smithi162 bash[9856]: cluster 2021-01-28T03:59:21.467751+0000 mgr.y (mgr.14138) 446 : cluster [DBG] pgmap v313: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:23.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:23 smithi100 bash[9834]: cluster 2021-01-28T03:59:23.469058+0000 mgr.y (mgr.14138) 447 : cluster [DBG] pgmap v314: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:23.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:23 smithi100 bash[13549]: cluster 2021-01-28T03:59:23.469058+0000 mgr.y (mgr.14138) 447 : cluster [DBG] pgmap v314: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:24.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:23 smithi162 bash[9856]: cluster 2021-01-28T03:59:23.469058+0000 mgr.y (mgr.14138) 447 : cluster [DBG] pgmap v314: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:25.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:25 smithi100 bash[9834]: cluster 2021-01-28T03:59:25.470022+0000 mgr.y (mgr.14138) 448 : cluster [DBG] pgmap v315: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:25.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:25 smithi100 bash[13549]: cluster 2021-01-28T03:59:25.470022+0000 mgr.y (mgr.14138) 448 : cluster [DBG] pgmap v315: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:26.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:25 smithi162 bash[9856]: cluster 2021-01-28T03:59:25.470022+0000 mgr.y (mgr.14138) 448 : cluster [DBG] pgmap v315: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:28.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:27 smithi162 bash[9856]: cluster 2021-01-28T03:59:27.471130+0000 mgr.y (mgr.14138) 449 : cluster [DBG] pgmap v316: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:28.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:27 smithi100 bash[9834]: cluster 2021-01-28T03:59:27.471130+0000 mgr.y (mgr.14138) 449 : cluster [DBG] pgmap v316: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:28.077 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:27 smithi100 bash[13549]: cluster 2021-01-28T03:59:27.471130+0000 mgr.y (mgr.14138) 449 : cluster [DBG] pgmap v316: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:29.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:29 smithi100 bash[9834]: cluster 2021-01-28T03:59:29.472487+0000 mgr.y (mgr.14138) 450 : cluster [DBG] pgmap v317: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:29.827 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:59:29 smithi100 bash[10061]: debug 2021-01-28T03:59:29.638+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T03:59:29.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:29 smithi100 bash[13549]: cluster 2021-01-28T03:59:29.472487+0000 mgr.y (mgr.14138) 450 : cluster [DBG] pgmap v317: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:30.012 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 03:59:29 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T03:59:30.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:29 smithi162 bash[9856]: cluster 2021-01-28T03:59:29.472487+0000 mgr.y (mgr.14138) 450 : cluster [DBG] pgmap v317: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:30.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:30 smithi100 bash[9834]: audit 2021-01-28T03:59:29.642265+0000 mgr.y (mgr.14138) 451 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:59:30.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:30 smithi100 bash[13549]: audit 2021-01-28T03:59:29.642265+0000 mgr.y (mgr.14138) 451 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:59:31.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:30 smithi162 bash[9856]: audit 2021-01-28T03:59:29.642265+0000 mgr.y (mgr.14138) 451 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:59:31.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:31 smithi100 bash[9834]: cluster 2021-01-28T03:59:31.473344+0000 mgr.y (mgr.14138) 452 : cluster [DBG] pgmap v318: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:31.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:31 smithi100 bash[13549]: cluster 2021-01-28T03:59:31.473344+0000 mgr.y (mgr.14138) 452 : cluster [DBG] pgmap v318: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:32.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:31 smithi162 bash[9856]: cluster 2021-01-28T03:59:31.473344+0000 mgr.y (mgr.14138) 452 : cluster [DBG] pgmap v318: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:33.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:33 smithi100 bash[9834]: cluster 2021-01-28T03:59:33.474608+0000 mgr.y (mgr.14138) 453 : cluster [DBG] pgmap v319: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:33.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:33 smithi100 bash[13549]: cluster 2021-01-28T03:59:33.474608+0000 mgr.y (mgr.14138) 453 : cluster [DBG] pgmap v319: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:34.011 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:33 smithi162 bash[9856]: cluster 2021-01-28T03:59:33.474608+0000 mgr.y (mgr.14138) 453 : cluster [DBG] pgmap v319: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:35.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:35 smithi100 bash[9834]: cluster 2021-01-28T03:59:35.475505+0000 mgr.y (mgr.14138) 454 : cluster [DBG] pgmap v320: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:35.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:35 smithi100 bash[9834]: audit 2021-01-28T03:59:35.506623+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T03:59:35.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:35 smithi100 bash[9834]: audit 2021-01-28T03:59:35.507198+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T03:59:35.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:35 smithi100 bash[13549]: cluster 2021-01-28T03:59:35.475505+0000 mgr.y (mgr.14138) 454 : cluster [DBG] pgmap v320: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:35.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:35 smithi100 bash[13549]: audit 2021-01-28T03:59:35.506623+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T03:59:35.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:35 smithi100 bash[13549]: audit 2021-01-28T03:59:35.507198+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T03:59:36.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:35 smithi162 bash[9856]: cluster 2021-01-28T03:59:35.475505+0000 mgr.y (mgr.14138) 454 : cluster [DBG] pgmap v320: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:36.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:35 smithi162 bash[9856]: audit 2021-01-28T03:59:35.506623+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T03:59:36.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:35 smithi162 bash[9856]: audit 2021-01-28T03:59:35.507198+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T03:59:38.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:37 smithi162 bash[9856]: cluster 2021-01-28T03:59:37.476517+0000 mgr.y (mgr.14138) 455 : cluster [DBG] pgmap v321: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:38.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:37 smithi100 bash[9834]: cluster 2021-01-28T03:59:37.476517+0000 mgr.y (mgr.14138) 455 : cluster [DBG] pgmap v321: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:38.077 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:37 smithi100 bash[13549]: cluster 2021-01-28T03:59:37.476517+0000 mgr.y (mgr.14138) 455 : cluster [DBG] pgmap v321: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:39.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:39 smithi100 bash[9834]: cluster 2021-01-28T03:59:39.477808+0000 mgr.y (mgr.14138) 456 : cluster [DBG] pgmap v322: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:39.827 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:59:39 smithi100 bash[10061]: debug 2021-01-28T03:59:39.645+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T03:59:39.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:39 smithi100 bash[13549]: cluster 2021-01-28T03:59:39.477808+0000 mgr.y (mgr.14138) 456 : cluster [DBG] pgmap v322: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:40.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:39 smithi162 bash[9856]: cluster 2021-01-28T03:59:39.477808+0000 mgr.y (mgr.14138) 456 : cluster [DBG] pgmap v322: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:40.012 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 03:59:39 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T03:59:40.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:40 smithi100 bash[13549]: audit 2021-01-28T03:59:39.651017+0000 mgr.y (mgr.14138) 457 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:59:40.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:40 smithi100 bash[9834]: audit 2021-01-28T03:59:39.651017+0000 mgr.y (mgr.14138) 457 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:59:41.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:40 smithi162 bash[9856]: audit 2021-01-28T03:59:39.651017+0000 mgr.y (mgr.14138) 457 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:59:42.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:41 smithi162 bash[9856]: cluster 2021-01-28T03:59:41.478628+0000 mgr.y (mgr.14138) 458 : cluster [DBG] pgmap v323: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:42.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:41 smithi100 bash[9834]: cluster 2021-01-28T03:59:41.478628+0000 mgr.y (mgr.14138) 458 : cluster [DBG] pgmap v323: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:42.077 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:41 smithi100 bash[13549]: cluster 2021-01-28T03:59:41.478628+0000 mgr.y (mgr.14138) 458 : cluster [DBG] pgmap v323: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:43.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:43 smithi100 bash[9834]: cluster 2021-01-28T03:59:43.479960+0000 mgr.y (mgr.14138) 459 : cluster [DBG] pgmap v324: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:43.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:43 smithi100 bash[13549]: cluster 2021-01-28T03:59:43.479960+0000 mgr.y (mgr.14138) 459 : cluster [DBG] pgmap v324: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:44.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:43 smithi162 bash[9856]: cluster 2021-01-28T03:59:43.479960+0000 mgr.y (mgr.14138) 459 : cluster [DBG] pgmap v324: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:45.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:45 smithi100 bash[9834]: cluster 2021-01-28T03:59:45.481000+0000 mgr.y (mgr.14138) 460 : cluster [DBG] pgmap v325: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:45.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:45 smithi100 bash[13549]: cluster 2021-01-28T03:59:45.481000+0000 mgr.y (mgr.14138) 460 : cluster [DBG] pgmap v325: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:46.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:45 smithi162 bash[9856]: cluster 2021-01-28T03:59:45.481000+0000 mgr.y (mgr.14138) 460 : cluster [DBG] pgmap v325: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:48.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:47 smithi162 bash[9856]: cluster 2021-01-28T03:59:47.482101+0000 mgr.y (mgr.14138) 461 : cluster [DBG] pgmap v326: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:48.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:47 smithi100 bash[9834]: cluster 2021-01-28T03:59:47.482101+0000 mgr.y (mgr.14138) 461 : cluster [DBG] pgmap v326: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:48.077 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:47 smithi100 bash[13549]: cluster 2021-01-28T03:59:47.482101+0000 mgr.y (mgr.14138) 461 : cluster [DBG] pgmap v326: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:49.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:49 smithi100 bash[9834]: cluster 2021-01-28T03:59:49.483227+0000 mgr.y (mgr.14138) 462 : cluster [DBG] pgmap v327: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:49.827 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:59:49 smithi100 bash[10061]: debug 2021-01-28T03:59:49.657+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T03:59:49.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:49 smithi100 bash[13549]: cluster 2021-01-28T03:59:49.483227+0000 mgr.y (mgr.14138) 462 : cluster [DBG] pgmap v327: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:50.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:49 smithi162 bash[9856]: cluster 2021-01-28T03:59:49.483227+0000 mgr.y (mgr.14138) 462 : cluster [DBG] pgmap v327: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:50.012 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 03:59:49 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T03:59:50.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:50 smithi100 bash[9834]: audit 2021-01-28T03:59:49.662312+0000 mgr.y (mgr.14138) 463 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:59:50.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:50 smithi100 bash[13549]: audit 2021-01-28T03:59:49.662312+0000 mgr.y (mgr.14138) 463 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:59:51.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:50 smithi162 bash[9856]: audit 2021-01-28T03:59:49.662312+0000 mgr.y (mgr.14138) 463 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T03:59:51.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:51 smithi100 bash[13549]: cluster 2021-01-28T03:59:51.483812+0000 mgr.y (mgr.14138) 464 : cluster [DBG] pgmap v328: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:51.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:51 smithi100 bash[9834]: cluster 2021-01-28T03:59:51.483812+0000 mgr.y (mgr.14138) 464 : cluster [DBG] pgmap v328: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:52.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:51 smithi162 bash[9856]: cluster 2021-01-28T03:59:51.483812+0000 mgr.y (mgr.14138) 464 : cluster [DBG] pgmap v328: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:53.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:53 smithi100 bash[9834]: cluster 2021-01-28T03:59:53.484684+0000 mgr.y (mgr.14138) 465 : cluster [DBG] pgmap v329: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:53.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:53 smithi100 bash[13549]: cluster 2021-01-28T03:59:53.484684+0000 mgr.y (mgr.14138) 465 : cluster [DBG] pgmap v329: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:54.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:53 smithi162 bash[9856]: cluster 2021-01-28T03:59:53.484684+0000 mgr.y (mgr.14138) 465 : cluster [DBG] pgmap v329: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:55.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:55 smithi100 bash[13549]: cluster 2021-01-28T03:59:55.485570+0000 mgr.y (mgr.14138) 466 : cluster [DBG] pgmap v330: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:55.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:55 smithi100 bash[9834]: cluster 2021-01-28T03:59:55.485570+0000 mgr.y (mgr.14138) 466 : cluster [DBG] pgmap v330: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:56.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:55 smithi162 bash[9856]: cluster 2021-01-28T03:59:55.485570+0000 mgr.y (mgr.14138) 466 : cluster [DBG] pgmap v330: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:58.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:57 smithi162 bash[9856]: cluster 2021-01-28T03:59:57.486598+0000 mgr.y (mgr.14138) 467 : cluster [DBG] pgmap v331: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:58.077 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:57 smithi100 bash[13549]: cluster 2021-01-28T03:59:57.486598+0000 mgr.y (mgr.14138) 467 : cluster [DBG] pgmap v331: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:58.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:57 smithi100 bash[9834]: cluster 2021-01-28T03:59:57.486598+0000 mgr.y (mgr.14138) 467 : cluster [DBG] pgmap v331: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T03:59:59.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 03:59:59 smithi100 bash[13549]: cluster 2021-01-28T03:59:59.487766+0000 mgr.y (mgr.14138) 468 : cluster [DBG] pgmap v332: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:59.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 03:59:59 smithi100 bash[9834]: cluster 2021-01-28T03:59:59.487766+0000 mgr.y (mgr.14138) 468 : cluster [DBG] pgmap v332: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T03:59:59.828 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 03:59:59 smithi100 bash[10061]: debug 2021-01-28T03:59:59.669+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:00:00.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 03:59:59 smithi162 bash[9856]: cluster 2021-01-28T03:59:59.487766+0000 mgr.y (mgr.14138) 468 : cluster [DBG] pgmap v332: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:00:00.012 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 03:59:59 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T04:00:00.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:00 smithi100 bash[9834]: audit 2021-01-28T03:59:59.673581+0000 mgr.y (mgr.14138) 469 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:00:00.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:00 smithi100 bash[9834]: cluster 2021-01-28T04:00:00.000110+0000 mon.a (mon.0) 665 : cluster [INF] overall HEALTH_OK 2021-01-28T04:00:00.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:00 smithi100 bash[13549]: audit 2021-01-28T03:59:59.673581+0000 mgr.y (mgr.14138) 469 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:00:00.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:00 smithi100 bash[13549]: cluster 2021-01-28T04:00:00.000110+0000 mon.a (mon.0) 665 : cluster [INF] overall HEALTH_OK 2021-01-28T04:00:01.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:00 smithi162 bash[9856]: audit 2021-01-28T03:59:59.673581+0000 mgr.y (mgr.14138) 469 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:00:01.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:00 smithi162 bash[9856]: cluster 2021-01-28T04:00:00.000110+0000 mon.a (mon.0) 665 : cluster [INF] overall HEALTH_OK 2021-01-28T04:00:01.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:01 smithi100 bash[9834]: cluster 2021-01-28T04:00:01.488638+0000 mgr.y (mgr.14138) 470 : cluster [DBG] pgmap v333: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:00:01.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:01 smithi100 bash[13549]: cluster 2021-01-28T04:00:01.488638+0000 mgr.y (mgr.14138) 470 : cluster [DBG] pgmap v333: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:00:02.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:01 smithi162 bash[9856]: cluster 2021-01-28T04:00:01.488638+0000 mgr.y (mgr.14138) 470 : cluster [DBG] pgmap v333: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:00:03.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:03 smithi100 bash[9834]: cluster 2021-01-28T04:00:03.489918+0000 mgr.y (mgr.14138) 471 : cluster [DBG] pgmap v334: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:00:03.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:03 smithi100 bash[13549]: cluster 2021-01-28T04:00:03.489918+0000 mgr.y (mgr.14138) 471 : cluster [DBG] pgmap v334: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:00:04.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:03 smithi162 bash[9856]: cluster 2021-01-28T04:00:03.489918+0000 mgr.y (mgr.14138) 471 : cluster [DBG] pgmap v334: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:00:05.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:05 smithi100 bash[9834]: cluster 2021-01-28T04:00:05.490874+0000 mgr.y (mgr.14138) 472 : cluster [DBG] pgmap v335: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:00:05.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:05 smithi100 bash[13549]: cluster 2021-01-28T04:00:05.490874+0000 mgr.y (mgr.14138) 472 : cluster [DBG] pgmap v335: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:00:06.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:05 smithi162 bash[9856]: cluster 2021-01-28T04:00:05.490874+0000 mgr.y (mgr.14138) 472 : cluster [DBG] pgmap v335: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:00:08.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:07 smithi162 bash[9856]: cluster 2021-01-28T04:00:07.491981+0000 mgr.y (mgr.14138) 473 : cluster [DBG] pgmap v336: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:00:08.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:07 smithi100 bash[9834]: cluster 2021-01-28T04:00:07.491981+0000 mgr.y (mgr.14138) 473 : cluster [DBG] pgmap v336: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:00:08.078 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:07 smithi100 bash[13549]: cluster 2021-01-28T04:00:07.491981+0000 mgr.y (mgr.14138) 473 : cluster [DBG] pgmap v336: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:00:09.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:09 smithi100 bash[9834]: cluster 2021-01-28T04:00:09.493103+0000 mgr.y (mgr.14138) 474 : cluster [DBG] pgmap v337: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:00:09.827 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 04:00:09 smithi100 bash[10061]: debug 2021-01-28T04:00:09.680+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:00:09.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:09 smithi100 bash[13549]: cluster 2021-01-28T04:00:09.493103+0000 mgr.y (mgr.14138) 474 : cluster [DBG] pgmap v337: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:00:10.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:09 smithi162 bash[9856]: cluster 2021-01-28T04:00:09.493103+0000 mgr.y (mgr.14138) 474 : cluster [DBG] pgmap v337: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:00:10.012 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 04:00:09 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T04:00:10.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:10 smithi100 bash[9834]: audit 2021-01-28T04:00:09.684655+0000 mgr.y (mgr.14138) 475 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:00:10.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:10 smithi100 bash[13549]: audit 2021-01-28T04:00:09.684655+0000 mgr.y (mgr.14138) 475 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:00:11.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:10 smithi162 bash[9856]: audit 2021-01-28T04:00:09.684655+0000 mgr.y (mgr.14138) 475 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:00:12.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:11 smithi162 bash[9856]: cluster 2021-01-28T04:00:11.493732+0000 mgr.y (mgr.14138) 476 : cluster [DBG] pgmap v338: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:00:12.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:11 smithi100 bash[9834]: cluster 2021-01-28T04:00:11.493732+0000 mgr.y (mgr.14138) 476 : cluster [DBG] pgmap v338: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:00:12.078 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:11 smithi100 bash[13549]: cluster 2021-01-28T04:00:11.493732+0000 mgr.y (mgr.14138) 476 : cluster [DBG] pgmap v338: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:00:12.281 INFO:tasks.workunit.client.0.smithi100.stderr:Note: switching to '507028cb839c25d6666833702df6325fd8569096'. 2021-01-28T04:00:12.282 INFO:tasks.workunit.client.0.smithi100.stderr: 2021-01-28T04:00:12.282 INFO:tasks.workunit.client.0.smithi100.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2021-01-28T04:00:12.282 INFO:tasks.workunit.client.0.smithi100.stderr:changes and commit them, and you can discard any commits you make in this 2021-01-28T04:00:12.283 INFO:tasks.workunit.client.0.smithi100.stderr:state without impacting any branches by switching back to a branch. 2021-01-28T04:00:12.283 INFO:tasks.workunit.client.0.smithi100.stderr: 2021-01-28T04:00:12.283 INFO:tasks.workunit.client.0.smithi100.stderr:If you want to create a new branch to retain commits you create, you may 2021-01-28T04:00:12.283 INFO:tasks.workunit.client.0.smithi100.stderr:do so (now or later) by using -c with the switch command. Example: 2021-01-28T04:00:12.283 INFO:tasks.workunit.client.0.smithi100.stderr: 2021-01-28T04:00:12.284 INFO:tasks.workunit.client.0.smithi100.stderr: git switch -c 2021-01-28T04:00:12.284 INFO:tasks.workunit.client.0.smithi100.stderr: 2021-01-28T04:00:12.284 INFO:tasks.workunit.client.0.smithi100.stderr:Or undo this operation with: 2021-01-28T04:00:12.285 INFO:tasks.workunit.client.0.smithi100.stderr: 2021-01-28T04:00:12.285 INFO:tasks.workunit.client.0.smithi100.stderr: git switch - 2021-01-28T04:00:12.285 INFO:tasks.workunit.client.0.smithi100.stderr: 2021-01-28T04:00:12.285 INFO:tasks.workunit.client.0.smithi100.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2021-01-28T04:00:12.286 INFO:tasks.workunit.client.0.smithi100.stderr: 2021-01-28T04:00:12.286 INFO:tasks.workunit.client.0.smithi100.stderr:HEAD is now at 507028cb83 Merge branch 'wip-zabbix-ann' of https://github.com/tchaikov/ceph into wip-kefu-testing-2021-01-27-1353 2021-01-28T04:00:12.287 DEBUG:teuthology.orchestra.run.smithi100:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2021-01-28T04:00:12.346 INFO:tasks.workunit.client.0.smithi100.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2021-01-28T04:00:12.350 INFO:tasks.workunit.client.0.smithi100.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2021-01-28T04:00:12.350 INFO:tasks.workunit.client.0.smithi100.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2021-01-28T04:00:13.137 INFO:tasks.workunit.client.0.smithi100.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2021-01-28T04:00:13.238 INFO:tasks.workunit.client.0.smithi100.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2021-01-28T04:00:13.297 INFO:tasks.workunit.client.0.smithi100.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2021-01-28T04:00:13.300 INFO:tasks.workunit.client.0.smithi100.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2021-01-28T04:00:13.300 INFO:tasks.workunit.client.0.smithi100.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2021-01-28T04:00:13.359 INFO:tasks.workunit.client.0.smithi100.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2021-01-28T04:00:13.363 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2021-01-28T04:00:13.364 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2021-01-28T04:00:13.369 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2021-01-28T04:00:13.370 INFO:tasks.workunit:Running workunit rados/test.sh... 2021-01-28T04:00:13.370 DEBUG:teuthology.orchestra.run.smithi100:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=507028cb839c25d6666833702df6325fd8569096 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2021-01-28T04:00:13.383 INFO:tasks.workunit.client.0.smithi100.stderr:+ parallel=1 2021-01-28T04:00:13.383 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' '' = --serial ']' 2021-01-28T04:00:13.383 INFO:tasks.workunit.client.0.smithi100.stderr:+ color= 2021-01-28T04:00:13.383 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' -t 1 ']' 2021-01-28T04:00:13.384 INFO:tasks.workunit.client.0.smithi100.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2021-01-28T04:00:13.384 INFO:tasks.workunit.client.0.smithi100.stderr:+ declare -A pids 2021-01-28T04:00:13.384 INFO:tasks.workunit.client.0.smithi100.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-28T04:00:13.384 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' 1 -eq 1 ']' 2021-01-28T04:00:13.385 INFO:tasks.workunit.client.0.smithi100.stderr:++ printf %25s api_aio 2021-01-28T04:00:13.385 INFO:tasks.workunit.client.0.smithi100.stderr:+ r=' api_aio' 2021-01-28T04:00:13.385 INFO:tasks.workunit.client.0.smithi100.stderr:++ echo api_aio 2021-01-28T04:00:13.386 INFO:tasks.workunit.client.0.smithi100.stderr:++ awk '{print $1}' 2021-01-28T04:00:13.388 INFO:tasks.workunit.client.0.smithi100.stderr:+ ff=api_aio 2021-01-28T04:00:13.389 INFO:tasks.workunit.client.0.smithi100.stderr:+ pid=32150 2021-01-28T04:00:13.389 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo 'test api_aio on pid 32150' 2021-01-28T04:00:13.389 INFO:tasks.workunit.client.0.smithi100.stderr:+ pids[$f]=32150 2021-01-28T04:00:13.389 INFO:tasks.workunit.client.0.smithi100.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-28T04:00:13.390 INFO:tasks.workunit.client.0.smithi100.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2021-01-28T04:00:13.390 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' 1 -eq 1 ']' 2021-01-28T04:00:13.390 INFO:tasks.workunit.client.0.smithi100.stdout:test api_aio on pid 32150 2021-01-28T04:00:13.391 INFO:tasks.workunit.client.0.smithi100.stderr:++ printf %25s api_aio_pp 2021-01-28T04:00:13.392 INFO:tasks.workunit.client.0.smithi100.stderr:+ r=' api_aio_pp' 2021-01-28T04:00:13.392 INFO:tasks.workunit.client.0.smithi100.stderr:++ echo api_aio_pp 2021-01-28T04:00:13.393 INFO:tasks.workunit.client.0.smithi100.stderr:++ awk '{print $1}' 2021-01-28T04:00:13.393 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' -z '' ']' 2021-01-28T04:00:13.393 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.394 INFO:tasks.workunit.client.0.smithi100.stderr:+ case $- in 2021-01-28T04:00:13.394 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.395 INFO:tasks.workunit.client.0.smithi100.stderr:+ tee ceph_test_rados_api_aio.log 2021-01-28T04:00:13.395 INFO:tasks.workunit.client.0.smithi100.stderr:+ ceph_test_rados_api_aio 2021-01-28T04:00:13.396 INFO:tasks.workunit.client.0.smithi100.stderr:+ sed 's/^/ api_aio: /' 2021-01-28T04:00:13.399 INFO:tasks.workunit.client.0.smithi100.stderr:+ ff=api_aio_pp 2021-01-28T04:00:13.399 INFO:tasks.workunit.client.0.smithi100.stderr:+ pid=32158 2021-01-28T04:00:13.400 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo 'test api_aio_pp on pid 32158' 2021-01-28T04:00:13.400 INFO:tasks.workunit.client.0.smithi100.stderr:+ pids[$f]=32158 2021-01-28T04:00:13.401 INFO:tasks.workunit.client.0.smithi100.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-28T04:00:13.401 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' 1 -eq 1 ']' 2021-01-28T04:00:13.401 INFO:tasks.workunit.client.0.smithi100.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2021-01-28T04:00:13.402 INFO:tasks.workunit.client.0.smithi100.stderr:++ printf %25s api_io 2021-01-28T04:00:13.403 INFO:tasks.workunit.client.0.smithi100.stderr:+ r=' api_io' 2021-01-28T04:00:13.403 INFO:tasks.workunit.client.0.smithi100.stderr:++ echo api_io 2021-01-28T04:00:13.404 INFO:tasks.workunit.client.0.smithi100.stderr:++ awk '{print $1}' 2021-01-28T04:00:13.404 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' -z '' ']' 2021-01-28T04:00:13.404 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.405 INFO:tasks.workunit.client.0.smithi100.stderr:+ case $- in 2021-01-28T04:00:13.405 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.406 INFO:tasks.workunit.client.0.smithi100.stderr:+ tee ceph_test_rados_api_aio_pp.log 2021-01-28T04:00:13.406 INFO:tasks.workunit.client.0.smithi100.stderr:+ ceph_test_rados_api_aio_pp 2021-01-28T04:00:13.406 INFO:tasks.workunit.client.0.smithi100.stderr:+ sed 's/^/ api_aio_pp: /' 2021-01-28T04:00:13.407 INFO:tasks.workunit.client.0.smithi100.stderr:+ ff=api_io 2021-01-28T04:00:13.407 INFO:tasks.workunit.client.0.smithi100.stdout:test api_aio_pp on pid 32158 2021-01-28T04:00:13.419 INFO:tasks.workunit.client.0.smithi100.stderr:+ pid=32166 2021-01-28T04:00:13.420 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo 'test api_io on pid 32166' 2021-01-28T04:00:13.420 INFO:tasks.workunit.client.0.smithi100.stderr:+ pids[$f]=32166 2021-01-28T04:00:13.421 INFO:tasks.workunit.client.0.smithi100.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2021-01-28T04:00:13.421 INFO:tasks.workunit.client.0.smithi100.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-28T04:00:13.421 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' 1 -eq 1 ']' 2021-01-28T04:00:13.422 INFO:tasks.workunit.client.0.smithi100.stderr:++ printf %25s api_io_pp 2021-01-28T04:00:13.422 INFO:tasks.workunit.client.0.smithi100.stderr:+ r=' api_io_pp' 2021-01-28T04:00:13.423 INFO:tasks.workunit.client.0.smithi100.stderr:++ awk '{print $1}' 2021-01-28T04:00:13.423 INFO:tasks.workunit.client.0.smithi100.stderr:++ echo api_io_pp 2021-01-28T04:00:13.424 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' -z '' ']' 2021-01-28T04:00:13.424 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.424 INFO:tasks.workunit.client.0.smithi100.stderr:+ case $- in 2021-01-28T04:00:13.425 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.425 INFO:tasks.workunit.client.0.smithi100.stderr:+ tee ceph_test_rados_api_io.log 2021-01-28T04:00:13.426 INFO:tasks.workunit.client.0.smithi100.stderr:+ sed 's/^/ api_io: /' 2021-01-28T04:00:13.426 INFO:tasks.workunit.client.0.smithi100.stderr:+ ceph_test_rados_api_io 2021-01-28T04:00:13.426 INFO:tasks.workunit.client.0.smithi100.stderr:+ ff=api_io_pp 2021-01-28T04:00:13.427 INFO:tasks.workunit.client.0.smithi100.stderr:+ pid=32174 2021-01-28T04:00:13.427 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo 'test api_io_pp on pid 32174' 2021-01-28T04:00:13.428 INFO:tasks.workunit.client.0.smithi100.stderr:+ pids[$f]=32174 2021-01-28T04:00:13.428 INFO:tasks.workunit.client.0.smithi100.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-28T04:00:13.428 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' 1 -eq 1 ']' 2021-01-28T04:00:13.429 INFO:tasks.workunit.client.0.smithi100.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2021-01-28T04:00:13.429 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' -z '' ']' 2021-01-28T04:00:13.430 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.430 INFO:tasks.workunit.client.0.smithi100.stderr:+ case $- in 2021-01-28T04:00:13.430 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.431 INFO:tasks.workunit.client.0.smithi100.stderr:++ printf %25s api_asio 2021-01-28T04:00:13.431 INFO:tasks.workunit.client.0.smithi100.stderr:+ ceph_test_rados_api_io_pp 2021-01-28T04:00:13.432 INFO:tasks.workunit.client.0.smithi100.stderr:+ tee ceph_test_rados_api_io_pp.log 2021-01-28T04:00:13.432 INFO:tasks.workunit.client.0.smithi100.stderr:+ r=' api_asio' 2021-01-28T04:00:13.432 INFO:tasks.workunit.client.0.smithi100.stderr:++ echo api_asio 2021-01-28T04:00:13.433 INFO:tasks.workunit.client.0.smithi100.stderr:++ awk '{print $1}' 2021-01-28T04:00:13.433 INFO:tasks.workunit.client.0.smithi100.stderr:+ sed 's/^/ api_io_pp: /' 2021-01-28T04:00:13.433 INFO:tasks.workunit.client.0.smithi100.stderr:+ ff=api_asio 2021-01-28T04:00:13.434 INFO:tasks.workunit.client.0.smithi100.stderr:+ pid=32182 2021-01-28T04:00:13.434 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo 'test api_asio on pid 32182' 2021-01-28T04:00:13.434 INFO:tasks.workunit.client.0.smithi100.stderr:+ pids[$f]=32182 2021-01-28T04:00:13.434 INFO:tasks.workunit.client.0.smithi100.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-28T04:00:13.435 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' 1 -eq 1 ']' 2021-01-28T04:00:13.435 INFO:tasks.workunit.client.0.smithi100.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2021-01-28T04:00:13.435 INFO:tasks.workunit.client.0.smithi100.stderr:++ printf %25s api_list 2021-01-28T04:00:13.435 INFO:tasks.workunit.client.0.smithi100.stderr:+ r=' api_list' 2021-01-28T04:00:13.436 INFO:tasks.workunit.client.0.smithi100.stderr:++ echo api_list 2021-01-28T04:00:13.436 INFO:tasks.workunit.client.0.smithi100.stderr:++ awk '{print $1}' 2021-01-28T04:00:13.436 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' -z '' ']' 2021-01-28T04:00:13.436 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.436 INFO:tasks.workunit.client.0.smithi100.stderr:+ case $- in 2021-01-28T04:00:13.437 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.437 INFO:tasks.workunit.client.0.smithi100.stderr:+ ceph_test_rados_api_asio 2021-01-28T04:00:13.437 INFO:tasks.workunit.client.0.smithi100.stderr:+ sed 's/^/ api_asio: /' 2021-01-28T04:00:13.437 INFO:tasks.workunit.client.0.smithi100.stderr:+ tee ceph_test_rados_api_asio.log 2021-01-28T04:00:13.437 INFO:tasks.workunit.client.0.smithi100.stderr:+ ff=api_list 2021-01-28T04:00:13.438 INFO:tasks.workunit.client.0.smithi100.stderr:+ pid=32190 2021-01-28T04:00:13.438 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo 'test api_list on pid 32190' 2021-01-28T04:00:13.438 INFO:tasks.workunit.client.0.smithi100.stderr:+ pids[$f]=32190 2021-01-28T04:00:13.438 INFO:tasks.workunit.client.0.smithi100.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-28T04:00:13.438 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' 1 -eq 1 ']' 2021-01-28T04:00:13.439 INFO:tasks.workunit.client.0.smithi100.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2021-01-28T04:00:13.439 INFO:tasks.workunit.client.0.smithi100.stderr:++ printf %25s api_lock 2021-01-28T04:00:13.439 INFO:tasks.workunit.client.0.smithi100.stderr:+ r=' api_lock' 2021-01-28T04:00:13.439 INFO:tasks.workunit.client.0.smithi100.stderr:++ awk '{print $1}' 2021-01-28T04:00:13.440 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' -z '' ']' 2021-01-28T04:00:13.440 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.440 INFO:tasks.workunit.client.0.smithi100.stderr:+ case $- in 2021-01-28T04:00:13.440 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.440 INFO:tasks.workunit.client.0.smithi100.stderr:+ ceph_test_rados_api_list 2021-01-28T04:00:13.441 INFO:tasks.workunit.client.0.smithi100.stderr:++ echo api_lock 2021-01-28T04:00:13.441 INFO:tasks.workunit.client.0.smithi100.stderr:+ tee ceph_test_rados_api_list.log 2021-01-28T04:00:13.441 INFO:tasks.workunit.client.0.smithi100.stderr:+ sed 's/^/ api_list: /' 2021-01-28T04:00:13.441 INFO:tasks.workunit.client.0.smithi100.stderr:+ ff=api_lock 2021-01-28T04:00:13.441 INFO:tasks.workunit.client.0.smithi100.stderr:+ pid=32198 2021-01-28T04:00:13.442 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo 'test api_lock on pid 32198' 2021-01-28T04:00:13.442 INFO:tasks.workunit.client.0.smithi100.stderr:+ pids[$f]=32198 2021-01-28T04:00:13.442 INFO:tasks.workunit.client.0.smithi100.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-28T04:00:13.442 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' 1 -eq 1 ']' 2021-01-28T04:00:13.442 INFO:tasks.workunit.client.0.smithi100.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2021-01-28T04:00:13.443 INFO:tasks.workunit.client.0.smithi100.stdout:test api_io on pid 32166 2021-01-28T04:00:13.443 INFO:tasks.workunit.client.0.smithi100.stdout:test api_io_pp on pid 32174 2021-01-28T04:00:13.443 INFO:tasks.workunit.client.0.smithi100.stdout:test api_asio on pid 32182 2021-01-28T04:00:13.443 INFO:tasks.workunit.client.0.smithi100.stdout:test api_list on pid 32190 2021-01-28T04:00:13.444 INFO:tasks.workunit.client.0.smithi100.stdout:test api_lock on pid 32198 2021-01-28T04:00:13.449 INFO:tasks.workunit.client.0.smithi100.stderr:++ printf %25s api_lock_pp 2021-01-28T04:00:13.449 INFO:tasks.workunit.client.0.smithi100.stderr:+ r=' api_lock_pp' 2021-01-28T04:00:13.449 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' -z '' ']' 2021-01-28T04:00:13.449 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.449 INFO:tasks.workunit.client.0.smithi100.stderr:+ case $- in 2021-01-28T04:00:13.450 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.450 INFO:tasks.workunit.client.0.smithi100.stderr:+ tee ceph_test_rados_api_lock.log 2021-01-28T04:00:13.450 INFO:tasks.workunit.client.0.smithi100.stderr:++ echo api_lock_pp 2021-01-28T04:00:13.450 INFO:tasks.workunit.client.0.smithi100.stderr:+ sed 's/^/ api_lock: /' 2021-01-28T04:00:13.451 INFO:tasks.workunit.client.0.smithi100.stderr:++ awk '{print $1}' 2021-01-28T04:00:13.451 INFO:tasks.workunit.client.0.smithi100.stderr:+ ceph_test_rados_api_lock 2021-01-28T04:00:13.452 INFO:tasks.workunit.client.0.smithi100.stderr:+ ff=api_lock_pp 2021-01-28T04:00:13.452 INFO:tasks.workunit.client.0.smithi100.stderr:+ pid=32210 2021-01-28T04:00:13.452 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo 'test api_lock_pp on pid 32210' 2021-01-28T04:00:13.452 INFO:tasks.workunit.client.0.smithi100.stderr:+ pids[$f]=32210 2021-01-28T04:00:13.452 INFO:tasks.workunit.client.0.smithi100.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-28T04:00:13.453 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' 1 -eq 1 ']' 2021-01-28T04:00:13.453 INFO:tasks.workunit.client.0.smithi100.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2021-01-28T04:00:13.453 INFO:tasks.workunit.client.0.smithi100.stderr:++ printf %25s api_misc 2021-01-28T04:00:13.453 INFO:tasks.workunit.client.0.smithi100.stderr:+ r=' api_misc' 2021-01-28T04:00:13.454 INFO:tasks.workunit.client.0.smithi100.stderr:++ echo api_misc 2021-01-28T04:00:13.454 INFO:tasks.workunit.client.0.smithi100.stderr:++ awk '{print $1}' 2021-01-28T04:00:13.454 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' -z '' ']' 2021-01-28T04:00:13.454 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.454 INFO:tasks.workunit.client.0.smithi100.stderr:+ case $- in 2021-01-28T04:00:13.455 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.455 INFO:tasks.workunit.client.0.smithi100.stderr:+ ceph_test_rados_api_lock_pp 2021-01-28T04:00:13.455 INFO:tasks.workunit.client.0.smithi100.stderr:+ sed 's/^/ api_lock_pp: /' 2021-01-28T04:00:13.455 INFO:tasks.workunit.client.0.smithi100.stderr:+ tee ceph_test_rados_api_lock_pp.log 2021-01-28T04:00:13.455 INFO:tasks.workunit.client.0.smithi100.stderr:+ ff=api_misc 2021-01-28T04:00:13.456 INFO:tasks.workunit.client.0.smithi100.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2021-01-28T04:00:13.456 INFO:tasks.workunit.client.0.smithi100.stderr:+ pid=32269 2021-01-28T04:00:13.456 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo 'test api_misc on pid 32269' 2021-01-28T04:00:13.456 INFO:tasks.workunit.client.0.smithi100.stderr:+ pids[$f]=32269 2021-01-28T04:00:13.457 INFO:tasks.workunit.client.0.smithi100.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-28T04:00:13.457 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' 1 -eq 1 ']' 2021-01-28T04:00:13.457 INFO:tasks.workunit.client.0.smithi100.stderr:++ printf %25s api_misc_pp 2021-01-28T04:00:13.457 INFO:tasks.workunit.client.0.smithi100.stderr:+ r=' api_misc_pp' 2021-01-28T04:00:13.457 INFO:tasks.workunit.client.0.smithi100.stderr:++ awk '{print $1}' 2021-01-28T04:00:13.458 INFO:tasks.workunit.client.0.smithi100.stderr:++ echo api_misc_pp 2021-01-28T04:00:13.458 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' -z '' ']' 2021-01-28T04:00:13.458 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.458 INFO:tasks.workunit.client.0.smithi100.stderr:+ case $- in 2021-01-28T04:00:13.458 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.459 INFO:tasks.workunit.client.0.smithi100.stderr:+ tee ceph_test_rados_api_misc.log 2021-01-28T04:00:13.459 INFO:tasks.workunit.client.0.smithi100.stderr:+ ff=api_misc_pp 2021-01-28T04:00:13.459 INFO:tasks.workunit.client.0.smithi100.stderr:+ pid=32298 2021-01-28T04:00:13.459 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo 'test api_misc_pp on pid 32298' 2021-01-28T04:00:13.459 INFO:tasks.workunit.client.0.smithi100.stderr:+ pids[$f]=32298 2021-01-28T04:00:13.460 INFO:tasks.workunit.client.0.smithi100.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-28T04:00:13.460 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' 1 -eq 1 ']' 2021-01-28T04:00:13.460 INFO:tasks.workunit.client.0.smithi100.stderr:+ ceph_test_rados_api_misc 2021-01-28T04:00:13.460 INFO:tasks.workunit.client.0.smithi100.stderr:++ printf %25s api_tier_pp 2021-01-28T04:00:13.460 INFO:tasks.workunit.client.0.smithi100.stderr:+ r=' api_tier_pp' 2021-01-28T04:00:13.461 INFO:tasks.workunit.client.0.smithi100.stdout:test api_lock_pp on pid 32210 2021-01-28T04:00:13.461 INFO:tasks.workunit.client.0.smithi100.stdout:test api_misc on pid 32269 2021-01-28T04:00:13.461 INFO:tasks.workunit.client.0.smithi100.stdout:test api_misc_pp on pid 32298 2021-01-28T04:00:13.463 INFO:tasks.workunit.client.0.smithi100.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2021-01-28T04:00:13.463 INFO:tasks.workunit.client.0.smithi100.stderr:+ sed 's/^/ api_misc: /' 2021-01-28T04:00:13.463 INFO:tasks.workunit.client.0.smithi100.stderr:++ echo api_tier_pp 2021-01-28T04:00:13.463 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' -z '' ']' 2021-01-28T04:00:13.464 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.464 INFO:tasks.workunit.client.0.smithi100.stderr:++ awk '{print $1}' 2021-01-28T04:00:13.464 INFO:tasks.workunit.client.0.smithi100.stderr:+ case $- in 2021-01-28T04:00:13.465 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.465 INFO:tasks.workunit.client.0.smithi100.stderr:+ ceph_test_rados_api_misc_pp 2021-01-28T04:00:13.466 INFO:tasks.workunit.client.0.smithi100.stderr:+ tee ceph_test_rados_api_misc_pp.log 2021-01-28T04:00:13.466 INFO:tasks.workunit.client.0.smithi100.stderr:+ sed 's/^/ api_misc_pp: /' 2021-01-28T04:00:13.466 INFO:tasks.workunit.client.0.smithi100.stderr:+ ff=api_tier_pp 2021-01-28T04:00:13.467 INFO:tasks.workunit.client.0.smithi100.stderr:+ pid=32318 2021-01-28T04:00:13.467 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo 'test api_tier_pp on pid 32318' 2021-01-28T04:00:13.467 INFO:tasks.workunit.client.0.smithi100.stderr:+ pids[$f]=32318 2021-01-28T04:00:13.468 INFO:tasks.workunit.client.0.smithi100.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-28T04:00:13.468 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' 1 -eq 1 ']' 2021-01-28T04:00:13.468 INFO:tasks.workunit.client.0.smithi100.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_tier_pp 2>&1 | tee ceph_test_rados_api_tier_pp.log | sed "s/^/ api_tier_pp: /"' 2021-01-28T04:00:13.469 INFO:tasks.workunit.client.0.smithi100.stdout:test api_tier_pp on pid 32318 2021-01-28T04:00:13.470 INFO:tasks.workunit.client.0.smithi100.stderr:++ printf %25s api_pool 2021-01-28T04:00:13.470 INFO:tasks.workunit.client.0.smithi100.stderr:+ r=' api_pool' 2021-01-28T04:00:13.470 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' -z '' ']' 2021-01-28T04:00:13.471 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.471 INFO:tasks.workunit.client.0.smithi100.stderr:+ case $- in 2021-01-28T04:00:13.471 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.471 INFO:tasks.workunit.client.0.smithi100.stderr:+ ceph_test_rados_api_tier_pp 2021-01-28T04:00:13.471 INFO:tasks.workunit.client.0.smithi100.stderr:+ tee ceph_test_rados_api_tier_pp.log 2021-01-28T04:00:13.472 INFO:tasks.workunit.client.0.smithi100.stderr:++ awk '{print $1}' 2021-01-28T04:00:13.472 INFO:tasks.workunit.client.0.smithi100.stderr:++ echo api_pool 2021-01-28T04:00:13.473 INFO:tasks.workunit.client.0.smithi100.stderr:+ sed 's/^/ api_tier_pp: /' 2021-01-28T04:00:13.478 INFO:tasks.workunit.client.0.smithi100.stderr:+ ff=api_pool 2021-01-28T04:00:13.478 INFO:tasks.workunit.client.0.smithi100.stderr:+ pid=32349 2021-01-28T04:00:13.479 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo 'test api_pool on pid 32349' 2021-01-28T04:00:13.480 INFO:tasks.workunit.client.0.smithi100.stderr:+ pids[$f]=32349 2021-01-28T04:00:13.480 INFO:tasks.workunit.client.0.smithi100.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-28T04:00:13.480 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' 1 -eq 1 ']' 2021-01-28T04:00:13.481 INFO:tasks.workunit.client.0.smithi100.stdout:test api_pool on pid 32349 2021-01-28T04:00:13.483 INFO:tasks.workunit.client.0.smithi100.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2021-01-28T04:00:13.483 INFO:tasks.workunit.client.0.smithi100.stderr:++ printf %25s api_snapshots 2021-01-28T04:00:13.484 INFO:tasks.workunit.client.0.smithi100.stderr:+ r=' api_snapshots' 2021-01-28T04:00:13.484 INFO:tasks.workunit.client.0.smithi100.stderr:++ awk '{print $1}' 2021-01-28T04:00:13.484 INFO:tasks.workunit.client.0.smithi100.stderr:++ echo api_snapshots 2021-01-28T04:00:13.485 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: [==========] Running 11 tests from 4 test suites. 2021-01-28T04:00:13.485 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: [----------] Global test environment set-up. 2021-01-28T04:00:13.486 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2021-01-28T04:00:13.486 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2021-01-28T04:00:13.487 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2021-01-28T04:00:13.487 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2021-01-28T04:00:13.488 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.488 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: [----------] 1 test from LibRadosMiscConnectFailure 2021-01-28T04:00:13.489 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2021-01-28T04:00:13.489 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 0 2021-01-28T04:00:13.490 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc0b19d3c0 10 monclient: get_monmap_and_config 2021-01-28T04:00:13.490 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc0b19d3c0 10 monclient: build_initial_monmap 2021-01-28T04:00:13.490 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc0b19d3c0 10 monclient: monmap: 2021-01-28T04:00:13.491 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: epoch 0 2021-01-28T04:00:13.491 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: fsid c217df96-611b-11eb-8f9e-001a4aab830c 2021-01-28T04:00:13.492 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: last_changed 2021-01-28T04:00:13.481166+0000 2021-01-28T04:00:13.492 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: created 2021-01-28T04:00:13.481166+0000 2021-01-28T04:00:13.492 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: min_mon_release 0 (unknown) 2021-01-28T04:00:13.493 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: election_strategy: 1 2021-01-28T04:00:13.493 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.noname-a 2021-01-28T04:00:13.494 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.noname-b 2021-01-28T04:00:13.494 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2: [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] mon.noname-c 2021-01-28T04:00:13.494 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.495 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc0b19d3c0 1 Processor -- start 2021-01-28T04:00:13.495 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc0b19d3c0 1 -- start start 2021-01-28T04:00:13.496 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc0b19d3c0 10 monclient: init 2021-01-28T04:00:13.496 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc0b19d3c0 10 monclient: _reopen_session rank -1 2021-01-28T04:00:13.496 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc0b19d3c0 10 monclient: _add_conns ranks=[1,0,2] 2021-01-28T04:00:13.497 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc0b19d3c0 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbe9fa5e0 0x55fdbe9f9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T04:00:13.497 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc0b19d3c0 10 monclient(hunting): picked mon.noname-b con 0x55fdbe9fa5e0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2021-01-28T04:00:13.499 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc0b19d3c0 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbe9f9560 0x55fdbe9f99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T04:00:13.499 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc0b19d3c0 10 monclient(hunting): picked mon.noname-a con 0x55fdbe9f9560 addr [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] 2021-01-28T04:00:13.500 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc0b19d3c0 1 --2- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea98140 0x55fdbea9a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T04:00:13.500 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc0b19d3c0 10 monclient(hunting): picked mon.noname-c con 0x55fdbea98140 addr [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] 2021-01-28T04:00:13.500 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc0b19d3c0 10 monclient(hunting): start opening mon connection 2021-01-28T04:00:13.500 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc0b19d3c0 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdbe9483f0 con 0x55fdbe9f9560 2021-01-28T04:00:13.501 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc0b19d3c0 10 monclient(hunting): start opening mon connection 2021-01-28T04:00:13.501 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc0b19d3c0 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdbe949200 con 0x55fdbe9fa5e0 2021-01-28T04:00:13.501 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc0b19d3c0 10 monclient(hunting): start opening mon connection 2021-01-28T04:00:13.501 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc0b19d3c0 1 -- --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fdbe916760 con 0x55fdbea98140 2021-01-28T04:00:13.501 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc0b19d3c0 10 monclient(hunting): _renew_subs 2021-01-28T04:00:13.502 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc0b19d3c0 10 monclient(hunting): authenticate will time out at 2021-01-28T04:00:13.482085+0000 2021-01-28T04:00:13.502 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc0b19d3c0 0 monclient(hunting): authenticate timed out after 1e-09 2021-01-28T04:00:13.502 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc0b19d3c0 10 monclient(hunting): shutdown 2021-01-28T04:00:13.502 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc0b19d3c0 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-01-28T04:00:13.503 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc0b19d3c0 1 -- >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea98140 msgr2=0x55fdbea9a530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-28T04:00:13.503 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc07374700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbe9f9560 0x55fdbe9f99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T04:00:13.503 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc07374700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbe9f9560 0x55fdbe9f99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60284/0 (socket says 172.21.15.100:60284) 2021-01-28T04:00:13.504 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc07374700 1 -- 172.21.15.100:0/400957382 learned_addr learned my addr 172.21.15.100:0/400957382 (peer_addr_for_me v2:172.21.15.100:0/0) 2021-01-28T04:00:13.504 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc07b75700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbe9fa5e0 0x55fdbe9f9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T04:00:13.504 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc08376700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea98140 0x55fdbea9a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T04:00:13.505 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea98140 0x55fdbea9a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T04:00:13.505 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbe9fa5e0 msgr2=0x55fdbe9f9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-28T04:00:13.505 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbe9fa5e0 0x55fdbe9f9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T04:00:13.505 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbe9f9560 msgr2=0x55fdbe9f99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-28T04:00:13.505 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbe9f9560 0x55fdbe9f99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T04:00:13.506 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc07374700 10 monclient: get_auth_request con 0x55fdbe9f9560 auth_method 0 2021-01-28T04:00:13.508 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' -z '' ']' 2021-01-28T04:00:13.509 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.509 INFO:tasks.workunit.client.0.smithi100.stderr:+ case $- in 2021-01-28T04:00:13.509 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.509 INFO:tasks.workunit.client.0.smithi100.stderr:+ sed 's/^/ api_pool: /' 2021-01-28T04:00:13.509 INFO:tasks.workunit.client.0.smithi100.stderr:+ ff=api_snapshots 2021-01-28T04:00:13.510 INFO:tasks.workunit.client.0.smithi100.stderr:+ pid=32367 2021-01-28T04:00:13.510 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo 'test api_snapshots on pid 32367' 2021-01-28T04:00:13.510 INFO:tasks.workunit.client.0.smithi100.stderr:+ pids[$f]=32367 2021-01-28T04:00:13.510 INFO:tasks.workunit.client.0.smithi100.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-28T04:00:13.510 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' 1 -eq 1 ']' 2021-01-28T04:00:13.511 INFO:tasks.workunit.client.0.smithi100.stderr:+ tee ceph_test_rados_api_pool.log 2021-01-28T04:00:13.511 INFO:tasks.workunit.client.0.smithi100.stderr:+ ceph_test_rados_api_pool 2021-01-28T04:00:13.511 INFO:tasks.workunit.client.0.smithi100.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2021-01-28T04:00:13.511 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' -z '' ']' 2021-01-28T04:00:13.511 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.512 INFO:tasks.workunit.client.0.smithi100.stderr:+ case $- in 2021-01-28T04:00:13.512 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.512 INFO:tasks.workunit.client.0.smithi100.stderr:+ ceph_test_rados_api_snapshots 2021-01-28T04:00:13.512 INFO:tasks.workunit.client.0.smithi100.stderr:++ printf %25s api_snapshots_pp 2021-01-28T04:00:13.513 INFO:tasks.workunit.client.0.smithi100.stderr:+ r=' api_snapshots_pp' 2021-01-28T04:00:13.513 INFO:tasks.workunit.client.0.smithi100.stderr:+ tee ceph_test_rados_api_snapshots.log 2021-01-28T04:00:13.513 INFO:tasks.workunit.client.0.smithi100.stderr:+ sed 's/^/ api_snapshots: /' 2021-01-28T04:00:13.513 INFO:tasks.workunit.client.0.smithi100.stderr:++ echo api_snapshots_pp 2021-01-28T04:00:13.513 INFO:tasks.workunit.client.0.smithi100.stderr:++ awk '{print $1}' 2021-01-28T04:00:13.514 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc07374700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbe9f9560 0x55fdbe9f99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 test api_snapshots on pid 32367 2021-01-28T04:00:13.514 INFO:tasks.workunit.client.0.smithi100.stdout:rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-28T04:00:13.514 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc07b75700 10 monclient: get_auth_request con 0x55fdbe9fa5e0 auth_method 0 2021-01-28T04:00:13.514 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc08376700 10 monclient: get_auth_request con 0x55fdbea98140 auth_method 0 2021-01-28T04:00:13.514 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc07b75700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbe9fa5e0 0x55fdbe9f9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-28T04:00:13.515 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.476+0000 7fbc08376700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea98140 0x55fdbea9a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-28T04:00:13.515 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.480+0000 7fbc0b19d3c0 10 monclient: init 2021-01-28T04:00:13.515 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.480+0000 7fbc0b19d3c0 10 monclient: _reopen_session rank -1 2021-01-28T04:00:13.515 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.480+0000 7fbc0b19d3c0 10 monclient: _add_conns ranks=[1,0,2] 2021-01-28T04:00:13.516 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.480+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbe9fa5e0 0x55fdbe9f9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T04:00:13.516 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.480+0000 7fbc0b19d3c0 10 monclient(hunting): picked mon.noname-b con 0x55fdbe9fa5e0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2021-01-28T04:00:13.516 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.480+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbe9f9560 0x55fdbe9f99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T04:00:13.516 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.480+0000 7fbc0b19d3c0 10 monclient(hunting): picked mon.noname-a con 0x55fdbe9f9560 addr [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] 2021-01-28T04:00:13.516 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.480+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea98140 0x55fdbea9a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T04:00:13.517 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.480+0000 7fbc0b19d3c0 10 monclient(hunting): picked mon.noname-c con 0x55fdbea98140 addr [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] 2021-01-28T04:00:13.517 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.480+0000 7fbc0b19d3c0 10 monclient(hunting): start opening mon connection 2021-01-28T04:00:13.517 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.480+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdbe9483f0 con 0x55fdbe9f9560 2021-01-28T04:00:13.517 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.480+0000 7fbc0b19d3c0 10 monclient(hunting): start opening mon connection 2021-01-28T04:00:13.517 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.480+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdbe949200 con 0x55fdbe9fa5e0 2021-01-28T04:00:13.518 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.480+0000 7fbc0b19d3c0 10 monclient(hunting): start opening mon connection 2021-01-28T04:00:13.518 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.480+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fdbe916760 con 0x55fdbea98140 2021-01-28T04:00:13.518 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.480+0000 7fbc0b19d3c0 10 monclient(hunting): _renew_subs 2021-01-28T04:00:13.518 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.480+0000 7fbc0b19d3c0 10 monclient(hunting): authenticate will time out at 2021-01-28T04:00:13.484702+0000 2021-01-28T04:00:13.519 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.480+0000 7fbc07374700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbe9f9560 0x55fdbe9f99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T04:00:13.519 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.480+0000 7fbc0b19d3c0 0 monclient(hunting): authenticate timed out after 1e-09 2021-01-28T04:00:13.519 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.480+0000 7fbc0b19d3c0 10 monclient(hunting): shutdown 2021-01-28T04:00:13.519 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.480+0000 7fbc0b19d3c0 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-01-28T04:00:13.519 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.480+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea98140 msgr2=0x55fdbea9a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-28T04:00:13.520 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.480+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea98140 0x55fdbea9a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-28T04:00:13.520 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.480+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbe9fa5e0 msgr2=0x55fdbe9f9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-28T04:00:13.520 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.480+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbe9fa5e0 0x55fdbe9f9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-28T04:00:13.520 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.480+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbe9f9560 msgr2=0x55fdbe9f99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-28T04:00:13.520 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.480+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbe9f9560 0x55fdbe9f99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T04:00:13.521 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.480+0000 7fbc07374700 10 monclient: get_auth_request con 0x55fdbe9f9560 auth_method 0 2021-01-28T04:00:13.521 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.480+0000 7fbc07374700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbe9f9560 0x55fdbe9f99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-28T04:00:13.521 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.484+0000 7fbc0b19d3c0 10 monclient: init 2021-01-28T04:00:13.521 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.484+0000 7fbc0b19d3c0 10 monclient: _reopen_session rank -1 2021-01-28T04:00:13.521 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.484+0000 7fbc0b19d3c0 10 monclient: _add_conns ranks=[2,0,1] 2021-01-28T04:00:13.522 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.484+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea98140 0x55fdbea9a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T04:00:13.522 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.484+0000 7fbc0b19d3c0 10 monclient(hunting): picked mon.noname-c con 0x55fdbea98140 addr [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] 2021-01-28T04:00:13.522 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.484+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbe9f9560 0x55fdbe9f99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T04:00:13.522 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.484+0000 7fbc0b19d3c0 10 monclient(hunting): picked mon.noname-a con 0x55fdbe9f9560 addr [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] 2021-01-28T04:00:13.523 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.484+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbe9fa5e0 0x55fdbe9f9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T04:00:13.523 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.484+0000 7fbc0b19d3c0 10 monclient(hunting): picked mon.noname-b con 0x55fdbe9fa5e0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2021-01-28T04:00:13.523 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.484+0000 7fbc0b19d3c0 10 monclient(hunting): start opening mon connection 2021-01-28T04:00:13.523 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.484+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdbe9483f0 con 0x55fdbe9f9560 2021-01-28T04:00:13.523 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.484+0000 7fbc0b19d3c0 10 monclient(hunting): start opening mon connection 2021-01-28T04:00:13.524 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.484+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdbe949200 con 0x55fdbe9fa5e0 2021-01-28T04:00:13.524 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.484+0000 7fbc0b19d3c0 10 monclient(hunting): start opening mon connection 2021-01-28T04:00:13.524 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.484+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fdbe916760 con 0x55fdbea98140 2021-01-28T04:00:13.524 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.484+0000 7fbc0b19d3c0 10 monclient(hunting): _renew_subs 2021-01-28T04:00:13.524 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.484+0000 7fbc0b19d3c0 10 monclient(hunting): authenticate will time out at 2021-01-28T04:00:13.487686+0000 2021-01-28T04:00:13.525 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.484+0000 7fbc0b19d3c0 0 monclient(hunting): authenticate timed out after 1e-09 2021-01-28T04:00:13.525 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.484+0000 7fbc0b19d3c0 10 monclient(hunting): shutdown 2021-01-28T04:00:13.525 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.484+0000 7fbc0b19d3c0 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-01-28T04:00:13.525 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.484+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea98140 msgr2=0x55fdbea9a530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-28T04:00:13.525 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.484+0000 7fbc08376700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbe9fa5e0 0x55fdbe9f9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T04:00:13.526 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.484+0000 7fbc07b75700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea98140 0x55fdbea9a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T04:00:13.526 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.484+0000 7fbc07374700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbe9f9560 0x55fdbe9f99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T04:00:13.526 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.484+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea98140 0x55fdbea9a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T04:00:13.526 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.484+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbe9fa5e0 msgr2=0x55fdbe9f9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-28T04:00:13.527 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.484+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbe9fa5e0 0x55fdbe9f9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T04:00:13.527 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.484+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbe9f9560 msgr2=0x55fdbe9f99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-28T04:00:13.527 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.484+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbe9f9560 0x55fdbe9f99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T04:00:13.527 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.484+0000 7fbc08376700 10 monclient: get_auth_request con 0x55fdbe9fa5e0 auth_method 0 2021-01-28T04:00:13.527 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.484+0000 7fbc08376700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbe9fa5e0 0x55fdbe9f9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-28T04:00:13.528 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.484+0000 7fbc07b75700 10 monclient: get_auth_request con 0x55fdbea98140 auth_method 0 2021-01-28T04:00:13.528 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.484+0000 7fbc07b75700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea98140 0x55fdbea9a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-28T04:00:13.528 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.484+0000 7fbc07374700 10 monclient: get_auth_request con 0x55fdbe9f9560 auth_method 0 2021-01-28T04:00:13.528 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.484+0000 7fbc07374700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbe9f9560 0x55fdbe9f99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-28T04:00:13.528 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.492+0000 7fbc0b19d3c0 10 monclient: init 2021-01-28T04:00:13.529 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.492+0000 7fbc0b19d3c0 10 monclient: _reopen_session rank -1 2021-01-28T04:00:13.529 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.492+0000 7fbc0b19d3c0 10 monclient: _add_conns ranks=[1,0,2] 2021-01-28T04:00:13.529 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.492+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbe9fa5e0 0x55fdbe9f9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T04:00:13.529 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.492+0000 7fbc0b19d3c0 10 monclient(hunting): picked mon.noname-b con 0x55fdbe9fa5e0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2021-01-28T04:00:13.529 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.492+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbe9f9560 0x55fdbe9f99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T04:00:13.530 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.492+0000 7fbc0b19d3c0 10 monclient(hunting): picked mon.noname-a con 0x55fdbe9f9560 addr [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] 2021-01-28T04:00:13.530 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.492+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea98140 0x55fdbea9a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T04:00:13.530 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.492+0000 7fbc0b19d3c0 10 monclient(hunting): picked mon.noname-c con 0x55fdbea98140 addr [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] 2021-01-28T04:00:13.530 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.492+0000 7fbc0b19d3c0 10 monclient(hunting): start opening mon connection 2021-01-28T04:00:13.530 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.492+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdbe9483f0 con 0x55fdbe9f9560 2021-01-28T04:00:13.531 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.492+0000 7fbc0b19d3c0 10 monclient(hunting): start opening mon connection 2021-01-28T04:00:13.531 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.492+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdbe949200 con 0x55fdbe9fa5e0 2021-01-28T04:00:13.531 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.492+0000 7fbc0b19d3c0 10 monclient(hunting): start opening mon connection 2021-01-28T04:00:13.531 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.492+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fdbe916760 con 0x55fdbea98140 2021-01-28T04:00:13.532 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.492+0000 7fbc0b19d3c0 10 monclient(hunting): _renew_subs 2021-01-28T04:00:13.532 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.492+0000 7fbc0b19d3c0 10 monclient(hunting): authenticate will time out at 2021-01-28T04:00:13.495694+0000 2021-01-28T04:00:13.532 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.492+0000 7fbc0b19d3c0 0 monclient(hunting): authenticate timed out after 1e-09 2021-01-28T04:00:13.532 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.492+0000 7fbc0b19d3c0 10 monclient(hunting): shutdown 2021-01-28T04:00:13.532 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.492+0000 7fbc0b19d3c0 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-01-28T04:00:13.533 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.492+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea98140 msgr2=0x55fdbea9a530 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-01-28T04:00:13.533 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.492+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea98140 0x55fdbea9a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-28T04:00:13.533 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.492+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbe9fa5e0 msgr2=0x55fdbe9f9070 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-01-28T04:00:13.533 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.492+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbe9fa5e0 0x55fdbe9f9070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-28T04:00:13.533 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.492+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbe9f9560 msgr2=0x55fdbe9f99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-28T04:00:13.534 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.492+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbe9f9560 0x55fdbe9f99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-28T04:00:13.534 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.492+0000 7fbc0b19d3c0 10 monclient: init 2021-01-28T04:00:13.534 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 10 monclient: _reopen_session rank -1 2021-01-28T04:00:13.534 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 10 monclient: _add_conns ranks=[1,2,0] 2021-01-28T04:00:13.535 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbe9fa5e0 0x55fdbe9f9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T04:00:13.535 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 10 monclient(hunting): picked mon.noname-b con 0x55fdbe9fa5e0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2021-01-28T04:00:13.535 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea98140 0x55fdbea9a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T04:00:13.535 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 10 monclient(hunting): picked mon.noname-c con 0x55fdbea98140 addr [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] 2021-01-28T04:00:13.535 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbe9f9560 0x55fdbe9f99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T04:00:13.536 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 10 monclient(hunting): picked mon.noname-a con 0x55fdbe9f9560 addr [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] 2021-01-28T04:00:13.536 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 10 monclient(hunting): start opening mon connection 2021-01-28T04:00:13.536 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdbe9483f0 con 0x55fdbe9f9560 2021-01-28T04:00:13.536 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 10 monclient(hunting): start opening mon connection 2021-01-28T04:00:13.536 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdbe949200 con 0x55fdbe9fa5e0 2021-01-28T04:00:13.537 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 10 monclient(hunting): start opening mon connection 2021-01-28T04:00:13.537 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fdbe916760 con 0x55fdbea98140 2021-01-28T04:00:13.537 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 10 monclient(hunting): _renew_subs 2021-01-28T04:00:13.537 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 10 monclient(hunting): authenticate will time out at 2021-01-28T04:00:13.499517+0000 2021-01-28T04:00:13.537 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 0 monclient(hunting): authenticate timed out after 1e-09 2021-01-28T04:00:13.538 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 10 monclient(hunting): shutdown 2021-01-28T04:00:13.538 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-01-28T04:00:13.538 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea98140 msgr2=0x55fdbea9a530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-28T04:00:13.538 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc07374700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea98140 0x55fdbea9a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T04:00:13.539 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea98140 0x55fdbea9a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T04:00:13.539 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc07b75700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbe9fa5e0 0x55fdbe9f9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T04:00:13.539 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbe9fa5e0 msgr2=0x55fdbe9f9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-28T04:00:13.539 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc08376700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbe9f9560 0x55fdbe9f99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T04:00:13.539 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbe9fa5e0 0x55fdbe9f9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T04:00:13.540 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbe9f9560 msgr2=0x55fdbe9f99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-28T04:00:13.540 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbe9f9560 0x55fdbe9f99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T04:00:13.540 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc07b75700 10 monclient: get_auth_request con 0x55fdbe9fa5e0 auth_method 0 2021-01-28T04:00:13.540 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 10 monclient: init 2021-01-28T04:00:13.540 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc07b75700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbe9fa5e0 0x55fdbe9f9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-28T04:00:13.541 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc08376700 10 monclient: get_auth_request con 0x55fdbe9f9560 auth_method 0 2021-01-28T04:00:13.541 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc08376700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbe9f9560 0x55fdbe9f99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-28T04:00:13.541 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 10 monclient: _reopen_session rank -1 2021-01-28T04:00:13.541 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 10 monclient: _add_conns ranks=[1,2,0] 2021-01-28T04:00:13.541 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbe9fa5e0 0x55fdbe9f9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T04:00:13.542 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 10 monclient(hunting): picked mon.noname-b con 0x55fdbe9fa5e0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2021-01-28T04:00:13.542 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea98140 0x55fdbea9a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T04:00:13.542 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 10 monclient(hunting): picked mon.noname-c con 0x55fdbea98140 addr [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] 2021-01-28T04:00:13.542 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbe9f9560 0x55fdbe9f99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T04:00:13.542 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 10 monclient(hunting): picked mon.noname-a con 0x55fdbe9f9560 addr [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] 2021-01-28T04:00:13.543 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 10 monclient(hunting): start opening mon connection 2021-01-28T04:00:13.543 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdbe9483f0 con 0x55fdbe9f9560 2021-01-28T04:00:13.543 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 10 monclient(hunting): start opening mon connection 2021-01-28T04:00:13.543 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdbe949200 con 0x55fdbe9fa5e0 2021-01-28T04:00:13.544 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 10 monclient(hunting): start opening mon connection 2021-01-28T04:00:13.544 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fdbe916760 con 0x55fdbea98140 2021-01-28T04:00:13.544 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 10 monclient(hunting): _renew_subs 2021-01-28T04:00:13.544 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 10 monclient(hunting): authenticate will time out at 2021-01-28T04:00:13.500612+0000 2021-01-28T04:00:13.544 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc08376700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbe9f9560 0x55fdbe9f99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T04:00:13.545 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc07374700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea98140 0x55fdbea9a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T04:00:13.545 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 0 monclient(hunting): authenticate timed out after 1e-09 2021-01-28T04:00:13.545 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 10 monclient(hunting): shutdown 2021-01-28T04:00:13.545 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-01-28T04:00:13.553 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea98140 msgr2=0x55fdbea9a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-28T04:00:13.553 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea98140 0x55fdbea9a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T04:00:13.553 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbe9fa5e0 msgr2=0x55fdbe9f9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-28T04:00:13.554 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbe9fa5e0 0x55fdbe9f9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-28T04:00:13.554 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbe9f9560 msgr2=0x55fdbe9f99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-28T04:00:13.554 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbe9f9560 0x55fdbe9f99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T04:00:13.554 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc08376700 10 monclient: get_auth_request con 0x55fdbe9f9560 auth_method 0 2021-01-28T04:00:13.555 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc08376700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbe9f9560 0x55fdbe9f99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-28T04:00:13.555 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc07374700 10 monclient: get_auth_request con 0x55fdbea98140 auth_method 0 2021-01-28T04:00:13.555 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.496+0000 7fbc07374700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea98140 0x55fdbea9a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-28T04:00:13.555 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 10 monclient: init 2021-01-28T04:00:13.555 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 10 monclient: _reopen_session rank -1 2021-01-28T04:00:13.556 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 10 monclient: _add_conns ranks=[0,1,2] 2021-01-28T04:00:13.556 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbe9f9560 0x55fdbe9f99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T04:00:13.556 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 10 monclient(hunting): picked mon.noname-a con 0x55fdbe9f9560 addr [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] 2021-01-28T04:00:13.556 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbe9fa5e0 0x55fdbe9f9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T04:00:13.556 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 10 monclient(hunting): picked mon.noname-b con 0x55fdbe9fa5e0 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2021-01-28T04:00:13.557 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea98140 0x55fdbea9a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T04:00:13.557 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 10 monclient(hunting): picked mon.noname-c con 0x55fdbea98140 addr [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] 2021-01-28T04:00:13.557 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 10 monclient(hunting): start opening mon connection 2021-01-28T04:00:13.557 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdbe9483f0 con 0x55fdbe9f9560 2021-01-28T04:00:13.558 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 10 monclient(hunting): start opening mon connection 2021-01-28T04:00:13.558 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdbe949200 con 0x55fdbe9fa5e0 2021-01-28T04:00:13.558 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 10 monclient(hunting): start opening mon connection 2021-01-28T04:00:13.558 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fdbe916760 con 0x55fdbea98140 2021-01-28T04:00:13.558 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 10 monclient(hunting): _renew_subs 2021-01-28T04:00:13.559 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 10 monclient(hunting): authenticate will time out at 2021-01-28T04:00:13.508438+0000 2021-01-28T04:00:13.559 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 0 monclient(hunting): authenticate timed out after 1e-09 2021-01-28T04:00:13.559 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 10 monclient(hunting): shutdown 2021-01-28T04:00:13.559 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-01-28T04:00:13.560 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea98140 msgr2=0x55fdbea9a530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-28T04:00:13.560 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc07b75700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbe9f9560 0x55fdbe9f99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T04:00:13.560 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc07374700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbe9fa5e0 0x55fdbe9f9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T04:00:13.560 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc08376700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea98140 0x55fdbea9a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T04:00:13.561 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea98140 0x55fdbea9a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T04:00:13.561 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbe9fa5e0 msgr2=0x55fdbe9f9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-28T04:00:13.561 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbe9fa5e0 0x55fdbe9f9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T04:00:13.561 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbe9f9560 msgr2=0x55fdbe9f99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-28T04:00:13.561 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbe9f9560 0x55fdbe9f99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T04:00:13.562 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 10 monclient: init 2021-01-28T04:00:13.562 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 10 monclient: _reopen_session rank -1 2021-01-28T04:00:13.562 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 10 monclient: _add_conns ranks=[1,2,0] 2021-01-28T04:00:13.562 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbea93b20 0x55fdbea91d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T04:00:13.563 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 10 monclient(hunting): picked mon.noname-b con 0x55fdbea93b20 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2021-01-28T04:00:13.563 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea92210 0x55fdbea92690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T04:00:13.563 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 10 monclient(hunting): picked mon.noname-c con 0x55fdbea92210 addr [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] 2021-01-28T04:00:13.563 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbea96240 0x55fdbea966c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T04:00:13.563 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 10 monclient(hunting): picked mon.noname-a con 0x55fdbea96240 addr [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] 2021-01-28T04:00:13.564 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 10 monclient(hunting): start opening mon connection 2021-01-28T04:00:13.564 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdbe9483f0 con 0x55fdbea96240 2021-01-28T04:00:13.564 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 10 monclient(hunting): start opening mon connection 2021-01-28T04:00:13.564 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdbe949200 con 0x55fdbea93b20 2021-01-28T04:00:13.564 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 10 monclient(hunting): start opening mon connection 2021-01-28T04:00:13.565 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fdbe916760 con 0x55fdbea92210 2021-01-28T04:00:13.565 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 10 monclient(hunting): _renew_subs 2021-01-28T04:00:13.565 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 10 monclient(hunting): authenticate will time out at 2021-01-28T04:00:13.509626+0000 2021-01-28T04:00:13.565 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc07b75700 10 monclient(hunting): get_auth_request con 0x55fdbe9f9560 auth_method 0 2021-01-28T04:00:13.565 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc07b75700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbe9f9560 0x55fdbe9f99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-28T04:00:13.566 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc07374700 10 monclient(hunting): get_auth_request con 0x55fdbe9fa5e0 auth_method 0 2021-01-28T04:00:13.566 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc07374700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbe9fa5e0 0x55fdbe9f9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-28T04:00:13.566 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc08376700 10 monclient(hunting): get_auth_request con 0x55fdbea98140 auth_method 0 2021-01-28T04:00:13.566 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc08376700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea98140 0x55fdbea9a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-28T04:00:13.567 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc07374700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea92210 0x55fdbea92690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1test api_snapshots_pp on pid 32420 2021-01-28T04:00:13.567 INFO:tasks.workunit.client.0.smithi100.stdout: required=0 2021-01-28T04:00:13.567 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc07374700 10 monclient(hunting): get_auth_request con 0x55fdbea92210 auth_method 0 2021-01-28T04:00:13.567 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc07374700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2021-01-28T04:00:13.567 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc07374700 10 monclient(hunting): _init_auth method 2 2021-01-28T04:00:13.568 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 0 monclient(hunting): authenticate timed out after 1e-09 2021-01-28T04:00:13.568 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 10 monclient(hunting): shutdown 2021-01-28T04:00:13.568 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-01-28T04:00:13.569 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea92210 msgr2=0x55fdbea92690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-28T04:00:13.569 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea92210 0x55fdbea92690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T04:00:13.569 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbea93b20 msgr2=0x55fdbea91d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-28T04:00:13.570 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbea93b20 0x55fdbea91d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-28T04:00:13.570 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbea96240 msgr2=0x55fdbea966c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2021-01-28T04:00:13.571 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc08376700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbea96240 0x55fdbea966c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T04:00:13.571 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbea96240 0x55fdbea966c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T04:00:13.571 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc08376700 10 monclient: get_auth_request con 0x55fdbea96240 auth_method 0 2021-01-28T04:00:13.572 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc08376700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbea96240 0x55fdbea966c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-28T04:00:13.572 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 10 monclient: init 2021-01-28T04:00:13.572 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 10 monclient: _reopen_session rank -1 2021-01-28T04:00:13.573 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 10 monclient: _add_conns ranks=[0,2,1] 2021-01-28T04:00:13.573 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbea96240 0x55fdbe9f9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T04:00:13.573 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 10 monclient(hunting): picked mon.noname-a con 0x55fdbea96240 addr [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] 2021-01-28T04:00:13.574 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea92210 0x55fdbea92670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T04:00:13.574 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 10 monclient(hunting): picked mon.noname-c con 0x55fdbea92210 addr [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] 2021-01-28T04:00:13.574 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbea93b20 0x55fdbea91d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T04:00:13.574 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 10 monclient(hunting): picked mon.noname-b con 0x55fdbea93b20 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2021-01-28T04:00:13.575 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 10 monclient(hunting): start opening mon connection 2021-01-28T04:00:13.575 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdbe9483f0 con 0x55fdbea96240 2021-01-28T04:00:13.575 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 10 monclient(hunting): start opening mon connection 2021-01-28T04:00:13.575 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdbe949200 con 0x55fdbea93b20 2021-01-28T04:00:13.575 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 10 monclient(hunting): start opening mon connection 2021-01-28T04:00:13.576 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fdbe916760 con 0x55fdbea92210 2021-01-28T04:00:13.576 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 10 monclient(hunting): _renew_subs 2021-01-28T04:00:13.576 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.504+0000 7fbc0b19d3c0 10 monclient(hunting): authenticate will time out at 2021-01-28T04:00:13.511216+0000 2021-01-28T04:00:13.576 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc07b75700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbea96240 0x55fdbe9f9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T04:00:13.577 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc07374700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea92210 0x55fdbea92670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T04:00:13.577 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc07b75700 10 monclient(hunting): get_auth_request con 0x55fdbea96240 auth_method 0 2021-01-28T04:00:13.577 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc07b75700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2021-01-28T04:00:13.577 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc07b75700 10 monclient(hunting): _init_auth method 2 2021-01-28T04:00:13.577 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc07374700 10 monclient(hunting): get_auth_request con 0x55fdbea92210 auth_method 0 2021-01-28T04:00:13.578 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc07374700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2021-01-28T04:00:13.578 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc07374700 10 monclient(hunting): _init_auth method 2 2021-01-28T04:00:13.578 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 0 monclient(hunting): authenticate timed out after 1e-09 2021-01-28T04:00:13.579 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 10 monclient(hunting): shutdown 2021-01-28T04:00:13.579 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-01-28T04:00:13.579 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea92210 msgr2=0x55fdbea92670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-28T04:00:13.579 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea92210 0x55fdbea92670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T04:00:13.580 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbea93b20 msgr2=0x55fdbea91d20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2021-01-28T04:00:13.580 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbea93b20 0x55fdbea91d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2021-01-28T04:00:13.580 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbea96240 msgr2=0x55fdbe9f9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-28T04:00:13.581 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbea96240 0x55fdbe9f9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T04:00:13.581 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 10 monclient: init 2021-01-28T04:00:13.581 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 10 monclient: _reopen_session rank -1 2021-01-28T04:00:13.582 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 10 monclient: _add_conns ranks=[2,1,0] 2021-01-28T04:00:13.582 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea9a530 0x55fdbea96670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T04:00:13.583 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 10 monclient(hunting): picked mon.noname-c con 0x55fdbea9a530 addr [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] 2021-01-28T04:00:13.583 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbea96b60 0x55fdbea96fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T04:00:13.583 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 10 monclient(hunting): picked mon.noname-b con 0x55fdbea96b60 addr [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] 2021-01-28T04:00:13.584 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbea974d0 0x55fdbea97950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2021-01-28T04:00:13.584 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 10 monclient(hunting): picked mon.noname-a con 0x55fdbea974d0 addr [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] 2021-01-28T04:00:13.584 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 10 monclient(hunting): start opening mon connection 2021-01-28T04:00:13.584 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdbe9483f0 con 0x55fdbea974d0 2021-01-28T04:00:13.585 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 10 monclient(hunting): start opening mon connection 2021-01-28T04:00:13.585 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdbe949200 con 0x55fdbea96b60 2021-01-28T04:00:13.586 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 10 monclient(hunting): start opening mon connection 2021-01-28T04:00:13.586 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 --> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fdbe916760 con 0x55fdbea9a530 2021-01-28T04:00:13.586 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 10 monclient(hunting): _renew_subs 2021-01-28T04:00:13.587 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 10 monclient(hunting): authenticate will time out at 2021-01-28T04:00:13.511996+0000 2021-01-28T04:00:13.587 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc08376700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbea974d0 0x55fdbea97950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T04:00:13.587 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc08376700 10 monclient(hunting): get_auth_request con 0x55fdbea974d0 auth_method 0 2021-01-28T04:00:13.588 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc08376700 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2021-01-28T04:00:13.588 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc08376700 10 monclient(hunting): _init_auth method 2 2021-01-28T04:00:13.588 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc07b75700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea9a530 0x55fdbea96670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T04:00:13.588 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 0 monclient(hunting): authenticate timed out after 1e-09 2021-01-28T04:00:13.589 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 10 monclient(hunting): shutdown 2021-01-28T04:00:13.589 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 20 monclient(hunting): shutdown discarding 1 pending message(s) 2021-01-28T04:00:13.589 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc07374700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbea96b60 0x55fdbea96fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2021-01-28T04:00:13.589 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea9a530 msgr2=0x55fdbea96670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-28T04:00:13.589 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea9a530 0x55fdbea96670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T04:00:13.590 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbea96b60 msgr2=0x55fdbea96fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-28T04:00:13.590 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbea96b60 0x55fdbea96fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T04:00:13.590 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbea974d0 msgr2=0x55fdbea97950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2021-01-28T04:00:13.590 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbea974d0 0x55fdbea97950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T04:00:13.590 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 10 monclient: shutdown 2021-01-28T04:00:13.591 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 20 monclient: shutdown discarding 0 pending message(s) 2021-01-28T04:00:13.591 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 shutdown_connections 2021-01-28T04:00:13.591 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55fdbea974d0 0x55fdbea97950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T04:00:13.591 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbea96b60 0x55fdbea96fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T04:00:13.592 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.100:3301/0,v1:172.21.15.100:6790/0] conn(0x55fdbea9a530 0x55fdbea96670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2021-01-28T04:00:13.592 INFO:tasks.workunit.client.0.smithi100.stdout: test api_stat on pid 32437 2021-01-28T04:00:13.592 INFO:tasks.workunit.client.0.smithi100.stdout:test api_stat_pp on pid 32445 2021-01-28T04:00:13.592 INFO:tasks.workunit.client.0.smithi100.stdout:test api_watch_notify on pid 32479 2021-01-28T04:00:13.592 INFO:tasks.workunit.client.0.smithi100.stdout:test api_watch_notify_pp on pid 32505 2021-01-28T04:00:13.593 INFO:tasks.workunit.client.0.smithi100.stderr:+ ff=api_snapshots_pp 2021-01-28T04:00:13.593 INFO:tasks.workunit.client.0.smithi100.stderr:+ pid=32420 2021-01-28T04:00:13.593 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo 'test api_snapshots_pp on pid 32420' 2021-01-28T04:00:13.593 INFO:tasks.workunit.client.0.smithi100.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2021-01-28T04:00:13.593 INFO:tasks.workunit.client.0.smithi100.stderr:+ pids[$f]=32420 2021-01-28T04:00:13.594 INFO:tasks.workunit.client.0.smithi100.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-28T04:00:13.594 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' 1 -eq 1 ']' 2021-01-28T04:00:13.594 INFO:tasks.workunit.client.0.smithi100.stderr:++ printf %25s api_stat 2021-01-28T04:00:13.594 INFO:tasks.workunit.client.0.smithi100.stderr:+ r=' api_stat' 2021-01-28T04:00:13.595 INFO:tasks.workunit.client.0.smithi100.stderr:++ echo api_stat 2021-01-28T04:00:13.595 INFO:tasks.workunit.client.0.smithi100.stderr:++ awk '{print $1}' 2021-01-28T04:00:13.595 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' -z '' ']' 2021-01-28T04:00:13.595 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.595 INFO:tasks.workunit.client.0.smithi100.stderr:+ case $- in 2021-01-28T04:00:13.596 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.596 INFO:tasks.workunit.client.0.smithi100.stderr:+ ceph_test_rados_api_snapshots_pp 2021-01-28T04:00:13.596 INFO:tasks.workunit.client.0.smithi100.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2021-01-28T04:00:13.596 INFO:tasks.workunit.client.0.smithi100.stderr:+ ff=api_stat 2021-01-28T04:00:13.596 INFO:tasks.workunit.client.0.smithi100.stderr:+ pid=32437 2021-01-28T04:00:13.597 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo 'test api_stat on pid 32437' 2021-01-28T04:00:13.597 INFO:tasks.workunit.client.0.smithi100.stderr:+ pids[$f]=32437 2021-01-28T04:00:13.597 INFO:tasks.workunit.client.0.smithi100.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2021-01-28T04:00:13.597 INFO:tasks.workunit.client.0.smithi100.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-28T04:00:13.598 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' 1 -eq 1 ']' 2021-01-28T04:00:13.598 INFO:tasks.workunit.client.0.smithi100.stderr:++ printf %25s api_stat_pp 2021-01-28T04:00:13.598 INFO:tasks.workunit.client.0.smithi100.stderr:+ r=' api_stat_pp' 2021-01-28T04:00:13.598 INFO:tasks.workunit.client.0.smithi100.stderr:++ echo api_stat_pp 2021-01-28T04:00:13.599 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' -z '' ']' 2021-01-28T04:00:13.599 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.599 INFO:tasks.workunit.client.0.smithi100.stderr:++ awk '{print $1}' 2021-01-28T04:00:13.599 INFO:tasks.workunit.client.0.smithi100.stderr:+ case $- in 2021-01-28T04:00:13.600 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.600 INFO:tasks.workunit.client.0.smithi100.stderr:+ ceph_test_rados_api_stat 2021-01-28T04:00:13.600 INFO:tasks.workunit.client.0.smithi100.stderr:+ sed 's/^/ api_snapshots_pp: /' 2021-01-28T04:00:13.600 INFO:tasks.workunit.client.0.smithi100.stderr:+ ff=api_stat_pp 2021-01-28T04:00:13.600 INFO:tasks.workunit.client.0.smithi100.stderr:+ tee ceph_test_rados_api_stat.log 2021-01-28T04:00:13.601 INFO:tasks.workunit.client.0.smithi100.stderr:+ pid=32445 2021-01-28T04:00:13.601 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo 'test api_stat_pp on pid 32445' 2021-01-28T04:00:13.601 INFO:tasks.workunit.client.0.smithi100.stderr:+ pids[$f]=32445 2021-01-28T04:00:13.601 INFO:tasks.workunit.client.0.smithi100.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-28T04:00:13.601 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' 1 -eq 1 ']' 2021-01-28T04:00:13.602 INFO:tasks.workunit.client.0.smithi100.stderr:+ sed 's/^/ api_stat: /' 2021-01-28T04:00:13.602 INFO:tasks.workunit.client.0.smithi100.stderr:++ printf %25s api_watch_notify 2021-01-28T04:00:13.602 INFO:tasks.workunit.client.0.smithi100.stderr:+ r=' api_watch_notify' 2021-01-28T04:00:13.603 INFO:tasks.workunit.client.0.smithi100.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2021-01-28T04:00:13.603 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' -z '' ']' 2021-01-28T04:00:13.604 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.604 INFO:tasks.workunit.client.0.smithi100.stderr:+ case $- in 2021-01-28T04:00:13.604 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.605 INFO:tasks.workunit.client.0.smithi100.stderr:+ ceph_test_rados_api_stat_pp 2021-01-28T04:00:13.605 INFO:tasks.workunit.client.0.smithi100.stderr:++ echo api_watch_notify 2021-01-28T04:00:13.605 INFO:tasks.workunit.client.0.smithi100.stderr:++ awk '{print $1}' 2021-01-28T04:00:13.606 INFO:tasks.workunit.client.0.smithi100.stderr:+ tee ceph_test_rados_api_stat_pp.log 2021-01-28T04:00:13.606 INFO:tasks.workunit.client.0.smithi100.stderr:+ sed 's/^/ api_stat_pp: /' 2021-01-28T04:00:13.606 INFO:tasks.workunit.client.0.smithi100.stderr:+ ff=api_watch_notify 2021-01-28T04:00:13.606 INFO:tasks.workunit.client.0.smithi100.stderr:+ pid=32479 2021-01-28T04:00:13.607 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo 'test api_watch_notify on pid 32479' 2021-01-28T04:00:13.607 INFO:tasks.workunit.client.0.smithi100.stderr:+ pids[$f]=32479 2021-01-28T04:00:13.607 INFO:tasks.workunit.client.0.smithi100.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-28T04:00:13.607 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' 1 -eq 1 ']' 2021-01-28T04:00:13.607 INFO:tasks.workunit.client.0.smithi100.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2021-01-28T04:00:13.608 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' -z '' ']' 2021-01-28T04:00:13.608 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.608 INFO:tasks.workunit.client.0.smithi100.stderr:+ case $- in 2021-01-28T04:00:13.609 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.609 INFO:tasks.workunit.client.0.smithi100.stderr:+ ceph_test_rados_api_watch_notify 2021-01-28T04:00:13.610 INFO:tasks.workunit.client.0.smithi100.stderr:+ tee ceph_test_rados_api_watch_notify.log 2021-01-28T04:00:13.610 INFO:tasks.workunit.client.0.smithi100.stderr:+ sed 's/^/ api_watch_notify: /' 2021-01-28T04:00:13.611 INFO:tasks.workunit.client.0.smithi100.stderr:++ printf %25s api_watch_notify_pp 2021-01-28T04:00:13.611 INFO:tasks.workunit.client.0.smithi100.stderr:+ r=' api_watch_notify_pp' 2021-01-28T04:00:13.611 INFO:tasks.workunit.client.0.smithi100.stderr:++ echo api_watch_notify_pp 2021-01-28T04:00:13.612 INFO:tasks.workunit.client.0.smithi100.stderr:++ awk '{print $1}' 2021-01-28T04:00:13.612 INFO:tasks.workunit.client.0.smithi100.stderr:+ ff=api_watch_notify_pp 2021-01-28T04:00:13.612 INFO:tasks.workunit.client.0.smithi100.stderr:+ pid=32505 2021-01-28T04:00:13.612 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo 'test api_watch_notify_pp on pid 32505' 2021-01-28T04:00:13.613 INFO:tasks.workunit.client.0.smithi100.stderr:+ pids[$f]=32505 2021-01-28T04:00:13.613 INFO:tasks.workunit.client.0.smithi100.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-28T04:00:13.613 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' 1 -eq 1 ']' 2021-01-28T04:00:13.613 INFO:tasks.workunit.client.0.smithi100.stderr:++ printf %25s api_cmd 2021-01-28T04:00:13.613 INFO:tasks.workunit.client.0.smithi100.stderr:+ r=' api_cmd' 2021-01-28T04:00:13.614 INFO:tasks.workunit.client.0.smithi100.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2021-01-28T04:00:13.614 INFO:tasks.workunit.client.0.smithi100.stderr:++ echo api_cmd 2021-01-28T04:00:13.614 INFO:tasks.workunit.client.0.smithi100.stderr:++ awk '{print $1}' 2021-01-28T04:00:13.614 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' -z '' ']' 2021-01-28T04:00:13.614 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.615 INFO:tasks.workunit.client.0.smithi100.stderr:+ case $- in 2021-01-28T04:00:13.615 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.615 INFO:tasks.workunit.client.0.smithi100.stderr:+ ceph_test_rados_api_watch_notify_pp 2021-01-28T04:00:13.615 INFO:tasks.workunit.client.0.smithi100.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2021-01-28T04:00:13.616 INFO:tasks.workunit.client.0.smithi100.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2021-01-28T04:00:13.630 INFO:tasks.workunit.client.0.smithi100.stderr:+ ff=api_cmd 2021-01-28T04:00:13.631 INFO:tasks.workunit.client.0.smithi100.stderr:+ pid=32514 2021-01-28T04:00:13.631 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo 'test api_cmd on pid 32514' 2021-01-28T04:00:13.631 INFO:tasks.workunit.client.0.smithi100.stderr:+ pids[$f]=32514 2021-01-28T04:00:13.631 INFO:tasks.workunit.client.0.smithi100.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2021-01-28T04:00:13.632 INFO:tasks.workunit.client.0.smithi100.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-28T04:00:13.632 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' 1 -eq 1 ']' 2021-01-28T04:00:13.632 INFO:tasks.workunit.client.0.smithi100.stderr:++ printf %25s api_cmd_pp 2021-01-28T04:00:13.632 INFO:tasks.workunit.client.0.smithi100.stderr:+ r=' api_cmd_pp' 2021-01-28T04:00:13.632 INFO:tasks.workunit.client.0.smithi100.stderr:++ awk '{print $1}' 2021-01-28T04:00:13.633 INFO:tasks.workunit.client.0.smithi100.stderr:++ echo api_cmd_pp 2021-01-28T04:00:13.633 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' -z '' ']' 2021-01-28T04:00:13.633 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.633 INFO:tasks.workunit.client.0.smithi100.stderr:+ case $- in 2021-01-28T04:00:13.633 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.634 INFO:tasks.workunit.client.0.smithi100.stderr:+ tee ceph_test_rados_api_cmd.log 2021-01-28T04:00:13.634 INFO:tasks.workunit.client.0.smithi100.stderr:+ ceph_test_rados_api_cmd 2021-01-28T04:00:13.634 INFO:tasks.workunit.client.0.smithi100.stderr:+ sed 's/^/ api_cmd: /' 2021-01-28T04:00:13.634 INFO:tasks.workunit.client.0.smithi100.stderr:+ ff=api_cmd_pp 2021-01-28T04:00:13.635 INFO:tasks.workunit.client.0.smithi100.stderr:+ pid=32522 2021-01-28T04:00:13.635 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo 'test api_cmd_pp on pid 32522' 2021-01-28T04:00:13.635 INFO:tasks.workunit.client.0.smithi100.stderr:+ pids[$f]=32522 2021-01-28T04:00:13.635 INFO:tasks.workunit.client.0.smithi100.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-28T04:00:13.635 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' 1 -eq 1 ']' 2021-01-28T04:00:13.636 INFO:tasks.workunit.client.0.smithi100.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2021-01-28T04:00:13.636 INFO:tasks.workunit.client.0.smithi100.stderr:++ printf %25s api_service 2021-01-28T04:00:13.636 INFO:tasks.workunit.client.0.smithi100.stderr:+ r=' api_service' 2021-01-28T04:00:13.636 INFO:tasks.workunit.client.0.smithi100.stderr:++ echo api_service 2021-01-28T04:00:13.636 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' -z '' ']' 2021-01-28T04:00:13.637 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.637 INFO:tasks.workunit.client.0.smithi100.stderr:++ awk '{print $1}' 2021-01-28T04:00:13.637 INFO:tasks.workunit.client.0.smithi100.stderr:+ case $- in 2021-01-28T04:00:13.637 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.637 INFO:tasks.workunit.client.0.smithi100.stderr:+ ceph_test_rados_api_cmd_pp 2021-01-28T04:00:13.638 INFO:tasks.workunit.client.0.smithi100.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2021-01-28T04:00:13.638 INFO:tasks.workunit.client.0.smithi100.stderr:+ sed 's/^/ api_cmd_pp: /' 2021-01-28T04:00:13.638 INFO:tasks.workunit.client.0.smithi100.stderr:+ ff=api_service 2021-01-28T04:00:13.638 INFO:tasks.workunit.client.0.smithi100.stderr:+ pid=32544 2021-01-28T04:00:13.638 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo 'test api_service on pid 32544' 2021-01-28T04:00:13.639 INFO:tasks.workunit.client.0.smithi100.stderr:+ pids[$f]=32544 2021-01-28T04:00:13.639 INFO:tasks.workunit.client.0.smithi100.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-28T04:00:13.639 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' 1 -eq 1 ']' 2021-01-28T04:00:13.639 INFO:tasks.workunit.client.0.smithi100.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2021-01-28T04:00:13.639 INFO:tasks.workunit.client.0.smithi100.stderr:++ printf %25s api_service_pp 2021-01-28T04:00:13.640 INFO:tasks.workunit.client.0.smithi100.stderr:+ r=' api_service_pp' 2021-01-28T04:00:13.640 INFO:tasks.workunit.client.0.smithi100.stderr:++ awk '{print $1}' 2021-01-28T04:00:13.640 INFO:tasks.workunit.client.0.smithi100.stderr:++ echo api_service_pp 2021-01-28T04:00:13.640 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' -z '' ']' 2021-01-28T04:00:13.640 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.641 INFO:tasks.workunit.client.0.smithi100.stderr:+ case $- in 2021-01-28T04:00:13.641 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.641 INFO:tasks.workunit.client.0.smithi100.stderr:+ ceph_test_rados_api_service 2021-01-28T04:00:13.641 INFO:tasks.workunit.client.0.smithi100.stderr:+ tee ceph_test_rados_api_service.log 2021-01-28T04:00:13.641 INFO:tasks.workunit.client.0.smithi100.stderr:+ sed 's/^/ api_service: /' 2021-01-28T04:00:13.642 INFO:tasks.workunit.client.0.smithi100.stderr:+ ff=api_service_pp 2021-01-28T04:00:13.642 INFO:tasks.workunit.client.0.smithi100.stderr:+ pid=32553 2021-01-28T04:00:13.642 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo 'test api_service_pp on pid 32553' 2021-01-28T04:00:13.642 INFO:tasks.workunit.client.0.smithi100.stderr:+ pids[$f]=32553 2021-01-28T04:00:13.642 INFO:tasks.workunit.client.0.smithi100.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-28T04:00:13.643 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' 1 -eq 1 ']' 2021-01-28T04:00:13.643 INFO:tasks.workunit.client.0.smithi100.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2021-01-28T04:00:13.643 INFO:tasks.workunit.client.0.smithi100.stderr:++ printf %25s api_c_write_operations 2021-01-28T04:00:13.643 INFO:tasks.workunit.client.0.smithi100.stderr:+ r=' api_c_write_operations' 2021-01-28T04:00:13.643 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' -z '' ']' 2021-01-28T04:00:13.644 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.644 INFO:tasks.workunit.client.0.smithi100.stderr:+ case $- in 2021-01-28T04:00:13.644 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.644 INFO:tasks.workunit.client.0.smithi100.stderr:++ echo api_c_write_operations 2021-01-28T04:00:13.644 INFO:tasks.workunit.client.0.smithi100.stderr:+ sed 's/^/ api_service_pp: /' 2021-01-28T04:00:13.645 INFO:tasks.workunit.client.0.smithi100.stderr:+ ceph_test_rados_api_service_pp 2021-01-28T04:00:13.645 INFO:tasks.workunit.client.0.smithi100.stderr:+ tee ceph_test_rados_api_service_pp.log 2021-01-28T04:00:13.645 INFO:tasks.workunit.client.0.smithi100.stderr:++ awk '{print $1}' 2021-01-28T04:00:13.645 INFO:tasks.workunit.client.0.smithi100.stderr:+ ff=api_c_write_operations 2021-01-28T04:00:13.645 INFO:tasks.workunit.client.0.smithi100.stderr:+ pid=32574 2021-01-28T04:00:13.646 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo 'test api_c_write_operations on pid 32574' 2021-01-28T04:00:13.646 INFO:tasks.workunit.client.0.smithi100.stderr:+ pids[$f]=32574 2021-01-28T04:00:13.646 INFO:tasks.workunit.client.0.smithi100.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-28T04:00:13.646 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' 1 -eq 1 ']' 2021-01-28T04:00:13.646 INFO:tasks.workunit.client.0.smithi100.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2021-01-28T04:00:13.647 INFO:tasks.workunit.client.0.smithi100.stderr:++ printf %25s api_c_read_operations 2021-01-28T04:00:13.647 INFO:tasks.workunit.client.0.smithi100.stderr:+ r=' api_c_read_operations' 2021-01-28T04:00:13.647 INFO:tasks.workunit.client.0.smithi100.stderr:++ echo api_c_read_operations 2021-01-28T04:00:13.647 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' -z '' ']' 2021-01-28T04:00:13.648 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.648 INFO:tasks.workunit.client.0.smithi100.stderr:+ case $- in 2021-01-28T04:00:13.648 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.648 INFO:tasks.workunit.client.0.smithi100.stderr:++ awk '{print $1}' 2021-01-28T04:00:13.648 INFO:tasks.workunit.client.0.smithi100.stderr:+ ceph_test_rados_api_c_write_operations 2021-01-28T04:00:13.649 INFO:tasks.workunit.client.0.smithi100.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2021-01-28T04:00:13.649 INFO:tasks.workunit.client.0.smithi100.stderr:+ sed 's/^/ api_c_write_operations: /' 2021-01-28T04:00:13.649 INFO:tasks.workunit.client.0.smithi100.stderr:+ ff=api_c_read_operations 2021-01-28T04:00:13.649 INFO:tasks.workunit.client.0.smithi100.stderr:+ pid=32593 2021-01-28T04:00:13.649 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo 'test api_c_read_operations on pid 32593' 2021-01-28T04:00:13.649 INFO:tasks.workunit.client.0.smithi100.stderr:+ pids[$f]=32593 2021-01-28T04:00:13.650 INFO:tasks.workunit.client.0.smithi100.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-28T04:00:13.650 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' 1 -eq 1 ']' 2021-01-28T04:00:13.650 INFO:tasks.workunit.client.0.smithi100.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2021-01-28T04:00:13.650 INFO:tasks.workunit.client.0.smithi100.stderr:++ printf %25s list_parallel 2021-01-28T04:00:13.651 INFO:tasks.workunit.client.0.smithi100.stderr:+ r=' list_parallel' 2021-01-28T04:00:13.651 INFO:tasks.workunit.client.0.smithi100.stderr:++ echo list_parallel 2021-01-28T04:00:13.651 INFO:tasks.workunit.client.0.smithi100.stderr:++ awk '{print $1}' 2021-01-28T04:00:13.651 INFO:tasks.workunit.client.0.smithi100.stderr:+ ff=list_parallel 2021-01-28T04:00:13.651 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' -z '' ']' 2021-01-28T04:00:13.652 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.652 INFO:tasks.workunit.client.0.smithi100.stderr:+ pid=32620 2021-01-28T04:00:13.652 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo 'test list_parallel on pid 32620' 2021-01-28T04:00:13.652 INFO:tasks.workunit.client.0.smithi100.stderr:+ case $- in 2021-01-28T04:00:13.652 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.653 INFO:tasks.workunit.client.0.smithi100.stderr:+ pids[$f]=32620 2021-01-28T04:00:13.653 INFO:tasks.workunit.client.0.smithi100.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-28T04:00:13.653 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' 1 -eq 1 ']' 2021-01-28T04:00:13.653 INFO:tasks.workunit.client.0.smithi100.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2021-01-28T04:00:13.653 INFO:tasks.workunit.client.0.smithi100.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2021-01-28T04:00:13.654 INFO:tasks.workunit.client.0.smithi100.stderr:+ sed 's/^/ api_c_read_operations: /' 2021-01-28T04:00:13.654 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' -z '' ']' 2021-01-28T04:00:13.654 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.654 INFO:tasks.workunit.client.0.smithi100.stderr:+ case $- in 2021-01-28T04:00:13.654 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.655 INFO:tasks.workunit.client.0.smithi100.stderr:+ tee ceph_test_rados_list_parallel.log 2021-01-28T04:00:13.655 INFO:tasks.workunit.client.0.smithi100.stderr:+ ceph_test_rados_api_c_read_operations 2021-01-28T04:00:13.655 INFO:tasks.workunit.client.0.smithi100.stderr:+ ceph_test_rados_list_parallel 2021-01-28T04:00:13.655 INFO:tasks.workunit.client.0.smithi100.stderr:++ printf %25s open_pools_parallel 2021-01-28T04:00:13.655 INFO:tasks.workunit.client.0.smithi100.stderr:+ r=' open_pools_parallel' 2021-01-28T04:00:13.656 INFO:tasks.workunit.client.0.smithi100.stderr:++ echo open_pools_parallel 2021-01-28T04:00:13.656 INFO:tasks.workunit.client.0.smithi100.stderr:++ awk '{print $1}' 2021-01-28T04:00:13.656 INFO:tasks.workunit.client.0.smithi100.stderr:+ ff=open_pools_parallel 2021-01-28T04:00:13.656 INFO:tasks.workunit.client.0.smithi100.stderr:+ pid=32652 2021-01-28T04:00:13.656 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo 'test open_pools_parallel on pid 32652' 2021-01-28T04:00:13.657 INFO:tasks.workunit.client.0.smithi100.stderr:+ pids[$f]=32652 2021-01-28T04:00:13.657 INFO:tasks.workunit.client.0.smithi100.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations list_parallel open_pools_parallel delete_pools_parallel 2021-01-28T04:00:13.657 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' 1 -eq 1 ']' 2021-01-28T04:00:13.657 INFO:tasks.workunit.client.0.smithi100.stderr:++ printf %25s delete_pools_parallel 2021-01-28T04:00:13.657 INFO:tasks.workunit.client.0.smithi100.stderr:+ r=' delete_pools_parallel' 2021-01-28T04:00:13.658 INFO:tasks.workunit.client.0.smithi100.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2021-01-28T04:00:13.658 INFO:tasks.workunit.client.0.smithi100.stderr:++ awk '{print $1}' 2021-01-28T04:00:13.658 INFO:tasks.workunit.client.0.smithi100.stderr:++ echo delete_pools_parallel 2021-01-28T04:00:13.658 INFO:tasks.workunit.client.0.smithi100.stderr:+ sed 's/^/ list_parallel: /' 2021-01-28T04:00:13.658 INFO:tasks.workunit.client.0.smithi100.stderr:+ ff=delete_pools_parallel 2021-01-28T04:00:13.659 INFO:tasks.workunit.client.0.smithi100.stderr:+ pid=32664 2021-01-28T04:00:13.659 INFO:tasks.workunit.client.0.smithi100.stderr:+ echo 'test delete_pools_parallel on pid 32664' 2021-01-28T04:00:13.659 INFO:tasks.workunit.client.0.smithi100.stderr:+ pids[$f]=32664 2021-01-28T04:00:13.659 INFO:tasks.workunit.client.0.smithi100.stderr:+ ret=0 2021-01-28T04:00:13.659 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' 1 -eq 1 ']' 2021-01-28T04:00:13.660 INFO:tasks.workunit.client.0.smithi100.stderr:+ for t in "${!pids[@]}" 2021-01-28T04:00:13.660 INFO:tasks.workunit.client.0.smithi100.stderr:+ pid=32150 2021-01-28T04:00:13.660 INFO:tasks.workunit.client.0.smithi100.stderr:+ wait 32150 2021-01-28T04:00:13.660 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' -z '' ']' 2021-01-28T04:00:13.660 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.661 INFO:tasks.workunit.client.0.smithi100.stderr:+ case $- in 2021-01-28T04:00:13.661 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.661 INFO:tasks.workunit.client.0.smithi100.stderr:+ ceph_test_rados_open_pools_parallel 2021-01-28T04:00:13.661 INFO:tasks.workunit.client.0.smithi100.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2021-01-28T04:00:13.661 INFO:tasks.workunit.client.0.smithi100.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2021-01-28T04:00:13.662 INFO:tasks.workunit.client.0.smithi100.stderr:+ '[' -z '' ']' 2021-01-28T04:00:13.662 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.662 INFO:tasks.workunit.client.0.smithi100.stderr:+ case $- in 2021-01-28T04:00:13.662 INFO:tasks.workunit.client.0.smithi100.stderr:+ return 2021-01-28T04:00:13.662 INFO:tasks.workunit.client.0.smithi100.stderr:+ sed 's/^/ open_pools_parallel: /' 2021-01-28T04:00:13.663 INFO:tasks.workunit.client.0.smithi100.stderr:+ ceph_test_rados_delete_pools_parallel 2021-01-28T04:00:13.663 INFO:tasks.workunit.client.0.smithi100.stdout:test api_cmd on pid 32514 2021-01-28T04:00:13.663 INFO:tasks.workunit.client.0.smithi100.stdout:test api_cmd_pp on pid 32522 2021-01-28T04:00:13.663 INFO:tasks.workunit.client.0.smithi100.stdout:test api_service on pid 32544 2021-01-28T04:00:13.663 INFO:tasks.workunit.client.0.smithi100.stdout:test api_service_pp on pid 32553 2021-01-28T04:00:13.664 INFO:tasks.workunit.client.0.smithi100.stdout:test api_c_write_operations on pid 32574 2021-01-28T04:00:13.664 INFO:tasks.workunit.client.0.smithi100.stdout:test api_c_read_operations on pid 32593 2021-01-28T04:00:13.664 INFO:tasks.workunit.client.0.smithi100.stdout:test list_parallel on pid 32620 2021-01-28T04:00:13.664 INFO:tasks.workunit.client.0.smithi100.stdout:test open_pools_parallel on pid 32652 2021-01-28T04:00:13.664 INFO:tasks.workunit.client.0.smithi100.stdout:test delete_pools_parallel on pid 32664 2021-01-28T04:00:13.665 INFO:tasks.workunit.client.0.smithi100.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2021-01-28T04:00:13.665 INFO:tasks.workunit.client.0.smithi100.stderr:+ sed 's/^/ delete_pools_parallel: /' 2021-01-28T04:00:16.327 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:16 smithi100 bash[9834]: cluster 2021-01-28T04:00:13.494463+0000 mgr.y (mgr.14138) 477 : cluster [DBG] pgmap v339: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:00:16.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:16 smithi100 bash[9834]: cluster 2021-01-28T04:00:15.179552+0000 mon.a (mon.0) 666 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-01-28T04:00:16.328 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:16 smithi100 bash[13549]: cluster 2021-01-28T04:00:13.494463+0000 mgr.y (mgr.14138) 477 : cluster [DBG] pgmap v339: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:00:16.328 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:16 smithi100 bash[13549]: cluster 2021-01-28T04:00:15.179552+0000 mon.a (mon.0) 666 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-01-28T04:00:16.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:16 smithi162 bash[9856]: cluster 2021-01-28T04:00:13.494463+0000 mgr.y (mgr.14138) 477 : cluster [DBG] pgmap v339: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:00:16.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:16 smithi162 bash[9856]: cluster 2021-01-28T04:00:15.179552+0000 mon.a (mon.0) 666 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-01-28T04:00:17.008 INFO:tasks.workunit.client.0.smithi100.stdout: api_asio: [==========] Running 12 tests from 1 test suite. 2021-01-28T04:00:17.009 INFO:tasks.workunit.client.0.smithi100.stdout: api_asio: [----------] Global test environment set-up. 2021-01-28T04:00:17.009 INFO:tasks.workunit.client.0.smithi100.stdout: api_asio: [----------] 12 tests from AsioRados 2021-01-28T04:00:17.009 INFO:tasks.workunit.client.0.smithi100.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2021-01-28T04:00:17.010 INFO:tasks.workunit.client.0.smithi100.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (2 ms) 2021-01-28T04:00:17.010 INFO:tasks.workunit.client.0.smithi100.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2021-01-28T04:00:17.010 INFO:tasks.workunit.client.0.smithi100.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (3 ms) 2021-01-28T04:00:17.010 INFO:tasks.workunit.client.0.smithi100.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2021-01-28T04:00:17.010 INFO:tasks.workunit.client.0.smithi100.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (1 ms) 2021-01-28T04:00:17.011 INFO:tasks.workunit.client.0.smithi100.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2021-01-28T04:00:17.011 INFO:tasks.workunit.client.0.smithi100.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (2 ms) 2021-01-28T04:00:17.011 INFO:tasks.workunit.client.0.smithi100.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2021-01-28T04:00:17.011 INFO:tasks.workunit.client.0.smithi100.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (1 ms) 2021-01-28T04:00:17.012 INFO:tasks.workunit.client.0.smithi100.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2021-01-28T04:00:17.012 INFO:tasks.workunit.client.0.smithi100.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (2 ms) 2021-01-28T04:00:17.012 INFO:tasks.workunit.client.0.smithi100.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2021-01-28T04:00:17.012 INFO:tasks.workunit.client.0.smithi100.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (1 ms) 2021-01-28T04:00:17.012 INFO:tasks.workunit.client.0.smithi100.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2021-01-28T04:00:17.013 INFO:tasks.workunit.client.0.smithi100.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (1 ms) 2021-01-28T04:00:17.013 INFO:tasks.workunit.client.0.smithi100.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2021-01-28T04:00:17.013 INFO:tasks.workunit.client.0.smithi100.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (1 ms) 2021-01-28T04:00:17.013 INFO:tasks.workunit.client.0.smithi100.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2021-01-28T04:00:17.013 INFO:tasks.workunit.client.0.smithi100.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (2 ms) 2021-01-28T04:00:17.014 INFO:tasks.workunit.client.0.smithi100.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2021-01-28T04:00:17.014 INFO:tasks.workunit.client.0.smithi100.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (2 ms) 2021-01-28T04:00:17.014 INFO:tasks.workunit.client.0.smithi100.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2021-01-28T04:00:17.014 INFO:tasks.workunit.client.0.smithi100.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (1 ms) 2021-01-28T04:00:17.014 INFO:tasks.workunit.client.0.smithi100.stdout: api_asio: [----------] 12 tests from AsioRados (20 ms total) 2021-01-28T04:00:17.015 INFO:tasks.workunit.client.0.smithi100.stdout: api_asio: 2021-01-28T04:00:17.015 INFO:tasks.workunit.client.0.smithi100.stdout: api_asio: [----------] Global test environment tear-down 2021-01-28T04:00:17.015 INFO:tasks.workunit.client.0.smithi100.stdout: api_asio: [==========] 12 tests from 1 test suite ran. (3564 ms total) 2021-01-28T04:00:17.015 INFO:tasks.workunit.client.0.smithi100.stdout: api_asio: [ PASSED ] 12 tests. 2021-01-28T04:00:18.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:18 smithi162 bash[9856]: audit 2021-01-28T04:00:15.620164+0000 mon.c (mon.1) 26 : audit [INF] from='client.? 172.21.15.100:0/336531704' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32256-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:18.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:18 smithi162 bash[9856]: audit 2021-01-28T04:00:15.620828+0000 mon.b (mon.2) 23 : audit [INF] from='client.? 172.21.15.100:0/1077289981' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:18.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:18 smithi162 bash[9856]: cluster 2021-01-28T04:00:16.041762+0000 mon.a (mon.0) 667 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-01-28T04:00:18.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:18 smithi162 bash[9856]: audit 2021-01-28T04:00:16.478192+0000 mon.a (mon.0) 668 : audit [INF] from='client.? 172.21.15.100:0/4228899249' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32171-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:18.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:18 smithi162 bash[9856]: audit 2021-01-28T04:00:16.478704+0000 mon.a (mon.0) 669 : audit [INF] from='client.? 172.21.15.100:0/541817092' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:18.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:18 smithi162 bash[9856]: audit 2021-01-28T04:00:16.919167+0000 mon.a (mon.0) 670 : audit [INF] from='client.? 172.21.15.100:0/4224254830' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32511-1"}]: dispatch 2021-01-28T04:00:18.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:18 smithi100 bash[9834]: audit 2021-01-28T04:00:15.620164+0000 mon.c (mon.1) 26 : audit [INF] from='client.? 172.21.15.100:0/336531704' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32256-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:18.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:18 smithi100 bash[9834]: audit 2021-01-28T04:00:15.620828+0000 mon.b (mon.2) 23 : audit [INF] from='client.? 172.21.15.100:0/1077289981' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:18.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:18 smithi100 bash[9834]: cluster 2021-01-28T04:00:16.041762+0000 mon.a (mon.0) 667 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-01-28T04:00:18.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:18 smithi100 bash[9834]: audit 2021-01-28T04:00:16.478192+0000 mon.a (mon.0) 668 : audit [INF] from='client.? 172.21.15.100:0/4228899249' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32171-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:18.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:18 smithi100 bash[9834]: audit 2021-01-28T04:00:16.478704+0000 mon.a (mon.0) 669 : audit [INF] from='client.? 172.21.15.100:0/541817092' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:18.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:18 smithi100 bash[9834]: audit 2021-01-28T04:00:16.919167+0000 mon.a (mon.0) 670 : audit [INF] from='client.? 172.21.15.100:0/4224254830' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32511-1"}]: dispatch 2021-01-28T04:00:18.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:18 smithi100 bash[13549]: audit 2021-01-28T04:00:15.620164+0000 mon.c (mon.1) 26 : audit [INF] from='client.? 172.21.15.100:0/336531704' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32256-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:18.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:18 smithi100 bash[13549]: audit 2021-01-28T04:00:15.620828+0000 mon.b (mon.2) 23 : audit [INF] from='client.? 172.21.15.100:0/1077289981' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:18.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:18 smithi100 bash[13549]: cluster 2021-01-28T04:00:16.041762+0000 mon.a (mon.0) 667 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-01-28T04:00:18.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:18 smithi100 bash[13549]: audit 2021-01-28T04:00:16.478192+0000 mon.a (mon.0) 668 : audit [INF] from='client.? 172.21.15.100:0/4228899249' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32171-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:18.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:18 smithi100 bash[13549]: audit 2021-01-28T04:00:16.478704+0000 mon.a (mon.0) 669 : audit [INF] from='client.? 172.21.15.100:0/541817092' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:18.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:18 smithi100 bash[13549]: audit 2021-01-28T04:00:16.919167+0000 mon.a (mon.0) 670 : audit [INF] from='client.? 172.21.15.100:0/4224254830' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32511-1"}]: dispatch 2021-01-28T04:00:19.762 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 04:00:19 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T04:00:19.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:19 smithi162 bash[9856]: cluster 2021-01-28T04:00:15.495398+0000 mgr.y (mgr.14138) 478 : cluster [DBG] pgmap v341: 196 pgs: 13 creating+peering, 51 unknown, 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-28T04:00:19.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:19 smithi162 bash[9856]: audit 2021-01-28T04:00:16.933631+0000 mon.a (mon.0) 671 : audit [INF] from='client.? 172.21.15.100:0/4228899249' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32171-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:19.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:19 smithi162 bash[9856]: audit 2021-01-28T04:00:16.933763+0000 mon.a (mon.0) 672 : audit [INF] from='client.? 172.21.15.100:0/541817092' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:19.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:19 smithi162 bash[9856]: audit 2021-01-28T04:00:16.938578+0000 mon.c (mon.1) 27 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:19.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:19 smithi162 bash[9856]: audit 2021-01-28T04:00:16.940951+0000 mon.c (mon.1) 28 : audit [INF] from='client.? 172.21.15.100:0/3775270421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32381-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:19.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:19 smithi162 bash[9856]: audit 2021-01-28T04:00:16.942432+0000 mon.b (mon.2) 24 : audit [INF] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32195-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:19.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:19 smithi162 bash[9856]: cluster 2021-01-28T04:00:17.769818+0000 mon.a (mon.0) 673 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2021-01-28T04:00:19.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:19 smithi162 bash[9856]: audit 2021-01-28T04:00:18.188783+0000 mon.a (mon.0) 674 : audit [INF] from='client.? 172.21.15.100:0/4224254830' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32511-1"}]: dispatch 2021-01-28T04:00:19.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:19 smithi162 bash[9856]: cluster 2021-01-28T04:00:18.610342+0000 mon.a (mon.0) 675 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2021-01-28T04:00:19.827 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 04:00:19 smithi100 bash[10061]: debug 2021-01-28T04:00:19.684+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:00:19.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:19 smithi100 bash[9834]: cluster 2021-01-28T04:00:15.495398+0000 mgr.y (mgr.14138) 478 : cluster [DBG] pgmap v341: 196 pgs: 13 creating+peering, 51 unknown, 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-28T04:00:19.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:19 smithi100 bash[9834]: audit 2021-01-28T04:00:16.933631+0000 mon.a (mon.0) 671 : audit [INF] from='client.? 172.21.15.100:0/4228899249' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32171-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:19.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:19 smithi100 bash[9834]: audit 2021-01-28T04:00:16.933763+0000 mon.a (mon.0) 672 : audit [INF] from='client.? 172.21.15.100:0/541817092' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:19.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:19 smithi100 bash[9834]: audit 2021-01-28T04:00:16.938578+0000 mon.c (mon.1) 27 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:19.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:19 smithi100 bash[9834]: audit 2021-01-28T04:00:16.940951+0000 mon.c (mon.1) 28 : audit [INF] from='client.? 172.21.15.100:0/3775270421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32381-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:19.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:19 smithi100 bash[9834]: audit 2021-01-28T04:00:16.942432+0000 mon.b (mon.2) 24 : audit [INF] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32195-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:19.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:19 smithi100 bash[9834]: cluster 2021-01-28T04:00:17.769818+0000 mon.a (mon.0) 673 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2021-01-28T04:00:19.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:19 smithi100 bash[9834]: audit 2021-01-28T04:00:18.188783+0000 mon.a (mon.0) 674 : audit [INF] from='client.? 172.21.15.100:0/4224254830' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32511-1"}]: dispatch 2021-01-28T04:00:19.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:19 smithi100 bash[9834]: cluster 2021-01-28T04:00:18.610342+0000 mon.a (mon.0) 675 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2021-01-28T04:00:19.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:19 smithi100 bash[13549]: cluster 2021-01-28T04:00:15.495398+0000 mgr.y (mgr.14138) 478 : cluster [DBG] pgmap v341: 196 pgs: 13 creating+peering, 51 unknown, 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-28T04:00:19.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:19 smithi100 bash[13549]: audit 2021-01-28T04:00:16.933631+0000 mon.a (mon.0) 671 : audit [INF] from='client.? 172.21.15.100:0/4228899249' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32171-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:19.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:19 smithi100 bash[13549]: audit 2021-01-28T04:00:16.933763+0000 mon.a (mon.0) 672 : audit [INF] from='client.? 172.21.15.100:0/541817092' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:19.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:19 smithi100 bash[13549]: audit 2021-01-28T04:00:16.938578+0000 mon.c (mon.1) 27 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:19.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:19 smithi100 bash[13549]: audit 2021-01-28T04:00:16.940951+0000 mon.c (mon.1) 28 : audit [INF] from='client.? 172.21.15.100:0/3775270421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32381-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:19.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:19 smithi100 bash[13549]: audit 2021-01-28T04:00:16.942432+0000 mon.b (mon.2) 24 : audit [INF] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32195-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:19.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:19 smithi100 bash[13549]: cluster 2021-01-28T04:00:17.769818+0000 mon.a (mon.0) 673 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2021-01-28T04:00:19.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:19 smithi100 bash[13549]: audit 2021-01-28T04:00:18.188783+0000 mon.a (mon.0) 674 : audit [INF] from='client.? 172.21.15.100:0/4224254830' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32511-1"}]: dispatch 2021-01-28T04:00:19.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:19 smithi100 bash[13549]: cluster 2021-01-28T04:00:18.610342+0000 mon.a (mon.0) 675 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2021-01-28T04:00:22.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:21 smithi162 bash[9856]: cluster 2021-01-28T04:00:17.496511+0000 mgr.y (mgr.14138) 479 : cluster [DBG] pgmap v343: 292 pgs: 69 creating+peering, 91 unknown, 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-01-28T04:00:22.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:21 smithi162 bash[9856]: audit 2021-01-28T04:00:19.441553+0000 mon.a (mon.0) 676 : audit [INF] from='client.? 172.21.15.100:0/4224254830' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32511-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:22.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:21 smithi162 bash[9856]: audit 2021-01-28T04:00:19.442947+0000 mon.a (mon.0) 677 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:22.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:21 smithi162 bash[9856]: audit 2021-01-28T04:00:19.443516+0000 mon.a (mon.0) 678 : audit [INF] from='client.? 172.21.15.100:0/1779980284' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32176-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:22.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:21 smithi162 bash[9856]: audit 2021-01-28T04:00:19.443890+0000 mon.a (mon.0) 679 : audit [INF] from='client.? 172.21.15.100:0/468117236' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:22.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:21 smithi162 bash[9856]: audit 2021-01-28T04:00:19.453257+0000 mon.c (mon.1) 29 : audit [INF] from='client.? 172.21.15.100:0/4244453848' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32442-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:22.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:21 smithi162 bash[9856]: audit 2021-01-28T04:00:19.453562+0000 mon.c (mon.1) 30 : audit [INF] from='client.? 172.21.15.100:0/1695863794' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:22.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:21 smithi162 bash[9856]: audit 2021-01-28T04:00:19.459586+0000 mon.b (mon.2) 25 : audit [INF] from='client.? 172.21.15.100:0/4010312909' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32201-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:22.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:21 smithi162 bash[9856]: cluster 2021-01-28T04:00:19.878557+0000 mon.a (mon.0) 680 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2021-01-28T04:00:22.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:21 smithi162 bash[9856]: audit 2021-01-28T04:00:19.879582+0000 mon.a (mon.0) 681 : audit [INF] from='client.? 172.21.15.100:0/2476257348' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32622-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:22.078 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:21 smithi100 bash[13549]: cluster 2021-01-28T04:00:17.496511+0000 mgr.y (mgr.14138) 479 : cluster [DBG] pgmap v343: 292 pgs: 69 creating+peering, 91 unknown, 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-01-28T04:00:22.078 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:21 smithi100 bash[13549]: audit 2021-01-28T04:00:19.441553+0000 mon.a (mon.0) 676 : audit [INF] from='client.? 172.21.15.100:0/4224254830' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32511-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:22.078 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:21 smithi100 bash[13549]: audit 2021-01-28T04:00:19.442947+0000 mon.a (mon.0) 677 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:22.079 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:21 smithi100 bash[13549]: audit 2021-01-28T04:00:19.443516+0000 mon.a (mon.0) 678 : audit [INF] from='client.? 172.21.15.100:0/1779980284' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32176-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:22.079 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:21 smithi100 bash[13549]: audit 2021-01-28T04:00:19.443890+0000 mon.a (mon.0) 679 : audit [INF] from='client.? 172.21.15.100:0/468117236' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:22.079 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:21 smithi100 bash[13549]: audit 2021-01-28T04:00:19.453257+0000 mon.c (mon.1) 29 : audit [INF] from='client.? 172.21.15.100:0/4244453848' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32442-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:22.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:21 smithi100 bash[13549]: audit 2021-01-28T04:00:19.453562+0000 mon.c (mon.1) 30 : audit [INF] from='client.? 172.21.15.100:0/1695863794' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:22.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:21 smithi100 bash[13549]: audit 2021-01-28T04:00:19.459586+0000 mon.b (mon.2) 25 : audit [INF] from='client.? 172.21.15.100:0/4010312909' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32201-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:22.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:21 smithi100 bash[13549]: cluster 2021-01-28T04:00:19.878557+0000 mon.a (mon.0) 680 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2021-01-28T04:00:22.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:21 smithi100 bash[13549]: audit 2021-01-28T04:00:19.879582+0000 mon.a (mon.0) 681 : audit [INF] from='client.? 172.21.15.100:0/2476257348' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32622-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:22.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:21 smithi100 bash[9834]: cluster 2021-01-28T04:00:17.496511+0000 mgr.y (mgr.14138) 479 : cluster [DBG] pgmap v343: 292 pgs: 69 creating+peering, 91 unknown, 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2021-01-28T04:00:22.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:21 smithi100 bash[9834]: audit 2021-01-28T04:00:19.441553+0000 mon.a (mon.0) 676 : audit [INF] from='client.? 172.21.15.100:0/4224254830' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32511-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:22.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:21 smithi100 bash[9834]: audit 2021-01-28T04:00:19.442947+0000 mon.a (mon.0) 677 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:22.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:21 smithi100 bash[9834]: audit 2021-01-28T04:00:19.443516+0000 mon.a (mon.0) 678 : audit [INF] from='client.? 172.21.15.100:0/1779980284' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32176-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:22.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:21 smithi100 bash[9834]: audit 2021-01-28T04:00:19.443890+0000 mon.a (mon.0) 679 : audit [INF] from='client.? 172.21.15.100:0/468117236' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:22.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:21 smithi100 bash[9834]: audit 2021-01-28T04:00:19.453257+0000 mon.c (mon.1) 29 : audit [INF] from='client.? 172.21.15.100:0/4244453848' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32442-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:22.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:21 smithi100 bash[9834]: audit 2021-01-28T04:00:19.453562+0000 mon.c (mon.1) 30 : audit [INF] from='client.? 172.21.15.100:0/1695863794' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:22.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:21 smithi100 bash[9834]: audit 2021-01-28T04:00:19.459586+0000 mon.b (mon.2) 25 : audit [INF] from='client.? 172.21.15.100:0/4010312909' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32201-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:22.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:21 smithi100 bash[9834]: cluster 2021-01-28T04:00:19.878557+0000 mon.a (mon.0) 680 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2021-01-28T04:00:22.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:21 smithi100 bash[9834]: audit 2021-01-28T04:00:19.879582+0000 mon.a (mon.0) 681 : audit [INF] from='client.? 172.21.15.100:0/2476257348' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32622-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:23.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:23 smithi162 bash[9856]: cluster 2021-01-28T04:00:19.497528+0000 mgr.y (mgr.14138) 480 : cluster [DBG] pgmap v345: 484 pgs: 132 creating+peering, 172 unknown, 180 active+clean; 25 KiB data, 55 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-01-28T04:00:23.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:23 smithi162 bash[9856]: audit 2021-01-28T04:00:19.689872+0000 mgr.y (mgr.14138) 481 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:00:23.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:23 smithi162 bash[9856]: audit 2021-01-28T04:00:20.713627+0000 mon.a (mon.0) 682 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32195-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:23.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:23 smithi162 bash[9856]: audit 2021-01-28T04:00:20.722725+0000 mon.a (mon.0) 683 : audit [INF] from='client.? 172.21.15.100:0/4224254830' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32511-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:00:23.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:23 smithi162 bash[9856]: audit 2021-01-28T04:00:20.722894+0000 mon.a (mon.0) 684 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:23.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:23 smithi162 bash[9856]: audit 2021-01-28T04:00:20.723035+0000 mon.a (mon.0) 685 : audit [INF] from='client.? 172.21.15.100:0/1779980284' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32176-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:23.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:23 smithi162 bash[9856]: audit 2021-01-28T04:00:20.723138+0000 mon.a (mon.0) 686 : audit [INF] from='client.? 172.21.15.100:0/468117236' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:23.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:23 smithi162 bash[9856]: audit 2021-01-28T04:00:20.723215+0000 mon.a (mon.0) 687 : audit [INF] from='client.? 172.21.15.100:0/2476257348' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32622-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:23.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:23 smithi162 bash[9856]: audit 2021-01-28T04:00:20.731258+0000 mon.c (mon.1) 31 : audit [INF] from='client.? 172.21.15.100:0/4173951184' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:23.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:23 smithi162 bash[9856]: audit 2021-01-28T04:00:20.733437+0000 mon.c (mon.1) 32 : audit [INF] from='client.? 172.21.15.100:0/4058683869' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32492-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:23.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:23 smithi162 bash[9856]: audit 2021-01-28T04:00:20.735850+0000 mon.c (mon.1) 33 : audit [INF] from='client.? 172.21.15.100:0/3219415284' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32534-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:23.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:23 smithi162 bash[9856]: cluster 2021-01-28T04:00:21.576519+0000 mon.a (mon.0) 688 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2021-01-28T04:00:23.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:23 smithi162 bash[9856]: audit 2021-01-28T04:00:21.579811+0000 mon.a (mon.0) 689 : audit [INF] from='client.? 172.21.15.100:0/4224254830' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32511-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32511-1"}]: dispatch 2021-01-28T04:00:23.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:23 smithi162 bash[9856]: audit 2021-01-28T04:00:22.031095+0000 mon.a (mon.0) 690 : audit [DBG] from='client.? 172.21.15.100:0/1619986776' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2021-01-28T04:00:23.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:23 smithi100 bash[9834]: cluster 2021-01-28T04:00:19.497528+0000 mgr.y (mgr.14138) 480 : cluster [DBG] pgmap v345: 484 pgs: 132 creating+peering, 172 unknown, 180 active+clean; 25 KiB data, 55 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-01-28T04:00:23.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:23 smithi100 bash[9834]: audit 2021-01-28T04:00:19.689872+0000 mgr.y (mgr.14138) 481 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:00:23.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:23 smithi100 bash[9834]: audit 2021-01-28T04:00:20.713627+0000 mon.a (mon.0) 682 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32195-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:23.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:23 smithi100 bash[9834]: audit 2021-01-28T04:00:20.722725+0000 mon.a (mon.0) 683 : audit [INF] from='client.? 172.21.15.100:0/4224254830' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32511-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:00:23.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:23 smithi100 bash[9834]: audit 2021-01-28T04:00:20.722894+0000 mon.a (mon.0) 684 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:23.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:23 smithi100 bash[9834]: audit 2021-01-28T04:00:20.723035+0000 mon.a (mon.0) 685 : audit [INF] from='client.? 172.21.15.100:0/1779980284' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32176-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:23.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:23 smithi100 bash[9834]: audit 2021-01-28T04:00:20.723138+0000 mon.a (mon.0) 686 : audit [INF] from='client.? 172.21.15.100:0/468117236' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:23.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:23 smithi100 bash[9834]: audit 2021-01-28T04:00:20.723215+0000 mon.a (mon.0) 687 : audit [INF] from='client.? 172.21.15.100:0/2476257348' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32622-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:23.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:23 smithi100 bash[9834]: audit 2021-01-28T04:00:20.731258+0000 mon.c (mon.1) 31 : audit [INF] from='client.? 172.21.15.100:0/4173951184' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:23.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:23 smithi100 bash[9834]: audit 2021-01-28T04:00:20.733437+0000 mon.c (mon.1) 32 : audit [INF] from='client.? 172.21.15.100:0/4058683869' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32492-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:23.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:23 smithi100 bash[9834]: audit 2021-01-28T04:00:20.735850+0000 mon.c (mon.1) 33 : audit [INF] from='client.? 172.21.15.100:0/3219415284' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32534-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:23.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:23 smithi100 bash[9834]: cluster 2021-01-28T04:00:21.576519+0000 mon.a (mon.0) 688 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2021-01-28T04:00:23.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:23 smithi100 bash[9834]: audit 2021-01-28T04:00:21.579811+0000 mon.a (mon.0) 689 : audit [INF] from='client.? 172.21.15.100:0/4224254830' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32511-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32511-1"}]: dispatch 2021-01-28T04:00:23.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:23 smithi100 bash[9834]: audit 2021-01-28T04:00:22.031095+0000 mon.a (mon.0) 690 : audit [DBG] from='client.? 172.21.15.100:0/1619986776' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2021-01-28T04:00:23.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:23 smithi100 bash[13549]: cluster 2021-01-28T04:00:19.497528+0000 mgr.y (mgr.14138) 480 : cluster [DBG] pgmap v345: 484 pgs: 132 creating+peering, 172 unknown, 180 active+clean; 25 KiB data, 55 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-01-28T04:00:23.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:23 smithi100 bash[13549]: audit 2021-01-28T04:00:19.689872+0000 mgr.y (mgr.14138) 481 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:00:23.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:23 smithi100 bash[13549]: audit 2021-01-28T04:00:20.713627+0000 mon.a (mon.0) 682 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32195-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:23.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:23 smithi100 bash[13549]: audit 2021-01-28T04:00:20.722725+0000 mon.a (mon.0) 683 : audit [INF] from='client.? 172.21.15.100:0/4224254830' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32511-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:00:23.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:23 smithi100 bash[13549]: audit 2021-01-28T04:00:20.722894+0000 mon.a (mon.0) 684 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:23.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:23 smithi100 bash[13549]: audit 2021-01-28T04:00:20.723035+0000 mon.a (mon.0) 685 : audit [INF] from='client.? 172.21.15.100:0/1779980284' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32176-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:23.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:23 smithi100 bash[13549]: audit 2021-01-28T04:00:20.723138+0000 mon.a (mon.0) 686 : audit [INF] from='client.? 172.21.15.100:0/468117236' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:23.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:23 smithi100 bash[13549]: audit 2021-01-28T04:00:20.723215+0000 mon.a (mon.0) 687 : audit [INF] from='client.? 172.21.15.100:0/2476257348' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32622-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:23.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:23 smithi100 bash[13549]: audit 2021-01-28T04:00:20.731258+0000 mon.c (mon.1) 31 : audit [INF] from='client.? 172.21.15.100:0/4173951184' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:23.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:23 smithi100 bash[13549]: audit 2021-01-28T04:00:20.733437+0000 mon.c (mon.1) 32 : audit [INF] from='client.? 172.21.15.100:0/4058683869' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32492-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:23.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:23 smithi100 bash[13549]: audit 2021-01-28T04:00:20.735850+0000 mon.c (mon.1) 33 : audit [INF] from='client.? 172.21.15.100:0/3219415284' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32534-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:23.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:23 smithi100 bash[13549]: cluster 2021-01-28T04:00:21.576519+0000 mon.a (mon.0) 688 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2021-01-28T04:00:23.834 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:23 smithi100 bash[13549]: audit 2021-01-28T04:00:21.579811+0000 mon.a (mon.0) 689 : audit [INF] from='client.? 172.21.15.100:0/4224254830' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32511-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32511-1"}]: dispatch 2021-01-28T04:00:23.834 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:23 smithi100 bash[13549]: audit 2021-01-28T04:00:22.031095+0000 mon.a (mon.0) 690 : audit [DBG] from='client.? 172.21.15.100:0/1619986776' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2021-01-28T04:00:25.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:25 smithi162 bash[9856]: cluster 2021-01-28T04:00:21.499110+0000 mgr.y (mgr.14138) 482 : cluster [DBG] pgmap v347: 580 pgs: 178 creating+peering, 213 unknown, 189 active+clean; 25 KiB data, 56 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-01-28T04:00:25.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:25 smithi162 bash[9856]: audit 2021-01-28T04:00:22.041444+0000 mon.a (mon.0) 691 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32195-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:25.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:25 smithi162 bash[9856]: audit 2021-01-28T04:00:22.050367+0000 mon.c (mon.1) 34 : audit [INF] from='client.? 172.21.15.100:0/1834170228' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32465-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:25 smithi162 bash[9856]: cluster 2021-01-28T04:00:23.309916+0000 mon.a (mon.0) 692 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2021-01-28T04:00:25.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:25 smithi162 bash[9856]: cluster 2021-01-28T04:00:23.310844+0000 mon.a (mon.0) 693 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:00:25.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:25 smithi162 bash[9856]: audit 2021-01-28T04:00:23.330827+0000 mon.a (mon.0) 694 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32256-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:25 smithi162 bash[9856]: audit 2021-01-28T04:00:23.331987+0000 mon.a (mon.0) 695 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:25 smithi162 bash[9856]: audit 2021-01-28T04:00:23.332347+0000 mon.a (mon.0) 696 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32381-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:25 smithi162 bash[9856]: audit 2021-01-28T04:00:23.334041+0000 mon.a (mon.0) 697 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32442-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:25 smithi162 bash[9856]: audit 2021-01-28T04:00:23.334420+0000 mon.a (mon.0) 698 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:25 smithi162 bash[9856]: audit 2021-01-28T04:00:23.335195+0000 mon.a (mon.0) 699 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:25 smithi162 bash[9856]: audit 2021-01-28T04:00:23.335456+0000 mon.a (mon.0) 700 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32201-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:25 smithi162 bash[9856]: audit 2021-01-28T04:00:23.336658+0000 mon.a (mon.0) 701 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32492-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:25 smithi162 bash[9856]: audit 2021-01-28T04:00:23.337083+0000 mon.a (mon.0) 702 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32534-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:25 smithi162 bash[9856]: audit 2021-01-28T04:00:23.347912+0000 mon.a (mon.0) 703 : audit [INF] from='client.? 172.21.15.100:0/4224254830' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32511-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32511-1"}]': finished 2021-01-28T04:00:25.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:25 smithi162 bash[9856]: audit 2021-01-28T04:00:23.359625+0000 mon.c (mon.1) 35 : audit [INF] from='client.? 172.21.15.100:0/224755860' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32434-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:25 smithi162 bash[9856]: audit 2021-01-28T04:00:23.360415+0000 mon.c (mon.1) 36 : audit [INF] from='client.? 172.21.15.100:0/2406390797' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32171-15"}]: dispatch 2021-01-28T04:00:25.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:25 smithi162 bash[9856]: cluster 2021-01-28T04:00:23.500982+0000 mgr.y (mgr.14138) 483 : cluster [DBG] pgmap v351: 780 pgs: 384 creating+peering, 229 unknown, 167 active+clean; 25 KiB data, 65 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:00:25.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:25 smithi162 bash[9856]: cluster 2021-01-28T04:00:24.182177+0000 mon.a (mon.0) 704 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2021-01-28T04:00:25.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:25 smithi162 bash[9856]: audit 2021-01-28T04:00:24.190887+0000 mon.a (mon.0) 705 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32465-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:25 smithi162 bash[9856]: audit 2021-01-28T04:00:24.191829+0000 mon.a (mon.0) 706 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32434-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:25 smithi162 bash[9856]: audit 2021-01-28T04:00:24.192165+0000 mon.a (mon.0) 707 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32171-15"}]: dispatch 2021-01-28T04:00:25.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:25 smithi162 bash[9856]: audit 2021-01-28T04:00:24.192991+0000 mon.c (mon.1) 37 : audit [INF] from='client.? 172.21.15.100:0/2406390797' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32171-15"}]: dispatch 2021-01-28T04:00:25.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:25 smithi162 bash[9856]: audit 2021-01-28T04:00:24.193648+0000 mon.a (mon.0) 708 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32171-15"}]: dispatch 2021-01-28T04:00:25.518 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:25 smithi162 bash[9856]: audit 2021-01-28T04:00:24.194216+0000 mon.c (mon.1) 38 : audit [INF] from='client.? 172.21.15.100:0/2406390797' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32171-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:25.518 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:25 smithi162 bash[9856]: audit 2021-01-28T04:00:24.194812+0000 mon.a (mon.0) 709 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32171-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:25.577 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[13549]: cluster 2021-01-28T04:00:21.499110+0000 mgr.y (mgr.14138) 482 : cluster [DBG] pgmap v347: 580 pgs: 178 creating+peering, 213 unknown, 189 active+clean; 25 KiB data, 56 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-01-28T04:00:25.578 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[13549]: audit 2021-01-28T04:00:22.041444+0000 mon.a (mon.0) 691 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32195-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:25.578 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[13549]: audit 2021-01-28T04:00:22.050367+0000 mon.c (mon.1) 34 : audit [INF] from='client.? 172.21.15.100:0/1834170228' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32465-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.578 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[13549]: cluster 2021-01-28T04:00:23.309916+0000 mon.a (mon.0) 692 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2021-01-28T04:00:25.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[13549]: cluster 2021-01-28T04:00:23.310844+0000 mon.a (mon.0) 693 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:00:25.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[13549]: audit 2021-01-28T04:00:23.330827+0000 mon.a (mon.0) 694 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32256-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[13549]: audit 2021-01-28T04:00:23.331987+0000 mon.a (mon.0) 695 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[13549]: audit 2021-01-28T04:00:23.332347+0000 mon.a (mon.0) 696 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32381-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[13549]: audit 2021-01-28T04:00:23.334041+0000 mon.a (mon.0) 697 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32442-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[13549]: audit 2021-01-28T04:00:23.334420+0000 mon.a (mon.0) 698 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[13549]: audit 2021-01-28T04:00:23.335195+0000 mon.a (mon.0) 699 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[13549]: audit 2021-01-28T04:00:23.335456+0000 mon.a (mon.0) 700 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32201-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[13549]: audit 2021-01-28T04:00:23.336658+0000 mon.a (mon.0) 701 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32492-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[13549]: audit 2021-01-28T04:00:23.337083+0000 mon.a (mon.0) 702 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32534-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[13549]: audit 2021-01-28T04:00:23.347912+0000 mon.a (mon.0) 703 : audit [INF] from='client.? 172.21.15.100:0/4224254830' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32511-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32511-1"}]': finished 2021-01-28T04:00:25.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[13549]: audit 2021-01-28T04:00:23.359625+0000 mon.c (mon.1) 35 : audit [INF] from='client.? 172.21.15.100:0/224755860' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32434-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[13549]: audit 2021-01-28T04:00:23.360415+0000 mon.c (mon.1) 36 : audit [INF] from='client.? 172.21.15.100:0/2406390797' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32171-15"}]: dispatch 2021-01-28T04:00:25.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[13549]: cluster 2021-01-28T04:00:23.500982+0000 mgr.y (mgr.14138) 483 : cluster [DBG] pgmap v351: 780 pgs: 384 creating+peering, 229 unknown, 167 active+clean; 25 KiB data, 65 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:00:25.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[13549]: cluster 2021-01-28T04:00:24.182177+0000 mon.a (mon.0) 704 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2021-01-28T04:00:25.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[13549]: audit 2021-01-28T04:00:24.190887+0000 mon.a (mon.0) 705 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32465-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[13549]: audit 2021-01-28T04:00:24.191829+0000 mon.a (mon.0) 706 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32434-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.585 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[13549]: audit 2021-01-28T04:00:24.192165+0000 mon.a (mon.0) 707 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32171-15"}]: dispatch 2021-01-28T04:00:25.585 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[13549]: audit 2021-01-28T04:00:24.192991+0000 mon.c (mon.1) 37 : audit [INF] from='client.? 172.21.15.100:0/2406390797' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32171-15"}]: dispatch 2021-01-28T04:00:25.585 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[13549]: audit 2021-01-28T04:00:24.193648+0000 mon.a (mon.0) 708 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32171-15"}]: dispatch 2021-01-28T04:00:25.586 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[13549]: audit 2021-01-28T04:00:24.194216+0000 mon.c (mon.1) 38 : audit [INF] from='client.? 172.21.15.100:0/2406390797' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32171-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:25.586 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[13549]: audit 2021-01-28T04:00:24.194812+0000 mon.a (mon.0) 709 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32171-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:25.587 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[9834]: cluster 2021-01-28T04:00:21.499110+0000 mgr.y (mgr.14138) 482 : cluster [DBG] pgmap v347: 580 pgs: 178 creating+peering, 213 unknown, 189 active+clean; 25 KiB data, 56 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-01-28T04:00:25.587 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[9834]: audit 2021-01-28T04:00:22.041444+0000 mon.a (mon.0) 691 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32195-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:25.588 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[9834]: audit 2021-01-28T04:00:22.050367+0000 mon.c (mon.1) 34 : audit [INF] from='client.? 172.21.15.100:0/1834170228' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32465-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.588 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[9834]: cluster 2021-01-28T04:00:23.309916+0000 mon.a (mon.0) 692 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2021-01-28T04:00:25.589 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[9834]: cluster 2021-01-28T04:00:23.310844+0000 mon.a (mon.0) 693 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:00:25.589 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[9834]: audit 2021-01-28T04:00:23.330827+0000 mon.a (mon.0) 694 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32256-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.589 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[9834]: audit 2021-01-28T04:00:23.331987+0000 mon.a (mon.0) 695 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.590 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[9834]: audit 2021-01-28T04:00:23.332347+0000 mon.a (mon.0) 696 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32381-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.590 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[9834]: audit 2021-01-28T04:00:23.334041+0000 mon.a (mon.0) 697 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32442-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.591 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[9834]: audit 2021-01-28T04:00:23.334420+0000 mon.a (mon.0) 698 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.591 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[9834]: audit 2021-01-28T04:00:23.335195+0000 mon.a (mon.0) 699 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.592 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[9834]: audit 2021-01-28T04:00:23.335456+0000 mon.a (mon.0) 700 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32201-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.592 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[9834]: audit 2021-01-28T04:00:23.336658+0000 mon.a (mon.0) 701 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32492-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.592 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[9834]: audit 2021-01-28T04:00:23.337083+0000 mon.a (mon.0) 702 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32534-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.593 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[9834]: audit 2021-01-28T04:00:23.347912+0000 mon.a (mon.0) 703 : audit [INF] from='client.? 172.21.15.100:0/4224254830' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32511-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32511-1"}]': finished 2021-01-28T04:00:25.593 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[9834]: audit 2021-01-28T04:00:23.359625+0000 mon.c (mon.1) 35 : audit [INF] from='client.? 172.21.15.100:0/224755860' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32434-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.594 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[9834]: audit 2021-01-28T04:00:23.360415+0000 mon.c (mon.1) 36 : audit [INF] from='client.? 172.21.15.100:0/2406390797' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32171-15"}]: dispatch 2021-01-28T04:00:25.594 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[9834]: cluster 2021-01-28T04:00:23.500982+0000 mgr.y (mgr.14138) 483 : cluster [DBG] pgmap v351: 780 pgs: 384 creating+peering, 229 unknown, 167 active+clean; 25 KiB data, 65 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:00:25.595 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[9834]: cluster 2021-01-28T04:00:24.182177+0000 mon.a (mon.0) 704 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2021-01-28T04:00:25.595 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[9834]: audit 2021-01-28T04:00:24.190887+0000 mon.a (mon.0) 705 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32465-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.595 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[9834]: audit 2021-01-28T04:00:24.191829+0000 mon.a (mon.0) 706 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32434-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:25.596 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[9834]: audit 2021-01-28T04:00:24.192165+0000 mon.a (mon.0) 707 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32171-15"}]: dispatch 2021-01-28T04:00:25.596 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[9834]: audit 2021-01-28T04:00:24.192991+0000 mon.c (mon.1) 37 : audit [INF] from='client.? 172.21.15.100:0/2406390797' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32171-15"}]: dispatch 2021-01-28T04:00:25.597 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[9834]: audit 2021-01-28T04:00:24.193648+0000 mon.a (mon.0) 708 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32171-15"}]: dispatch 2021-01-28T04:00:25.597 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[9834]: audit 2021-01-28T04:00:24.194216+0000 mon.c (mon.1) 38 : audit [INF] from='client.? 172.21.15.100:0/2406390797' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32171-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:25.598 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:25 smithi100 bash[9834]: audit 2021-01-28T04:00:24.194812+0000 mon.a (mon.0) 709 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32171-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:25.599 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: [==========] Running 10 tests from 3 test suites. 2021-01-28T04:00:25.599 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: [----------] Global test environment set-up. 2021-01-28T04:00:25.599 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: [----------] 6 tests from LibRadosList 2021-01-28T04:00:25.600 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: [ RUN ] LibRadosList.ListObjects 2021-01-28T04:00:25.600 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: [ OK ] LibRadosList.ListObjects (3064 ms) 2021-01-28T04:00:25.601 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: [ RUN ] LibRadosList.ListObjectsNS 2021-01-28T04:00:25.601 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: myset foo1,foo2,foo3 2021-01-28T04:00:25.602 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: foo1 2021-01-28T04:00:25.602 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: foo2 2021-01-28T04:00:25.602 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: foo3 2021-01-28T04:00:25.603 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: myset foo1,foo4,foo5 2021-01-28T04:00:25.603 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: foo4 2021-01-28T04:00:25.604 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: foo5 2021-01-28T04:00:25.604 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: foo1 2021-01-28T04:00:25.604 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: myset foo6,foo7 2021-01-28T04:00:25.605 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: foo7 2021-01-28T04:00:25.605 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: foo6 2021-01-28T04:00:25.606 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2021-01-28T04:00:25.606 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: ns1:foo4 2021-01-28T04:00:25.607 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: ns1:foo5 2021-01-28T04:00:25.607 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: ns2:foo7 2021-01-28T04:00:25.607 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: ns2:foo6 2021-01-28T04:00:25.608 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: ns1:foo1 2021-01-28T04:00:25.608 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: :foo1 2021-01-28T04:00:25.609 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: :foo2 2021-01-28T04:00:25.609 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: :foo3 2021-01-28T04:00:25.609 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: [ OK ] LibRadosList.ListObjectsNS (163 ms) 2021-01-28T04:00:25.610 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: [ RUN ] LibRadosList.ListObjectsStart 2021-01-28T04:00:25.610 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: 1 0 2021-01-28T04:00:25.611 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: 10 0 2021-01-28T04:00:25.611 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: 13 0 2021-01-28T04:00:25.612 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: 7 0 2021-01-28T04:00:25.612 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: 14 0 2021-01-28T04:00:25.612 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: 0 0 2021-01-28T04:00:25.613 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: 15 0 2021-01-28T04:00:25.613 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: 11 0 2021-01-28T04:00:25.614 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: 5 0 2021-01-28T04:00:25.614 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: 8 0 2021-01-28T04:00:25.614 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: 6 0 2021-01-28T04:00:25.615 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: 3 0 2021-01-28T04:00:25.615 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: 4 0 2021-01-28T04:00:25.616 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: 12 0 2021-01-28T04:00:25.616 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: 9 0 2021-01-28T04:00:25.617 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: 2 0 2021-01-28T04:00:25.617 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2021-01-28T04:00:25.617 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: [ OK ] LibRadosList.ListObjectsStart (130 ms) 2021-01-28T04:00:25.618 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: [ RUN ] LibRadosList.ListObjectsCursor 2021-01-28T04:00:25.618 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: x cursor=MIN 2021-01-28T04:00:25.619 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > oid=1 cursor=12:02547ec2:::1:head 2021-01-28T04:00:25.619 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > oid=10 cursor=12:52ea6a34:::10:head 2021-01-28T04:00:25.619 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > oid=13 cursor=12:566253c9:::13:head 2021-01-28T04:00:25.620 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > oid=7 cursor=12:5c6b0b28:::7:head 2021-01-28T04:00:25.620 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > oid=14 cursor=12:62a1935d:::14:head 2021-01-28T04:00:25.620 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > oid=0 cursor=12:6cac518f:::0:head 2021-01-28T04:00:25.620 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > oid=15 cursor=12:863748b0:::15:head 2021-01-28T04:00:25.621 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > oid=11 cursor=12:89d3ae78:::11:head 2021-01-28T04:00:25.621 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > oid=5 cursor=12:b29083e3:::5:head 2021-01-28T04:00:25.621 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > oid=8 cursor=12:bd63b0f1:::8:head 2021-01-28T04:00:25.621 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > oid=6 cursor=12:c4fdafeb:::6:head 2021-01-28T04:00:25.621 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > oid=3 cursor=12:cfc208b3:::3:head 2021-01-28T04:00:25.622 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > oid=4 cursor=12:d83876eb:::4:head 2021-01-28T04:00:25.622 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > oid=12 cursor=12:de5d7c5f:::12:head 2021-01-28T04:00:25.622 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > oid=9 cursor=12:e960b815:::9:head 2021-01-28T04:00:25.622 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > oid=2 cursor=12:f905c69b:::2:head 2021-01-28T04:00:25.623 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: FIRST> seek to MIN oid=1 2021-01-28T04:00:25.623 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : oid=1 cursor=12:02547ec2:::1:head 2021-01-28T04:00:25.623 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : seek to 12:02547ec2:::1:head 2021-01-28T04:00:25.623 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > 12:02547ec2:::1:head -> 1 2021-01-28T04:00:25.623 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : oid=10 cursor=12:52ea6a34:::10:head 2021-01-28T04:00:25.624 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : seek to 12:52ea6a34:::10:head 2021-01-28T04:00:25.624 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > 12:52ea6a34:::10:head -> 10 2021-01-28T04:00:25.624 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : oid=13 cursor=12:566253c9:::13:head 2021-01-28T04:00:25.624 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : seek to 12:566253c9:::13:head 2021-01-28T04:00:25.624 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > 12:566253c9:::13:head -> 13 2021-01-28T04:00:25.625 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : oid=7 cursor=12:5c6b0b28:::7:head 2021-01-28T04:00:25.625 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : seek to 12:5c6b0b28:::7:head 2021-01-28T04:00:25.625 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > 12:5c6b0b28:::7:head -> 7 2021-01-28T04:00:25.625 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : oid=14 cursor=12:62a1935d:::14:head 2021-01-28T04:00:25.625 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : seek to 12:62a1935d:::14:head 2021-01-28T04:00:25.626 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > 12:62a1935d:::14:head -> 14 2021-01-28T04:00:25.790 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : oid=0 cursor=12:6cac518f:::0:head 2021-01-28T04:00:25.790 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : seek to 12:6cac518f:::0:head 2021-01-28T04:00:25.790 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > 12:6cac518f:::0:head -> 0 2021-01-28T04:00:25.791 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : oid=15 cursor=12:863748b0:::15:head 2021-01-28T04:00:25.791 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : seek to 12:863748b0:::15:head 2021-01-28T04:00:25.791 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > 12:863748b0:::15:head -> 15 2021-01-28T04:00:25.791 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : oid=11 cursor=12:89d3ae78:::11:head 2021-01-28T04:00:25.791 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : seek to 12:89d3ae78:::11:head 2021-01-28T04:00:25.792 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > 12:89d3ae78:::11:head -> 11 2021-01-28T04:00:25.792 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : oid=5 cursor=12:b29083e3:::5:head 2021-01-28T04:00:25.792 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : seek to 12:b29083e3:::5:head 2021-01-28T04:00:25.792 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > 12:b29083e3:::5:head -> 5 2021-01-28T04:00:25.792 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : oid=8 cursor=12:bd63b0f1:::8:head 2021-01-28T04:00:25.793 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : seek to 12:bd63b0f1:::8:head 2021-01-28T04:00:25.793 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > 12:bd63b0f1:::8:head -> 8 2021-01-28T04:00:25.793 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : oid=6 cursor=12:c4fdafeb:::6:head 2021-01-28T04:00:25.793 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : seek to 12:c4fdafeb:::6:head 2021-01-28T04:00:25.794 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > 12:c4fdafeb:::6:head -> 6 2021-01-28T04:00:25.794 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : oid=3 cursor=12:cfc208b3:::3:head 2021-01-28T04:00:25.794 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : seek to 12:cfc208b3:::3:head 2021-01-28T04:00:25.794 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > 12:cfc208b3:::3:head -> 3 2021-01-28T04:00:25.794 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : oid=4 cursor=12:d83876eb:::4:head 2021-01-28T04:00:25.795 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : seek to 12:d83876eb:::4:head 2021-01-28T04:00:25.795 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > 12:d83876eb:::4:head -> 4 2021-01-28T04:00:25.795 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : oid=12 cursor=12:de5d7c5f:::12:head 2021-01-28T04:00:25.795 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : seek to 12:de5d7c5f:::12:head 2021-01-28T04:00:25.795 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > 12:de5d7c5f:::12:head -> 12 2021-01-28T04:00:25.796 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : oid=9 cursor=12:e960b815:::9:head 2021-01-28T04:00:25.796 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : seek to 12:e960b815:::9:head 2021-01-28T04:00:25.796 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > 12:e960b815:::9:head -> 9 2021-01-28T04:00:25.796 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : oid=2 cursor=12:f905c69b:::2:head 2021-01-28T04:00:25.797 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : seek to 12:f905c69b:::2:head 2021-01-28T04:00:25.797 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > 12:f905c69b:::2:head -> 2 2021-01-28T04:00:25.797 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : seek to 12:52ea6a34:::10:head 2021-01-28T04:00:25.797 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : cursor()=12:52ea6a34:::10:head expected=12:52ea6a34:::10:head 2021-01-28T04:00:25.797 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > 12:52ea6a34:::10:head -> 10 2021-01-28T04:00:25.798 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : entry=10 expected=10 2021-01-28T04:00:25.798 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : seek to 12:f905c69b:::2:head 2021-01-28T04:00:25.798 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : cursor()=12:f905c69b:::2:head expected=12:f905c69b:::2:head 2021-01-28T04:00:25.798 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > 12:f905c69b:::2:head -> 2 2021-01-28T04:00:25.799 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : entry=2 expected=2 2021-01-28T04:00:25.799 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : seek to 12:e960b815:::9:head 2021-01-28T04:00:25.799 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : cursor()=12:e960b815:::9:head expected=12:e960b815:::9:head 2021-01-28T04:00:25.799 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > 12:e960b815:::9:head -> 9 2021-01-28T04:00:25.800 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : entry=9 expected=9 2021-01-28T04:00:25.800 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : seek to 12:de5d7c5f:::12:head 2021-01-28T04:00:25.800 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : cursor()=12:de5d7c5f:::12:head expected=12:de5d7c5f:::12:head 2021-01-28T04:00:25.800 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > 12:de5d7c5f:::12:head -> 12 2021-01-28T04:00:25.800 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : entry=12 expected=12 2021-01-28T04:00:25.801 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : seek to 12:d83876eb:::4:head 2021-01-28T04:00:25.801 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : cursor()=12:d83876eb:::4:head expected=12:d83876eb:::4:head 2021-01-28T04:00:25.801 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > 12:d83876eb:::4:head -> 4 2021-01-28T04:00:25.801 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : entry=4 expected=4 2021-01-28T04:00:25.801 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : seek to 12:cfc208b3:::3:head 2021-01-28T04:00:25.802 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : cursor()=12:cfc208b3:::3:head expected=12:cfc208b3:::3:head 2021-01-28T04:00:25.802 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > 12:cfc208b3:::3:head -> 3 2021-01-28T04:00:25.802 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : entry=3 expected=3 2021-01-28T04:00:25.802 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : seek to 12:c4fdafeb:::6:head 2021-01-28T04:00:25.803 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : cursor()=12:c4fdafeb:::6:head expected=12:c4fdafeb:::6:head 2021-01-28T04:00:25.803 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > 12:c4fdafeb:::6:head -> 6 2021-01-28T04:00:25.803 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : entry=6 expected=6 2021-01-28T04:00:25.803 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : seek to 12:bd63b0f1:::8:head 2021-01-28T04:00:25.803 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : cursor()=12:bd63b0f1:::8:head expected=12:bd63b0f1:::8:head 2021-01-28T04:00:25.804 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > 12:bd63b0f1:::8:head -> 8 2021-01-28T04:00:25.804 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : entry=8 expected=8 2021-01-28T04:00:25.804 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : seek to 12:b29083e3:::5:head 2021-01-28T04:00:26.687 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : cursor()=12:b29083e3:::5:head expected=12:b29083e3:::5:he api_c_read_operations: Running main() from gmock_main.cc 2021-01-28T04:00:26.687 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [==========] Running 16 tests from 1 test suite. 2021-01-28T04:00:26.687 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [----------] Global test environment set-up. 2021-01-28T04:00:26.688 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [----------] 16 tests from CReadOpsTest 2021-01-28T04:00:26.688 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2021-01-28T04:00:26.688 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (0 ms) 2021-01-28T04:00:26.688 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2021-01-28T04:00:26.688 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (2940 ms) 2021-01-28T04:00:26.689 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2021-01-28T04:00:26.689 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (22 ms) 2021-01-28T04:00:26.689 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2021-01-28T04:00:26.689 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (62 ms) 2021-01-28T04:00:26.689 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2021-01-28T04:00:26.690 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (40 ms) 2021-01-28T04:00:26.690 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2021-01-28T04:00:26.690 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (10 ms) 2021-01-28T04:00:26.690 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2021-01-28T04:00:26.691 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (11 ms) 2021-01-28T04:00:26.691 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2021-01-28T04:00:26.691 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (7 ms) 2021-01-28T04:00:26.691 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2021-01-28T04:00:26.691 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (10 ms) 2021-01-28T04:00:26.692 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2021-01-28T04:00:26.692 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (10 ms) 2021-01-28T04:00:26.692 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2021-01-28T04:00:26.692 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (8 ms) 2021-01-28T04:00:26.692 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2021-01-28T04:00:26.693 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (6 ms) 2021-01-28T04:00:26.693 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2021-01-28T04:00:26.693 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (33 ms) 2021-01-28T04:00:26.693 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2021-01-28T04:00:26.693 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (24 ms) 2021-01-28T04:00:26.694 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2021-01-28T04:00:26.694 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (17 ms) 2021-01-28T04:00:26.694 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2021-01-28T04:00:26.694 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (5 ms) 2021-01-28T04:00:26.694 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [----------] 16 tests from CReadOpsTest (3205 ms total) 2021-01-28T04:00:26.695 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: 2021-01-28T04:00:26.695 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [----------] Global test environment tear-down 2021-01-28T04:00:26.695 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [==========] 16 tests from 1 test suite ran. (13062 ms total) 2021-01-28T04:00:26.695 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_read_operations: [ PASSED ] 16 tests. 2021-01-28T04:00:27.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:26 smithi162 bash[9856]: audit 2021-01-28T04:00:24.629851+0000 mon.a (mon.0) 710 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32256-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:26 smithi162 bash[9856]: audit 2021-01-28T04:00:24.630220+0000 mon.a (mon.0) 711 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:26 smithi162 bash[9856]: audit 2021-01-28T04:00:24.630405+0000 mon.a (mon.0) 712 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32381-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:26 smithi162 bash[9856]: audit 2021-01-28T04:00:24.631511+0000 mon.a (mon.0) 713 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32442-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:26 smithi162 bash[9856]: audit 2021-01-28T04:00:24.631734+0000 mon.a (mon.0) 714 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:26 smithi162 bash[9856]: audit 2021-01-28T04:00:24.632030+0000 mon.a (mon.0) 715 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:26 smithi162 bash[9856]: audit 2021-01-28T04:00:24.632200+0000 mon.a (mon.0) 716 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32201-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:26 smithi162 bash[9856]: audit 2021-01-28T04:00:24.632356+0000 mon.a (mon.0) 717 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32492-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:26 smithi162 bash[9856]: audit 2021-01-28T04:00:24.632555+0000 mon.a (mon.0) 718 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32534-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:26 smithi162 bash[9856]: audit 2021-01-28T04:00:24.633200+0000 mon.a (mon.0) 719 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32465-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:26 smithi162 bash[9856]: audit 2021-01-28T04:00:24.633548+0000 mon.a (mon.0) 720 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32434-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:26 smithi162 bash[9856]: audit 2021-01-28T04:00:24.633711+0000 mon.a (mon.0) 721 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32171-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:00:27.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:26 smithi162 bash[9856]: cluster 2021-01-28T04:00:24.633906+0000 mon.a (mon.0) 722 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2021-01-28T04:00:27.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:26 smithi162 bash[9856]: audit 2021-01-28T04:00:24.638402+0000 mon.c (mon.1) 39 : audit [INF] from='client.? 172.21.15.100:0/2406390797' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32171-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32171-15"}]: dispatch 2021-01-28T04:00:27.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:26 smithi162 bash[9856]: audit 2021-01-28T04:00:24.647276+0000 mon.b (mon.2) 26 : audit [INF] from='client.? 172.21.15.100:0/3881269778' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32519-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:27.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:26 smithi162 bash[9856]: audit 2021-01-28T04:00:25.176573+0000 mon.a (mon.0) 723 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32171-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32171-15"}]: dispatch 2021-01-28T04:00:27.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:26 smithi162 bash[9856]: audit 2021-01-28T04:00:25.179042+0000 mon.a (mon.0) 724 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32519-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:27.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:26 smithi162 bash[9856]: audit 2021-01-28T04:00:25.179389+0000 mon.a (mon.0) 725 : audit [INF] from='client.? 172.21.15.100:0/3772060724' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:27.018 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:26 smithi162 bash[9856]: cluster 2021-01-28T04:00:25.502007+0000 mgr.y (mgr.14138) 484 : cluster [DBG] pgmap v353: 844 pgs: 446 creating+peering, 216 unknown, 182 active+clean; 25 KiB data, 70 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:00:27.018 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:26 smithi162 bash[9856]: audit 2021-01-28T04:00:25.983706+0000 mon.b (mon.2) 27 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:27.018 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:26 smithi162 bash[9856]: audit 2021-01-28T04:00:26.135715+0000 mon.a (mon.0) 726 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32519-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.018 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:26 smithi162 bash[9856]: audit 2021-01-28T04:00:26.136051+0000 mon.a (mon.0) 727 : audit [INF] from='client.? 172.21.15.100:0/3772060724' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.019 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:26 smithi162 bash[9856]: audit 2021-01-28T04:00:26.137728+0000 mon.c (mon.1) 40 : audit [INF] from='client.? 172.21.15.100:0/988282123' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:27.019 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:26 smithi162 bash[9856]: cluster 2021-01-28T04:00:26.138361+0000 mon.a (mon.0) 728 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2021-01-28T04:00:27.019 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:26 smithi162 bash[9856]: audit 2021-01-28T04:00:26.142871+0000 mon.a (mon.0) 729 : audit [INF] from='client.? 172.21.15.100:0/4224254830' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32511-1"}]: dispatch 2021-01-28T04:00:27.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[9834]: audit 2021-01-28T04:00:24.629851+0000 mon.a (mon.0) 710 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32256-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[9834]: audit 2021-01-28T04:00:24.630220+0000 mon.a (mon.0) 711 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[9834]: audit 2021-01-28T04:00:24.630405+0000 mon.a (mon.0) 712 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32381-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[9834]: audit 2021-01-28T04:00:24.631511+0000 mon.a (mon.0) 713 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32442-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[9834]: audit 2021-01-28T04:00:24.631734+0000 mon.a (mon.0) 714 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[9834]: audit 2021-01-28T04:00:24.632030+0000 mon.a (mon.0) 715 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[9834]: audit 2021-01-28T04:00:24.632200+0000 mon.a (mon.0) 716 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32201-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[9834]: audit 2021-01-28T04:00:24.632356+0000 mon.a (mon.0) 717 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32492-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[9834]: audit 2021-01-28T04:00:24.632555+0000 mon.a (mon.0) 718 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32534-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[9834]: audit 2021-01-28T04:00:24.633200+0000 mon.a (mon.0) 719 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32465-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[9834]: audit 2021-01-28T04:00:24.633548+0000 mon.a (mon.0) 720 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32434-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[9834]: audit 2021-01-28T04:00:24.633711+0000 mon.a (mon.0) 721 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32171-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:00:27.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[9834]: cluster 2021-01-28T04:00:24.633906+0000 mon.a (mon.0) 722 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2021-01-28T04:00:27.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[9834]: audit 2021-01-28T04:00:24.638402+0000 mon.c (mon.1) 39 : audit [INF] from='client.? 172.21.15.100:0/2406390797' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32171-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32171-15"}]: dispatch 2021-01-28T04:00:27.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[9834]: audit 2021-01-28T04:00:24.647276+0000 mon.b (mon.2) 26 : audit [INF] from='client.? 172.21.15.100:0/3881269778' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32519-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:27.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[9834]: audit 2021-01-28T04:00:25.176573+0000 mon.a (mon.0) 723 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32171-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32171-15"}]: dispatch 2021-01-28T04:00:27.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[9834]: audit 2021-01-28T04:00:25.179042+0000 mon.a (mon.0) 724 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32519-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:27.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[9834]: audit 2021-01-28T04:00:25.179389+0000 mon.a (mon.0) 725 : audit [INF] from='client.? 172.21.15.100:0/3772060724' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:27.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[9834]: cluster 2021-01-28T04:00:25.502007+0000 mgr.y (mgr.14138) 484 : cluster [DBG] pgmap v353: 844 pgs: 446 creating+peering, 216 unknown, 182 active+clean; 25 KiB data, 70 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:00:27.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[9834]: audit 2021-01-28T04:00:25.983706+0000 mon.b (mon.2) 27 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:27.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[9834]: audit 2021-01-28T04:00:26.135715+0000 mon.a (mon.0) 726 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32519-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[9834]: audit 2021-01-28T04:00:26.136051+0000 mon.a (mon.0) 727 : audit [INF] from='client.? 172.21.15.100:0/3772060724' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[9834]: audit 2021-01-28T04:00:26.137728+0000 mon.c (mon.1) 40 : audit [INF] from='client.? 172.21.15.100:0/988282123' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:27.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[9834]: cluster 2021-01-28T04:00:26.138361+0000 mon.a (mon.0) 728 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2021-01-28T04:00:27.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[9834]: audit 2021-01-28T04:00:26.142871+0000 mon.a (mon.0) 729 : audit [INF] from='client.? 172.21.15.100:0/4224254830' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32511-1"}]: dispatch 2021-01-28T04:00:27.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[13549]: audit 2021-01-28T04:00:24.629851+0000 mon.a (mon.0) 710 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32256-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[13549]: audit 2021-01-28T04:00:24.630220+0000 mon.a (mon.0) 711 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[13549]: audit 2021-01-28T04:00:24.630405+0000 mon.a (mon.0) 712 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32381-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[13549]: audit 2021-01-28T04:00:24.631511+0000 mon.a (mon.0) 713 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32442-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[13549]: audit 2021-01-28T04:00:24.631734+0000 mon.a (mon.0) 714 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[13549]: audit 2021-01-28T04:00:24.632030+0000 mon.a (mon.0) 715 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[13549]: audit 2021-01-28T04:00:24.632200+0000 mon.a (mon.0) 716 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32201-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[13549]: audit 2021-01-28T04:00:24.632356+0000 mon.a (mon.0) 717 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32492-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[13549]: audit 2021-01-28T04:00:24.632555+0000 mon.a (mon.0) 718 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32534-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[13549]: audit 2021-01-28T04:00:24.633200+0000 mon.a (mon.0) 719 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32465-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.087 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[13549]: audit 2021-01-28T04:00:24.633548+0000 mon.a (mon.0) 720 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32434-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.087 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[13549]: audit 2021-01-28T04:00:24.633711+0000 mon.a (mon.0) 721 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32171-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:00:27.087 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[13549]: cluster 2021-01-28T04:00:24.633906+0000 mon.a (mon.0) 722 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2021-01-28T04:00:27.087 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[13549]: audit 2021-01-28T04:00:24.638402+0000 mon.c (mon.1) 39 : audit [INF] from='client.? 172.21.15.100:0/2406390797' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32171-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32171-15"}]: dispatch 2021-01-28T04:00:27.088 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[13549]: audit 2021-01-28T04:00:24.647276+0000 mon.b (mon.2) 26 : audit [INF] from='client.? 172.21.15.100:0/3881269778' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32519-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:27.088 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[13549]: audit 2021-01-28T04:00:25.176573+0000 mon.a (mon.0) 723 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32171-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32171-15"}]: dispatch 2021-01-28T04:00:27.088 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[13549]: audit 2021-01-28T04:00:25.179042+0000 mon.a (mon.0) 724 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32519-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:27.088 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[13549]: audit 2021-01-28T04:00:25.179389+0000 mon.a (mon.0) 725 : audit [INF] from='client.? 172.21.15.100:0/3772060724' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:27.088 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[13549]: cluster 2021-01-28T04:00:25.502007+0000 mgr.y (mgr.14138) 484 : cluster [DBG] pgmap v353: 844 pgs: 446 creating+peering, 216 unknown, 182 active+clean; 25 KiB data, 70 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:00:27.089 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[13549]: audit 2021-01-28T04:00:25.983706+0000 mon.b (mon.2) 27 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:27.089 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[13549]: audit 2021-01-28T04:00:26.135715+0000 mon.a (mon.0) 726 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32519-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.089 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[13549]: audit 2021-01-28T04:00:26.136051+0000 mon.a (mon.0) 727 : audit [INF] from='client.? 172.21.15.100:0/3772060724' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:27.089 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[13549]: audit 2021-01-28T04:00:26.137728+0000 mon.c (mon.1) 40 : audit [INF] from='client.? 172.21.15.100:0/988282123' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:27.089 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[13549]: cluster 2021-01-28T04:00:26.138361+0000 mon.a (mon.0) 728 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2021-01-28T04:00:27.090 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:26 smithi100 bash[13549]: audit 2021-01-28T04:00:26.142871+0000 mon.a (mon.0) 729 : audit [INF] from='client.? 172.21.15.100:0/4224254830' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32511-1"}]: dispatch 2021-01-28T04:00:27.359 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_1_[32662]: starting. 2021-01-28T04:00:27.359 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_1_[32662]: creating pool ceph_test_rados_list_parallel.smithi100-32631 2021-01-28T04:00:27.360 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_1_[32662]: created object 0... 2021-01-28T04:00:27.360 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_1_[32662]: created object 25... 2021-01-28T04:00:27.360 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_1_[32662]: created object 49... 2021-01-28T04:00:27.360 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_1_[32662]: finishing. 2021-01-28T04:00:27.361 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_1_[32662]: shutting down. 2021-01-28T04:00:27.361 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_2_[32663]: starting. 2021-01-28T04:00:27.361 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_2_[32663]: listing objects. 2021-01-28T04:00:27.362 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_2_[32663]: listed object 0... 2021-01-28T04:00:27.362 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_2_[32663]: listed object 25... 2021-01-28T04:00:27.363 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_2_[32663]: saw 50 objects 2021-01-28T04:00:27.363 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_2_[32663]: shutting down. 2021-01-28T04:00:27.363 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:27.363 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_3_[33131]: starting. 2021-01-28T04:00:27.364 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_3_[33131]: creating pool ceph_test_rados_list_parallel.smithi100-32631 2021-01-28T04:00:27.364 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_3_[33131]: created object 0... 2021-01-28T04:00:27.364 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_3_[33131]: created object 25... 2021-01-28T04:00:27.364 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_3_[33131]: created object 49... 2021-01-28T04:00:27.365 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_3_[33131]: finishing. 2021-01-28T04:00:27.365 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_3_[33131]: shutting down. 2021-01-28T04:00:27.365 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:27.365 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_5_[33133]: starting. 2021-01-28T04:00:27.366 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_5_[33133]: removed 25 objects... 2021-01-28T04:00:27.366 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_5_[33133]: removed half of the objects 2021-01-28T04:00:27.366 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_5_[33133]: removed 50 objects... 2021-01-28T04:00:27.367 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_5_[33133]: removed 50 objects 2021-01-28T04:00:27.367 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_5_[33133]: shutting down. 2021-01-28T04:00:27.367 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:27.367 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_4_[33132]: starting. 2021-01-28T04:00:27.368 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_4_[33132]: listing objects. 2021-01-28T04:00:27.368 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_4_[33132]: saw 0 objects 2021-01-28T04:00:27.369 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_4_[33132]: shutting down. 2021-01-28T04:00:27.369 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:27.369 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:27.369 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_6_[33198]: starting. 2021-01-28T04:00:27.370 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_6_[33198]: creating pool ceph_test_rados_list_parallel.smithi100-32631 2021-01-28T04:00:27.370 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_6_[33198]: created object 0... 2021-01-28T04:00:27.370 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_6_[33198]: created object 25... 2021-01-28T04:00:27.371 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_6_[33198]: created object 49... 2021-01-28T04:00:27.371 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_6_[33198]: finishing. 2021-01-28T04:00:27.371 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_6_[33198]: shutting down. 2021-01-28T04:00:27.372 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:27.372 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:27.372 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_8_[33200]: starting. 2021-01-28T04:00:27.372 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_8_[33200]: added 25 objects... 2021-01-28T04:00:27.373 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_8_[33200]: added half of the objects 2021-01-28T04:00:27.373 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_8_[33200]: added 50 objects... 2021-01-28T04:00:27.373 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_8_[33200]: added 50 objects 2021-01-28T04:00:27.374 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_8_[33200]: shutting down. 2021-01-28T04:00:27.374 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:27.374 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:27.374 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_7_[33199]: starting. 2021-01-28T04:00:27.375 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_7_[33199]: listing objects. 2021-01-28T04:00:27.375 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_7_[33199]: listed object 0... 2021-01-28T04:00:27.375 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_7_[33199]: listed object 25... 2021-01-28T04:00:27.375 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_7_[33199]: listed object 50... 2021-01-28T04:00:27.376 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_7_[33199]: listed object 75... 2021-01-28T04:00:27.376 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_7_[33199]: saw 100 objects 2021-01-28T04:00:27.377 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_7_[33199]: shutting down. 2021-01-28T04:00:27.377 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:27.378 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:27.378 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:27.752 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_9_[33291]: starting. api_cmd_pp: Running main() from gmock_main.cc 2021-01-28T04:00:27.752 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd_pp: [==========] Running 3 tests from 1 test suite. 2021-01-28T04:00:27.752 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd_pp: [----------] Global test environment set-up. 2021-01-28T04:00:27.753 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd 2021-01-28T04:00:27.753 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.MonDescribePP 2021-01-28T04:00:27.753 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd_pp: [ OK ] LibRadosCmd.MonDescribePP (32 ms) 2021-01-28T04:00:27.754 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.OSDCmdPP 2021-01-28T04:00:27.754 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd_pp: [ OK ] LibRadosCmd.OSDCmdPP (52 ms) 2021-01-28T04:00:27.754 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.PGCmdPP 2021-01-28T04:00:27.754 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd_pp: [ OK ] LibRadosCmd.PGCmdPP (14085 ms) 2021-01-28T04:00:27.755 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd (14169 ms total) 2021-01-28T04:00:27.755 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd_pp: 2021-01-28T04:00:27.755 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd_pp: [----------] Global test environment tear-down 2021-01-28T04:00:27.756 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd_pp: [==========] 3 tests from 1 test suite ran. (14169 ms total) 2021-01-28T04:00:27.756 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd_pp: [ PASSED ] 3 tests. 2021-01-28T04:00:27.933 INFO:tasks.workunit.client.0.smithi100.stdout: 2021-01-28T04:00:27.933 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_9_[33291]: creating pool ceph_test_rados_list_parallel.smithi100-32631 2021-01-28T04:00:27.933 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_9_[33291]: created object 0... 2021-01-28T04:00:27.933 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_9_[33291]: created object 25... 2021-01-28T04:00:27.934 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_9_[33291]: created object 49... 2021-01-28T04:00:27.934 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_9_[33291]: finishing. 2021-01-28T04:00:27.934 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_9_[33291]: shutting down. 2021-01-28T04:00:27.934 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:27.935 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:27.935 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:27.935 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_10_[33292]: starting. 2021-01-28T04:00:27.935 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_10_[33292]: listing objects. 2021-01-28T04:00:27.935 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_10_[33292]: listed object 0... 2021-01-28T04:00:27.936 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_10_[33292]: listed object 25... 2021-01-28T04:00:27.936 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_10_[33292]: listed object 50... 2021-01-28T04:00:27.936 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_10_[33292]: listed object 75... 2021-01-28T04:00:27.936 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_10_[33292]: saw 98 objects 2021-01-28T04:00:27.936 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_10_[33292]: shutting down. 2021-01-28T04:00:27.937 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:27.937 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:27.937 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:27.937 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_13_[33295]: starting. 2021-01-28T04:00:27.938 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_13_[33295]: removed 25 objects... 2021-01-28T04:00:27.938 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_13_[33295]: removed half of the objects 2021-01-28T04:00:27.938 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_13_[33295]: removed 50 objects... 2021-01-28T04:00:27.938 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_13_[33295]: removed 50 objects 2021-01-28T04:00:27.938 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_13_[33295]: shutting down. 2021-01-28T04:00:27.939 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:27.939 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:27.939 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:27.939 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_11_[33293]: starting. 2021-01-28T04:00:27.939 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_11_[33293]: added 25 objects... 2021-01-28T04:00:27.940 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_11_[33293]: added half of the objects 2021-01-28T04:00:27.940 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_11_[33293]: added 50 objects... 2021-01-28T04:00:27.940 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_11_[33293]: added 50 objects 2021-01-28T04:00:27.941 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_11_[33293]: shutting down. 2021-01-28T04:00:27.941 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:27.941 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:27.941 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:27.941 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_12_[33294]: starting. 2021-01-28T04:00:27.942 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_12_[33294]: added 25 objects... 2021-01-28T04:00:27.942 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_12_[33294]: added half of the objects 2021-01-28T04:00:27.942 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_12_[33294]: added 50 objects... 2021-01-28T04:00:27.942 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_12_[33294]: added 50 objects 2021-01-28T04:00:27.942 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_12_[33294]: shutting down. 2021-01-28T04:00:27.943 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:27.943 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:27.943 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:27.943 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:27.943 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_14_[33375]: starting. 2021-01-28T04:00:27.944 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_14_[33375]: creating pool ceph_test_rados_list_parallel.smithi100-32631 2021-01-28T04:00:27.944 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_14_[33375]: created object 0... 2021-01-28T04:00:27.944 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_14_[33375]: created object 25... 2021-01-28T04:00:27.944 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_14_[33375]: created object 49... 2021-01-28T04:00:27.944 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_14_[33375]: finishing. 2021-01-28T04:00:27.945 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_14_[33375]: shutting down. 2021-01-28T04:00:27.945 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:27.945 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:27.945 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:27.945 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:27.946 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_16_[33377]: starting. 2021-01-28T04:00:27.946 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_16_[33377]: added 25 objects... 2021-01-28T04:00:27.946 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_16_[33377]: added half of the objects 2021-01-28T04:00:27.946 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_16_[33377]: added 50 objects... 2021-01-28T04:00:28.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:27 smithi162 bash[9856]: audit 2021-01-28T04:00:26.666326+0000 mon.a (mon.0) 730 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32171-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32171-15"}]': finished 2021-01-28T04:00:28.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:27 smithi162 bash[9856]: audit 2021-01-28T04:00:26.666793+0000 mon.a (mon.0) 731 : audit [INF] from='client.? 172.21.15.100:0/4224254830' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32511-1"}]': finished 2021-01-28T04:00:28.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:27 smithi162 bash[9856]: cluster 2021-01-28T04:00:26.668652+0000 mon.a (mon.0) 732 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2021-01-28T04:00:28.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:27 smithi162 bash[9856]: audit 2021-01-28T04:00:26.676941+0000 mon.a (mon.0) 733 : audit [INF] from='client.? 172.21.15.100:0/4224254830' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32511-1"}]: dispatch 2021-01-28T04:00:28.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:27 smithi162 bash[9856]: audit 2021-01-28T04:00:26.680838+0000 mon.a (mon.0) 734 : audit [INF] from='client.? 172.21.15.100:0/1050323559' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:28.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:27 smithi162 bash[9856]: audit 2021-01-28T04:00:26.985246+0000 mon.b (mon.2) 28 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:28.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:27 smithi100 bash[9834]: audit 2021-01-28T04:00:26.666326+0000 mon.a (mon.0) 730 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32171-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32171-15"}]': finished 2021-01-28T04:00:28.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:27 smithi100 bash[9834]: audit 2021-01-28T04:00:26.666793+0000 mon.a (mon.0) 731 : audit [INF] from='client.? 172.21.15.100:0/4224254830' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32511-1"}]': finished 2021-01-28T04:00:28.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:27 smithi100 bash[9834]: cluster 2021-01-28T04:00:26.668652+0000 mon.a (mon.0) 732 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2021-01-28T04:00:28.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:27 smithi100 bash[9834]: audit 2021-01-28T04:00:26.676941+0000 mon.a (mon.0) 733 : audit [INF] from='client.? 172.21.15.100:0/4224254830' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32511-1"}]: dispatch 2021-01-28T04:00:28.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:27 smithi100 bash[9834]: audit 2021-01-28T04:00:26.680838+0000 mon.a (mon.0) 734 : audit [INF] from='client.? 172.21.15.100:0/1050323559' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:28.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:27 smithi100 bash[9834]: audit 2021-01-28T04:00:26.985246+0000 mon.b (mon.2) 28 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:28.079 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:27 smithi100 bash[13549]: audit 2021-01-28T04:00:26.666326+0000 mon.a (mon.0) 730 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32171-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32171-15"}]': finished 2021-01-28T04:00:28.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:27 smithi100 bash[13549]: audit 2021-01-28T04:00:26.666793+0000 mon.a (mon.0) 731 : audit [INF] from='client.? 172.21.15.100:0/4224254830' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32511-1"}]': finished 2021-01-28T04:00:28.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:27 smithi100 bash[13549]: cluster 2021-01-28T04:00:26.668652+0000 mon.a (mon.0) 732 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2021-01-28T04:00:28.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:27 smithi100 bash[13549]: audit 2021-01-28T04:00:26.676941+0000 mon.a (mon.0) 733 : audit [INF] from='client.? 172.21.15.100:0/4224254830' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32511-1"}]: dispatch 2021-01-28T04:00:28.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:27 smithi100 bash[13549]: audit 2021-01-28T04:00:26.680838+0000 mon.a (mon.0) 734 : audit [INF] from='client.? 172.21.15.100:0/1050323559' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:28.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:27 smithi100 bash[13549]: audit 2021-01-28T04:00:26.985246+0000 mon.b (mon.2) 28 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:29.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:28 smithi162 bash[9856]: cluster 2021-01-28T04:00:27.503959+0000 mgr.y (mgr.14138) 485 : cluster [DBG] pgmap v356: 780 pgs: 243 creating+peering, 128 unknown, 409 active+clean; 40 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 56 KiB/s wr, 81 op/s 2021-01-28T04:00:29.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:28 smithi162 bash[9856]: audit 2021-01-28T04:00:27.711402+0000 mon.a (mon.0) 735 : audit [INF] from='client.? 172.21.15.100:0/2279206164' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32176-22"}]: dispatch 2021-01-28T04:00:29.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:28 smithi162 bash[9856]: audit 2021-01-28T04:00:27.725570+0000 mon.a (mon.0) 736 : audit [INF] from='client.? 172.21.15.100:0/4224254830' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32511-1"}]': finished 2021-01-28T04:00:29.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:28 smithi162 bash[9856]: audit 2021-01-28T04:00:27.725653+0000 mon.a (mon.0) 737 : audit [INF] from='client.? 172.21.15.100:0/1050323559' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:29.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:28 smithi162 bash[9856]: audit 2021-01-28T04:00:27.739585+0000 mon.b (mon.2) 29 : audit [INF] from='client.? 172.21.15.100:0/3218297031' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:29.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:28 smithi162 bash[9856]: audit 2021-01-28T04:00:27.743515+0000 mon.c (mon.1) 41 : audit [INF] from='client.? 172.21.15.100:0/2261469346' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:29.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:28 smithi162 bash[9856]: audit 2021-01-28T04:00:27.828699+0000 mon.b (mon.2) 30 : audit [INF] from='client.? 172.21.15.100:0/380907029' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32465-7"}]: dispatch 2021-01-28T04:00:29.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:28 smithi162 bash[9856]: audit 2021-01-28T04:00:27.986843+0000 mon.b (mon.2) 31 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:29.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:28 smithi162 bash[9856]: cluster 2021-01-28T04:00:28.230362+0000 mon.a (mon.0) 738 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2021-01-28T04:00:29.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:28 smithi162 bash[9856]: audit 2021-01-28T04:00:28.232367+0000 mon.a (mon.0) 739 : audit [INF] from='client.? 172.21.15.100:0/2279206164' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32176-22"}]: dispatch 2021-01-28T04:00:29.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:28 smithi162 bash[9856]: audit 2021-01-28T04:00:28.233120+0000 mon.a (mon.0) 740 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:29.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:28 smithi162 bash[9856]: audit 2021-01-28T04:00:28.235569+0000 mon.a (mon.0) 741 : audit [INF] from='client.? 172.21.15.100:0/2279206164' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32176-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:29.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:28 smithi162 bash[9856]: audit 2021-01-28T04:00:28.243530+0000 mon.a (mon.0) 742 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:29.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:28 smithi100 bash[9834]: cluster 2021-01-28T04:00:27.503959+0000 mgr.y (mgr.14138) 485 : cluster [DBG] pgmap v356: 780 pgs: 243 creating+peering, 128 unknown, 409 active+clean; 40 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 56 KiB/s wr, 81 op/s 2021-01-28T04:00:29.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:28 smithi100 bash[9834]: audit 2021-01-28T04:00:27.711402+0000 mon.a (mon.0) 735 : audit [INF] from='client.? 172.21.15.100:0/2279206164' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32176-22"}]: dispatch 2021-01-28T04:00:29.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:28 smithi100 bash[9834]: audit 2021-01-28T04:00:27.725570+0000 mon.a (mon.0) 736 : audit [INF] from='client.? 172.21.15.100:0/4224254830' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32511-1"}]': finished 2021-01-28T04:00:29.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:28 smithi100 bash[9834]: audit 2021-01-28T04:00:27.725653+0000 mon.a (mon.0) 737 : audit [INF] from='client.? 172.21.15.100:0/1050323559' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:29.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:28 smithi100 bash[9834]: audit 2021-01-28T04:00:27.739585+0000 mon.b (mon.2) 29 : audit [INF] from='client.? 172.21.15.100:0/3218297031' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:29.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:28 smithi100 bash[9834]: audit 2021-01-28T04:00:27.743515+0000 mon.c (mon.1) 41 : audit [INF] from='client.? 172.21.15.100:0/2261469346' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:29.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:28 smithi100 bash[9834]: audit 2021-01-28T04:00:27.828699+0000 mon.b (mon.2) 30 : audit [INF] from='client.? 172.21.15.100:0/380907029' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32465-7"}]: dispatch 2021-01-28T04:00:29.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:28 smithi100 bash[9834]: audit 2021-01-28T04:00:27.986843+0000 mon.b (mon.2) 31 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:29.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:28 smithi100 bash[9834]: cluster 2021-01-28T04:00:28.230362+0000 mon.a (mon.0) 738 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2021-01-28T04:00:29.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:28 smithi100 bash[9834]: audit 2021-01-28T04:00:28.232367+0000 mon.a (mon.0) 739 : audit [INF] from='client.? 172.21.15.100:0/2279206164' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32176-22"}]: dispatch 2021-01-28T04:00:29.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:28 smithi100 bash[9834]: audit 2021-01-28T04:00:28.233120+0000 mon.a (mon.0) 740 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:29.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:28 smithi100 bash[9834]: audit 2021-01-28T04:00:28.235569+0000 mon.a (mon.0) 741 : audit [INF] from='client.? 172.21.15.100:0/2279206164' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32176-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:29.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:28 smithi100 bash[9834]: audit 2021-01-28T04:00:28.243530+0000 mon.a (mon.0) 742 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:29.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:28 smithi100 bash[13549]: cluster 2021-01-28T04:00:27.503959+0000 mgr.y (mgr.14138) 485 : cluster [DBG] pgmap v356: 780 pgs: 243 creating+peering, 128 unknown, 409 active+clean; 40 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 3.6 KiB/s rd, 56 KiB/s wr, 81 op/s 2021-01-28T04:00:29.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:28 smithi100 bash[13549]: audit 2021-01-28T04:00:27.711402+0000 mon.a (mon.0) 735 : audit [INF] from='client.? 172.21.15.100:0/2279206164' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32176-22"}]: dispatch 2021-01-28T04:00:29.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:28 smithi100 bash[13549]: audit 2021-01-28T04:00:27.725570+0000 mon.a (mon.0) 736 : audit [INF] from='client.? 172.21.15.100:0/4224254830' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32511-1"}]': finished 2021-01-28T04:00:29.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:28 smithi100 bash[13549]: audit 2021-01-28T04:00:27.725653+0000 mon.a (mon.0) 737 : audit [INF] from='client.? 172.21.15.100:0/1050323559' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:29.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:28 smithi100 bash[13549]: audit 2021-01-28T04:00:27.739585+0000 mon.b (mon.2) 29 : audit [INF] from='client.? 172.21.15.100:0/3218297031' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:29.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:28 smithi100 bash[13549]: audit 2021-01-28T04:00:27.743515+0000 mon.c (mon.1) 41 : audit [INF] from='client.? 172.21.15.100:0/2261469346' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:29.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:28 smithi100 bash[13549]: audit 2021-01-28T04:00:27.828699+0000 mon.b (mon.2) 30 : audit [INF] from='client.? 172.21.15.100:0/380907029' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32465-7"}]: dispatch 2021-01-28T04:00:29.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:28 smithi100 bash[13549]: audit 2021-01-28T04:00:27.986843+0000 mon.b (mon.2) 31 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:29.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:28 smithi100 bash[13549]: cluster 2021-01-28T04:00:28.230362+0000 mon.a (mon.0) 738 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2021-01-28T04:00:29.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:28 smithi100 bash[13549]: audit 2021-01-28T04:00:28.232367+0000 mon.a (mon.0) 739 : audit [INF] from='client.? 172.21.15.100:0/2279206164' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32176-22"}]: dispatch 2021-01-28T04:00:29.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:28 smithi100 bash[13549]: audit 2021-01-28T04:00:28.233120+0000 mon.a (mon.0) 740 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:29.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:28 smithi100 bash[13549]: audit 2021-01-28T04:00:28.235569+0000 mon.a (mon.0) 741 : audit [INF] from='client.? 172.21.15.100:0/2279206164' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32176-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:29.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:28 smithi100 bash[13549]: audit 2021-01-28T04:00:28.243530+0000 mon.a (mon.0) 742 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:30.012 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 04:00:29 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T04:00:30.077 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 04:00:29 smithi100 bash[10061]: debug 2021-01-28T04:00:29.692+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:00:30.105 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_16_[33377]: add api_cmd: Running main() from gmock_main.cc 2021-01-28T04:00:30.106 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: [==========] Running 4 tests from 1 test suite. 2021-01-28T04:00:30.106 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: [----------] Global test environment set-up. 2021-01-28T04:00:30.106 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: [----------] 4 tests from LibRadosCmd 2021-01-28T04:00:30.106 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: [ RUN ] LibRadosCmd.MonDescribe 2021-01-28T04:00:30.107 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: [ OK ] LibRadosCmd.MonDescribe (8460 ms) 2021-01-28T04:00:30.107 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: [ RUN ] LibRadosCmd.OSDCmd 2021-01-28T04:00:30.107 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: [ OK ] LibRadosCmd.OSDCmd (1324 ms) 2021-01-28T04:00:30.107 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: [ RUN ] LibRadosCmd.PGCmd 2021-01-28T04:00:30.107 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: [ OK ] LibRadosCmd.PGCmd (5389 ms) 2021-01-28T04:00:30.108 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: [ RUN ] LibRadosCmd.WatchLog 2021-01-28T04:00:30.108 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:27.711402+0000 mon.a [INF] from='client.? 172.21.15.100:0/2279206164' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32176-22"}]: dispatch 2021-01-28T04:00:30.108 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:27.725570+0000 mon.a [INF] from='client.? 172.21.15.100:0/4224254830' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32511-1"}]': finished 2021-01-28T04:00:30.108 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:27.725653+0000 mon.a [INF] from='client.? 172.21.15.100:0/1050323559' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:30.109 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:27.739585+0000 mon.b [INF] from='client.? 172.21.15.100:0/3218297031' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:30.109 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:27.743515+0000 mon.c [INF] from='client.? 172.21.15.100:0/2261469346' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:30.109 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:27.828699+0000 mon.b [INF] from='client.? 172.21.15.100:0/380907029' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32465-7"}]: dispatch 2021-01-28T04:00:30.109 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:28.232367+0000 mon.a [INF] from='client.? 172.21.15.100:0/2279206164' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32176-22"}]: dispatch 2021-01-28T04:00:30.109 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:28.233120+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:30.110 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:28.235569+0000 mon.a [INF] from='client.? 172.21.15.100:0/2279206164' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32176-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:30.110 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:28.243530+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:30.110 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:28.243911+0000 mon.a [INF] from='client.? 172.21.15.100:0/2214300162' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32442-6"}]: dispatch 2021-01-28T04:00:30.110 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:28.715097+0000 mon.a [WRN] Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:00:30.111 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:28.716380+0000 mon.a [INF] from='client.? 172.21.15.100:0/2214300162' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32442-6"}]: dispatch 2021-01-28T04:00:30.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:30 smithi162 bash[9856]: audit 2021-01-28T04:00:28.243911+0000 mon.a (mon.0) 743 : audit [INF] from='client.? 172.21.15.100:0/2214300162' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32442-6"}]: dispatch 2021-01-28T04:00:30.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:30 smithi162 bash[9856]: cluster 2021-01-28T04:00:28.715097+0000 mon.a (mon.0) 744 : cluster [WRN] Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:00:30.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:30 smithi162 bash[9856]: audit 2021-01-28T04:00:28.716380+0000 mon.a (mon.0) 745 : audit [INF] from='client.? 172.21.15.100:0/2214300162' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32442-6"}]: dispatch 2021-01-28T04:00:30.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:30 smithi162 bash[9856]: audit 2021-01-28T04:00:28.717029+0000 mon.a (mon.0) 746 : audit [INF] from='client.? 172.21.15.100:0/2214300162' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32442-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:30.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:30 smithi162 bash[9856]: audit 2021-01-28T04:00:28.724608+0000 mon.a (mon.0) 747 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32465-7"}]: dispatch 2021-01-28T04:00:30.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:30 smithi162 bash[9856]: audit 2021-01-28T04:00:28.731426+0000 mon.a (mon.0) 748 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:30.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:30 smithi162 bash[9856]: audit 2021-01-28T04:00:28.741000+0000 mon.a (mon.0) 749 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:30.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:30 smithi162 bash[9856]: audit 2021-01-28T04:00:28.741223+0000 mon.a (mon.0) 750 : audit [INF] from='client.? 172.21.15.100:0/2279206164' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32176-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:00:30.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:30 smithi162 bash[9856]: audit 2021-01-28T04:00:28.741755+0000 mon.a (mon.0) 751 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:30.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:30 smithi162 bash[9856]: audit 2021-01-28T04:00:28.742209+0000 mon.a (mon.0) 752 : audit [INF] from='client.? 172.21.15.100:0/2214300162' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32442-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:00:30.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:30 smithi162 bash[9856]: audit 2021-01-28T04:00:28.797383+0000 mon.b (mon.2) 32 : audit [INF] from='client.? 172.21.15.100:0/3981027325' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2021-01-28T04:00:30.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:30 smithi162 bash[9856]: audit 2021-01-28T04:00:28.988776+0000 mon.b (mon.2) 33 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:30.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:30 smithi162 bash[9856]: audit 2021-01-28T04:00:29.208593+0000 mon.b (mon.2) 34 : audit [INF] from='client.? 172.21.15.100:0/380907029' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32465-7"}]: dispatch 2021-01-28T04:00:30.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:30 smithi162 bash[9856]: cluster 2021-01-28T04:00:29.210866+0000 mon.a (mon.0) 753 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2021-01-28T04:00:30.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:30 smithi162 bash[9856]: audit 2021-01-28T04:00:29.642882+0000 mon.a (mon.0) 754 : audit [INF] from='client.? 172.21.15.100:0/2279206164' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32176-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32176-22"}]: dispatch 2021-01-28T04:00:30.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:30 smithi162 bash[9856]: audit 2021-01-28T04:00:29.643668+0000 mon.a (mon.0) 755 : audit [INF] from='client.? 172.21.15.100:0/2214300162' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32442-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32442-6"}]: dispatch 2021-01-28T04:00:30.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:30 smithi162 bash[9856]: audit 2021-01-28T04:00:29.644563+0000 mon.a (mon.0) 756 : audit [INF] from='client.? 172.21.15.100:0/1719341281' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:30.578 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:30 smithi100 bash[13549]: audit 2021-01-28T04:00:28.243911+0000 mon.a (mon.0) 743 : audit [INF] from='client.? 172.21.15.100:0/2214300162' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32442-6"}]: dispatch 2021-01-28T04:00:30.578 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:30 smithi100 bash[13549]: cluster 2021-01-28T04:00:28.715097+0000 mon.a (mon.0) 744 : cluster [WRN] Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:00:30.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:30 smithi100 bash[13549]: audit 2021-01-28T04:00:28.716380+0000 mon.a (mon.0) 745 : audit [INF] from='client.? 172.21.15.100:0/2214300162' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32442-6"}]: dispatch 2021-01-28T04:00:30.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:30 smithi100 bash[13549]: audit 2021-01-28T04:00:28.717029+0000 mon.a (mon.0) 746 : audit [INF] from='client.? 172.21.15.100:0/2214300162' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32442-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:30.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:30 smithi100 bash[13549]: audit 2021-01-28T04:00:28.724608+0000 mon.a (mon.0) 747 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32465-7"}]: dispatch 2021-01-28T04:00:30.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:30 smithi100 bash[13549]: audit 2021-01-28T04:00:28.731426+0000 mon.a (mon.0) 748 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:30.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:30 smithi100 bash[13549]: audit 2021-01-28T04:00:28.741000+0000 mon.a (mon.0) 749 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:30.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:30 smithi100 bash[13549]: audit 2021-01-28T04:00:28.741223+0000 mon.a (mon.0) 750 : audit [INF] from='client.? 172.21.15.100:0/2279206164' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32176-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:00:30.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:30 smithi100 bash[13549]: audit 2021-01-28T04:00:28.741755+0000 mon.a (mon.0) 751 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:30.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:30 smithi100 bash[13549]: audit 2021-01-28T04:00:28.742209+0000 mon.a (mon.0) 752 : audit [INF] from='client.? 172.21.15.100:0/2214300162' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32442-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:00:30.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:30 smithi100 bash[13549]: audit 2021-01-28T04:00:28.797383+0000 mon.b (mon.2) 32 : audit [INF] from='client.? 172.21.15.100:0/3981027325' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2021-01-28T04:00:30.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:30 smithi100 bash[13549]: audit 2021-01-28T04:00:28.988776+0000 mon.b (mon.2) 33 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:30.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:30 smithi100 bash[13549]: audit 2021-01-28T04:00:29.208593+0000 mon.b (mon.2) 34 : audit [INF] from='client.? 172.21.15.100:0/380907029' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32465-7"}]: dispatch 2021-01-28T04:00:30.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:30 smithi100 bash[13549]: cluster 2021-01-28T04:00:29.210866+0000 mon.a (mon.0) 753 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2021-01-28T04:00:30.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:30 smithi100 bash[13549]: audit 2021-01-28T04:00:29.642882+0000 mon.a (mon.0) 754 : audit [INF] from='client.? 172.21.15.100:0/2279206164' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32176-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32176-22"}]: dispatch 2021-01-28T04:00:30.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:30 smithi100 bash[13549]: audit 2021-01-28T04:00:29.643668+0000 mon.a (mon.0) 755 : audit [INF] from='client.? 172.21.15.100:0/2214300162' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32442-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32442-6"}]: dispatch 2021-01-28T04:00:30.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:30 smithi100 bash[13549]: audit 2021-01-28T04:00:29.644563+0000 mon.a (mon.0) 756 : audit [INF] from='client.? 172.21.15.100:0/1719341281' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:30.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:30 smithi100 bash[9834]: audit 2021-01-28T04:00:28.243911+0000 mon.a (mon.0) 743 : audit [INF] from='client.? 172.21.15.100:0/2214300162' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32442-6"}]: dispatch 2021-01-28T04:00:30.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:30 smithi100 bash[9834]: cluster 2021-01-28T04:00:28.715097+0000 mon.a (mon.0) 744 : cluster [WRN] Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:00:30.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:30 smithi100 bash[9834]: audit 2021-01-28T04:00:28.716380+0000 mon.a (mon.0) 745 : audit [INF] from='client.? 172.21.15.100:0/2214300162' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32442-6"}]: dispatch 2021-01-28T04:00:30.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:30 smithi100 bash[9834]: audit 2021-01-28T04:00:28.717029+0000 mon.a (mon.0) 746 : audit [INF] from='client.? 172.21.15.100:0/2214300162' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32442-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:30.584 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:30 smithi100 bash[9834]: audit 2021-01-28T04:00:28.724608+0000 mon.a (mon.0) 747 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32465-7"}]: dispatch 2021-01-28T04:00:30.584 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:30 smithi100 bash[9834]: audit 2021-01-28T04:00:28.731426+0000 mon.a (mon.0) 748 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:30.584 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:30 smithi100 bash[9834]: audit 2021-01-28T04:00:28.741000+0000 mon.a (mon.0) 749 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:30.585 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:30 smithi100 bash[9834]: audit 2021-01-28T04:00:28.741223+0000 mon.a (mon.0) 750 : audit [INF] from='client.? 172.21.15.100:0/2279206164' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32176-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:00:30.585 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:30 smithi100 bash[9834]: audit 2021-01-28T04:00:28.741755+0000 mon.a (mon.0) 751 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:30.585 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:30 smithi100 bash[9834]: audit 2021-01-28T04:00:28.742209+0000 mon.a (mon.0) 752 : audit [INF] from='client.? 172.21.15.100:0/2214300162' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32442-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:00:30.585 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:30 smithi100 bash[9834]: audit 2021-01-28T04:00:28.797383+0000 mon.b (mon.2) 32 : audit [INF] from='client.? 172.21.15.100:0/3981027325' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2021-01-28T04:00:30.586 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:30 smithi100 bash[9834]: audit 2021-01-28T04:00:28.988776+0000 mon.b (mon.2) 33 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:30.586 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:30 smithi100 bash[9834]: audit 2021-01-28T04:00:29.208593+0000 mon.b (mon.2) 34 : audit [INF] from='client.? 172.21.15.100:0/380907029' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32465-7"}]: dispatch 2021-01-28T04:00:30.587 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:30 smithi100 bash[9834]: cluster 2021-01-28T04:00:29.210866+0000 mon.a (mon.0) 753 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2021-01-28T04:00:30.587 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:30 smithi100 bash[9834]: audit 2021-01-28T04:00:29.642882+0000 mon.a (mon.0) 754 : audit [INF] from='client.? 172.21.15.100:0/2279206164' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32176-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32176-22"}]: dispatch 2021-01-28T04:00:30.587 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:30 smithi100 bash[9834]: audit 2021-01-28T04:00:29.643668+0000 mon.a (mon.0) 755 : audit [INF] from='client.? 172.21.15.100:0/2214300162' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32442-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32442-6"}]: dispatch 2021-01-28T04:00:30.588 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:30 smithi100 bash[9834]: audit 2021-01-28T04:00:29.644563+0000 mon.a (mon.0) 756 : audit [INF] from='client.? 172.21.15.100:0/1719341281' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:30.962 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00ed 50 objects 2021-01-28T04:00:30.962 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_16_[33377]: shutting down. 2021-01-28T04:00:30.962 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:30.963 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:30.963 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:30.963 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:30.963 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_15_[33376]: starting. 2021-01-28T04:00:30.963 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_15_[33376]: listing objects. 2021-01-28T04:00:30.964 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_15_[33376]: listed object 0... 2021-01-28T04:00:30.964 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_15_[33376]: listed object 25... 2021-01-28T04:00:30.964 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_15_[33376]: listed object 50... 2021-01-28T04:00:30.964 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_15_[33376]: listed object 75... 2021-01-28T04:00:30.964 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_15_[33376]: listed object 100... 2021-01-28T04:00:30.965 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_15_[33376]: listed object 125... 2021-01-28T04:00:30.965 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_15_[33376]: saw 150 objects 2021-01-28T04:00:30.965 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: process_15_[33376]: shutting down. 2021-01-28T04:00:30.965 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:30.965 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:30.966 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:30.966 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:30.966 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******************************* 2021-01-28T04:00:30.966 INFO:tasks.workunit.client.0.smithi100.stdout: list_parallel: ******* SUCCESS ********** 2021-01-28T04:00:31.392 INFO:tasks.workunit.client.0.smithi100.stdout::28.717029+0000 mon.a [INF] from='client.? 172.21.15.100:0/2214300162' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32442-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:31.392 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:28.724608+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32465-7"}]: dispatch 2021-01-28T04:00:31.392 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:28.731426+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:31.393 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:28.741000+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:31.393 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:28.741223+0000 mon.a [INF] from='client.? 172.21.15.100:0/2279206164' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32176-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:00:31.393 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:28.741755+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:31.393 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:28.742209+0000 mon.a [INF] from='client.? 172.21.15.100:0/2214300162' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32442-6", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:00:31.394 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:28.797383+0000 mon.b [INF] from='client.? 172.21.15.100:0/3981027325' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2021-01-28T04:00:31.394 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:29.208593+0000 mon.b [INF] from='client.? 172.21.15.100:0/380907029' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32465-7"}]: dispatch 2021-01-28T04:00:31.394 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:29.642882+0000 mon.a [INF] from='client.? 172.21.15.100:0/2279206164' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32176-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32176-22"}]: dispatch 2021-01-28T04:00:31.394 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:29.643668+0000 mon.a [INF] from='client.? 172.21.15.100:0/2214300162' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32442-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32442-6"}]: dispatch 2021-01-28T04:00:31.395 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:29.644563+0000 mon.a [INF] from='client.? 172.21.15.100:0/1719341281' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:31.395 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:28.797426+0000 client.admin [INF] onexx 2021-01-28T04:00:31.395 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:29.698984+0000 mgr.y [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:00:31.395 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:29.777595+0000 mon.c [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2021-01-28T04:00:31.396 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:29.778582+0000 mon.c [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2021-01-28T04:00:31.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:31 smithi162 bash[9856]: cluster 2021-01-28T04:00:28.797426+0000 client.admin (client.?) 0 : cluster [INF] onexx 2021-01-28T04:00:31.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:31 smithi162 bash[9856]: cluster 2021-01-28T04:00:29.505668+0000 mgr.y (mgr.14138) 486 : cluster [DBG] pgmap v359: 652 pgs: 79 creating+peering, 92 unknown, 481 active+clean; 46 KiB data, 132 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 107 KiB/s wr, 652 op/s 2021-01-28T04:00:31.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:31 smithi162 bash[9856]: audit 2021-01-28T04:00:29.698984+0000 mgr.y (mgr.14138) 487 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:00:31.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:31 smithi162 bash[9856]: audit 2021-01-28T04:00:29.777595+0000 mon.c (mon.1) 42 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2021-01-28T04:00:31.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:31 smithi162 bash[9856]: audit 2021-01-28T04:00:29.777870+0000 mgr.y (mgr.14138) 488 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2021-01-28T04:00:31.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:31 smithi162 bash[9856]: audit 2021-01-28T04:00:29.778582+0000 mon.c (mon.1) 43 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2021-01-28T04:00:31.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:31 smithi162 bash[9856]: audit 2021-01-28T04:00:29.778764+0000 mgr.y (mgr.14138) 489 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2021-01-28T04:00:31.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:31 smithi162 bash[9856]: audit 2021-01-28T04:00:29.779377+0000 mon.c (mon.1) 44 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2021-01-28T04:00:31.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:31 smithi162 bash[9856]: audit 2021-01-28T04:00:29.779564+0000 mgr.y (mgr.14138) 490 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2021-01-28T04:00:31.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:31 smithi162 bash[9856]: audit 2021-01-28T04:00:29.780174+0000 mon.c (mon.1) 45 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2021-01-28T04:00:31.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:31 smithi162 bash[9856]: audit 2021-01-28T04:00:29.780368+0000 mgr.y (mgr.14138) 491 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2021-01-28T04:00:31.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:31 smithi162 bash[9856]: audit 2021-01-28T04:00:29.781005+0000 mon.c (mon.1) 46 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2021-01-28T04:00:31.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:31 smithi162 bash[9856]: audit 2021-01-28T04:00:29.781215+0000 mgr.y (mgr.14138) 492 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2021-01-28T04:00:31.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:31 smithi162 bash[9856]: audit 2021-01-28T04:00:29.781824+0000 mon.c (mon.1) 47 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2021-01-28T04:00:31.766 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:31 smithi162 bash[9856]: audit 2021-01-28T04:00:29.782026+0000 mgr.y (mgr.14138) 493 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2021-01-28T04:00:31.766 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:31 smithi162 bash[9856]: audit 2021-01-28T04:00:29.782625+0000 mon.c (mon.1) 48 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2021-01-28T04:00:31.766 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:31 smithi162 bash[9856]: audit 2021-01-28T04:00:29.782823+0000 mgr.y (mgr.14138) 494 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2021-01-28T04:00:31.766 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:31 smithi162 bash[9856]: audit 2021-01-28T04:00:29.783449+0000 mon.c (mon.1) 49 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2021-01-28T04:00:31.767 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:31 smithi162 bash[9856]: audit 2021-01-28T04:00:29.783668+0000 mgr.y (mgr.14138) 495 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2021-01-28T04:00:31.767 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:31 smithi162 bash[9856]: audit 2021-01-28T04:00:29.784303+0000 mon.c (mon.1) 50 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2021-01-28T04:00:31.767 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:31 smithi162 bash[9856]: audit 2021-01-28T04:00:29.784479+0000 mgr.y (mgr.14138) 496 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2021-01-28T04:00:31.767 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:31 smithi162 bash[9856]: audit 2021-01-28T04:00:29.785095+0000 mon.c (mon.1) 51 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2021-01-28T04:00:31.768 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:31 smithi162 bash[9856]: audit 2021-01-28T04:00:29.785285+0000 mgr.y (mgr.14138) 497 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2021-01-28T04:00:31.768 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:31 smithi162 bash[9856]: audit 2021-01-28T04:00:29.990365+0000 mon.b (mon.2) 35 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:31.768 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:31 smithi162 bash[9856]: audit 2021-01-28T04:00:30.112422+0000 mon.a (mon.0) 757 : audit [INF] from='client.? 172.21.15.100:0/727307177' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32201-10"}]: dispatch 2021-01-28T04:00:31.768 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:31 smithi162 bash[9856]: audit 2021-01-28T04:00:30.112823+0000 mon.a (mon.0) 758 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2021-01-28T04:00:31.769 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:31 smithi162 bash[9856]: audit 2021-01-28T04:00:30.117844+0000 mon.a (mon.0) 759 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:31.769 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:31 smithi162 bash[9856]: audit 2021-01-28T04:00:30.123869+0000 mon.c (mon.1) 52 : audit [INF] from='client.? 172.21.15.100:0/1700367650' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32511-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:31.769 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:31 smithi162 bash[9856]: audit 2021-01-28T04:00:30.957354+0000 mon.a (mon.0) 760 : audit [INF] from='client.? 172.21.15.100:0/1719341281' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:31.769 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:31 smithi162 bash[9856]: audit 2021-01-28T04:00:30.958960+0000 mon.c (mon.1) 53 : audit [INF] from='client.? 172.21.15.100:0/988282123' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:31.769 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:31 smithi162 bash[9856]: cluster 2021-01-28T04:00:30.960419+0000 mon.a (mon.0) 761 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2021-01-28T04:00:31.770 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:31 smithi162 bash[9856]: audit 2021-01-28T04:00:30.962290+0000 mon.a (mon.0) 762 : audit [INF] from='client.? 172.21.15.100:0/727307177' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32201-10"}]: dispatch 2021-01-28T04:00:31.770 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:31 smithi162 bash[9856]: audit 2021-01-28T04:00:30.963396+0000 mon.a (mon.0) 763 : audit [INF] from='client.? 172.21.15.100:0/727307177' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32201-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:31.770 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:31 smithi162 bash[9856]: audit 2021-01-28T04:00:30.966103+0000 mon.a (mon.0) 764 : audit [INF] from='client.? 172.21.15.100:0/4062725283' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32256-10"}]: dispatch 2021-01-28T04:00:31.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[13549]: cluster 2021-01-28T04:00:28.797426+0000 client.admin (client.?) 0 : cluster [INF] onexx 2021-01-28T04:00:31.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[13549]: cluster 2021-01-28T04:00:29.505668+0000 mgr.y (mgr.14138) 486 : cluster [DBG] pgmap v359: 652 pgs: 79 creating+peering, 92 unknown, 481 active+clean; 46 KiB data, 132 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 107 KiB/s wr, 652 op/s 2021-01-28T04:00:31.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[13549]: audit 2021-01-28T04:00:29.698984+0000 mgr.y (mgr.14138) 487 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:00:31.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[13549]: audit 2021-01-28T04:00:29.777595+0000 mon.c (mon.1) 42 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2021-01-28T04:00:31.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[13549]: audit 2021-01-28T04:00:29.777870+0000 mgr.y (mgr.14138) 488 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2021-01-28T04:00:31.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[13549]: audit 2021-01-28T04:00:29.778582+0000 mon.c (mon.1) 43 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2021-01-28T04:00:31.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[13549]: audit 2021-01-28T04:00:29.778764+0000 mgr.y (mgr.14138) 489 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2021-01-28T04:00:31.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[13549]: audit 2021-01-28T04:00:29.779377+0000 mon.c (mon.1) 44 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2021-01-28T04:00:31.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[13549]: audit 2021-01-28T04:00:29.779564+0000 mgr.y (mgr.14138) 490 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2021-01-28T04:00:31.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[13549]: audit 2021-01-28T04:00:29.780174+0000 mon.c (mon.1) 45 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2021-01-28T04:00:31.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[13549]: audit 2021-01-28T04:00:29.780368+0000 mgr.y (mgr.14138) 491 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2021-01-28T04:00:31.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[13549]: audit 2021-01-28T04:00:29.781005+0000 mon.c (mon.1) 46 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2021-01-28T04:00:31.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[13549]: audit 2021-01-28T04:00:29.781215+0000 mgr.y (mgr.14138) 492 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2021-01-28T04:00:31.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[13549]: audit 2021-01-28T04:00:29.781824+0000 mon.c (mon.1) 47 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2021-01-28T04:00:31.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[13549]: audit 2021-01-28T04:00:29.782026+0000 mgr.y (mgr.14138) 493 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2021-01-28T04:00:31.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[13549]: audit 2021-01-28T04:00:29.782625+0000 mon.c (mon.1) 48 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2021-01-28T04:00:31.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[13549]: audit 2021-01-28T04:00:29.782823+0000 mgr.y (mgr.14138) 494 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2021-01-28T04:00:31.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[13549]: audit 2021-01-28T04:00:29.783449+0000 mon.c (mon.1) 49 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2021-01-28T04:00:31.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[13549]: audit 2021-01-28T04:00:29.783668+0000 mgr.y (mgr.14138) 495 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2021-01-28T04:00:31.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[13549]: audit 2021-01-28T04:00:29.784303+0000 mon.c (mon.1) 50 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2021-01-28T04:00:31.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[13549]: audit 2021-01-28T04:00:29.784479+0000 mgr.y (mgr.14138) 496 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2021-01-28T04:00:31.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[13549]: audit 2021-01-28T04:00:29.785095+0000 mon.c (mon.1) 51 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2021-01-28T04:00:31.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[13549]: audit 2021-01-28T04:00:29.785285+0000 mgr.y (mgr.14138) 497 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2021-01-28T04:00:31.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[13549]: audit 2021-01-28T04:00:29.990365+0000 mon.b (mon.2) 35 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:31.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[13549]: audit 2021-01-28T04:00:30.112422+0000 mon.a (mon.0) 757 : audit [INF] from='client.? 172.21.15.100:0/727307177' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32201-10"}]: dispatch 2021-01-28T04:00:31.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[13549]: audit 2021-01-28T04:00:30.112823+0000 mon.a (mon.0) 758 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2021-01-28T04:00:31.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[13549]: audit 2021-01-28T04:00:30.117844+0000 mon.a (mon.0) 759 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:31.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[13549]: audit 2021-01-28T04:00:30.123869+0000 mon.c (mon.1) 52 : audit [INF] from='client.? 172.21.15.100:0/1700367650' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32511-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:31.834 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[13549]: audit 2021-01-28T04:00:30.957354+0000 mon.a (mon.0) 760 : audit [INF] from='client.? 172.21.15.100:0/1719341281' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:31.834 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[13549]: audit 2021-01-28T04:00:30.958960+0000 mon.c (mon.1) 53 : audit [INF] from='client.? 172.21.15.100:0/988282123' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:31.834 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[13549]: cluster 2021-01-28T04:00:30.960419+0000 mon.a (mon.0) 761 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2021-01-28T04:00:31.834 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[13549]: audit 2021-01-28T04:00:30.962290+0000 mon.a (mon.0) 762 : audit [INF] from='client.? 172.21.15.100:0/727307177' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32201-10"}]: dispatch 2021-01-28T04:00:31.834 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[13549]: audit 2021-01-28T04:00:30.963396+0000 mon.a (mon.0) 763 : audit [INF] from='client.? 172.21.15.100:0/727307177' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32201-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:31.835 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[13549]: audit 2021-01-28T04:00:30.966103+0000 mon.a (mon.0) 764 : audit [INF] from='client.? 172.21.15.100:0/4062725283' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32256-10"}]: dispatch 2021-01-28T04:00:31.835 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[9834]: cluster 2021-01-28T04:00:28.797426+0000 client.admin (client.?) 0 : cluster [INF] onexx 2021-01-28T04:00:31.835 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[9834]: cluster 2021-01-28T04:00:29.505668+0000 mgr.y (mgr.14138) 486 : cluster [DBG] pgmap v359: 652 pgs: 79 creating+peering, 92 unknown, 481 active+clean; 46 KiB data, 132 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 107 KiB/s wr, 652 op/s 2021-01-28T04:00:31.835 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[9834]: audit 2021-01-28T04:00:29.698984+0000 mgr.y (mgr.14138) 487 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:00:31.836 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[9834]: audit 2021-01-28T04:00:29.777595+0000 mon.c (mon.1) 42 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2021-01-28T04:00:31.836 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[9834]: audit 2021-01-28T04:00:29.777870+0000 mgr.y (mgr.14138) 488 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2021-01-28T04:00:31.836 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[9834]: audit 2021-01-28T04:00:29.778582+0000 mon.c (mon.1) 43 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2021-01-28T04:00:31.836 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[9834]: audit 2021-01-28T04:00:29.778764+0000 mgr.y (mgr.14138) 489 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2021-01-28T04:00:31.836 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[9834]: audit 2021-01-28T04:00:29.779377+0000 mon.c (mon.1) 44 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2021-01-28T04:00:31.837 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[9834]: audit 2021-01-28T04:00:29.779564+0000 mgr.y (mgr.14138) 490 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2021-01-28T04:00:31.837 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[9834]: audit 2021-01-28T04:00:29.780174+0000 mon.c (mon.1) 45 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2021-01-28T04:00:31.837 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[9834]: audit 2021-01-28T04:00:29.780368+0000 mgr.y (mgr.14138) 491 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2021-01-28T04:00:31.837 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[9834]: audit 2021-01-28T04:00:29.781005+0000 mon.c (mon.1) 46 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2021-01-28T04:00:31.837 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[9834]: audit 2021-01-28T04:00:29.781215+0000 mgr.y (mgr.14138) 492 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2021-01-28T04:00:31.838 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[9834]: audit 2021-01-28T04:00:29.781824+0000 mon.c (mon.1) 47 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2021-01-28T04:00:31.838 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[9834]: audit 2021-01-28T04:00:29.782026+0000 mgr.y (mgr.14138) 493 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2021-01-28T04:00:31.838 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[9834]: audit 2021-01-28T04:00:29.782625+0000 mon.c (mon.1) 48 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2021-01-28T04:00:31.838 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[9834]: audit 2021-01-28T04:00:29.782823+0000 mgr.y (mgr.14138) 494 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2021-01-28T04:00:31.838 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[9834]: audit 2021-01-28T04:00:29.783449+0000 mon.c (mon.1) 49 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2021-01-28T04:00:31.839 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[9834]: audit 2021-01-28T04:00:29.783668+0000 mgr.y (mgr.14138) 495 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2021-01-28T04:00:31.839 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[9834]: audit 2021-01-28T04:00:29.784303+0000 mon.c (mon.1) 50 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2021-01-28T04:00:31.840 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[9834]: audit 2021-01-28T04:00:29.784479+0000 mgr.y (mgr.14138) 496 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2021-01-28T04:00:31.840 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[9834]: audit 2021-01-28T04:00:29.785095+0000 mon.c (mon.1) 51 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2021-01-28T04:00:31.840 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[9834]: audit 2021-01-28T04:00:29.785285+0000 mgr.y (mgr.14138) 497 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2021-01-28T04:00:31.840 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[9834]: audit 2021-01-28T04:00:29.990365+0000 mon.b (mon.2) 35 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:31.840 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[9834]: audit 2021-01-28T04:00:30.112422+0000 mon.a (mon.0) 757 : audit [INF] from='client.? 172.21.15.100:0/727307177' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32201-10"}]: dispatch 2021-01-28T04:00:31.841 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[9834]: audit 2021-01-28T04:00:30.112823+0000 mon.a (mon.0) 758 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2021-01-28T04:00:31.841 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[9834]: audit 2021-01-28T04:00:30.117844+0000 mon.a (mon.0) 759 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:31.841 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[9834]: audit 2021-01-28T04:00:30.123869+0000 mon.c (mon.1) 52 : audit [INF] from='client.? 172.21.15.100:0/1700367650' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32511-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:31.841 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[9834]: audit 2021-01-28T04:00:30.957354+0000 mon.a (mon.0) 760 : audit [INF] from='client.? 172.21.15.100:0/1719341281' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:31.841 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[9834]: audit 2021-01-28T04:00:30.958960+0000 mon.c (mon.1) 53 : audit [INF] from='client.? 172.21.15.100:0/988282123' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:31.842 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[9834]: cluster 2021-01-28T04:00:30.960419+0000 mon.a (mon.0) 761 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2021-01-28T04:00:31.842 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[9834]: audit 2021-01-28T04:00:30.962290+0000 mon.a (mon.0) 762 : audit [INF] from='client.? 172.21.15.100:0/727307177' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32201-10"}]: dispatch 2021-01-28T04:00:31.842 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[9834]: audit 2021-01-28T04:00:30.963396+0000 mon.a (mon.0) 763 : audit [INF] from='client.? 172.21.15.100:0/727307177' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32201-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:31.842 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:31 smithi100 bash[9834]: audit 2021-01-28T04:00:30.966103+0000 mon.a (mon.0) 764 : audit [INF] from='client.? 172.21.15.100:0/4062725283' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32256-10"}]: dispatch 2021-01-28T04:00:32.611 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:29.779377+0000 mon.c [INF] from='client api_io_pp: Running main() from gmock_main.cc 2021-01-28T04:00:32.612 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [==========] Running 37 tests from 2 test suites. 2021-01-28T04:00:32.612 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [----------] Global test environment set-up. 2021-01-28T04:00:32.612 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP 2021-01-28T04:00:32.612 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: seed 32176 2021-01-28T04:00:32.612 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TooBigPP 2021-01-28T04:00:32.613 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoPP.TooBigPP (0 ms) 2021-01-28T04:00:32.613 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SimpleWritePP 2021-01-28T04:00:32.613 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoPP.SimpleWritePP (2969 ms) 2021-01-28T04:00:32.613 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadOpPP 2021-01-28T04:00:32.614 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadOpPP (42 ms) 2021-01-28T04:00:32.614 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadOpPP 2021-01-28T04:00:32.614 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadOpPP (7 ms) 2021-01-28T04:00:32.614 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP 2021-01-28T04:00:32.615 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP (5 ms) 2021-01-28T04:00:32.615 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP2 2021-01-28T04:00:32.615 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP2 (6 ms) 2021-01-28T04:00:32.615 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN ] LibRadosIoPP.Checksum 2021-01-28T04:00:32.616 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoPP.Checksum (4 ms) 2021-01-28T04:00:32.616 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadIntoBufferlist 2021-01-28T04:00:32.617 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadIntoBufferlist (4 ms) 2021-01-28T04:00:32.617 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2021-01-28T04:00:32.617 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (6 ms) 2021-01-28T04:00:32.618 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2021-01-28T04:00:32.618 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP (6 ms) 2021-01-28T04:00:32.619 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2021-01-28T04:00:32.619 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (6 ms) 2021-01-28T04:00:32.620 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN ] LibRadosIoPP.AppendRoundTripPP 2021-01-28T04:00:32.620 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoPP.AppendRoundTripPP (6 ms) 2021-01-28T04:00:32.620 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TruncTestPP 2021-01-28T04:00:32.620 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoPP.TruncTestPP (7 ms) 2021-01-28T04:00:32.621 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RemoveTestPP 2021-01-28T04:00:32.621 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoPP.RemoveTestPP (7 ms) 2021-01-28T04:00:32.621 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrsRoundTripPP 2021-01-28T04:00:32.621 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrsRoundTripPP (9 ms) 2021-01-28T04:00:32.622 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RmXattrPP 2021-01-28T04:00:32.622 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoPP.RmXattrPP (28 ms) 2021-01-28T04:00:32.622 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrListPP 2021-01-28T04:00:32.622 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrListPP (9 ms) 2021-01-28T04:00:32.623 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtPP 2021-01-28T04:00:32.623 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtPP (11 ms) 2021-01-28T04:00:32.623 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtDNEPP 2021-01-28T04:00:32.623 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtDNEPP (14 ms) 2021-01-28T04:00:32.623 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtMismatchPP 2021-01-28T04:00:32.624 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtMismatchPP (12 ms) 2021-01-28T04:00:32.624 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP (3159 ms total) 2021-01-28T04:00:32.624 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: 2021-01-28T04:00:32.624 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP 2021-01-28T04:00:32.624 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SimpleWritePP 2021-01-28T04:00:32.625 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SimpleWritePP (710 ms) 2021-01-28T04:00:32.625 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.ReadOpPP 2021-01-28T04:00:32.625 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoECPP.ReadOpPP (39 ms) 2021-01-28T04:00:32.625 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SparseReadOpPP 2021-01-28T04:00:32.625 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SparseReadOpPP (5 ms) 2021-01-28T04:00:32.626 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP 2021-01-28T04:00:32.626 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP (5 ms) 2021-01-28T04:00:32.626 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP2 2021-01-28T04:00:32.626 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP2 (5 ms) 2021-01-28T04:00:32.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:32 smithi162 bash[9856]: cluster 2021-01-28T04:00:29.833859+0000 osd.6 (osd.6) 3 : cluster [DBG] 13.1 deep-scrub ok 2021-01-28T04:00:32.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:32 smithi162 bash[9856]: cluster 2021-01-28T04:00:29.876840+0000 osd.4 (osd.4) 3 : cluster [DBG] 13.5 deep-scrub ok 2021-01-28T04:00:32.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:32 smithi162 bash[9856]: cluster 2021-01-28T04:00:29.918952+0000 osd.5 (osd.5) 3 : cluster [DBG] 13.2 deep-scrub ok 2021-01-28T04:00:32.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:32 smithi162 bash[9856]: audit 2021-01-28T04:00:30.992278+0000 mon.b (mon.2) 36 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:32.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:32 smithi162 bash[9856]: audit 2021-01-28T04:00:31.393018+0000 mon.a (mon.0) 765 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2021-01-28T04:00:32.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:32 smithi162 bash[9856]: audit 2021-01-28T04:00:31.394511+0000 mon.a (mon.0) 766 : audit [INF] from='client.? 172.21.15.100:0/4062725283' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32256-10"}]: dispatch 2021-01-28T04:00:32.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:32 smithi162 bash[9856]: audit 2021-01-28T04:00:31.394942+0000 mon.a (mon.0) 767 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32511-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:32.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:32 smithi162 bash[9856]: audit 2021-01-28T04:00:31.396637+0000 mon.a (mon.0) 768 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32465-7"}]: dispatch 2021-01-28T04:00:32.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:32 smithi162 bash[9856]: audit 2021-01-28T04:00:31.397249+0000 mon.b (mon.2) 37 : audit [INF] from='client.? 172.21.15.100:0/3981027325' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2021-01-28T04:00:32.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:32 smithi162 bash[9856]: audit 2021-01-28T04:00:31.403344+0000 mon.a (mon.0) 769 : audit [INF] from='client.? 172.21.15.100:0/2279206164' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32176-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32176-22"}]': finished 2021-01-28T04:00:32.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:32 smithi162 bash[9856]: audit 2021-01-28T04:00:31.403572+0000 mon.a (mon.0) 770 : audit [INF] from='client.? 172.21.15.100:0/2214300162' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32442-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32442-6"}]': finished 2021-01-28T04:00:32.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:32 smithi162 bash[9856]: audit 2021-01-28T04:00:31.404034+0000 mon.a (mon.0) 771 : audit [INF] from='client.? 172.21.15.100:0/727307177' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32201-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:00:32.766 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:32 smithi162 bash[9856]: cluster 2021-01-28T04:00:31.406980+0000 client.admin (client.?) 0 : cluster [INF] twoxx 2021-01-28T04:00:32.766 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:32 smithi162 bash[9856]: audit 2021-01-28T04:00:31.408922+0000 mon.c (mon.1) 54 : audit [INF] from='client.? 172.21.15.100:0/3320243548' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:32.766 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:32 smithi162 bash[9856]: audit 2021-01-28T04:00:31.409238+0000 mon.c (mon.1) 55 : audit [INF] from='client.? 172.21.15.100:0/2406390797' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32171-15"}]: dispatch 2021-01-28T04:00:32.767 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:32 smithi162 bash[9856]: cluster 2021-01-28T04:00:31.506731+0000 mgr.y (mgr.14138) 498 : cluster [DBG] pgmap v362: 692 pgs: 80 creating+peering, 203 unknown, 409 active+clean; 24 MiB data, 157 MiB used, 715 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.0 MiB/s wr, 452 op/s 2021-01-28T04:00:32.767 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:32 smithi162 bash[9856]: cluster 2021-01-28T04:00:31.679705+0000 osd.7 (osd.7) 3 : cluster [DBG] 13.0 deep-scrub ok 2021-01-28T04:00:32.767 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:32 smithi162 bash[9856]: cluster 2021-01-28T04:00:31.842354+0000 mon.a (mon.0) 772 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2021-01-28T04:00:32.768 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:32 smithi162 bash[9856]: audit 2021-01-28T04:00:31.842587+0000 mon.b (mon.2) 38 : audit [INF] from='client.? 172.21.15.100:0/380907029' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32465-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:32.768 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:32 smithi162 bash[9856]: audit 2021-01-28T04:00:31.844153+0000 mon.a (mon.0) 773 : audit [INF] from='client.? 172.21.15.100:0/727307177' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32201-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32201-10"}]: dispatch 2021-01-28T04:00:32.769 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:32 smithi162 bash[9856]: audit 2021-01-28T04:00:31.844686+0000 mon.a (mon.0) 774 : audit [INF] from='client.? 172.21.15.100:0/4062725283' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32256-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:32.769 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:32 smithi162 bash[9856]: audit 2021-01-28T04:00:31.852597+0000 mon.a (mon.0) 775 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2021-01-28T04:00:32.769 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:32 smithi162 bash[9856]: audit 2021-01-28T04:00:31.854565+0000 mon.a (mon.0) 776 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:32.769 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:32 smithi162 bash[9856]: audit 2021-01-28T04:00:31.855024+0000 mon.a (mon.0) 777 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:32.770 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:32 smithi162 bash[9856]: audit 2021-01-28T04:00:31.855522+0000 mon.a (mon.0) 778 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32171-15"}]: dispatch 2021-01-28T04:00:32.770 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:32 smithi162 bash[9856]: audit 2021-01-28T04:00:31.856033+0000 mon.a (mon.0) 779 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32465-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:32.770 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:32 smithi162 bash[9856]: audit 2021-01-28T04:00:31.993931+0000 mon.b (mon.2) 39 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:32.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[9834]: cluster 2021-01-28T04:00:29.833859+0000 osd.6 (osd.6) 3 : cluster [DBG] 13.1 deep-scrub ok 2021-01-28T04:00:32.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[9834]: cluster 2021-01-28T04:00:29.876840+0000 osd.4 (osd.4) 3 : cluster [DBG] 13.5 deep-scrub ok 2021-01-28T04:00:32.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[9834]: cluster 2021-01-28T04:00:29.918952+0000 osd.5 (osd.5) 3 : cluster [DBG] 13.2 deep-scrub ok 2021-01-28T04:00:32.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[9834]: audit 2021-01-28T04:00:30.992278+0000 mon.b (mon.2) 36 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:32.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[9834]: audit 2021-01-28T04:00:31.393018+0000 mon.a (mon.0) 765 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2021-01-28T04:00:32.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[9834]: audit 2021-01-28T04:00:31.394511+0000 mon.a (mon.0) 766 : audit [INF] from='client.? 172.21.15.100:0/4062725283' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32256-10"}]: dispatch 2021-01-28T04:00:32.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[9834]: audit 2021-01-28T04:00:31.394942+0000 mon.a (mon.0) 767 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32511-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:32.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[9834]: audit 2021-01-28T04:00:31.396637+0000 mon.a (mon.0) 768 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32465-7"}]: dispatch 2021-01-28T04:00:32.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[9834]: audit 2021-01-28T04:00:31.397249+0000 mon.b (mon.2) 37 : audit [INF] from='client.? 172.21.15.100:0/3981027325' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2021-01-28T04:00:32.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[9834]: audit 2021-01-28T04:00:31.403344+0000 mon.a (mon.0) 769 : audit [INF] from='client.? 172.21.15.100:0/2279206164' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32176-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32176-22"}]': finished 2021-01-28T04:00:32.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[9834]: audit 2021-01-28T04:00:31.403572+0000 mon.a (mon.0) 770 : audit [INF] from='client.? 172.21.15.100:0/2214300162' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32442-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32442-6"}]': finished 2021-01-28T04:00:32.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[9834]: audit 2021-01-28T04:00:31.404034+0000 mon.a (mon.0) 771 : audit [INF] from='client.? 172.21.15.100:0/727307177' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32201-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:00:32.832 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[9834]: cluster 2021-01-28T04:00:31.406980+0000 client.admin (client.?) 0 : cluster [INF] twoxx 2021-01-28T04:00:32.832 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[9834]: audit 2021-01-28T04:00:31.408922+0000 mon.c (mon.1) 54 : audit [INF] from='client.? 172.21.15.100:0/3320243548' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:32.832 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[9834]: audit 2021-01-28T04:00:31.409238+0000 mon.c (mon.1) 55 : audit [INF] from='client.? 172.21.15.100:0/2406390797' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32171-15"}]: dispatch 2021-01-28T04:00:32.832 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[9834]: cluster 2021-01-28T04:00:31.506731+0000 mgr.y (mgr.14138) 498 : cluster [DBG] pgmap v362: 692 pgs: 80 creating+peering, 203 unknown, 409 active+clean; 24 MiB data, 157 MiB used, 715 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.0 MiB/s wr, 452 op/s 2021-01-28T04:00:32.833 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[9834]: cluster 2021-01-28T04:00:31.679705+0000 osd.7 (osd.7) 3 : cluster [DBG] 13.0 deep-scrub ok 2021-01-28T04:00:32.833 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[9834]: cluster 2021-01-28T04:00:31.842354+0000 mon.a (mon.0) 772 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2021-01-28T04:00:32.834 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[9834]: audit 2021-01-28T04:00:31.842587+0000 mon.b (mon.2) 38 : audit [INF] from='client.? 172.21.15.100:0/380907029' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32465-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:32.834 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[9834]: audit 2021-01-28T04:00:31.844153+0000 mon.a (mon.0) 773 : audit [INF] from='client.? 172.21.15.100:0/727307177' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32201-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32201-10"}]: dispatch 2021-01-28T04:00:32.834 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[9834]: audit 2021-01-28T04:00:31.844686+0000 mon.a (mon.0) 774 : audit [INF] from='client.? 172.21.15.100:0/4062725283' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32256-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:32.835 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[9834]: audit 2021-01-28T04:00:31.852597+0000 mon.a (mon.0) 775 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2021-01-28T04:00:32.835 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[9834]: audit 2021-01-28T04:00:31.854565+0000 mon.a (mon.0) 776 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:32.835 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[9834]: audit 2021-01-28T04:00:31.855024+0000 mon.a (mon.0) 777 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:32.835 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[9834]: audit 2021-01-28T04:00:31.855522+0000 mon.a (mon.0) 778 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32171-15"}]: dispatch 2021-01-28T04:00:32.836 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[9834]: audit 2021-01-28T04:00:31.856033+0000 mon.a (mon.0) 779 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32465-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:32.836 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[9834]: audit 2021-01-28T04:00:31.993931+0000 mon.b (mon.2) 39 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:32.836 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[13549]: cluster 2021-01-28T04:00:29.833859+0000 osd.6 (osd.6) 3 : cluster [DBG] 13.1 deep-scrub ok 2021-01-28T04:00:32.837 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[13549]: cluster 2021-01-28T04:00:29.876840+0000 osd.4 (osd.4) 3 : cluster [DBG] 13.5 deep-scrub ok 2021-01-28T04:00:32.837 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[13549]: cluster 2021-01-28T04:00:29.918952+0000 osd.5 (osd.5) 3 : cluster [DBG] 13.2 deep-scrub ok 2021-01-28T04:00:32.838 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[13549]: audit 2021-01-28T04:00:30.992278+0000 mon.b (mon.2) 36 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:32.838 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[13549]: audit 2021-01-28T04:00:31.393018+0000 mon.a (mon.0) 765 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2021-01-28T04:00:32.838 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[13549]: audit 2021-01-28T04:00:31.394511+0000 mon.a (mon.0) 766 : audit [INF] from='client.? 172.21.15.100:0/4062725283' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32256-10"}]: dispatch 2021-01-28T04:00:32.839 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[13549]: audit 2021-01-28T04:00:31.394942+0000 mon.a (mon.0) 767 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32511-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:32.839 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[13549]: audit 2021-01-28T04:00:31.396637+0000 mon.a (mon.0) 768 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32465-7"}]: dispatch 2021-01-28T04:00:32.840 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[13549]: audit 2021-01-28T04:00:31.397249+0000 mon.b (mon.2) 37 : audit [INF] from='client.? 172.21.15.100:0/3981027325' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2021-01-28T04:00:32.840 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[13549]: audit 2021-01-28T04:00:31.403344+0000 mon.a (mon.0) 769 : audit [INF] from='client.? 172.21.15.100:0/2279206164' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32176-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32176-22"}]': finished 2021-01-28T04:00:32.841 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[13549]: audit 2021-01-28T04:00:31.403572+0000 mon.a (mon.0) 770 : audit [INF] from='client.? 172.21.15.100:0/2214300162' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32442-6", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32442-6"}]': finished 2021-01-28T04:00:32.841 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[13549]: audit 2021-01-28T04:00:31.404034+0000 mon.a (mon.0) 771 : audit [INF] from='client.? 172.21.15.100:0/727307177' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32201-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:00:32.841 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[13549]: cluster 2021-01-28T04:00:31.406980+0000 client.admin (client.?) 0 : cluster [INF] twoxx 2021-01-28T04:00:32.842 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[13549]: audit 2021-01-28T04:00:31.408922+0000 mon.c (mon.1) 54 : audit [INF] from='client.? 172.21.15.100:0/3320243548' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:32.842 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[13549]: audit 2021-01-28T04:00:31.409238+0000 mon.c (mon.1) 55 : audit [INF] from='client.? 172.21.15.100:0/2406390797' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32171-15"}]: dispatch 2021-01-28T04:00:32.843 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[13549]: cluster 2021-01-28T04:00:31.506731+0000 mgr.y (mgr.14138) 498 : cluster [DBG] pgmap v362: 692 pgs: 80 creating+peering, 203 unknown, 409 active+clean; 24 MiB data, 157 MiB used, 715 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.0 MiB/s wr, 452 op/s 2021-01-28T04:00:32.843 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[13549]: cluster 2021-01-28T04:00:31.679705+0000 osd.7 (osd.7) 3 : cluster [DBG] 13.0 deep-scrub ok 2021-01-28T04:00:32.843 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[13549]: cluster 2021-01-28T04:00:31.842354+0000 mon.a (mon.0) 772 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2021-01-28T04:00:32.844 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[13549]: audit 2021-01-28T04:00:31.842587+0000 mon.b (mon.2) 38 : audit [INF] from='client.? 172.21.15.100:0/380907029' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32465-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:32.844 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[13549]: audit 2021-01-28T04:00:31.844153+0000 mon.a (mon.0) 773 : audit [INF] from='client.? 172.21.15.100:0/727307177' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32201-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32201-10"}]: dispatch 2021-01-28T04:00:32.845 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[13549]: audit 2021-01-28T04:00:31.844686+0000 mon.a (mon.0) 774 : audit [INF] from='client.? 172.21.15.100:0/4062725283' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32256-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:32.845 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[13549]: audit 2021-01-28T04:00:31.852597+0000 mon.a (mon.0) 775 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2021-01-28T04:00:32.846 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[13549]: audit 2021-01-28T04:00:31.854565+0000 mon.a (mon.0) 776 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:32.846 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[13549]: audit 2021-01-28T04:00:31.855024+0000 mon.a (mon.0) 777 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:32.846 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[13549]: audit 2021-01-28T04:00:31.855522+0000 mon.a (mon.0) 778 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32171-15"}]: dispatch 2021-01-28T04:00:32.847 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[13549]: audit 2021-01-28T04:00:31.856033+0000 mon.a (mon.0) 779 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32465-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:32.847 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:32 smithi100 bash[13549]: audit 2021-01-28T04:00:31.993931+0000 mon.b (mon.2) 39 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:32.886 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN open_pools_parallel: process_1_[32685]: starting. 2021-01-28T04:00:32.886 INFO:tasks.workunit.client.0.smithi100.stdout: open_pools_parallel: process_1_[32685]: creating pool ceph_test_rados_open_pools_parallel.smithi100-32668 2021-01-28T04:00:32.886 INFO:tasks.workunit.client.0.smithi100.stdout: open_pools_parallel: process_1_[32685]: created object 0... 2021-01-28T04:00:32.887 INFO:tasks.workunit.client.0.smithi100.stdout: open_pools_parallel: process_1_[32685]: created object 25... 2021-01-28T04:00:32.887 INFO:tasks.workunit.client.0.smithi100.stdout: open_pools_parallel: process_1_[32685]: created object 49... 2021-01-28T04:00:32.887 INFO:tasks.workunit.client.0.smithi100.stdout: open_pools_parallel: process_1_[32685]: finishing. 2021-01-28T04:00:32.887 INFO:tasks.workunit.client.0.smithi100.stdout: open_pools_parallel: process_1_[32685]: shutting down. 2021-01-28T04:00:32.888 INFO:tasks.workunit.client.0.smithi100.stdout: open_pools_parallel: process_2_[32686]: starting. 2021-01-28T04:00:32.888 INFO:tasks.workunit.client.0.smithi100.stdout: open_pools_parallel: process_2_[32686]: rados_pool_create. 2021-01-28T04:00:32.888 INFO:tasks.workunit.client.0.smithi100.stdout: open_pools_parallel: process_2_[32686]: rados_ioctx_create. 2021-01-28T04:00:32.888 INFO:tasks.workunit.client.0.smithi100.stdout: open_pools_parallel: process_2_[32686]: shutting down. 2021-01-28T04:00:32.888 INFO:tasks.workunit.client.0.smithi100.stdout: open_pools_parallel: ******************************* 2021-01-28T04:00:32.889 INFO:tasks.workunit.client.0.smithi100.stdout: open_pools_parallel: process_3_[33424]: starting. 2021-01-28T04:00:32.889 INFO:tasks.workunit.client.0.smithi100.stdout: open_pools_parallel: process_3_[33424]: creating pool ceph_test_rados_open_pools_parallel.smithi100-32668 2021-01-28T04:00:32.889 INFO:tasks.workunit.client.0.smithi100.stdout: open_pools_parallel: process_3_[33424]: created object 0... 2021-01-28T04:00:32.889 INFO:tasks.workunit.client.0.smithi100.stdout: open_pools_parallel: process_3_[33424]: created object 25... 2021-01-28T04:00:32.889 INFO:tasks.workunit.client.0.smithi100.stdout: open_pools_parallel: process_3_[33424]: created object 49... 2021-01-28T04:00:32.890 INFO:tasks.workunit.client.0.smithi100.stdout: open_pools_parallel: process_3_[33424]: finishing. 2021-01-28T04:00:32.890 INFO:tasks.workunit.client.0.smithi100.stdout: open_pools_parallel: process_3_[33424]: shutting down. 2021-01-28T04:00:32.890 INFO:tasks.workunit.client.0.smithi100.stdout: open_pools_parallel: ******************************* 2021-01-28T04:00:32.890 INFO:tasks.workunit.client.0.smithi100.stdout: open_pools_parallel: process_4_[33425]: starting. 2021-01-28T04:00:32.891 INFO:tasks.workunit.client.0.smithi100.stdout: open_pools_parallel: process_4_[33425]: rados_pool_create. 2021-01-28T04:00:32.891 INFO:tasks.workunit.client.0.smithi100.stdout: open_pools_parallel: process_4_[33425]: rados_ioctx_create. 2021-01-28T04:00:32.891 INFO:tasks.workunit.client.0.smithi100.stdout: open_pools_parallel: process_4_[33425]: shutting down. 2021-01-28T04:00:32.891 INFO:tasks.workunit.client.0.smithi100.stdout: open_pools_parallel: ******************************* 2021-01-28T04:00:32.891 INFO:tasks.workunit.client.0.smithi100.stdout: open_pools_parallel: ******************************* 2021-01-28T04:00:32.892 INFO:tasks.workunit.client.0.smithi100.stdout: open_pools_parallel: ******* SUCCESS ********** 2021-01-28T04:00:34.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:33 smithi100 bash[9834]: cluster 2021-01-28T04:00:31.620400+0000 osd.2 (osd.2) 3 : cluster [DBG] 13.8 deep-scrub ok 2021-01-28T04:00:34.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:33 smithi100 bash[9834]: audit 2021-01-28T04:00:32.396597+0000 mon.a (mon.0) 780 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2021-01-28T04:00:34.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:33 smithi100 bash[9834]: audit 2021-01-28T04:00:32.409786+0000 mon.a (mon.0) 781 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32511-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:34.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:33 smithi100 bash[9834]: audit 2021-01-28T04:00:32.414272+0000 mon.c (mon.1) 56 : audit [INF] from='client.? 172.21.15.100:0/2261469346' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:34.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:33 smithi100 bash[9834]: audit 2021-01-28T04:00:32.563558+0000 mon.c (mon.1) 57 : audit [INF] from='client.? 172.21.15.100:0/1700367650' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32511-6", "pg_num": 4}]: dispatch 2021-01-28T04:00:34.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:33 smithi100 bash[9834]: audit 2021-01-28T04:00:32.879581+0000 mon.a (mon.0) 782 : audit [INF] from='client.? 172.21.15.100:0/4062725283' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32256-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:00:34.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:33 smithi100 bash[9834]: audit 2021-01-28T04:00:32.879819+0000 mon.a (mon.0) 783 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:34.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:33 smithi100 bash[9834]: audit 2021-01-28T04:00:32.879894+0000 mon.a (mon.0) 784 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:34.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:33 smithi100 bash[9834]: audit 2021-01-28T04:00:32.879957+0000 mon.a (mon.0) 785 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32171-15"}]': finished 2021-01-28T04:00:34.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:33 smithi100 bash[9834]: audit 2021-01-28T04:00:32.880046+0000 mon.a (mon.0) 786 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32465-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:00:34.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:33 smithi100 bash[9834]: cluster 2021-01-28T04:00:32.880146+0000 mon.a (mon.0) 787 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2021-01-28T04:00:34.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:33 smithi100 bash[9834]: audit 2021-01-28T04:00:32.881964+0000 mon.c (mon.1) 58 : audit [INF] from='client.? 172.21.15.100:0/2406390797' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32171-15"}]: dispatch 2021-01-28T04:00:34.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:33 smithi100 bash[9834]: audit 2021-01-28T04:00:32.882822+0000 mon.b (mon.2) 40 : audit [INF] from='client.? 172.21.15.100:0/380907029' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32465-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32465-7"}]: dispatch 2021-01-28T04:00:34.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:33 smithi100 bash[9834]: audit 2021-01-28T04:00:32.887488+0000 mon.a (mon.0) 788 : audit [INF] from='client.? 172.21.15.100:0/4062725283' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32256-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32256-10"}]: dispatch 2021-01-28T04:00:34.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:33 smithi100 bash[9834]: audit 2021-01-28T04:00:32.888051+0000 mon.a (mon.0) 789 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:34.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:33 smithi100 bash[9834]: audit 2021-01-28T04:00:32.893021+0000 mon.c (mon.1) 59 : audit [INF] from='client.? 172.21.15.100:0/988282123' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi100-32163-3", "field": "max_bytes", "val": "4096"}]: dispatch 2021-01-28T04:00:34.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:33 smithi100 bash[9834]: audit 2021-01-28T04:00:32.995858+0000 mon.b (mon.2) 41 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:34.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:33 smithi100 bash[9834]: audit 2021-01-28T04:00:33.351883+0000 mon.a (mon.0) 790 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32511-6", "pg_num": 4}]: dispatch 2021-01-28T04:00:34.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:33 smithi100 bash[13549]: cluster 2021-01-28T04:00:31.620400+0000 osd.2 (osd.2) 3 : cluster [DBG] 13.8 deep-scrub ok 2021-01-28T04:00:34.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:33 smithi100 bash[13549]: audit 2021-01-28T04:00:32.396597+0000 mon.a (mon.0) 780 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2021-01-28T04:00:34.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:33 smithi100 bash[13549]: audit 2021-01-28T04:00:32.409786+0000 mon.a (mon.0) 781 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32511-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:34.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:33 smithi100 bash[13549]: audit 2021-01-28T04:00:32.414272+0000 mon.c (mon.1) 56 : audit [INF] from='client.? 172.21.15.100:0/2261469346' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:34.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:33 smithi100 bash[13549]: audit 2021-01-28T04:00:32.563558+0000 mon.c (mon.1) 57 : audit [INF] from='client.? 172.21.15.100:0/1700367650' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32511-6", "pg_num": 4}]: dispatch 2021-01-28T04:00:34.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:33 smithi100 bash[13549]: audit 2021-01-28T04:00:32.879581+0000 mon.a (mon.0) 782 : audit [INF] from='client.? 172.21.15.100:0/4062725283' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32256-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:00:34.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:33 smithi100 bash[13549]: audit 2021-01-28T04:00:32.879819+0000 mon.a (mon.0) 783 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:34.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:33 smithi100 bash[13549]: audit 2021-01-28T04:00:32.879894+0000 mon.a (mon.0) 784 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:34.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:33 smithi100 bash[13549]: audit 2021-01-28T04:00:32.879957+0000 mon.a (mon.0) 785 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32171-15"}]': finished 2021-01-28T04:00:34.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:33 smithi100 bash[13549]: audit 2021-01-28T04:00:32.880046+0000 mon.a (mon.0) 786 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32465-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:00:34.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:33 smithi100 bash[13549]: cluster 2021-01-28T04:00:32.880146+0000 mon.a (mon.0) 787 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2021-01-28T04:00:34.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:33 smithi100 bash[13549]: audit 2021-01-28T04:00:32.881964+0000 mon.c (mon.1) 58 : audit [INF] from='client.? 172.21.15.100:0/2406390797' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32171-15"}]: dispatch 2021-01-28T04:00:34.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:33 smithi100 bash[13549]: audit 2021-01-28T04:00:32.882822+0000 mon.b (mon.2) 40 : audit [INF] from='client.? 172.21.15.100:0/380907029' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32465-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32465-7"}]: dispatch 2021-01-28T04:00:34.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:33 smithi100 bash[13549]: audit 2021-01-28T04:00:32.887488+0000 mon.a (mon.0) 788 : audit [INF] from='client.? 172.21.15.100:0/4062725283' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32256-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32256-10"}]: dispatch 2021-01-28T04:00:34.087 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:33 smithi100 bash[13549]: audit 2021-01-28T04:00:32.888051+0000 mon.a (mon.0) 789 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:34.087 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:33 smithi100 bash[13549]: audit 2021-01-28T04:00:32.893021+0000 mon.c (mon.1) 59 : audit [INF] from='client.? 172.21.15.100:0/988282123' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi100-32163-3", "field": "max_bytes", "val": "4096"}]: dispatch 2021-01-28T04:00:34.087 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:33 smithi100 bash[13549]: audit 2021-01-28T04:00:32.995858+0000 mon.b (mon.2) 41 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:34.087 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:33 smithi100 bash[13549]: audit 2021-01-28T04:00:33.351883+0000 mon.a (mon.0) 790 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32511-6", "pg_num": 4}]: dispatch 2021-01-28T04:00:34.262 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:33 smithi162 bash[9856]: cluster 2021-01-28T04:00:31.620400+0000 osd.2 (osd.2) 3 : cluster [DBG] 13.8 deep-scrub ok 2021-01-28T04:00:34.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:33 smithi162 bash[9856]: audit 2021-01-28T04:00:32.396597+0000 mon.a (mon.0) 780 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2021-01-28T04:00:34.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:33 smithi162 bash[9856]: audit 2021-01-28T04:00:32.409786+0000 mon.a (mon.0) 781 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32511-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:34.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:33 smithi162 bash[9856]: audit 2021-01-28T04:00:32.414272+0000 mon.c (mon.1) 56 : audit [INF] from='client.? 172.21.15.100:0/2261469346' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:34.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:33 smithi162 bash[9856]: audit 2021-01-28T04:00:32.563558+0000 mon.c (mon.1) 57 : audit [INF] from='client.? 172.21.15.100:0/1700367650' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32511-6", "pg_num": 4}]: dispatch 2021-01-28T04:00:34.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:33 smithi162 bash[9856]: audit 2021-01-28T04:00:32.879581+0000 mon.a (mon.0) 782 : audit [INF] from='client.? 172.21.15.100:0/4062725283' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32256-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:00:34.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:33 smithi162 bash[9856]: audit 2021-01-28T04:00:32.879819+0000 mon.a (mon.0) 783 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:34.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:33 smithi162 bash[9856]: audit 2021-01-28T04:00:32.879894+0000 mon.a (mon.0) 784 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:34.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:33 smithi162 bash[9856]: audit 2021-01-28T04:00:32.879957+0000 mon.a (mon.0) 785 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32171-15"}]': finished 2021-01-28T04:00:34.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:33 smithi162 bash[9856]: audit 2021-01-28T04:00:32.880046+0000 mon.a (mon.0) 786 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32465-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:00:34.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:33 smithi162 bash[9856]: cluster 2021-01-28T04:00:32.880146+0000 mon.a (mon.0) 787 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2021-01-28T04:00:34.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:33 smithi162 bash[9856]: audit 2021-01-28T04:00:32.881964+0000 mon.c (mon.1) 58 : audit [INF] from='client.? 172.21.15.100:0/2406390797' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32171-15"}]: dispatch 2021-01-28T04:00:34.266 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:33 smithi162 bash[9856]: audit 2021-01-28T04:00:32.882822+0000 mon.b (mon.2) 40 : audit [INF] from='client.? 172.21.15.100:0/380907029' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32465-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32465-7"}]: dispatch 2021-01-28T04:00:34.266 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:33 smithi162 bash[9856]: audit 2021-01-28T04:00:32.887488+0000 mon.a (mon.0) 788 : audit [INF] from='client.? 172.21.15.100:0/4062725283' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32256-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32256-10"}]: dispatch 2021-01-28T04:00:34.266 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:33 smithi162 bash[9856]: audit 2021-01-28T04:00:32.888051+0000 mon.a (mon.0) 789 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:34.266 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:33 smithi162 bash[9856]: audit 2021-01-28T04:00:32.893021+0000 mon.c (mon.1) 59 : audit [INF] from='client.? 172.21.15.100:0/988282123' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi100-32163-3", "field": "max_bytes", "val": "4096"}]: dispatch 2021-01-28T04:00:34.267 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:33 smithi162 bash[9856]: audit 2021-01-28T04:00:32.995858+0000 mon.b (mon.2) 41 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:34.267 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:33 smithi162 bash[9856]: audit 2021-01-28T04:00:33.351883+0000 mon.a (mon.0) 790 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32511-6", "pg_num": 4}]: dispatch 2021-01-28T04:00:34.399 INFO:tasks.workunit.client.0.smithi100.stdout:.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2021-01-28T04:00:34.400 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:29.780174+0000 mon.c [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2021-01-28T04:00:34.400 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:29.781005+0000 mon.c [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2021-01-28T04:00:34.401 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:29.781824+0000 mon.c [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2021-01-28T04:00:34.401 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:29.782625+0000 mon.c [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2021-01-28T04:00:34.402 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:29.783449+0000 mon.c [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2021-01-28T04:00:34.402 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:29.784303+0000 mon.c [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2021-01-28T04:00:34.402 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:29.785095+0000 mon.c [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2021-01-28T04:00:34.403 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:30.112422+0000 mon.a [INF] from='client.? 172.21.15.100:0/727307177' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32201-10"}]: dispatch 2021-01-28T04:00:34.403 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:30.112823+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2021-01-28T04:00:34.404 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:30.117844+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:34.404 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:30.123869+0000 mon.c [INF] from='client.? 172.21.15.100:0/1700367650' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32511-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:34.404 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:30.957354+0000 mon.a [INF] from='client.? 172.21.15.100:0/1719341281' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:34.405 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:30.958960+0000 mon.c [INF] from='client.? 172.21.15.100:0/988282123' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:34.406 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:30.962290+0000 mon.a [INF] from='client.? 172.21.15.100:0/727307177' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32201-10"}]: dispatch 2021-01-28T04:00:34.406 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:30.963396+0000 mon.a [INF] from='client.? 172.21.15.100:0/727307177' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32201-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:34.406 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:30.966103+0000 mon.a [INF] from='client.? 172.21.15.100:0/4062725283' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32256-10"}]: dispatch 2021-01-28T04:00:34.406 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:32.396597+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2021-01-28T04:00:35.107 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:32.409786+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32511-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:35.108 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:32.414272+0000 mon.c [INF] from='client.? 172.21.15.100:0/2261469346' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:35.109 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:32.563558+0000 mon.c [INF] from='client.? 172.21.15.100:0/1700367650' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32511-6", "pg_num": 4}]: dispatch 2021-01-28T04:00:35.109 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:32.879581+0000 mon.a [INF] from='client.? 172.21.15.100:0/4062725283' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32256-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:00:35.109 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:32.879819+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:35.109 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:32.879894+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:35.110 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:32.879957+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32171-15"}]': finished 2021-01-28T04:00:35.110 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:32.880046+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32465-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:00:35.110 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:32.881964+0000 mon.c [INF] from='client.? 172.21.15.100:0/2406390797' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32171-15"}]: dispatch 2021-01-28T04:00:35.111 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:32.882822+0000 mon.b [INF] from='client.? 172.21.15.100:0/380907029' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32465-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32465-7"}]: dispatch 2021-01-28T04:00:35.111 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:32.887488+0000 mon.a [INF] from='client.? 172.21.15.100:0/4062725283' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32256-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32256-10"}]: dispatch 2021-01-28T04:00:35.111 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:32.888051+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:35.111 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:32.893021+0000 mon.c [INF] from='client.? 172.21.15.100:0/988282123' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi100-32163-3", "field": "max_bytes", "val": "4096"}]: dispatch 2021-01-28T04:00:35.112 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:33.351883+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32511-6", "pg_num": 4}]: dispatch 2021-01-28T04:00:35.112 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:33.811022+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32171-15"}]: dispatch 2021-01-28T04:00:35.116 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:33.811424+0000 mon.a [INF] from='client.? ' entity='cli api_io: Running main() from gmock_main.cc 2021-01-28T04:00:35.117 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [==========] Running 23 tests from 2 test suites. 2021-01-28T04:00:35.117 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [----------] Global test environment set-up. 2021-01-28T04:00:35.117 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [----------] 13 tests from LibRadosIo 2021-01-28T04:00:35.118 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ RUN ] LibRadosIo.SimpleWrite 2021-01-28T04:00:35.118 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ OK ] LibRadosIo.SimpleWrite (1335 ms) 2021-01-28T04:00:35.118 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ RUN ] LibRadosIo.TooBig 2021-01-28T04:00:35.119 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ OK ] LibRadosIo.TooBig (0 ms) 2021-01-28T04:00:35.119 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ RUN ] LibRadosIo.ReadTimeout 2021-01-28T04:00:35.119 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: no timeout :/ 2021-01-28T04:00:35.119 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: no timeout :/ 2021-01-28T04:00:35.119 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: no timeout :/ 2021-01-28T04:00:35.120 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: no timeout :/ 2021-01-28T04:00:35.120 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: no timeout :/ 2021-01-28T04:00:35.120 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ OK ] LibRadosIo.ReadTimeout (44 ms) 2021-01-28T04:00:35.120 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ RUN ] LibRadosIo.RoundTrip 2021-01-28T04:00:35.121 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ OK ] LibRadosIo.RoundTrip (8 ms) 2021-01-28T04:00:35.121 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ RUN ] LibRadosIo.Checksum 2021-01-28T04:00:35.121 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ OK ] LibRadosIo.Checksum (5 ms) 2021-01-28T04:00:35.121 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2021-01-28T04:00:35.121 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ OK ] LibRadosIo.OverlappingWriteRoundTrip (8 ms) 2021-01-28T04:00:35.122 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ RUN ] LibRadosIo.WriteFullRoundTrip 2021-01-28T04:00:35.122 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ OK ] LibRadosIo.WriteFullRoundTrip (7 ms) 2021-01-28T04:00:35.122 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ RUN ] LibRadosIo.AppendRoundTrip 2021-01-28T04:00:35.122 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ OK ] LibRadosIo.AppendRoundTrip (9 ms) 2021-01-28T04:00:35.123 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ RUN ] LibRadosIo.TruncTest 2021-01-28T04:00:35.123 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ OK ] LibRadosIo.TruncTest (9 ms) 2021-01-28T04:00:35.123 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ RUN ] LibRadosIo.RemoveTest 2021-01-28T04:00:35.123 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ OK ] LibRadosIo.RemoveTest (6 ms) 2021-01-28T04:00:35.124 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ RUN ] LibRadosIo.XattrsRoundTrip 2021-01-28T04:00:35.124 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ OK ] LibRadosIo.XattrsRoundTrip (9 ms) 2021-01-28T04:00:35.124 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ RUN ] LibRadosIo.RmXattr 2021-01-28T04:00:35.124 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ OK ] LibRadosIo.RmXattr (20 ms) 2021-01-28T04:00:35.124 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ RUN ] LibRadosIo.XattrIter 2021-01-28T04:00:35.125 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ OK ] LibRadosIo.XattrIter (9 ms) 2021-01-28T04:00:35.125 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [----------] 13 tests from LibRadosIo (1469 ms total) 2021-01-28T04:00:35.125 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: 2021-01-28T04:00:35.125 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [----------] 10 tests from LibRadosIoEC 2021-01-28T04:00:35.125 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ RUN ] LibRadosIoEC.SimpleWrite 2021-01-28T04:00:35.126 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ OK ] LibRadosIoEC.SimpleWrite (2173 ms) 2021-01-28T04:00:35.126 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ RUN ] LibRadosIoEC.RoundTrip 2021-01-28T04:00:35.126 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ OK ] LibRadosIoEC.RoundTrip (7 ms) 2021-01-28T04:00:35.126 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2021-01-28T04:00:35.126 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ OK ] LibRadosIoEC.OverlappingWriteRoundTrip (7 ms) 2021-01-28T04:00:35.127 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ RUN ] LibRadosIoEC.WriteFullRoundTrip 2021-01-28T04:00:35.127 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ OK ] LibRadosIoEC.WriteFullRoundTrip (10 ms) 2021-01-28T04:00:35.127 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ RUN ] LibRadosIoEC.AppendRoundTrip 2021-01-28T04:00:35.127 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ OK ] LibRadosIoEC.AppendRoundTrip (66 ms) 2021-01-28T04:00:35.128 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ RUN ] LibRadosIoEC.TruncTest 2021-01-28T04:00:35.128 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ OK ] LibRadosIoEC.TruncTest (10 ms) 2021-01-28T04:00:35.128 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ RUN ] LibRadosIoEC.RemoveTest 2021-01-28T04:00:35.128 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ OK ] LibRadosIoEC.RemoveTest (6 ms) 2021-01-28T04:00:35.129 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ RUN ] LibRadosIoEC.XattrsRoundTrip 2021-01-28T04:00:35.129 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ OK ] LibRadosIoEC.XattrsRoundTrip (9 ms) 2021-01-28T04:00:35.129 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ RUN ] LibRadosIoEC.RmXattr 2021-01-28T04:00:35.129 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ OK ] LibRadosIoEC.RmXattr (20 ms) 2021-01-28T04:00:35.130 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ RUN ] LibRadosIoEC.XattrIter 2021-01-28T04:00:35.130 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ OK ] LibRadosIoEC.XattrIter (44 ms) 2021-01-28T04:00:35.131 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [----------] 10 tests from LibRadosIoEC (2353 ms total) 2021-01-28T04:00:35.131 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: 2021-01-28T04:00:35.131 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [----------] Global test environment tear-down 2021-01-28T04:00:35.132 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [==========] 23 tests from 2 test suites ran. (21703 ms tota delete_pools_parallel: process_1_[32691]: starting. 2021-01-28T04:00:35.133 INFO:tasks.workunit.client.0.smithi100.stdout: delete_pools_parallel: process_1_[32691]: creating pool ceph_test_rados_delete_pools_parallel.smithi100-32671 2021-01-28T04:00:35.133 INFO:tasks.workunit.client.0.smithi100.stdout: delete_pools_parallel: process_1_[32691]: created object 0... 2021-01-28T04:00:35.134 INFO:tasks.workunit.client.0.smithi100.stdout: delete_pools_parallel: process_1_[32691]: created object 25... 2021-01-28T04:00:35.134 INFO:tasks.workunit.client.0.smithi100.stdout: delete_pools_parallel: process_1_[32691]: created object 49... 2021-01-28T04:00:35.134 INFO:tasks.workunit.client.0.smithi100.stdout: delete_pools_parallel: process_1_[32691]: finishing. 2021-01-28T04:00:35.134 INFO:tasks.workunit.client.0.smithi100.stdout: delete_pools_parallel: process_1_[32691]: shutting down. 2021-01-28T04:00:35.135 INFO:tasks.workunit.client.0.smithi100.stdout: delete_pools_parallel: process_2_[32692]: starting. 2021-01-28T04:00:35.135 INFO:tasks.workunit.client.0.smithi100.stdout: delete_pools_parallel: process_2_[32692]: deleting pool ceph_test_rados_delete_pools_parallel.smithi100-32671 2021-01-28T04:00:35.135 INFO:tasks.workunit.client.0.smithi100.stdout: delete_pools_parallel: process_2_[32692]: shutting down. 2021-01-28T04:00:35.136 INFO:tasks.workunit.client.0.smithi100.stdout: delete_pools_parallel: ******************************* 2021-01-28T04:00:35.136 INFO:tasks.workunit.client.0.smithi100.stdout: delete_pools_parallel: process_3_[33426]: starting. 2021-01-28T04:00:35.136 INFO:tasks.workunit.client.0.smithi100.stdout: delete_pools_parallel: process_3_[33426]: creating pool ceph_test_rados_delete_pools_parallel.smithi100-32671 2021-01-28T04:00:35.137 INFO:tasks.workunit.client.0.smithi100.stdout: delete_pools_parallel: process_3_[33426]: created object 0... 2021-01-28T04:00:35.137 INFO:tasks.workunit.client.0.smithi100.stdout: delete_pools_parallel: process_3_[33426]: created object 25... 2021-01-28T04:00:35.137 INFO:tasks.workunit.client.0.smithi100.stdout: delete_pools_parallel: process_3_[33426]: created object 49... 2021-01-28T04:00:35.138 INFO:tasks.workunit.client.0.smithi100.stdout: delete_pools_parallel: process_3_[33426]: finishing. 2021-01-28T04:00:35.138 INFO:tasks.workunit.client.0.smithi100.stdout: delete_pools_parallel: process_3_[33426]: shutting down. 2021-01-28T04:00:35.138 INFO:tasks.workunit.client.0.smithi100.stdout: delete_pools_parallel: ******************************* 2021-01-28T04:00:35.138 INFO:tasks.workunit.client.0.smithi100.stdout: delete_pools_parallel: process_5_[33428]: starting. 2021-01-28T04:00:35.139 INFO:tasks.workunit.client.0.smithi100.stdout: delete_pools_parallel: process_5_[33428]: listing objects. 2021-01-28T04:00:35.139 INFO:tasks.workunit.client.0.smithi100.stdout: delete_pools_parallel: process_5_[33428]: listed object 0... 2021-01-28T04:00:35.139 INFO:tasks.workunit.client.0.smithi100.stdout: delete_pools_parallel: process_5_[33428]: listed object 25... 2021-01-28T04:00:35.140 INFO:tasks.workunit.client.0.smithi100.stdout: delete_pools_parallel: process_5_[33428]: saw 50 objects 2021-01-28T04:00:35.140 INFO:tasks.workunit.client.0.smithi100.stdout: delete_pools_parallel: process_5_[33428]: shutting down. 2021-01-28T04:00:35.140 INFO:tasks.workunit.client.0.smithi100.stdout: delete_pools_parallel: ******************************* 2021-01-28T04:00:35.140 INFO:tasks.workunit.client.0.smithi100.stdout: delete_pools_parallel: process_4_[33427]: starting. 2021-01-28T04:00:35.141 INFO:tasks.workunit.client.0.smithi100.stdout: delete_pools_parallel: process_4_[33427]: deleting pool ceph_test_rados_delete_pools_parallel.smithi100-32671 2021-01-28T04:00:35.141 INFO:tasks.workunit.client.0.smithi100.stdout: delete_pools_parallel: process_4_[33427]: shutting down. 2021-01-28T04:00:35.141 INFO:tasks.workunit.client.0.smithi100.stdout: delete_pools_parallel: ******************************* 2021-01-28T04:00:35.141 INFO:tasks.workunit.client.0.smithi100.stdout: delete_pools_parallel: ******************************* 2021-01-28T04:00:35.141 INFO:tasks.workunit.client.0.smithi100.stdout: delete_pools_parallel: ******* SUCCESS ********** 2021-01-28T04:00:35.142 INFO:tasks.workunit.client.0.smithi100.stdout:l) 2021-01-28T04:00:35.142 INFO:tasks.workunit.client.0.smithi100.stdout: api_io: [ PASSED ] 23 tests. 2021-01-28T04:00:35.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:35 smithi162 bash[9856]: cluster 2021-01-28T04:00:32.877443+0000 osd.0 (osd.0) 3 : cluster [DBG] 13.3 deep-scrub ok 2021-01-28T04:00:35.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:35 smithi162 bash[9856]: cluster 2021-01-28T04:00:33.509540+0000 mgr.y (mgr.14138) 499 : cluster [DBG] pgmap v364: 596 pgs: 33 creating+activating, 54 creating+peering, 60 unknown, 449 active+clean; 144 MiB data, 533 MiB used, 715 GiB / 715 GiB avail; 10 MiB/s rd, 31 MiB/s wr, 343 op/s 2021-01-28T04:00:35.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:35 smithi162 bash[9856]: audit 2021-01-28T04:00:33.811022+0000 mon.a (mon.0) 791 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32171-15"}]: dispatch 2021-01-28T04:00:35.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:35 smithi162 bash[9856]: audit 2021-01-28T04:00:33.811424+0000 mon.a (mon.0) 792 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi100-32163-3", "field": "max_bytes", "val": "4096"}]: dispatch 2021-01-28T04:00:35.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:35 smithi162 bash[9856]: audit 2021-01-28T04:00:33.812589+0000 mon.a (mon.0) 793 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32465-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32465-7"}]: dispatch 2021-01-28T04:00:35.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:35 smithi100 bash[9834]: cluster 2021-01-28T04:00:32.877443+0000 osd.0 (osd.0) 3 : cluster [DBG] 13.3 deep-scrub ok 2021-01-28T04:00:35.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:35 smithi100 bash[9834]: cluster 2021-01-28T04:00:33.509540+0000 mgr.y (mgr.14138) 499 : cluster [DBG] pgmap v364: 596 pgs: 33 creating+activating, 54 creating+peering, 60 unknown, 449 active+clean; 144 MiB data, 533 MiB used, 715 GiB / 715 GiB avail; 10 MiB/s rd, 31 MiB/s wr, 343 op/s 2021-01-28T04:00:35.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:35 smithi100 bash[9834]: audit 2021-01-28T04:00:33.811022+0000 mon.a (mon.0) 791 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32171-15"}]: dispatch 2021-01-28T04:00:35.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:35 smithi100 bash[9834]: audit 2021-01-28T04:00:33.811424+0000 mon.a (mon.0) 792 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi100-32163-3", "field": "max_bytes", "val": "4096"}]: dispatch 2021-01-28T04:00:35.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:35 smithi100 bash[9834]: audit 2021-01-28T04:00:33.812589+0000 mon.a (mon.0) 793 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32465-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32465-7"}]: dispatch 2021-01-28T04:00:35.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:35 smithi100 bash[13549]: cluster 2021-01-28T04:00:32.877443+0000 osd.0 (osd.0) 3 : cluster [DBG] 13.3 deep-scrub ok 2021-01-28T04:00:35.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:35 smithi100 bash[13549]: cluster 2021-01-28T04:00:33.509540+0000 mgr.y (mgr.14138) 499 : cluster [DBG] pgmap v364: 596 pgs: 33 creating+activating, 54 creating+peering, 60 unknown, 449 active+clean; 144 MiB data, 533 MiB used, 715 GiB / 715 GiB avail; 10 MiB/s rd, 31 MiB/s wr, 343 op/s 2021-01-28T04:00:35.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:35 smithi100 bash[13549]: audit 2021-01-28T04:00:33.811022+0000 mon.a (mon.0) 791 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32171-15"}]: dispatch 2021-01-28T04:00:35.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:35 smithi100 bash[13549]: audit 2021-01-28T04:00:33.811424+0000 mon.a (mon.0) 792 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi100-32163-3", "field": "max_bytes", "val": "4096"}]: dispatch 2021-01-28T04:00:35.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:35 smithi100 bash[13549]: audit 2021-01-28T04:00:33.812589+0000 mon.a (mon.0) 793 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32465-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32465-7"}]: dispatch 2021-01-28T04:00:36.115 INFO:tasks.workunit.client.0.smithi100.stdout:ent.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi100-32163-3", "field": "max_bytes", "val": "4096"}]: dispatch 2021-01-28T04:00:36.116 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:33.812589+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32465-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32465-7"}]: dispatch 2021-01-28T04:00:36.116 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:33.821106+0000 mon.a [INF] from='client.? 172.21.15.100:0/727307177' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32201-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32201-10"}]': finished 2021-01-28T04:00:36.116 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:34.252797+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:36.116 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:34.253881+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32511-6", "pg_num": 4}]': finished 2021-01-28T04:00:36.116 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:34.255114+0000 mon.c [INF] from='client.? 172.21.15.100:0/1700367650' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32511-4", "tierpool": "test-rados-api-smithi100-32511-6", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:00:36.117 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:34.256395+0000 mon.b [INF] from='client.? 172.21.15.100:0/1050750335' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32286-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:36.117 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:34.256706+0000 mon.c [INF] from='client.? 172.21.15.100:0/2261469346' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-4", "tierpool": "test-rados-api-smithi100-32332-4-cache"}]: dispatch 2021-01-28T04:00:36.117 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:34.398861+0000 client.admin [INF] threexx 2021-01-28T04:00:36.117 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:34.399516+0000 mon.b [INF] from='client.? 172.21.15.100:0/3981027325' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2021-01-28T04:00:36.118 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:35.089828+0000 mon.a [WRN] Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:00:36.118 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:35.101108+0000 mon.a [INF] from='client.? 172.21.15.100:0/2279206164' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32176-22"}]: dispatch 2021-01-28T04:00:36.118 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:35.101289+0000 mon.a [INF] from='client.? 172.21.15.100:0/2214300162' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32442-6"}]: dispatch 2021-01-28T04:00:36.118 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:35.103010+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32511-4", "tierpool": "test-rados-api-smithi100-32511-6", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:00:36.119 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:35.103196+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-4", "tierpool": "test-rados-api-smithi100-32332-4-cache"}]: dispatch 2021-01-28T04:00:36.119 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:35.103449+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32286-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:36.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:36 smithi162 bash[9856]: audit 2021-01-28T04:00:33.821106+0000 mon.a (mon.0) 794 : audit [INF] from='client.? 172.21.15.100:0/727307177' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32201-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32201-10"}]': finished 2021-01-28T04:00:36.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:36 smithi162 bash[9856]: cluster 2021-01-28T04:00:33.930311+0000 osd.6 (osd.6) 4 : cluster [DBG] 13.4 deep-scrub ok 2021-01-28T04:00:36.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:36 smithi162 bash[9856]: cluster 2021-01-28T04:00:33.952737+0000 osd.4 (osd.4) 4 : cluster [DBG] 13.6 deep-scrub ok 2021-01-28T04:00:36.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:36 smithi162 bash[9856]: audit 2021-01-28T04:00:33.997520+0000 mon.b (mon.2) 42 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:36.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:36 smithi162 bash[9856]: audit 2021-01-28T04:00:34.252797+0000 mon.a (mon.0) 795 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:36.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:36 smithi162 bash[9856]: audit 2021-01-28T04:00:34.253881+0000 mon.a (mon.0) 796 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32511-6", "pg_num": 4}]': finished 2021-01-28T04:00:36.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:36 smithi162 bash[9856]: audit 2021-01-28T04:00:34.255114+0000 mon.c (mon.1) 60 : audit [INF] from='client.? 172.21.15.100:0/1700367650' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32511-4", "tierpool": "test-rados-api-smithi100-32511-6", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:00:36.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:36 smithi162 bash[9856]: audit 2021-01-28T04:00:34.256395+0000 mon.b (mon.2) 43 : audit [INF] from='client.? 172.21.15.100:0/1050750335' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32286-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:36.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:36 smithi162 bash[9856]: audit 2021-01-28T04:00:34.256706+0000 mon.c (mon.1) 61 : audit [INF] from='client.? 172.21.15.100:0/2261469346' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-4", "tierpool": "test-rados-api-smithi100-32332-4-cache"}]: dispatch 2021-01-28T04:00:36.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:36 smithi162 bash[9856]: cluster 2021-01-28T04:00:34.398861+0000 client.admin (client.?) 0 : cluster [INF] threexx 2021-01-28T04:00:36.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:36 smithi162 bash[9856]: audit 2021-01-28T04:00:34.399516+0000 mon.b (mon.2) 44 : audit [INF] from='client.? 172.21.15.100:0/3981027325' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2021-01-28T04:00:36.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:36 smithi162 bash[9856]: audit 2021-01-28T04:00:34.999546+0000 mon.b (mon.2) 45 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:36.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:36 smithi162 bash[9856]: cluster 2021-01-28T04:00:35.089290+0000 mon.a (mon.0) 797 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2021-01-28T04:00:36.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:36 smithi162 bash[9856]: cluster 2021-01-28T04:00:35.089828+0000 mon.a (mon.0) 798 : cluster [WRN] Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:00:36.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:36 smithi162 bash[9856]: audit 2021-01-28T04:00:35.101108+0000 mon.a (mon.0) 799 : audit [INF] from='client.? 172.21.15.100:0/2279206164' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32176-22"}]: dispatch 2021-01-28T04:00:36.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:36 smithi162 bash[9856]: audit 2021-01-28T04:00:35.101289+0000 mon.a (mon.0) 800 : audit [INF] from='client.? 172.21.15.100:0/2214300162' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32442-6"}]: dispatch 2021-01-28T04:00:36.518 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:36 smithi162 bash[9856]: audit 2021-01-28T04:00:35.103010+0000 mon.a (mon.0) 801 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32511-4", "tierpool": "test-rados-api-smithi100-32511-6", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:00:36.518 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:36 smithi162 bash[9856]: audit 2021-01-28T04:00:35.103196+0000 mon.a (mon.0) 802 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-4", "tierpool": "test-rados-api-smithi100-32332-4-cache"}]: dispatch 2021-01-28T04:00:36.518 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:36 smithi162 bash[9856]: audit 2021-01-28T04:00:35.103449+0000 mon.a (mon.0) 803 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32286-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:36.518 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:36 smithi162 bash[9856]: audit 2021-01-28T04:00:35.107103+0000 mon.a (mon.0) 804 : audit [INF] from='client.? 172.21.15.100:0/4062725283' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32256-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32256-10"}]': finished 2021-01-28T04:00:36.519 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:36 smithi162 bash[9856]: audit 2021-01-28T04:00:35.107185+0000 mon.a (mon.0) 805 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32171-15"}]': finished 2021-01-28T04:00:36.519 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:36 smithi162 bash[9856]: audit 2021-01-28T04:00:35.107246+0000 mon.a (mon.0) 806 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi100-32163-3", "field": "max_bytes", "val": "4096"}]': finished 2021-01-28T04:00:36.519 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:36 smithi162 bash[9856]: audit 2021-01-28T04:00:35.113416+0000 mon.c (mon.1) 62 : audit [INF] from='client.? 172.21.15.100:0/3957013370' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:36.519 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:36 smithi162 bash[9856]: audit 2021-01-28T04:00:35.113957+0000 mon.c (mon.1) 63 : audit [INF] from='client.? 172.21.15.100:0/1646093421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:36.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:36 smithi162 bash[9856]: cluster 2021-01-28T04:00:35.510882+0000 mgr.y (mgr.14138) 500 : cluster [DBG] pgmap v367: 632 pgs: 15 creating+activating, 38 creating+peering, 126 unknown, 453 active+clean; 144 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 5.8 MiB/s rd, 31 MiB/s wr, 7 op/s 2021-01-28T04:00:36.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:36 smithi162 bash[9856]: cluster 2021-01-28T04:00:35.521323+0000 mon.a (mon.0) 807 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2021-01-28T04:00:36.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:36 smithi162 bash[9856]: audit 2021-01-28T04:00:35.521701+0000 mon.a (mon.0) 808 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2021-01-28T04:00:36.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:36 smithi162 bash[9856]: audit 2021-01-28T04:00:35.523172+0000 mon.a (mon.0) 809 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:36.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:36 smithi162 bash[9856]: audit 2021-01-28T04:00:35.526272+0000 mon.a (mon.0) 810 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:36.521 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:36 smithi162 bash[9856]: audit 2021-01-28T04:00:35.961940+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:00:36.521 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:36 smithi162 bash[9856]: audit 2021-01-28T04:00:35.962129+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:00:36.521 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:36 smithi162 bash[9856]: audit 2021-01-28T04:00:36.001589+0000 mon.b (mon.2) 46 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:36.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[9834]: audit 2021-01-28T04:00:33.821106+0000 mon.a (mon.0) 794 : audit [INF] from='client.? 172.21.15.100:0/727307177' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32201-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32201-10"}]': finished 2021-01-28T04:00:36.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[9834]: cluster 2021-01-28T04:00:33.930311+0000 osd.6 (osd.6) 4 : cluster [DBG] 13.4 deep-scrub ok 2021-01-28T04:00:36.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[9834]: cluster 2021-01-28T04:00:33.952737+0000 osd.4 (osd.4) 4 : cluster [DBG] 13.6 deep-scrub ok 2021-01-28T04:00:36.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[9834]: audit 2021-01-28T04:00:33.997520+0000 mon.b (mon.2) 42 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:36.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[9834]: audit 2021-01-28T04:00:34.252797+0000 mon.a (mon.0) 795 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:36.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[9834]: audit 2021-01-28T04:00:34.253881+0000 mon.a (mon.0) 796 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32511-6", "pg_num": 4}]': finished 2021-01-28T04:00:36.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[9834]: audit 2021-01-28T04:00:34.255114+0000 mon.c (mon.1) 60 : audit [INF] from='client.? 172.21.15.100:0/1700367650' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32511-4", "tierpool": "test-rados-api-smithi100-32511-6", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:00:36.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[9834]: audit 2021-01-28T04:00:34.256395+0000 mon.b (mon.2) 43 : audit [INF] from='client.? 172.21.15.100:0/1050750335' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32286-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:36.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[9834]: audit 2021-01-28T04:00:34.256706+0000 mon.c (mon.1) 61 : audit [INF] from='client.? 172.21.15.100:0/2261469346' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-4", "tierpool": "test-rados-api-smithi100-32332-4-cache"}]: dispatch 2021-01-28T04:00:36.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[9834]: cluster 2021-01-28T04:00:34.398861+0000 client.admin (client.?) 0 : cluster [INF] threexx 2021-01-28T04:00:36.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[9834]: audit 2021-01-28T04:00:34.399516+0000 mon.b (mon.2) 44 : audit [INF] from='client.? 172.21.15.100:0/3981027325' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2021-01-28T04:00:36.584 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[9834]: audit 2021-01-28T04:00:34.999546+0000 mon.b (mon.2) 45 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:36.584 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[9834]: cluster 2021-01-28T04:00:35.089290+0000 mon.a (mon.0) 797 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2021-01-28T04:00:36.584 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[9834]: cluster 2021-01-28T04:00:35.089828+0000 mon.a (mon.0) 798 : cluster [WRN] Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:00:36.585 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[9834]: audit 2021-01-28T04:00:35.101108+0000 mon.a (mon.0) 799 : audit [INF] from='client.? 172.21.15.100:0/2279206164' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32176-22"}]: dispatch 2021-01-28T04:00:36.585 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[9834]: audit 2021-01-28T04:00:35.101289+0000 mon.a (mon.0) 800 : audit [INF] from='client.? 172.21.15.100:0/2214300162' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32442-6"}]: dispatch 2021-01-28T04:00:36.586 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[9834]: audit 2021-01-28T04:00:35.103010+0000 mon.a (mon.0) 801 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32511-4", "tierpool": "test-rados-api-smithi100-32511-6", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:00:36.586 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[9834]: audit 2021-01-28T04:00:35.103196+0000 mon.a (mon.0) 802 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-4", "tierpool": "test-rados-api-smithi100-32332-4-cache"}]: dispatch 2021-01-28T04:00:36.586 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[9834]: audit 2021-01-28T04:00:35.103449+0000 mon.a (mon.0) 803 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32286-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:36.586 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[9834]: audit 2021-01-28T04:00:35.107103+0000 mon.a (mon.0) 804 : audit [INF] from='client.? 172.21.15.100:0/4062725283' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32256-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32256-10"}]': finished 2021-01-28T04:00:36.587 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[9834]: audit 2021-01-28T04:00:35.107185+0000 mon.a (mon.0) 805 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32171-15"}]': finished 2021-01-28T04:00:36.587 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[9834]: audit 2021-01-28T04:00:35.107246+0000 mon.a (mon.0) 806 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi100-32163-3", "field": "max_bytes", "val": "4096"}]': finished 2021-01-28T04:00:36.587 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[9834]: audit 2021-01-28T04:00:35.113416+0000 mon.c (mon.1) 62 : audit [INF] from='client.? 172.21.15.100:0/3957013370' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:36.587 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[9834]: audit 2021-01-28T04:00:35.113957+0000 mon.c (mon.1) 63 : audit [INF] from='client.? 172.21.15.100:0/1646093421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:36.588 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[9834]: cluster 2021-01-28T04:00:35.510882+0000 mgr.y (mgr.14138) 500 : cluster [DBG] pgmap v367: 632 pgs: 15 creating+activating, 38 creating+peering, 126 unknown, 453 active+clean; 144 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 5.8 MiB/s rd, 31 MiB/s wr, 7 op/s 2021-01-28T04:00:36.588 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[9834]: cluster 2021-01-28T04:00:35.521323+0000 mon.a (mon.0) 807 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2021-01-28T04:00:36.588 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[9834]: audit 2021-01-28T04:00:35.521701+0000 mon.a (mon.0) 808 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2021-01-28T04:00:36.589 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[9834]: audit 2021-01-28T04:00:35.523172+0000 mon.a (mon.0) 809 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:36.589 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[9834]: audit 2021-01-28T04:00:35.526272+0000 mon.a (mon.0) 810 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:36.589 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[9834]: audit 2021-01-28T04:00:35.961940+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:00:36.589 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[9834]: audit 2021-01-28T04:00:35.962129+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:00:36.589 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[9834]: audit 2021-01-28T04:00:36.001589+0000 mon.b (mon.2) 46 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:36.590 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[13549]: audit 2021-01-28T04:00:33.821106+0000 mon.a (mon.0) 794 : audit [INF] from='client.? 172.21.15.100:0/727307177' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32201-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32201-10"}]': finished 2021-01-28T04:00:36.590 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[13549]: cluster 2021-01-28T04:00:33.930311+0000 osd.6 (osd.6) 4 : cluster [DBG] 13.4 deep-scrub ok 2021-01-28T04:00:36.590 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[13549]: cluster 2021-01-28T04:00:33.952737+0000 osd.4 (osd.4) 4 : cluster [DBG] 13.6 deep-scrub ok 2021-01-28T04:00:36.590 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[13549]: audit 2021-01-28T04:00:33.997520+0000 mon.b (mon.2) 42 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:36.591 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[13549]: audit 2021-01-28T04:00:34.252797+0000 mon.a (mon.0) 795 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:36.591 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[13549]: audit 2021-01-28T04:00:34.253881+0000 mon.a (mon.0) 796 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32511-6", "pg_num": 4}]': finished 2021-01-28T04:00:36.591 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[13549]: audit 2021-01-28T04:00:34.255114+0000 mon.c (mon.1) 60 : audit [INF] from='client.? 172.21.15.100:0/1700367650' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32511-4", "tierpool": "test-rados-api-smithi100-32511-6", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:00:36.591 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[13549]: audit 2021-01-28T04:00:34.256395+0000 mon.b (mon.2) 43 : audit [INF] from='client.? 172.21.15.100:0/1050750335' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32286-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:36.592 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[13549]: audit 2021-01-28T04:00:34.256706+0000 mon.c (mon.1) 61 : audit [INF] from='client.? 172.21.15.100:0/2261469346' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-4", "tierpool": "test-rados-api-smithi100-32332-4-cache"}]: dispatch 2021-01-28T04:00:36.592 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[13549]: cluster 2021-01-28T04:00:34.398861+0000 client.admin (client.?) 0 : cluster [INF] threexx 2021-01-28T04:00:36.592 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[13549]: audit 2021-01-28T04:00:34.399516+0000 mon.b (mon.2) 44 : audit [INF] from='client.? 172.21.15.100:0/3981027325' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2021-01-28T04:00:36.592 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[13549]: audit 2021-01-28T04:00:34.999546+0000 mon.b (mon.2) 45 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:36.592 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[13549]: cluster 2021-01-28T04:00:35.089290+0000 mon.a (mon.0) 797 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2021-01-28T04:00:36.593 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[13549]: cluster 2021-01-28T04:00:35.089828+0000 mon.a (mon.0) 798 : cluster [WRN] Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:00:36.593 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[13549]: audit 2021-01-28T04:00:35.101108+0000 mon.a (mon.0) 799 : audit [INF] from='client.? 172.21.15.100:0/2279206164' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32176-22"}]: dispatch 2021-01-28T04:00:36.593 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[13549]: audit 2021-01-28T04:00:35.101289+0000 mon.a (mon.0) 800 : audit [INF] from='client.? 172.21.15.100:0/2214300162' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32442-6"}]: dispatch 2021-01-28T04:00:36.593 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[13549]: audit 2021-01-28T04:00:35.103010+0000 mon.a (mon.0) 801 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32511-4", "tierpool": "test-rados-api-smithi100-32511-6", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:00:36.598 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[13549]: audit 2021-01-28T04:00:35.103196+0000 mon.a (mon.0) 802 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-4", "tierpool": "test-rados-api-smithi100-32332-4-cache"}]: dispatch 2021-01-28T04:00:36.599 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[13549]: audit 2021-01-28T04:00:35.103449+0000 mon.a (mon.0) 803 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32286-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:36.599 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[13549]: audit 2021-01-28T04:00:35.107103+0000 mon.a (mon.0) 804 : audit [INF] from='client.? 172.21.15.100:0/4062725283' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32256-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32256-10"}]': finished 2021-01-28T04:00:36.600 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[13549]: audit 2021-01-28T04:00:35.107185+0000 mon.a (mon.0) 805 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32171-15"}]': finished 2021-01-28T04:00:36.600 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[13549]: audit 2021-01-28T04:00:35.107246+0000 mon.a (mon.0) 806 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi100-32163-3", "field": "max_bytes", "val": "4096"}]': finished 2021-01-28T04:00:36.601 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[13549]: audit 2021-01-28T04:00:35.113416+0000 mon.c (mon.1) 62 : audit [INF] from='client.? 172.21.15.100:0/3957013370' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:36.601 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[13549]: audit 2021-01-28T04:00:35.113957+0000 mon.c (mon.1) 63 : audit [INF] from='client.? 172.21.15.100:0/1646093421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:36.601 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[13549]: cluster 2021-01-28T04:00:35.510882+0000 mgr.y (mgr.14138) 500 : cluster [DBG] pgmap v367: 632 pgs: 15 creating+activating, 38 creating+peering, 126 unknown, 453 active+clean; 144 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 5.8 MiB/s rd, 31 MiB/s wr, 7 op/s 2021-01-28T04:00:36.601 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[13549]: cluster 2021-01-28T04:00:35.521323+0000 mon.a (mon.0) 807 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2021-01-28T04:00:36.602 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[13549]: audit 2021-01-28T04:00:35.521701+0000 mon.a (mon.0) 808 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2021-01-28T04:00:36.602 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[13549]: audit 2021-01-28T04:00:35.523172+0000 mon.a (mon.0) 809 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:36.602 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[13549]: audit 2021-01-28T04:00:35.526272+0000 mon.a (mon.0) 810 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:36.602 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[13549]: audit 2021-01-28T04:00:35.961940+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:00:36.603 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[13549]: audit 2021-01-28T04:00:35.962129+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:00:36.603 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:36 smithi100 bash[13549]: audit 2021-01-28T04:00:36.001589+0000 mon.b (mon.2) 46 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:37.139 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:35.107103+0000 mon.a [INF] from='client.? 172.21.15.100:0/4062725283' entity='client.admi api_stat: Running main() from gmock_main.cc 2021-01-28T04:00:37.140 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat: [==========] Running 8 tests from 2 test suites. 2021-01-28T04:00:37.140 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat: [----------] Global test environment set-up. 2021-01-28T04:00:37.140 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat: [----------] 4 tests from LibRadosStat 2021-01-28T04:00:37.141 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat: [ RUN ] LibRadosStat.Stat 2021-01-28T04:00:37.141 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat: [ OK ] LibRadosStat.Stat (276 ms) 2021-01-28T04:00:37.141 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat: [ RUN ] LibRadosStat.StatNS 2021-01-28T04:00:37.141 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat: [ OK ] LibRadosStat.StatNS (83 ms) 2021-01-28T04:00:37.141 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat: [ RUN ] LibRadosStat.ClusterStat 2021-01-28T04:00:37.142 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat: [ OK ] LibRadosStat.ClusterStat (189 ms) 2021-01-28T04:00:37.142 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat: [ RUN ] LibRadosStat.PoolStat 2021-01-28T04:00:37.142 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat: [ OK ] LibRadosStat.PoolStat (6 ms) 2021-01-28T04:00:37.142 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat: [----------] 4 tests from LibRadosStat (554 ms total) 2021-01-28T04:00:37.142 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat: 2021-01-28T04:00:37.143 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat: [----------] 4 tests from LibRadosStatEC 2021-01-28T04:00:37.143 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat: [ RUN ] LibRadosStatEC.Stat 2021-01-28T04:00:37.143 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat: [ OK ] LibRadosStatEC.Stat (703 ms) 2021-01-28T04:00:37.143 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat: [ RUN ] LibRadosStatEC.StatNS 2021-01-28T04:00:37.143 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat: [ OK ] LibRadosStatEC.StatNS (24 ms) 2021-01-28T04:00:37.144 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat: [ RUN ] LibRadosStatEC.ClusterStat 2021-01-28T04:00:37.144 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat: [ OK ] LibRadosStatEC.ClusterStat (314 ms) 2021-01-28T04:00:37.144 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat: [ RUN ] LibRadosStatEC.PoolStat 2021-01-28T04:00:37.144 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat: [ OK ] LibRadosStatEC.PoolStat (455 ms) 2021-01-28T04:00:37.144 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat: [----------] 4 tests from LibRadosStatEC (1496 ms total) 2021-01-28T04:00:37.145 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat: 2021-01-28T04:00:37.145 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat: [----------] Global test environment tear-down 2021-01-28T04:00:37.145 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat: [==========] 8 tests from 2 test suites ran. (23610 ms total) 2021-01-28T04:00:37.145 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat: [ PASSED ] 8 tests. 2021-01-28T04:00:37.151 INFO:tasks.workunit.client.0.smithi100.stdout: ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2021-01-28T04:00:37.151 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoECPP.OverlappingWriteRoundTripPP (8 ms) 2021-01-28T04:00:37.151 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2021-01-28T04:00:37.151 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP (9 ms) 2021-01-28T04:00:37.152 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2021-01-28T04:00:37.152 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP2 (6 ms) 2021-01-28T04:00:37.152 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.AppendRoundTripPP 2021-01-28T04:00:37.152 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoECPP.AppendRoundTripPP (9 ms) 2021-01-28T04:00:37.152 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.TruncTestPP 2021-01-28T04:00:37.153 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoECPP.TruncTestPP (7 ms) 2021-01-28T04:00:37.153 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RemoveTestPP 2021-01-28T04:00:37.153 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RemoveTestPP (5 ms) 2021-01-28T04:00:37.153 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2021-01-28T04:00:37.153 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrsRoundTripPP (6 ms) 2021-01-28T04:00:37.154 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RmXattrPP 2021-01-28T04:00:37.154 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RmXattrPP (17 ms) 2021-01-28T04:00:37.154 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrListPP 2021-01-28T04:00:37.154 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrListPP (7 ms) 2021-01-28T04:00:37.154 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtPP 2021-01-28T04:00:37.155 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtPP (11 ms) 2021-01-28T04:00:37.155 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtDNEPP 2021-01-28T04:00:37.155 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtDNEPP (5 ms) 2021-01-28T04:00:37.155 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2021-01-28T04:00:37.155 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtMismatchPP (8 ms) 2021-01-28T04:00:37.156 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP (862 ms total) 2021-01-28T04:00:37.156 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: 2021-01-28T04:00:37.156 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [----------] Global test environment tear-down 2021-01-28T04:00:37.156 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [==========] 37 tests from 2 test suites ran. (23734 ms total) 2021-01-28T04:00:37.156 INFO:tasks.workunit.client.0.smithi100.stdout: api_io_pp: [ PASSED ] 37 tests. 2021-01-28T04:00:37.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:37 smithi162 bash[9856]: cluster 2021-01-28T04:00:35.568188+0000 osd.7 (osd.7) 4 : cluster [DBG] 13.7 deep-scrub ok 2021-01-28T04:00:37.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:37 smithi162 bash[9856]: audit 2021-01-28T04:00:36.118809+0000 mon.a (mon.0) 813 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2021-01-28T04:00:37.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:37 smithi162 bash[9856]: cluster 2021-01-28T04:00:36.119901+0000 client.admin (client.?) 0 : cluster [INF] fourxx 2021-01-28T04:00:37.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:37 smithi162 bash[9856]: audit 2021-01-28T04:00:36.120691+0000 mon.b (mon.2) 47 : audit [INF] from='client.? 172.21.15.100:0/3981027325' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2021-01-28T04:00:37.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:37 smithi162 bash[9856]: audit 2021-01-28T04:00:36.120706+0000 mon.a (mon.0) 814 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2021-01-28T04:00:37.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:37 smithi162 bash[9856]: audit 2021-01-28T04:00:36.126763+0000 mon.a (mon.0) 815 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32465-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32465-7"}]': finished 2021-01-28T04:00:37.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:37 smithi162 bash[9856]: audit 2021-01-28T04:00:36.126989+0000 mon.a (mon.0) 816 : audit [INF] from='client.? 172.21.15.100:0/2279206164' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32176-22"}]': finished 2021-01-28T04:00:37.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:37 smithi162 bash[9856]: audit 2021-01-28T04:00:36.127100+0000 mon.a (mon.0) 817 : audit [INF] from='client.? 172.21.15.100:0/2214300162' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32442-6"}]': finished 2021-01-28T04:00:37.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:37 smithi162 bash[9856]: audit 2021-01-28T04:00:36.127292+0000 mon.a (mon.0) 818 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32511-4", "tierpool": "test-rados-api-smithi100-32511-6", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:00:37.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:37 smithi162 bash[9856]: audit 2021-01-28T04:00:36.127389+0000 mon.a (mon.0) 819 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-4", "tierpool": "test-rados-api-smithi100-32332-4-cache"}]': finished 2021-01-28T04:00:37.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:37 smithi162 bash[9856]: audit 2021-01-28T04:00:36.127487+0000 mon.a (mon.0) 820 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32286-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:37.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:37 smithi162 bash[9856]: audit 2021-01-28T04:00:36.127587+0000 mon.a (mon.0) 821 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:37.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:37 smithi162 bash[9856]: audit 2021-01-28T04:00:36.127689+0000 mon.a (mon.0) 822 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:37.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:37 smithi162 bash[9856]: cluster 2021-01-28T04:00:36.127860+0000 mon.a (mon.0) 823 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2021-01-28T04:00:37.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:37 smithi162 bash[9856]: audit 2021-01-28T04:00:36.131655+0000 mon.a (mon.0) 824 : audit [INF] from='client.? 172.21.15.100:0/2279206164' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32176-22"}]: dispatch 2021-01-28T04:00:37.518 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:37 smithi162 bash[9856]: audit 2021-01-28T04:00:36.131987+0000 mon.a (mon.0) 825 : audit [INF] from='client.? 172.21.15.100:0/2214300162' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32442-6"}]: dispatch 2021-01-28T04:00:37.518 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:37 smithi162 bash[9856]: audit 2021-01-28T04:00:36.133900+0000 mon.c (mon.1) 64 : audit [INF] from='client.? 172.21.15.100:0/1700367650' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32511-4", "overlaypool": "test-rados-api-smithi100-32511-6"}]: dispatch 2021-01-28T04:00:37.519 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:37 smithi162 bash[9856]: audit 2021-01-28T04:00:36.134385+0000 mon.c (mon.1) 65 : audit [INF] from='client.? 172.21.15.100:0/2261469346' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-4", "overlaypool": "test-rados-api-smithi100-32332-4-cache"}]: dispatch 2021-01-28T04:00:37.519 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:37 smithi162 bash[9856]: audit 2021-01-28T04:00:36.135997+0000 mon.a (mon.0) 826 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32511-4", "overlaypool": "test-rados-api-smithi100-32511-6"}]: dispatch 2021-01-28T04:00:37.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:37 smithi162 bash[9856]: audit 2021-01-28T04:00:36.136306+0000 mon.a (mon.0) 827 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-4", "overlaypool": "test-rados-api-smithi100-32332-4-cache"}]: dispatch 2021-01-28T04:00:37.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:37 smithi162 bash[9856]: audit 2021-01-28T04:00:36.140891+0000 mon.c (mon.1) 66 : audit [INF] from='client.? 172.21.15.100:0/2069985290' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:37.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:37 smithi162 bash[9856]: audit 2021-01-28T04:00:36.141759+0000 mon.a (mon.0) 828 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:37.521 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:37 smithi162 bash[9856]: audit 2021-01-28T04:00:36.241658+0000 mon.b (mon.2) 48 : audit [DBG] from='client.? 172.21.15.100:0/1050750335' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2021-01-28T04:00:37.521 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:37 smithi162 bash[9856]: audit 2021-01-28T04:00:36.242075+0000 mon.a (mon.0) 829 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32286-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:37.521 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:37 smithi162 bash[9856]: audit 2021-01-28T04:00:36.242730+0000 mon.b (mon.2) 49 : audit [INF] from='client.? 172.21.15.100:0/1050750335' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32286-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:37.522 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:37 smithi162 bash[9856]: audit 2021-01-28T04:00:37.003714+0000 mon.b (mon.2) 50 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:37.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[9834]: cluster 2021-01-28T04:00:35.568188+0000 osd.7 (osd.7) 4 : cluster [DBG] 13.7 deep-scrub ok 2021-01-28T04:00:37.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[9834]: audit 2021-01-28T04:00:36.118809+0000 mon.a (mon.0) 813 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2021-01-28T04:00:37.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[9834]: cluster 2021-01-28T04:00:36.119901+0000 client.admin (client.?) 0 : cluster [INF] fourxx 2021-01-28T04:00:37.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[9834]: audit 2021-01-28T04:00:36.120691+0000 mon.b (mon.2) 47 : audit [INF] from='client.? 172.21.15.100:0/3981027325' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2021-01-28T04:00:37.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[9834]: audit 2021-01-28T04:00:36.120706+0000 mon.a (mon.0) 814 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2021-01-28T04:00:37.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[9834]: audit 2021-01-28T04:00:36.126763+0000 mon.a (mon.0) 815 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32465-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32465-7"}]': finished 2021-01-28T04:00:37.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[9834]: audit 2021-01-28T04:00:36.126989+0000 mon.a (mon.0) 816 : audit [INF] from='client.? 172.21.15.100:0/2279206164' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32176-22"}]': finished 2021-01-28T04:00:37.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[9834]: audit 2021-01-28T04:00:36.127100+0000 mon.a (mon.0) 817 : audit [INF] from='client.? 172.21.15.100:0/2214300162' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32442-6"}]': finished 2021-01-28T04:00:37.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[9834]: audit 2021-01-28T04:00:36.127292+0000 mon.a (mon.0) 818 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32511-4", "tierpool": "test-rados-api-smithi100-32511-6", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:00:37.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[9834]: audit 2021-01-28T04:00:36.127389+0000 mon.a (mon.0) 819 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-4", "tierpool": "test-rados-api-smithi100-32332-4-cache"}]': finished 2021-01-28T04:00:37.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[9834]: audit 2021-01-28T04:00:36.127487+0000 mon.a (mon.0) 820 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32286-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:37.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[9834]: audit 2021-01-28T04:00:36.127587+0000 mon.a (mon.0) 821 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:37.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[9834]: audit 2021-01-28T04:00:36.127689+0000 mon.a (mon.0) 822 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:37.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[9834]: cluster 2021-01-28T04:00:36.127860+0000 mon.a (mon.0) 823 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2021-01-28T04:00:37.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[9834]: audit 2021-01-28T04:00:36.131655+0000 mon.a (mon.0) 824 : audit [INF] from='client.? 172.21.15.100:0/2279206164' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32176-22"}]: dispatch 2021-01-28T04:00:37.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[9834]: audit 2021-01-28T04:00:36.131987+0000 mon.a (mon.0) 825 : audit [INF] from='client.? 172.21.15.100:0/2214300162' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32442-6"}]: dispatch 2021-01-28T04:00:37.584 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[9834]: audit 2021-01-28T04:00:36.133900+0000 mon.c (mon.1) 64 : audit [INF] from='client.? 172.21.15.100:0/1700367650' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32511-4", "overlaypool": "test-rados-api-smithi100-32511-6"}]: dispatch 2021-01-28T04:00:37.584 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[9834]: audit 2021-01-28T04:00:36.134385+0000 mon.c (mon.1) 65 : audit [INF] from='client.? 172.21.15.100:0/2261469346' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-4", "overlaypool": "test-rados-api-smithi100-32332-4-cache"}]: dispatch 2021-01-28T04:00:37.584 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[9834]: audit 2021-01-28T04:00:36.135997+0000 mon.a (mon.0) 826 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32511-4", "overlaypool": "test-rados-api-smithi100-32511-6"}]: dispatch 2021-01-28T04:00:37.585 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[9834]: audit 2021-01-28T04:00:36.136306+0000 mon.a (mon.0) 827 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-4", "overlaypool": "test-rados-api-smithi100-32332-4-cache"}]: dispatch 2021-01-28T04:00:37.585 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[9834]: audit 2021-01-28T04:00:36.140891+0000 mon.c (mon.1) 66 : audit [INF] from='client.? 172.21.15.100:0/2069985290' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:37.586 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[9834]: audit 2021-01-28T04:00:36.141759+0000 mon.a (mon.0) 828 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:37.586 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[9834]: audit 2021-01-28T04:00:36.241658+0000 mon.b (mon.2) 48 : audit [DBG] from='client.? 172.21.15.100:0/1050750335' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2021-01-28T04:00:37.586 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[9834]: audit 2021-01-28T04:00:36.242075+0000 mon.a (mon.0) 829 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32286-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:37.587 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[9834]: audit 2021-01-28T04:00:36.242730+0000 mon.b (mon.2) 49 : audit [INF] from='client.? 172.21.15.100:0/1050750335' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32286-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:37.587 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[9834]: audit 2021-01-28T04:00:37.003714+0000 mon.b (mon.2) 50 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:37.587 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[13549]: cluster 2021-01-28T04:00:35.568188+0000 osd.7 (osd.7) 4 : cluster [DBG] 13.7 deep-scrub ok 2021-01-28T04:00:37.588 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[13549]: audit 2021-01-28T04:00:36.118809+0000 mon.a (mon.0) 813 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2021-01-28T04:00:37.588 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[13549]: cluster 2021-01-28T04:00:36.119901+0000 client.admin (client.?) 0 : cluster [INF] fourxx 2021-01-28T04:00:37.588 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[13549]: audit 2021-01-28T04:00:36.120691+0000 mon.b (mon.2) 47 : audit [INF] from='client.? 172.21.15.100:0/3981027325' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2021-01-28T04:00:37.589 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[13549]: audit 2021-01-28T04:00:36.120706+0000 mon.a (mon.0) 814 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2021-01-28T04:00:37.589 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[13549]: audit 2021-01-28T04:00:36.126763+0000 mon.a (mon.0) 815 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32465-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32465-7"}]': finished 2021-01-28T04:00:37.589 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[13549]: audit 2021-01-28T04:00:36.126989+0000 mon.a (mon.0) 816 : audit [INF] from='client.? 172.21.15.100:0/2279206164' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32176-22"}]': finished 2021-01-28T04:00:37.589 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[13549]: audit 2021-01-28T04:00:36.127100+0000 mon.a (mon.0) 817 : audit [INF] from='client.? 172.21.15.100:0/2214300162' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32442-6"}]': finished 2021-01-28T04:00:37.590 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[13549]: audit 2021-01-28T04:00:36.127292+0000 mon.a (mon.0) 818 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32511-4", "tierpool": "test-rados-api-smithi100-32511-6", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:00:37.590 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[13549]: audit 2021-01-28T04:00:36.127389+0000 mon.a (mon.0) 819 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-4", "tierpool": "test-rados-api-smithi100-32332-4-cache"}]': finished 2021-01-28T04:00:37.590 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[13549]: audit 2021-01-28T04:00:36.127487+0000 mon.a (mon.0) 820 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32286-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:37.591 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[13549]: audit 2021-01-28T04:00:36.127587+0000 mon.a (mon.0) 821 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:37.591 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[13549]: audit 2021-01-28T04:00:36.127689+0000 mon.a (mon.0) 822 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:37.591 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[13549]: cluster 2021-01-28T04:00:36.127860+0000 mon.a (mon.0) 823 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2021-01-28T04:00:37.592 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[13549]: audit 2021-01-28T04:00:36.131655+0000 mon.a (mon.0) 824 : audit [INF] from='client.? 172.21.15.100:0/2279206164' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32176-22"}]: dispatch 2021-01-28T04:00:37.592 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[13549]: audit 2021-01-28T04:00:36.131987+0000 mon.a (mon.0) 825 : audit [INF] from='client.? 172.21.15.100:0/2214300162' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32442-6"}]: dispatch 2021-01-28T04:00:37.592 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[13549]: audit 2021-01-28T04:00:36.133900+0000 mon.c (mon.1) 64 : audit [INF] from='client.? 172.21.15.100:0/1700367650' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32511-4", "overlaypool": "test-rados-api-smithi100-32511-6"}]: dispatch 2021-01-28T04:00:37.592 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[13549]: audit 2021-01-28T04:00:36.134385+0000 mon.c (mon.1) 65 : audit [INF] from='client.? 172.21.15.100:0/2261469346' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-4", "overlaypool": "test-rados-api-smithi100-32332-4-cache"}]: dispatch 2021-01-28T04:00:37.593 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[13549]: audit 2021-01-28T04:00:36.135997+0000 mon.a (mon.0) 826 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32511-4", "overlaypool": "test-rados-api-smithi100-32511-6"}]: dispatch 2021-01-28T04:00:37.593 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[13549]: audit 2021-01-28T04:00:36.136306+0000 mon.a (mon.0) 827 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-4", "overlaypool": "test-rados-api-smithi100-32332-4-cache"}]: dispatch 2021-01-28T04:00:37.594 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[13549]: audit 2021-01-28T04:00:36.140891+0000 mon.c (mon.1) 66 : audit [INF] from='client.? 172.21.15.100:0/2069985290' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:37.594 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[13549]: audit 2021-01-28T04:00:36.141759+0000 mon.a (mon.0) 828 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:37.594 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[13549]: audit 2021-01-28T04:00:36.241658+0000 mon.b (mon.2) 48 : audit [DBG] from='client.? 172.21.15.100:0/1050750335' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2021-01-28T04:00:37.594 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[13549]: audit 2021-01-28T04:00:36.242075+0000 mon.a (mon.0) 829 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32286-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:37.595 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[13549]: audit 2021-01-28T04:00:36.242730+0000 mon.b (mon.2) 49 : audit [INF] from='client.? 172.21.15.100:0/1050750335' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32286-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:37.595 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:37 smithi100 bash[13549]: audit 2021-01-28T04:00:37.003714+0000 mon.b (mon.2) 50 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:38.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[9834]: audit 2021-01-28T04:00:37.122169+0000 mon.a (mon.0) 830 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2021-01-28T04:00:38.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[9834]: audit 2021-01-28T04:00:37.131915+0000 mon.a (mon.0) 831 : audit [INF] from='client.? 172.21.15.100:0/2279206164' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32176-22"}]': finished 2021-01-28T04:00:38.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[9834]: audit 2021-01-28T04:00:37.131999+0000 mon.a (mon.0) 832 : audit [INF] from='client.? 172.21.15.100:0/2214300162' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32442-6"}]': finished 2021-01-28T04:00:38.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[9834]: audit 2021-01-28T04:00:37.132118+0000 mon.a (mon.0) 833 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32511-4", "overlaypool": "test-rados-api-smithi100-32511-6"}]': finished 2021-01-28T04:00:38.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[9834]: audit 2021-01-28T04:00:37.132207+0000 mon.a (mon.0) 834 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-4", "overlaypool": "test-rados-api-smithi100-32332-4-cache"}]': finished 2021-01-28T04:00:38.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[9834]: audit 2021-01-28T04:00:37.132317+0000 mon.a (mon.0) 835 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:38.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[9834]: audit 2021-01-28T04:00:37.132656+0000 mon.a (mon.0) 836 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32286-1","app": "app1","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:38.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[9834]: cluster 2021-01-28T04:00:37.132810+0000 mon.a (mon.0) 837 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2021-01-28T04:00:38.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[9834]: audit 2021-01-28T04:00:37.135245+0000 mon.c (mon.1) 67 : audit [INF] from='client.? 172.21.15.100:0/2261469346' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-4-cache", "mode": "writeback"}]: dispatch 2021-01-28T04:00:38.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[9834]: audit 2021-01-28T04:00:37.136531+0000 mon.c (mon.1) 68 : audit [INF] from='client.? 172.21.15.100:0/1700367650' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32511-6", "mode": "writeback"}]: dispatch 2021-01-28T04:00:38.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[9834]: audit 2021-01-28T04:00:37.140970+0000 mon.a (mon.0) 838 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-4-cache", "mode": "writeback"}]: dispatch 2021-01-28T04:00:38.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[9834]: audit 2021-01-28T04:00:37.141284+0000 mon.b (mon.2) 51 : audit [INF] from='client.? 172.21.15.100:0/1050750335' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32286-1","app": "app2"}]: dispatch 2021-01-28T04:00:38.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[9834]: audit 2021-01-28T04:00:37.141568+0000 mon.a (mon.0) 839 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32511-6", "mode": "writeback"}]: dispatch 2021-01-28T04:00:38.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[9834]: audit 2021-01-28T04:00:37.142284+0000 mon.a (mon.0) 840 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32286-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:38.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[9834]: audit 2021-01-28T04:00:37.142607+0000 mon.b (mon.2) 52 : audit [INF] from='client.? 172.21.15.100:0/1050750335' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32286-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:38.832 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[9834]: audit 2021-01-28T04:00:37.202468+0000 mon.a (mon.0) 841 : audit [INF] from='client.? 172.21.15.100:0/2118431073' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32492-12"}]: dispatch 2021-01-28T04:00:38.832 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[9834]: cluster 2021-01-28T04:00:37.512594+0000 mgr.y (mgr.14138) 501 : cluster [DBG] pgmap v370: 576 pgs: 9 creating+activating, 25 creating+peering, 69 unknown, 473 active+clean; 144 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 op/s 2021-01-28T04:00:38.832 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[9834]: cluster 2021-01-28T04:00:37.642768+0000 mon.a (mon.0) 842 : cluster [WRN] Health check failed: 2 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:00:38.832 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[9834]: audit 2021-01-28T04:00:37.654426+0000 mon.a (mon.0) 843 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-4-cache", "mode": "writeback"}]': finished 2021-01-28T04:00:38.832 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[9834]: audit 2021-01-28T04:00:37.654524+0000 mon.a (mon.0) 844 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32511-6", "mode": "writeback"}]': finished 2021-01-28T04:00:38.833 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[9834]: audit 2021-01-28T04:00:37.654638+0000 mon.a (mon.0) 845 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32286-1","app": "app2","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:38.833 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[9834]: audit 2021-01-28T04:00:37.670192+0000 mon.b (mon.2) 53 : audit [INF] from='client.? 172.21.15.100:0/1050750335' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32286-1","app":"dne","key":"key","value":"value"}]: dispatch 2021-01-28T04:00:38.833 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[9834]: audit 2021-01-28T04:00:37.671874+0000 mon.b (mon.2) 54 : audit [INF] from='client.? 172.21.15.100:0/1050750335' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32286-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-01-28T04:00:38.834 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[9834]: audit 2021-01-28T04:00:37.712986+0000 mon.c (mon.1) 69 : audit [INF] from='client.? 172.21.15.100:0/2261469346' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-4"}]: dispatch 2021-01-28T04:00:38.834 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[9834]: audit 2021-01-28T04:00:38.005853+0000 mon.b (mon.2) 55 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:38.834 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[9834]: cluster 2021-01-28T04:00:38.095351+0000 mon.a (mon.0) 846 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2021-01-28T04:00:38.834 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[9834]: audit 2021-01-28T04:00:38.097351+0000 mon.a (mon.0) 847 : audit [INF] from='client.? 172.21.15.100:0/2118431073' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32492-12"}]: dispatch 2021-01-28T04:00:38.835 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[9834]: audit 2021-01-28T04:00:38.102538+0000 mon.a (mon.0) 848 : audit [INF] from='client.? 172.21.15.100:0/2118431073' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32492-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:38.835 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[9834]: audit 2021-01-28T04:00:38.102871+0000 mon.a (mon.0) 849 : audit [INF] from='client.? 172.21.15.100:0/3797669259' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:38.835 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[13549]: audit 2021-01-28T04:00:37.122169+0000 mon.a (mon.0) 830 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2021-01-28T04:00:38.835 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[13549]: audit 2021-01-28T04:00:37.131915+0000 mon.a (mon.0) 831 : audit [INF] from='client.? 172.21.15.100:0/2279206164' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32176-22"}]': finished 2021-01-28T04:00:38.836 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[13549]: audit 2021-01-28T04:00:37.131999+0000 mon.a (mon.0) 832 : audit [INF] from='client.? 172.21.15.100:0/2214300162' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32442-6"}]': finished 2021-01-28T04:00:38.836 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[13549]: audit 2021-01-28T04:00:37.132118+0000 mon.a (mon.0) 833 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32511-4", "overlaypool": "test-rados-api-smithi100-32511-6"}]': finished 2021-01-28T04:00:38.836 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[13549]: audit 2021-01-28T04:00:37.132207+0000 mon.a (mon.0) 834 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-4", "overlaypool": "test-rados-api-smithi100-32332-4-cache"}]': finished 2021-01-28T04:00:38.836 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[13549]: audit 2021-01-28T04:00:37.132317+0000 mon.a (mon.0) 835 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:38.837 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[13549]: audit 2021-01-28T04:00:37.132656+0000 mon.a (mon.0) 836 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32286-1","app": "app1","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:38.837 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[13549]: cluster 2021-01-28T04:00:37.132810+0000 mon.a (mon.0) 837 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2021-01-28T04:00:38.837 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[13549]: audit 2021-01-28T04:00:37.135245+0000 mon.c (mon.1) 67 : audit [INF] from='client.? 172.21.15.100:0/2261469346' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-4-cache", "mode": "writeback"}]: dispatch 2021-01-28T04:00:38.837 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[13549]: audit 2021-01-28T04:00:37.136531+0000 mon.c (mon.1) 68 : audit [INF] from='client.? 172.21.15.100:0/1700367650' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32511-6", "mode": "writeback"}]: dispatch 2021-01-28T04:00:38.837 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[13549]: audit 2021-01-28T04:00:37.140970+0000 mon.a (mon.0) 838 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-4-cache", "mode": "writeback"}]: dispatch 2021-01-28T04:00:38.838 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[13549]: audit 2021-01-28T04:00:37.141284+0000 mon.b (mon.2) 51 : audit [INF] from='client.? 172.21.15.100:0/1050750335' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32286-1","app": "app2"}]: dispatch 2021-01-28T04:00:38.838 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[13549]: audit 2021-01-28T04:00:37.141568+0000 mon.a (mon.0) 839 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32511-6", "mode": "writeback"}]: dispatch 2021-01-28T04:00:38.838 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[13549]: audit 2021-01-28T04:00:37.142284+0000 mon.a (mon.0) 840 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32286-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:38.838 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[13549]: audit 2021-01-28T04:00:37.142607+0000 mon.b (mon.2) 52 : audit [INF] from='client.? 172.21.15.100:0/1050750335' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32286-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:38.838 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[13549]: audit 2021-01-28T04:00:37.202468+0000 mon.a (mon.0) 841 : audit [INF] from='client.? 172.21.15.100:0/2118431073' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32492-12"}]: dispatch 2021-01-28T04:00:38.839 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[13549]: cluster 2021-01-28T04:00:37.512594+0000 mgr.y (mgr.14138) 501 : cluster [DBG] pgmap v370: 576 pgs: 9 creating+activating, 25 creating+peering, 69 unknown, 473 active+clean; 144 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 op/s 2021-01-28T04:00:38.839 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[13549]: cluster 2021-01-28T04:00:37.642768+0000 mon.a (mon.0) 842 : cluster [WRN] Health check failed: 2 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:00:38.839 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[13549]: audit 2021-01-28T04:00:37.654426+0000 mon.a (mon.0) 843 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-4-cache", "mode": "writeback"}]': finished 2021-01-28T04:00:38.839 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[13549]: audit 2021-01-28T04:00:37.654524+0000 mon.a (mon.0) 844 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32511-6", "mode": "writeback"}]': finished 2021-01-28T04:00:38.840 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[13549]: audit 2021-01-28T04:00:37.654638+0000 mon.a (mon.0) 845 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32286-1","app": "app2","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:38.840 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[13549]: audit 2021-01-28T04:00:37.670192+0000 mon.b (mon.2) 53 : audit [INF] from='client.? 172.21.15.100:0/1050750335' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32286-1","app":"dne","key":"key","value":"value"}]: dispatch 2021-01-28T04:00:38.840 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[13549]: audit 2021-01-28T04:00:37.671874+0000 mon.b (mon.2) 54 : audit [INF] from='client.? 172.21.15.100:0/1050750335' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32286-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-01-28T04:00:38.840 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[13549]: audit 2021-01-28T04:00:37.712986+0000 mon.c (mon.1) 69 : audit [INF] from='client.? 172.21.15.100:0/2261469346' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-4"}]: dispatch 2021-01-28T04:00:38.841 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[13549]: audit 2021-01-28T04:00:38.005853+0000 mon.b (mon.2) 55 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:38.841 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[13549]: cluster 2021-01-28T04:00:38.095351+0000 mon.a (mon.0) 846 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2021-01-28T04:00:38.841 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[13549]: audit 2021-01-28T04:00:38.097351+0000 mon.a (mon.0) 847 : audit [INF] from='client.? 172.21.15.100:0/2118431073' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32492-12"}]: dispatch 2021-01-28T04:00:38.841 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[13549]: audit 2021-01-28T04:00:38.102538+0000 mon.a (mon.0) 848 : audit [INF] from='client.? 172.21.15.100:0/2118431073' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32492-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:38.842 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:38 smithi100 bash[13549]: audit 2021-01-28T04:00:38.102871+0000 mon.a (mon.0) 849 : audit [INF] from='client.? 172.21.15.100:0/3797669259' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:39.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:38 smithi162 bash[9856]: audit 2021-01-28T04:00:37.122169+0000 mon.a (mon.0) 830 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2021-01-28T04:00:39.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:38 smithi162 bash[9856]: audit 2021-01-28T04:00:37.131915+0000 mon.a (mon.0) 831 : audit [INF] from='client.? 172.21.15.100:0/2279206164' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32176-22"}]': finished 2021-01-28T04:00:39.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:38 smithi162 bash[9856]: audit 2021-01-28T04:00:37.131999+0000 mon.a (mon.0) 832 : audit [INF] from='client.? 172.21.15.100:0/2214300162' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32442-6"}]': finished 2021-01-28T04:00:39.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:38 smithi162 bash[9856]: audit 2021-01-28T04:00:37.132118+0000 mon.a (mon.0) 833 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32511-4", "overlaypool": "test-rados-api-smithi100-32511-6"}]': finished 2021-01-28T04:00:39.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:38 smithi162 bash[9856]: audit 2021-01-28T04:00:37.132207+0000 mon.a (mon.0) 834 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-4", "overlaypool": "test-rados-api-smithi100-32332-4-cache"}]': finished 2021-01-28T04:00:39.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:38 smithi162 bash[9856]: audit 2021-01-28T04:00:37.132317+0000 mon.a (mon.0) 835 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:39.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:38 smithi162 bash[9856]: audit 2021-01-28T04:00:37.132656+0000 mon.a (mon.0) 836 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32286-1","app": "app1","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:39.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:38 smithi162 bash[9856]: cluster 2021-01-28T04:00:37.132810+0000 mon.a (mon.0) 837 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2021-01-28T04:00:39.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:38 smithi162 bash[9856]: audit 2021-01-28T04:00:37.135245+0000 mon.c (mon.1) 67 : audit [INF] from='client.? 172.21.15.100:0/2261469346' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-4-cache", "mode": "writeback"}]: dispatch 2021-01-28T04:00:39.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:38 smithi162 bash[9856]: audit 2021-01-28T04:00:37.136531+0000 mon.c (mon.1) 68 : audit [INF] from='client.? 172.21.15.100:0/1700367650' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32511-6", "mode": "writeback"}]: dispatch 2021-01-28T04:00:39.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:38 smithi162 bash[9856]: audit 2021-01-28T04:00:37.140970+0000 mon.a (mon.0) 838 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-4-cache", "mode": "writeback"}]: dispatch 2021-01-28T04:00:39.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:38 smithi162 bash[9856]: audit 2021-01-28T04:00:37.141284+0000 mon.b (mon.2) 51 : audit [INF] from='client.? 172.21.15.100:0/1050750335' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32286-1","app": "app2"}]: dispatch 2021-01-28T04:00:39.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:38 smithi162 bash[9856]: audit 2021-01-28T04:00:37.141568+0000 mon.a (mon.0) 839 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32511-6", "mode": "writeback"}]: dispatch 2021-01-28T04:00:39.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:38 smithi162 bash[9856]: audit 2021-01-28T04:00:37.142284+0000 mon.a (mon.0) 840 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32286-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:39.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:38 smithi162 bash[9856]: audit 2021-01-28T04:00:37.142607+0000 mon.b (mon.2) 52 : audit [INF] from='client.? 172.21.15.100:0/1050750335' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32286-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:39.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:38 smithi162 bash[9856]: audit 2021-01-28T04:00:37.202468+0000 mon.a (mon.0) 841 : audit [INF] from='client.? 172.21.15.100:0/2118431073' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32492-12"}]: dispatch 2021-01-28T04:00:39.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:38 smithi162 bash[9856]: cluster 2021-01-28T04:00:37.512594+0000 mgr.y (mgr.14138) 501 : cluster [DBG] pgmap v370: 576 pgs: 9 creating+activating, 25 creating+peering, 69 unknown, 473 active+clean; 144 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 op/s 2021-01-28T04:00:39.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:38 smithi162 bash[9856]: cluster 2021-01-28T04:00:37.642768+0000 mon.a (mon.0) 842 : cluster [WRN] Health check failed: 2 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:00:39.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:38 smithi162 bash[9856]: audit 2021-01-28T04:00:37.654426+0000 mon.a (mon.0) 843 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-4-cache", "mode": "writeback"}]': finished 2021-01-28T04:00:39.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:38 smithi162 bash[9856]: audit 2021-01-28T04:00:37.654524+0000 mon.a (mon.0) 844 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32511-6", "mode": "writeback"}]': finished 2021-01-28T04:00:39.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:38 smithi162 bash[9856]: audit 2021-01-28T04:00:37.654638+0000 mon.a (mon.0) 845 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32286-1","app": "app2","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:39.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:38 smithi162 bash[9856]: audit 2021-01-28T04:00:37.670192+0000 mon.b (mon.2) 53 : audit [INF] from='client.? 172.21.15.100:0/1050750335' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32286-1","app":"dne","key":"key","value":"value"}]: dispatch 2021-01-28T04:00:39.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:38 smithi162 bash[9856]: audit 2021-01-28T04:00:37.671874+0000 mon.b (mon.2) 54 : audit [INF] from='client.? 172.21.15.100:0/1050750335' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32286-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-01-28T04:00:39.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:38 smithi162 bash[9856]: audit 2021-01-28T04:00:37.712986+0000 mon.c (mon.1) 69 : audit [INF] from='client.? 172.21.15.100:0/2261469346' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-4"}]: dispatch 2021-01-28T04:00:39.018 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:38 smithi162 bash[9856]: audit 2021-01-28T04:00:38.005853+0000 mon.b (mon.2) 55 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:39.018 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:38 smithi162 bash[9856]: cluster 2021-01-28T04:00:38.095351+0000 mon.a (mon.0) 846 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2021-01-28T04:00:39.018 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:38 smithi162 bash[9856]: audit 2021-01-28T04:00:38.097351+0000 mon.a (mon.0) 847 : audit [INF] from='client.? 172.21.15.100:0/2118431073' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32492-12"}]: dispatch 2021-01-28T04:00:39.018 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:38 smithi162 bash[9856]: audit 2021-01-28T04:00:38.102538+0000 mon.a (mon.0) 848 : audit [INF] from='client.? 172.21.15.100:0/2118431073' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32492-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:39.019 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:38 smithi162 bash[9856]: audit 2021-01-28T04:00:38.102871+0000 mon.a (mon.0) 849 : audit [INF] from='client.? 172.21.15.100:0/3797669259' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:39.128 INFO:tasks.workunit.client.0.smithi100.stdout:n' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32256-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32256-10"}]': finished 2021-01-28T04:00:39.128 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:35.107185+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32171-15"}]': finished 2021-01-28T04:00:39.128 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:35.107246+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "test-rados-api-smithi100-32163-3", "field": "max_bytes", "val": "4096"}]': finished 2021-01-28T04:00:39.128 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:35.113416+0000 mon.c [INF] from='client.? 172.21.15.100:0/3957013370' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:39.129 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:35.113957+0000 mon.c [INF] from='client.? 172.21.15.100:0/1646093421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:39.129 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:35.521701+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2021-01-28T04:00:39.129 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:35.523172+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:39.129 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:35.526272+0000 mon.a [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:39.130 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:35.961940+0000 mon.a [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:00:39.130 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: got: 2021-01-28T04:00:35.962129+0000 mon.a [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:00:39.130 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: [ OK ] LibRadosCmd.WatchLog (10379 ms) 2021-01-28T04:00:39.130 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: [----------] 4 tests from LibRadosCmd (25552 ms total) 2021-01-28T04:00:39.130 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: 2021-01-28T04:00:39.131 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: [----------] Global test environment tear-down 2021-01-28T04:00:39.131 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: [==========] 4 tests from 1 test suite ran. (25552 ms total) 2021-01-28T04:00:39.131 INFO:tasks.workunit.client.0.smithi100.stdout: api_cmd: [ PASSED ] 4 tests. 2021-01-28T04:00:39.450 INFO:tasks.workunit.client.0.smithi100.stdout: api_service: [==========] Running 3 tests from 1 test suite. 2021-01-28T04:00:39.451 INFO:tasks.workunit.client.0.smithi100.stdout: api_service: [----------] Global test environment set-up. 2021-01-28T04:00:39.451 INFO:tasks.workunit.client.0.smithi100.stdout: api_service: [----------] 3 tests from LibRadosService 2021-01-28T04:00:39.451 INFO:tasks.workunit.client.0.smithi100.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2021-01-28T04:00:39.451 INFO:tasks.workunit.client.0.smithi100.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5026 ms) 2021-01-28T04:00:39.452 INFO:tasks.workunit.client.0.smithi100.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2021-01-28T04:00:39.452 INFO:tasks.workunit.client.0.smithi100.stdout: api_service: [ OK ] LibRadosService.RegisterLate (42 ms) 2021-01-28T04:00:39.452 INFO:tasks.workunit.client.0.smithi100.stdout: api_service: [ RUN ] LibRadosService.Status 2021-01-28T04:00:39.452 INFO:tasks.workunit.client.0.smithi100.stdout: api_service: [ OK ] LibRadosService.Status (20793 ms) 2021-01-28T04:00:39.452 INFO:tasks.workunit.client.0.smithi100.stdout: api_service: [----------] 3 tests from LibRadosService (25861 ms total) 2021-01-28T04:00:39.453 INFO:tasks.workunit.client.0.smithi100.stdout: api_service: 2021-01-28T04:00:39.453 INFO:tasks.workunit.client.0.smithi100.stdout: api_service: [----------] Global test environment tear-down 2021-01-28T04:00:39.453 INFO:tasks.workunit.client.0.smithi100.stdout: api_service: [==========] 3 tests from 1 test suite ran. (25861 ms total) 2021-01-28T04:00:39.453 INFO:tasks.workunit.client.0.smithi100.stdout: api_service: [ PASSED ] 3 tests. 2021-01-28T04:00:39.827 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[10061]: debug 2021-01-28T04:00:39.703+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:00:39.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[13549]: cluster 2021-01-28T04:00:37.926014+0000 osd.5 (osd.5) 4 : cluster [DBG] 13.9 deep-scrub ok 2021-01-28T04:00:39.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[13549]: audit 2021-01-28T04:00:38.542684+0000 mon.a (mon.0) 850 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32286-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-01-28T04:00:39.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[13549]: audit 2021-01-28T04:00:38.559900+0000 mon.a (mon.0) 851 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-4"}]: dispatch 2021-01-28T04:00:39.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[13549]: audit 2021-01-28T04:00:38.663830+0000 mon.a (mon.0) 852 : audit [INF] from='client.? 172.21.15.100:0/2118431073' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32492-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:00:39.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[13549]: audit 2021-01-28T04:00:38.663933+0000 mon.a (mon.0) 853 : audit [INF] from='client.? 172.21.15.100:0/3797669259' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:39.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[13549]: audit 2021-01-28T04:00:38.664552+0000 mon.a (mon.0) 854 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32286-1","app":"app1","key":"key1","value":"value1"}]': finished 2021-01-28T04:00:39.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[13549]: audit 2021-01-28T04:00:38.664763+0000 mon.a (mon.0) 855 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-4"}]': finished 2021-01-28T04:00:39.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[13549]: cluster 2021-01-28T04:00:38.664827+0000 mon.a (mon.0) 856 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2021-01-28T04:00:39.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[13549]: audit 2021-01-28T04:00:38.666299+0000 mon.c (mon.1) 70 : audit [INF] from='client.? 172.21.15.100:0/2261469346' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-4", "tierpool": "test-rados-api-smithi100-32332-4-cache"}]: dispatch 2021-01-28T04:00:39.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[13549]: audit 2021-01-28T04:00:38.666431+0000 mon.b (mon.2) 56 : audit [INF] from='client.? 172.21.15.100:0/380907029' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32465-7"}]: dispatch 2021-01-28T04:00:39.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[13549]: audit 2021-01-28T04:00:38.667180+0000 mon.a (mon.0) 857 : audit [INF] from='client.? 172.21.15.100:0/2118431073' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32492-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32492-12"}]: dispatch 2021-01-28T04:00:39.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[13549]: audit 2021-01-28T04:00:38.668189+0000 mon.a (mon.0) 858 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-4", "tierpool": "test-rados-api-smithi100-32332-4-cache"}]: dispatch 2021-01-28T04:00:39.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[13549]: audit 2021-01-28T04:00:38.668385+0000 mon.a (mon.0) 859 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32465-7"}]: dispatch 2021-01-28T04:00:39.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[13549]: audit 2021-01-28T04:00:38.668933+0000 mon.a (mon.0) 860 : audit [INF] from='client.? 172.21.15.100:0/2688349763' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:39.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[13549]: audit 2021-01-28T04:00:38.669340+0000 mon.a (mon.0) 861 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32286-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-01-28T04:00:39.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[13549]: audit 2021-01-28T04:00:38.669528+0000 mon.a (mon.0) 862 : audit [INF] from='client.? 172.21.15.100:0/727307177' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32201-10"}]: dispatch 2021-01-28T04:00:39.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[13549]: audit 2021-01-28T04:00:38.669934+0000 mon.b (mon.2) 57 : audit [INF] from='client.? 172.21.15.100:0/1050750335' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32286-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-01-28T04:00:39.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[13549]: audit 2021-01-28T04:00:38.676186+0000 mon.a (mon.0) 863 : audit [INF] from='client.? 172.21.15.100:0/4062725283' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32256-10"}]: dispatch 2021-01-28T04:00:39.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[13549]: audit 2021-01-28T04:00:39.007855+0000 mon.b (mon.2) 58 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:39.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[13549]: cluster 2021-01-28T04:00:39.514398+0000 mgr.y (mgr.14138) 502 : cluster [DBG] pgmap v373: 616 pgs: 18 creating+peering, 74 unknown, 524 active+clean; 144 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 4.7 KiB/s wr, 4 op/s 2021-01-28T04:00:39.833 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[9834]: cluster 2021-01-28T04:00:37.926014+0000 osd.5 (osd.5) 4 : cluster [DBG] 13.9 deep-scrub ok 2021-01-28T04:00:39.833 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[9834]: audit 2021-01-28T04:00:38.542684+0000 mon.a (mon.0) 850 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32286-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-01-28T04:00:39.833 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[9834]: audit 2021-01-28T04:00:38.559900+0000 mon.a (mon.0) 851 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-4"}]: dispatch 2021-01-28T04:00:39.833 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[9834]: audit 2021-01-28T04:00:38.663830+0000 mon.a (mon.0) 852 : audit [INF] from='client.? 172.21.15.100:0/2118431073' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32492-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:00:39.834 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[9834]: audit 2021-01-28T04:00:38.663933+0000 mon.a (mon.0) 853 : audit [INF] from='client.? 172.21.15.100:0/3797669259' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:39.834 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[9834]: audit 2021-01-28T04:00:38.664552+0000 mon.a (mon.0) 854 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32286-1","app":"app1","key":"key1","value":"value1"}]': finished 2021-01-28T04:00:39.834 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[9834]: audit 2021-01-28T04:00:38.664763+0000 mon.a (mon.0) 855 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-4"}]': finished 2021-01-28T04:00:39.834 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[9834]: cluster 2021-01-28T04:00:38.664827+0000 mon.a (mon.0) 856 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2021-01-28T04:00:39.834 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[9834]: audit 2021-01-28T04:00:38.666299+0000 mon.c (mon.1) 70 : audit [INF] from='client.? 172.21.15.100:0/2261469346' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-4", "tierpool": "test-rados-api-smithi100-32332-4-cache"}]: dispatch 2021-01-28T04:00:39.835 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[9834]: audit 2021-01-28T04:00:38.666431+0000 mon.b (mon.2) 56 : audit [INF] from='client.? 172.21.15.100:0/380907029' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32465-7"}]: dispatch 2021-01-28T04:00:39.835 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[9834]: audit 2021-01-28T04:00:38.667180+0000 mon.a (mon.0) 857 : audit [INF] from='client.? 172.21.15.100:0/2118431073' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32492-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32492-12"}]: dispatch 2021-01-28T04:00:39.835 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[9834]: audit 2021-01-28T04:00:38.668189+0000 mon.a (mon.0) 858 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-4", "tierpool": "test-rados-api-smithi100-32332-4-cache"}]: dispatch 2021-01-28T04:00:39.835 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[9834]: audit 2021-01-28T04:00:38.668385+0000 mon.a (mon.0) 859 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32465-7"}]: dispatch 2021-01-28T04:00:39.836 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[9834]: audit 2021-01-28T04:00:38.668933+0000 mon.a (mon.0) 860 : audit [INF] from='client.? 172.21.15.100:0/2688349763' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:39.836 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[9834]: audit 2021-01-28T04:00:38.669340+0000 mon.a (mon.0) 861 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32286-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-01-28T04:00:39.836 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[9834]: audit 2021-01-28T04:00:38.669528+0000 mon.a (mon.0) 862 : audit [INF] from='client.? 172.21.15.100:0/727307177' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32201-10"}]: dispatch 2021-01-28T04:00:39.836 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[9834]: audit 2021-01-28T04:00:38.669934+0000 mon.b (mon.2) 57 : audit [INF] from='client.? 172.21.15.100:0/1050750335' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32286-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-01-28T04:00:39.837 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[9834]: audit 2021-01-28T04:00:38.676186+0000 mon.a (mon.0) 863 : audit [INF] from='client.? 172.21.15.100:0/4062725283' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32256-10"}]: dispatch 2021-01-28T04:00:39.837 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[9834]: audit 2021-01-28T04:00:39.007855+0000 mon.b (mon.2) 58 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:39.837 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:39 smithi100 bash[9834]: cluster 2021-01-28T04:00:39.514398+0000 mgr.y (mgr.14138) 502 : cluster [DBG] pgmap v373: 616 pgs: 18 creating+peering, 74 unknown, 524 active+clean; 144 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 4.7 KiB/s wr, 4 op/s 2021-01-28T04:00:40.012 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 04:00:39 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T04:00:40.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:39 smithi162 bash[9856]: cluster 2021-01-28T04:00:37.926014+0000 osd.5 (osd.5) 4 : cluster [DBG] 13.9 deep-scrub ok 2021-01-28T04:00:40.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:39 smithi162 bash[9856]: audit 2021-01-28T04:00:38.542684+0000 mon.a (mon.0) 850 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32286-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-01-28T04:00:40.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:39 smithi162 bash[9856]: audit 2021-01-28T04:00:38.559900+0000 mon.a (mon.0) 851 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-4"}]: dispatch 2021-01-28T04:00:40.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:39 smithi162 bash[9856]: audit 2021-01-28T04:00:38.663830+0000 mon.a (mon.0) 852 : audit [INF] from='client.? 172.21.15.100:0/2118431073' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32492-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:00:40.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:39 smithi162 bash[9856]: audit 2021-01-28T04:00:38.663933+0000 mon.a (mon.0) 853 : audit [INF] from='client.? 172.21.15.100:0/3797669259' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:40.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:39 smithi162 bash[9856]: audit 2021-01-28T04:00:38.664552+0000 mon.a (mon.0) 854 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32286-1","app":"app1","key":"key1","value":"value1"}]': finished 2021-01-28T04:00:40.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:39 smithi162 bash[9856]: audit 2021-01-28T04:00:38.664763+0000 mon.a (mon.0) 855 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-4"}]': finished 2021-01-28T04:00:40.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:39 smithi162 bash[9856]: cluster 2021-01-28T04:00:38.664827+0000 mon.a (mon.0) 856 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2021-01-28T04:00:40.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:39 smithi162 bash[9856]: audit 2021-01-28T04:00:38.666299+0000 mon.c (mon.1) 70 : audit [INF] from='client.? 172.21.15.100:0/2261469346' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-4", "tierpool": "test-rados-api-smithi100-32332-4-cache"}]: dispatch 2021-01-28T04:00:40.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:39 smithi162 bash[9856]: audit 2021-01-28T04:00:38.666431+0000 mon.b (mon.2) 56 : audit [INF] from='client.? 172.21.15.100:0/380907029' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32465-7"}]: dispatch 2021-01-28T04:00:40.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:39 smithi162 bash[9856]: audit 2021-01-28T04:00:38.667180+0000 mon.a (mon.0) 857 : audit [INF] from='client.? 172.21.15.100:0/2118431073' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32492-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32492-12"}]: dispatch 2021-01-28T04:00:40.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:39 smithi162 bash[9856]: audit 2021-01-28T04:00:38.668189+0000 mon.a (mon.0) 858 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-4", "tierpool": "test-rados-api-smithi100-32332-4-cache"}]: dispatch 2021-01-28T04:00:40.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:39 smithi162 bash[9856]: audit 2021-01-28T04:00:38.668385+0000 mon.a (mon.0) 859 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32465-7"}]: dispatch 2021-01-28T04:00:40.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:39 smithi162 bash[9856]: audit 2021-01-28T04:00:38.668933+0000 mon.a (mon.0) 860 : audit [INF] from='client.? 172.21.15.100:0/2688349763' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:40.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:39 smithi162 bash[9856]: audit 2021-01-28T04:00:38.669340+0000 mon.a (mon.0) 861 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32286-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-01-28T04:00:40.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:39 smithi162 bash[9856]: audit 2021-01-28T04:00:38.669528+0000 mon.a (mon.0) 862 : audit [INF] from='client.? 172.21.15.100:0/727307177' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32201-10"}]: dispatch 2021-01-28T04:00:40.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:39 smithi162 bash[9856]: audit 2021-01-28T04:00:38.669934+0000 mon.b (mon.2) 57 : audit [INF] from='client.? 172.21.15.100:0/1050750335' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32286-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-01-28T04:00:40.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:39 smithi162 bash[9856]: audit 2021-01-28T04:00:38.676186+0000 mon.a (mon.0) 863 : audit [INF] from='client.? 172.21.15.100:0/4062725283' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32256-10"}]: dispatch 2021-01-28T04:00:40.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:39 smithi162 bash[9856]: audit 2021-01-28T04:00:39.007855+0000 mon.b (mon.2) 58 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:40.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:39 smithi162 bash[9856]: cluster 2021-01-28T04:00:39.514398+0000 mgr.y (mgr.14138) 502 : cluster [DBG] pgmap v373: 616 pgs: 18 creating+peering, 74 unknown, 524 active+clean; 144 MiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 4.7 KiB/s wr, 4 op/s 2021-01-28T04:00:40.811 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: Running main() from gmock_main.cc 2021-01-28T04:00:40.811 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [==========] Running 16 tests from 2 test suites. 2021-01-28T04:00:40.811 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [----------] Global test environment set-up. 2021-01-28T04:00:40.812 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP 2021-01-28T04:00:40.812 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2021-01-28T04:00:40.812 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: notify 2021-01-28T04:00:40.812 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotify (817 ms) 2021-01-28T04:00:40.812 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2021-01-28T04:00:40.813 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (8 ms) 2021-01-28T04:00:40.813 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP (825 ms total) 2021-01-28T04:00:40.813 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: 2021-01-28T04:00:40.813 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2021-01-28T04:00:40.814 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2021-01-28T04:00:40.814 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: notify 2021-01-28T04:00:40.814 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (148 ms) 2021-01-28T04:00:40.814 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2021-01-28T04:00:40.814 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: notify 2021-01-28T04:00:40.815 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (5137 ms) 2021-01-28T04:00:40.815 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2021-01-28T04:00:40.815 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (9 ms) 2021-01-28T04:00:40.815 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2021-01-28T04:00:40.815 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (10 ms) 2021-01-28T04:00:40.816 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2021-01-28T04:00:40.816 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: handle_notify cookie 94678221255040 notify_id 347892350977 notifier_gid 25024 2021-01-28T04:00:40.816 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (11 ms) 2021-01-28T04:00:40.816 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2021-01-28T04:00:40.817 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: handle_notify cookie 94678221255040 notify_id 347892350977 notifier_gid 25024 2021-01-28T04:00:40.817 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (12 ms) 2021-01-28T04:00:40.817 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2021-01-28T04:00:40.817 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: handle_notify cookie 94678221258272 notify_id 347892350977 notifier_gid 25024 2021-01-28T04:00:40.818 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (16 ms) 2021-01-28T04:00:40.818 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2021-01-28T04:00:40.818 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: handle_notify cookie 94678221255040 notify_id 347892350978 notifier_gid 25024 2021-01-28T04:00:40.818 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (13 ms) 2021-01-28T04:00:40.818 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2021-01-28T04:00:40.819 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: handle_notify cookie 94678221260608 notify_id 347892350979 notifier_gid 25024 2021-01-28T04:00:40.819 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (12 ms) 2021-01-28T04:00:40.819 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2021-01-28T04:00:40.819 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: handle_notify cookie 94678221260608 notify_id 347892350978 notifier_gid 25024 2021-01-28T04:00:40.819 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (15 ms) 2021-01-28T04:00:40.820 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2021-01-28T04:00:40.820 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: trying... 2021-01-28T04:00:40.820 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: handle_notify cookie 94678221260544 notify_id 347892350980 notifier_gid 25024 2021-01-28T04:00:40.820 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: timed out 2021-01-28T04:00:40.820 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: flushing 2021-01-28T04:00:41.063 INFO:tasks.workunit.client.0.smithi100.stdout: api api_stat_pp: Running main() from gmock_main.cc 2021-01-28T04:00:41.064 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat_pp: [==========] Running 9 tests from 2 test suites. 2021-01-28T04:00:41.064 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat_pp: [----------] Global test environment set-up. 2021-01-28T04:00:41.064 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP 2021-01-28T04:00:41.065 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat_pp: seed 32465 2021-01-28T04:00:41.065 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPP 2021-01-28T04:00:41.065 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPP (346 ms) 2021-01-28T04:00:41.065 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.Stat2Mtime2PP 2021-01-28T04:00:41.065 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat_pp: [ OK ] LibRadosStatPP.Stat2Mtime2PP (47 ms) 2021-01-28T04:00:41.066 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.ClusterStatPP 2021-01-28T04:00:41.066 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat_pp: [ OK ] LibRadosStatPP.ClusterStatPP (158 ms) 2021-01-28T04:00:41.066 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.PoolStatPP 2021-01-28T04:00:41.067 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat_pp: [ OK ] LibRadosStatPP.PoolStatPP (5 ms) 2021-01-28T04:00:41.067 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPPNS 2021-01-28T04:00:41.067 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPPNS (16 ms) 2021-01-28T04:00:41.067 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP (572 ms total) 2021-01-28T04:00:41.068 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat_pp: 2021-01-28T04:00:41.068 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP 2021-01-28T04:00:41.068 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPP 2021-01-28T04:00:41.068 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPP (1107 ms) 2021-01-28T04:00:41.069 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.ClusterStatPP 2021-01-28T04:00:41.070 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.ClusterStatPP (1 ms) 2021-01-28T04:00:41.070 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.PoolStatPP 2021-01-28T04:00:41.070 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.PoolStatPP (2 ms) 2021-01-28T04:00:41.070 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPPNS 2021-01-28T04:00:41.071 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPPNS (13 ms) 2021-01-28T04:00:41.072 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP (1123 ms total) 2021-01-28T04:00:41.072 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat_pp: 2021-01-28T04:00:41.073 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat_pp: [----------] Global test environment tear-down 2021-01-28T04:00:41.074 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat_pp: [==========] 9 tests from 2 test suites ran. (27509 ms total) 2021-01-28T04:00:41.074 INFO:tasks.workunit.client.0.smithi100.stdout: api_stat_pp: [ PASSED ] 9 tests. 2021-01-28T04:00:41.075 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: Running main() from gmock_main.cc 2021-01-28T04:00:41.075 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [==========] Running 16 tests from 2 test suites. 2021-01-28T04:00:41.075 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [----------] Global test environment set-up. 2021-01-28T04:00:41.076 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP 2021-01-28T04:00:41.076 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: seed 32256 2021-01-28T04:00:41.076 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusivePP 2021-01-28T04:00:41.077 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusivePP (281 ms) 2021-01-28T04:00:41.077 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedPP 2021-01-28T04:00:41.077 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedPP (73 ms) 2021-01-28T04:00:41.077 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusiveDurPP 2021-01-28T04:00:41.078 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusiveDurPP (1009 ms) 2021-01-28T04:00:41.078 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedDurPP 2021-01-28T04:00:41.078 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedDurPP (1011 ms) 2021-01-28T04:00:41.079 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockMayRenewPP 2021-01-28T04:00:41.079 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockMayRenewPP (9 ms) 2021-01-28T04:00:41.079 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.UnlockPP 2021-01-28T04:00:41.080 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [ OK ] LibRadosLockPP.UnlockPP (9 ms) 2021-01-28T04:00:41.081 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.ListLockersPP 2021-01-28T04:00:41.081 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [ OK ] LibRadosLockPP.ListLockersPP (9 ms) 2021-01-28T04:00:41.082 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.BreakLockPP 2021-01-28T04:00:41.082 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [ OK ] LibRadosLockPP.BreakLockPP (5 ms) 2021-01-28T04:00:41.082 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP (2406 ms total) 2021-01-28T04:00:41.082 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: 2021-01-28T04:00:41.083 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP 2021-01-28T04:00:41.083 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusivePP 2021-01-28T04:00:41.083 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusivePP (700 ms) 2021-01-28T04:00:41.083 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedPP 2021-01-28T04:00:41.084 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedPP (5 ms) 2021-01-28T04:00:41.084 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2021-01-28T04:00:41.084 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusiveDurPP (1100 ms) 2021-01-28T04:00:41.084 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedDurPP 2021-01-28T04:00:41.085 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedDurPP (1011 ms) 2021-01-28T04:00:41.085 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockMayRenewPP 2021-01-28T04:00:41.085 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockMayRenewPP (9 ms) 2021-01-28T04:00:41.085 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.UnlockPP 2021-01-28T04:00:41.085 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.UnlockPP (8 ms) 2021-01-28T04:00:41.086 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.ListLockersPP 2021-01-28T04:00:41.086 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.ListLockersPP (8 ms) 2021-01-28T04:00:41.086 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.BreakLockPP 2021-01-28T04:00:41.086 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.BreakLockPP (9 ms) 2021-01-28T04:00:41.087 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP (2850 ms total) 2021-01-28T04:00:41.087 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: 2021-01-28T04:00:41.087 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [----------] Global test environment tear-down 2021-01-28T04:00:41.088 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [==========] 16 tests from 2 test suites ran. (27607 ms total) 2021-01-28T04:00:41.088 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock_pp: [ PASSED ] 16 tests. 2021-01-28T04:00:41.110 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: Running main() from gmock_main.cc 2021-01-28T04:00:41.110 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [==========] Running 16 tests from 2 test suites. 2021-01-28T04:00:41.111 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [----------] Global test environment set-up. 2021-01-28T04:00:41.111 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [----------] 8 tests from LibRadosLock 2021-01-28T04:00:41.111 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusive 2021-01-28T04:00:41.111 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [ OK ] LibRadosLock.LockExclusive (325 ms) 2021-01-28T04:00:41.112 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [ RUN ] LibRadosLock.LockShared 2021-01-28T04:00:41.112 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [ OK ] LibRadosLock.LockShared (81 ms) 2021-01-28T04:00:41.112 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusiveDur 2021-01-28T04:00:41.112 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [ OK ] LibRadosLock.LockExclusiveDur (1011 ms) 2021-01-28T04:00:41.112 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [ RUN ] LibRadosLock.LockSharedDur 2021-01-28T04:00:41.113 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [ OK ] LibRadosLock.LockSharedDur (1009 ms) 2021-01-28T04:00:41.113 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [ RUN ] LibRadosLock.LockMayRenew 2021-01-28T04:00:41.113 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [ OK ] LibRadosLock.LockMayRenew (9 ms) 2021-01-28T04:00:41.113 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [ RUN ] LibRadosLock.Unlock 2021-01-28T04:00:41.114 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [ OK ] LibRadosLock.Unlock (10 ms) 2021-01-28T04:00:41.114 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [ RUN ] LibRadosLock.ListLockers 2021-01-28T04:00:41.114 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [ OK ] LibRadosLock.ListLockers (9 ms) 2021-01-28T04:00:41.114 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [ RUN ] LibRadosLock.BreakLock 2021-01-28T04:00:41.115 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [ OK ] LibRadosLock.BreakLock (7 ms) 2021-01-28T04:00:41.115 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [----------] 8 tests from LibRadosLock (2461 ms total) 2021-01-28T04:00:41.115 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: 2021-01-28T04:00:41.115 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [----------] 8 tests from LibRadosLockEC 2021-01-28T04:00:41.115 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusive 2021-01-28T04:00:41.116 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusive (1120 ms) 2021-01-28T04:00:41.116 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [ RUN ] LibRadosLockEC.LockShared 2021-01-28T04:00:41.116 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [ OK ] LibRadosLockEC.LockShared (7 ms) 2021-01-28T04:00:41.116 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusiveDur 2021-01-28T04:00:41.117 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusiveDur (1048 ms) 2021-01-28T04:00:41.117 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [ RUN ] LibRadosLockEC.LockSharedDur 2021-01-28T04:00:41.117 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [ OK ] LibRadosLockEC.LockSharedDur (1013 ms) 2021-01-28T04:00:41.117 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [ RUN ] LibRadosLockEC.LockMayRenew 2021-01-28T04:00:41.117 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [ OK ] LibRadosLockEC.LockMayRenew (11 ms) 2021-01-28T04:00:41.118 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [ RUN ] LibRadosLockEC.Unlock 2021-01-28T04:00:41.118 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [ OK ] LibRadosLockEC.Unlock (9 ms) 2021-01-28T04:00:41.118 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [ RUN ] LibRadosLockEC.ListLockers 2021-01-28T04:00:41.118 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [ OK ] LibRadosLockEC.ListLockers (9 ms) 2021-01-28T04:00:41.119 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [ RUN ] LibRadosLockEC.BreakLock 2021-01-28T04:00:41.119 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [ OK ] LibRadosLockEC.BreakLock (6 ms) 2021-01-28T04:00:41.119 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [----------] 8 tests from LibRadosLockEC (3224 ms total) 2021-01-28T04:00:41.119 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: 2021-01-28T04:00:41.119 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [----------] Global test environment tear-down 2021-01-28T04:00:41.120 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [==========] 16 tests from 2 test suites ran. (27671 ms total) 2021-01-28T04:00:41.120 INFO:tasks.workunit.client.0.smithi100.stdout: api_lock: [ PASSED ] 16 tests. 2021-01-28T04:00:41.327 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:41 smithi100 bash[13549]: audit 2021-01-28T04:00:39.708287+0000 mgr.y (mgr.14138) 503 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:00:41.328 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:41 smithi100 bash[13549]: audit 2021-01-28T04:00:40.010014+0000 mon.b (mon.2) 59 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:41.328 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:41 smithi100 bash[13549]: audit 2021-01-28T04:00:40.101477+0000 mon.a (mon.0) 864 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-4", "tierpool": "test-rados-api-smithi100-32332-4-cache"}]': finished 2021-01-28T04:00:41.328 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:41 smithi100 bash[13549]: audit 2021-01-28T04:00:40.101697+0000 mon.a (mon.0) 865 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32465-7"}]': finished 2021-01-28T04:00:41.328 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:41 smithi100 bash[13549]: audit 2021-01-28T04:00:40.101894+0000 mon.a (mon.0) 866 : audit [INF] from='client.? 172.21.15.100:0/2688349763' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:41.328 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:41 smithi100 bash[13549]: audit 2021-01-28T04:00:40.102288+0000 mon.a (mon.0) 867 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32286-1","app":"app1","key":"key2","value":"value2"}]': finished 2021-01-28T04:00:41.329 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:41 smithi100 bash[13549]: audit 2021-01-28T04:00:40.102604+0000 mon.a (mon.0) 868 : audit [INF] from='client.? 172.21.15.100:0/727307177' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32201-10"}]': finished 2021-01-28T04:00:41.329 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:41 smithi100 bash[13549]: audit 2021-01-28T04:00:40.103035+0000 mon.a (mon.0) 869 : audit [INF] from='client.? 172.21.15.100:0/4062725283' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32256-10"}]': finished 2021-01-28T04:00:41.329 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:41 smithi100 bash[13549]: cluster 2021-01-28T04:00:40.103648+0000 mon.a (mon.0) 870 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2021-01-28T04:00:41.329 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:41 smithi100 bash[13549]: audit 2021-01-28T04:00:40.104121+0000 mon.b (mon.2) 60 : audit [INF] from='client.? 172.21.15.100:0/380907029' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32465-7"}]: dispatch 2021-01-28T04:00:41.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:41 smithi100 bash[13549]: audit 2021-01-28T04:00:40.106176+0000 mon.b (mon.2) 61 : audit [INF] from='client.? 172.21.15.100:0/1050750335' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi100-32286-1","app":"app1","key":"key1"}]: dispatch 2021-01-28T04:00:41.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:41 smithi100 bash[13549]: audit 2021-01-28T04:00:40.106825+0000 mon.a (mon.0) 871 : audit [INF] from='client.? 172.21.15.100:0/727307177' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32201-10"}]: dispatch 2021-01-28T04:00:41.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:41 smithi100 bash[13549]: audit 2021-01-28T04:00:40.107135+0000 mon.a (mon.0) 872 : audit [INF] from='client.? 172.21.15.100:0/4062725283' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32256-10"}]: dispatch 2021-01-28T04:00:41.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:41 smithi100 bash[13549]: audit 2021-01-28T04:00:40.113463+0000 mon.a (mon.0) 873 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32465-7"}]: dispatch 2021-01-28T04:00:41.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:41 smithi100 bash[13549]: audit 2021-01-28T04:00:40.113878+0000 mon.a (mon.0) 874 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi100-32286-1","app":"app1","key":"key1"}]: dispatch 2021-01-28T04:00:41.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:41 smithi100 bash[9834]: audit 2021-01-28T04:00:39.708287+0000 mgr.y (mgr.14138) 503 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:00:41.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:41 smithi100 bash[9834]: audit 2021-01-28T04:00:40.010014+0000 mon.b (mon.2) 59 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:41.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:41 smithi100 bash[9834]: audit 2021-01-28T04:00:40.101477+0000 mon.a (mon.0) 864 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-4", "tierpool": "test-rados-api-smithi100-32332-4-cache"}]': finished 2021-01-28T04:00:41.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:41 smithi100 bash[9834]: audit 2021-01-28T04:00:40.101697+0000 mon.a (mon.0) 865 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32465-7"}]': finished 2021-01-28T04:00:41.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:41 smithi100 bash[9834]: audit 2021-01-28T04:00:40.101894+0000 mon.a (mon.0) 866 : audit [INF] from='client.? 172.21.15.100:0/2688349763' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:41.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:41 smithi100 bash[9834]: audit 2021-01-28T04:00:40.102288+0000 mon.a (mon.0) 867 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32286-1","app":"app1","key":"key2","value":"value2"}]': finished 2021-01-28T04:00:41.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:41 smithi100 bash[9834]: audit 2021-01-28T04:00:40.102604+0000 mon.a (mon.0) 868 : audit [INF] from='client.? 172.21.15.100:0/727307177' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32201-10"}]': finished 2021-01-28T04:00:41.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:41 smithi100 bash[9834]: audit 2021-01-28T04:00:40.103035+0000 mon.a (mon.0) 869 : audit [INF] from='client.? 172.21.15.100:0/4062725283' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32256-10"}]': finished 2021-01-28T04:00:41.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:41 smithi100 bash[9834]: cluster 2021-01-28T04:00:40.103648+0000 mon.a (mon.0) 870 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2021-01-28T04:00:41.333 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:41 smithi100 bash[9834]: audit 2021-01-28T04:00:40.104121+0000 mon.b (mon.2) 60 : audit [INF] from='client.? 172.21.15.100:0/380907029' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32465-7"}]: dispatch 2021-01-28T04:00:41.333 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:41 smithi100 bash[9834]: audit 2021-01-28T04:00:40.106176+0000 mon.b (mon.2) 61 : audit [INF] from='client.? 172.21.15.100:0/1050750335' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi100-32286-1","app":"app1","key":"key1"}]: dispatch 2021-01-28T04:00:41.333 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:41 smithi100 bash[9834]: audit 2021-01-28T04:00:40.106825+0000 mon.a (mon.0) 871 : audit [INF] from='client.? 172.21.15.100:0/727307177' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32201-10"}]: dispatch 2021-01-28T04:00:41.333 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:41 smithi100 bash[9834]: audit 2021-01-28T04:00:40.107135+0000 mon.a (mon.0) 872 : audit [INF] from='client.? 172.21.15.100:0/4062725283' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32256-10"}]: dispatch 2021-01-28T04:00:41.334 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:41 smithi100 bash[9834]: audit 2021-01-28T04:00:40.113463+0000 mon.a (mon.0) 873 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32465-7"}]: dispatch 2021-01-28T04:00:41.334 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:41 smithi100 bash[9834]: audit 2021-01-28T04:00:40.113878+0000 mon.a (mon.0) 874 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi100-32286-1","app":"app1","key":"key1"}]: dispatch 2021-01-28T04:00:41.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:41 smithi162 bash[9856]: audit 2021-01-28T04:00:39.708287+0000 mgr.y (mgr.14138) 503 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:00:41.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:41 smithi162 bash[9856]: audit 2021-01-28T04:00:40.010014+0000 mon.b (mon.2) 59 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:41.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:41 smithi162 bash[9856]: audit 2021-01-28T04:00:40.101477+0000 mon.a (mon.0) 864 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-4", "tierpool": "test-rados-api-smithi100-32332-4-cache"}]': finished 2021-01-28T04:00:41.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:41 smithi162 bash[9856]: audit 2021-01-28T04:00:40.101697+0000 mon.a (mon.0) 865 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32465-7"}]': finished 2021-01-28T04:00:41.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:41 smithi162 bash[9856]: audit 2021-01-28T04:00:40.101894+0000 mon.a (mon.0) 866 : audit [INF] from='client.? 172.21.15.100:0/2688349763' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:41.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:41 smithi162 bash[9856]: audit 2021-01-28T04:00:40.102288+0000 mon.a (mon.0) 867 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32286-1","app":"app1","key":"key2","value":"value2"}]': finished 2021-01-28T04:00:41.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:41 smithi162 bash[9856]: audit 2021-01-28T04:00:40.102604+0000 mon.a (mon.0) 868 : audit [INF] from='client.? 172.21.15.100:0/727307177' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32201-10"}]': finished 2021-01-28T04:00:41.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:41 smithi162 bash[9856]: audit 2021-01-28T04:00:40.103035+0000 mon.a (mon.0) 869 : audit [INF] from='client.? 172.21.15.100:0/4062725283' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32256-10"}]': finished 2021-01-28T04:00:41.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:41 smithi162 bash[9856]: cluster 2021-01-28T04:00:40.103648+0000 mon.a (mon.0) 870 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2021-01-28T04:00:41.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:41 smithi162 bash[9856]: audit 2021-01-28T04:00:40.104121+0000 mon.b (mon.2) 60 : audit [INF] from='client.? 172.21.15.100:0/380907029' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32465-7"}]: dispatch 2021-01-28T04:00:41.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:41 smithi162 bash[9856]: audit 2021-01-28T04:00:40.106176+0000 mon.b (mon.2) 61 : audit [INF] from='client.? 172.21.15.100:0/1050750335' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi100-32286-1","app":"app1","key":"key1"}]: dispatch 2021-01-28T04:00:41.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:41 smithi162 bash[9856]: audit 2021-01-28T04:00:40.106825+0000 mon.a (mon.0) 871 : audit [INF] from='client.? 172.21.15.100:0/727307177' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32201-10"}]: dispatch 2021-01-28T04:00:41.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:41 smithi162 bash[9856]: audit 2021-01-28T04:00:40.107135+0000 mon.a (mon.0) 872 : audit [INF] from='client.? 172.21.15.100:0/4062725283' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32256-10"}]: dispatch 2021-01-28T04:00:41.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:41 smithi162 bash[9856]: audit 2021-01-28T04:00:40.113463+0000 mon.a (mon.0) 873 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32465-7"}]: dispatch 2021-01-28T04:00:41.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:41 smithi162 bash[9856]: audit 2021-01-28T04:00:40.113878+0000 mon.a (mon.0) 874 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi100-32286-1","app":"app1","key":"key1"}]: dispatch 2021-01-28T04:00:42.512 INFO:journalctl@ceph.osd.6.smithi162.stdout:Jan 28 04:00:42 smithi162 bash[17572]: debug 2021-01-28T04:00:42.193+0000 7f403f92c700 -1 osd.6 pg_epoch: 85 pg[29.13( v 84'4 (0'0,84'4] local-lis/les=68/69 n=2 ec=68/68 lis/c=68/68 les/c/f=69/69/0 sis=68) [6,2,1] r=0 lpr=68 crt=84'4 lcod 83'3 mlcod 83'3 active+clean+snaptrim trimq=[9~1] ps=[3~1,5~1,7~1]] removing snap head 2021-01-28T04:00:42.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:42 smithi162 bash[9856]: audit 2021-01-28T04:00:41.015408+0000 mon.b (mon.2) 62 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:42.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:42 smithi162 bash[9856]: audit 2021-01-28T04:00:41.020384+0000 mon.a (mon.0) 875 : audit [INF] from='client.? 172.21.15.100:0/2118431073' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32492-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32492-12"}]': finished 2021-01-28T04:00:42.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:42 smithi162 bash[9856]: audit 2021-01-28T04:00:41.020613+0000 mon.a (mon.0) 876 : audit [INF] from='client.? 172.21.15.100:0/727307177' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32201-10"}]': finished 2021-01-28T04:00:42.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:42 smithi162 bash[9856]: audit 2021-01-28T04:00:41.020714+0000 mon.a (mon.0) 877 : audit [INF] from='client.? 172.21.15.100:0/4062725283' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32256-10"}]': finished 2021-01-28T04:00:42.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:42 smithi162 bash[9856]: audit 2021-01-28T04:00:41.020794+0000 mon.a (mon.0) 878 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32465-7"}]': finished 2021-01-28T04:00:42.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:42 smithi162 bash[9856]: audit 2021-01-28T04:00:41.020885+0000 mon.a (mon.0) 879 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi100-32286-1","app":"app1","key":"key1"}]': finished 2021-01-28T04:00:42.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:42 smithi162 bash[9856]: cluster 2021-01-28T04:00:41.021112+0000 mon.a (mon.0) 880 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2021-01-28T04:00:42.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:42 smithi162 bash[9856]: audit 2021-01-28T04:00:41.030626+0000 mon.c (mon.1) 71 : audit [INF] from='client.? 172.21.15.100:0/2898938026' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:42.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:42 smithi162 bash[9856]: audit 2021-01-28T04:00:41.033639+0000 mon.c (mon.1) 72 : audit [INF] from='client.? 172.21.15.100:0/2519509403' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:42.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:42 smithi162 bash[9856]: audit 2021-01-28T04:00:41.040150+0000 mon.a (mon.0) 881 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:42.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:42 smithi162 bash[9856]: audit 2021-01-28T04:00:41.042561+0000 mon.a (mon.0) 882 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:42.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:42 smithi162 bash[9856]: audit 2021-01-28T04:00:42.018183+0000 mon.b (mon.2) 63 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:42.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:42 smithi100 bash[9834]: audit 2021-01-28T04:00:41.015408+0000 mon.b (mon.2) 62 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:42.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:42 smithi100 bash[9834]: audit 2021-01-28T04:00:41.020384+0000 mon.a (mon.0) 875 : audit [INF] from='client.? 172.21.15.100:0/2118431073' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32492-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32492-12"}]': finished 2021-01-28T04:00:42.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:42 smithi100 bash[9834]: audit 2021-01-28T04:00:41.020613+0000 mon.a (mon.0) 876 : audit [INF] from='client.? 172.21.15.100:0/727307177' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32201-10"}]': finished 2021-01-28T04:00:42.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:42 smithi100 bash[9834]: audit 2021-01-28T04:00:41.020714+0000 mon.a (mon.0) 877 : audit [INF] from='client.? 172.21.15.100:0/4062725283' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32256-10"}]': finished 2021-01-28T04:00:42.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:42 smithi100 bash[9834]: audit 2021-01-28T04:00:41.020794+0000 mon.a (mon.0) 878 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32465-7"}]': finished 2021-01-28T04:00:42.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:42 smithi100 bash[9834]: audit 2021-01-28T04:00:41.020885+0000 mon.a (mon.0) 879 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi100-32286-1","app":"app1","key":"key1"}]': finished 2021-01-28T04:00:42.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:42 smithi100 bash[9834]: cluster 2021-01-28T04:00:41.021112+0000 mon.a (mon.0) 880 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2021-01-28T04:00:42.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:42 smithi100 bash[9834]: audit 2021-01-28T04:00:41.030626+0000 mon.c (mon.1) 71 : audit [INF] from='client.? 172.21.15.100:0/2898938026' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:42.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:42 smithi100 bash[9834]: audit 2021-01-28T04:00:41.033639+0000 mon.c (mon.1) 72 : audit [INF] from='client.? 172.21.15.100:0/2519509403' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:42.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:42 smithi100 bash[9834]: audit 2021-01-28T04:00:41.040150+0000 mon.a (mon.0) 881 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:42.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:42 smithi100 bash[9834]: audit 2021-01-28T04:00:41.042561+0000 mon.a (mon.0) 882 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:42.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:42 smithi100 bash[9834]: audit 2021-01-28T04:00:42.018183+0000 mon.b (mon.2) 63 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:42.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:42 smithi100 bash[13549]: audit 2021-01-28T04:00:41.015408+0000 mon.b (mon.2) 62 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:42.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:42 smithi100 bash[13549]: audit 2021-01-28T04:00:41.020384+0000 mon.a (mon.0) 875 : audit [INF] from='client.? 172.21.15.100:0/2118431073' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32492-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32492-12"}]': finished 2021-01-28T04:00:42.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:42 smithi100 bash[13549]: audit 2021-01-28T04:00:41.020613+0000 mon.a (mon.0) 876 : audit [INF] from='client.? 172.21.15.100:0/727307177' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32201-10"}]': finished 2021-01-28T04:00:42.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:42 smithi100 bash[13549]: audit 2021-01-28T04:00:41.020714+0000 mon.a (mon.0) 877 : audit [INF] from='client.? 172.21.15.100:0/4062725283' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32256-10"}]': finished 2021-01-28T04:00:42.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:42 smithi100 bash[13549]: audit 2021-01-28T04:00:41.020794+0000 mon.a (mon.0) 878 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32465-7"}]': finished 2021-01-28T04:00:42.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:42 smithi100 bash[13549]: audit 2021-01-28T04:00:41.020885+0000 mon.a (mon.0) 879 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi100-32286-1","app":"app1","key":"key1"}]': finished 2021-01-28T04:00:42.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:42 smithi100 bash[13549]: cluster 2021-01-28T04:00:41.021112+0000 mon.a (mon.0) 880 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2021-01-28T04:00:42.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:42 smithi100 bash[13549]: audit 2021-01-28T04:00:41.030626+0000 mon.c (mon.1) 71 : audit [INF] from='client.? 172.21.15.100:0/2898938026' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:42.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:42 smithi100 bash[13549]: audit 2021-01-28T04:00:41.033639+0000 mon.c (mon.1) 72 : audit [INF] from='client.? 172.21.15.100:0/2519509403' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:42.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:42 smithi100 bash[13549]: audit 2021-01-28T04:00:41.040150+0000 mon.a (mon.0) 881 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:42.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:42 smithi100 bash[13549]: audit 2021-01-28T04:00:41.042561+0000 mon.a (mon.0) 882 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:42.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:42 smithi100 bash[13549]: audit 2021-01-28T04:00:42.018183+0000 mon.b (mon.2) 63 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:43.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:43 smithi162 bash[9856]: cluster 2021-01-28T04:00:41.515162+0000 mgr.y (mgr.14138) 504 : cluster [DBG] pgmap v376: 528 pgs: 72 unknown, 456 active+clean; 144 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 6.2 KiB/s wr, 5 op/s 2021-01-28T04:00:43.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:43 smithi162 bash[9856]: audit 2021-01-28T04:00:42.170733+0000 mon.a (mon.0) 883 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:43.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:43 smithi162 bash[9856]: audit 2021-01-28T04:00:42.170865+0000 mon.a (mon.0) 884 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:43.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:43 smithi162 bash[9856]: cluster 2021-01-28T04:00:42.171057+0000 mon.a (mon.0) 885 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2021-01-28T04:00:43.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:43 smithi162 bash[9856]: audit 2021-01-28T04:00:42.204342+0000 mon.a (mon.0) 886 : audit [INF] from='client.? 172.21.15.100:0/739331210' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:43.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:43 smithi162 bash[9856]: audit 2021-01-28T04:00:42.210185+0000 mon.c (mon.1) 73 : audit [INF] from='client.? 172.21.15.100:0/101619174' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32381-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:43.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:43 smithi162 bash[9856]: audit 2021-01-28T04:00:42.248663+0000 mon.a (mon.0) 887 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32381-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:43.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:43 smithi162 bash[9856]: cluster 2021-01-28T04:00:42.779453+0000 mon.a (mon.0) 888 : cluster [WRN] Health check update: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:00:43.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:43 smithi162 bash[9856]: cluster 2021-01-28T04:00:42.779499+0000 mon.a (mon.0) 889 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:00:43.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:43 smithi162 bash[9856]: cluster 2021-01-28T04:00:42.779954+0000 mon.a (mon.0) 890 : cluster [WRN] pool 'test-rados-api-smithi100-32163-3' is full (reached quota's max_bytes: 4 KiB) 2021-01-28T04:00:43.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:43 smithi162 bash[9856]: cluster 2021-01-28T04:00:42.781292+0000 mon.a (mon.0) 891 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2021-01-28T04:00:43.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:43 smithi162 bash[9856]: audit 2021-01-28T04:00:42.806249+0000 mon.a (mon.0) 892 : audit [INF] from='client.? 172.21.15.100:0/739331210' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:43.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:43 smithi162 bash[9856]: audit 2021-01-28T04:00:42.806463+0000 mon.a (mon.0) 893 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32381-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:43.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:43 smithi162 bash[9856]: cluster 2021-01-28T04:00:42.806814+0000 mon.a (mon.0) 894 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2021-01-28T04:00:43.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:43 smithi100 bash[13549]: cluster 2021-01-28T04:00:41.515162+0000 mgr.y (mgr.14138) 504 : cluster [DBG] pgmap v376: 528 pgs: 72 unknown, 456 active+clean; 144 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 6.2 KiB/s wr, 5 op/s 2021-01-28T04:00:43.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:43 smithi100 bash[13549]: audit 2021-01-28T04:00:42.170733+0000 mon.a (mon.0) 883 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:43.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:43 smithi100 bash[13549]: audit 2021-01-28T04:00:42.170865+0000 mon.a (mon.0) 884 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:43.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:43 smithi100 bash[13549]: cluster 2021-01-28T04:00:42.171057+0000 mon.a (mon.0) 885 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2021-01-28T04:00:43.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:43 smithi100 bash[13549]: audit 2021-01-28T04:00:42.204342+0000 mon.a (mon.0) 886 : audit [INF] from='client.? 172.21.15.100:0/739331210' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:43.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:43 smithi100 bash[13549]: audit 2021-01-28T04:00:42.210185+0000 mon.c (mon.1) 73 : audit [INF] from='client.? 172.21.15.100:0/101619174' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32381-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:43.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:43 smithi100 bash[13549]: audit 2021-01-28T04:00:42.248663+0000 mon.a (mon.0) 887 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32381-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:43.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:43 smithi100 bash[13549]: cluster 2021-01-28T04:00:42.779453+0000 mon.a (mon.0) 888 : cluster [WRN] Health check update: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:00:43.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:43 smithi100 bash[13549]: cluster 2021-01-28T04:00:42.779499+0000 mon.a (mon.0) 889 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:00:43.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:43 smithi100 bash[13549]: cluster 2021-01-28T04:00:42.779954+0000 mon.a (mon.0) 890 : cluster [WRN] pool 'test-rados-api-smithi100-32163-3' is full (reached quota's max_bytes: 4 KiB) 2021-01-28T04:00:43.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:43 smithi100 bash[13549]: cluster 2021-01-28T04:00:42.781292+0000 mon.a (mon.0) 891 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2021-01-28T04:00:43.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:43 smithi100 bash[13549]: audit 2021-01-28T04:00:42.806249+0000 mon.a (mon.0) 892 : audit [INF] from='client.? 172.21.15.100:0/739331210' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:43.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:43 smithi100 bash[13549]: audit 2021-01-28T04:00:42.806463+0000 mon.a (mon.0) 893 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32381-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:43.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:43 smithi100 bash[13549]: cluster 2021-01-28T04:00:42.806814+0000 mon.a (mon.0) 894 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2021-01-28T04:00:43.832 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:43 smithi100 bash[9834]: cluster 2021-01-28T04:00:41.515162+0000 mgr.y (mgr.14138) 504 : cluster [DBG] pgmap v376: 528 pgs: 72 unknown, 456 active+clean; 144 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 6.2 KiB/s wr, 5 op/s 2021-01-28T04:00:43.832 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:43 smithi100 bash[9834]: audit 2021-01-28T04:00:42.170733+0000 mon.a (mon.0) 883 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:43.832 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:43 smithi100 bash[9834]: audit 2021-01-28T04:00:42.170865+0000 mon.a (mon.0) 884 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:43.832 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:43 smithi100 bash[9834]: cluster 2021-01-28T04:00:42.171057+0000 mon.a (mon.0) 885 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2021-01-28T04:00:43.833 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:43 smithi100 bash[9834]: audit 2021-01-28T04:00:42.204342+0000 mon.a (mon.0) 886 : audit [INF] from='client.? 172.21.15.100:0/739331210' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:43.833 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:43 smithi100 bash[9834]: audit 2021-01-28T04:00:42.210185+0000 mon.c (mon.1) 73 : audit [INF] from='client.? 172.21.15.100:0/101619174' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32381-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:43.833 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:43 smithi100 bash[9834]: audit 2021-01-28T04:00:42.248663+0000 mon.a (mon.0) 887 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32381-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:43.833 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:43 smithi100 bash[9834]: cluster 2021-01-28T04:00:42.779453+0000 mon.a (mon.0) 888 : cluster [WRN] Health check update: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:00:43.833 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:43 smithi100 bash[9834]: cluster 2021-01-28T04:00:42.779499+0000 mon.a (mon.0) 889 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:00:43.834 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:43 smithi100 bash[9834]: cluster 2021-01-28T04:00:42.779954+0000 mon.a (mon.0) 890 : cluster [WRN] pool 'test-rados-api-smithi100-32163-3' is full (reached quota's max_bytes: 4 KiB) 2021-01-28T04:00:43.834 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:43 smithi100 bash[9834]: cluster 2021-01-28T04:00:42.781292+0000 mon.a (mon.0) 891 : cluster [WRN] Health check failed: 1 pool(s) full (POOL_FULL) 2021-01-28T04:00:43.834 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:43 smithi100 bash[9834]: audit 2021-01-28T04:00:42.806249+0000 mon.a (mon.0) 892 : audit [INF] from='client.? 172.21.15.100:0/739331210' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:43.834 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:43 smithi100 bash[9834]: audit 2021-01-28T04:00:42.806463+0000 mon.a (mon.0) 893 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32381-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:43.834 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:43 smithi100 bash[9834]: cluster 2021-01-28T04:00:42.806814+0000 mon.a (mon.0) 894 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2021-01-28T04:00:45.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:45 smithi162 bash[9856]: audit 2021-01-28T04:00:43.020195+0000 mon.b (mon.2) 64 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:45.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:45 smithi162 bash[9856]: cluster 2021-01-28T04:00:43.516195+0000 mgr.y (mgr.14138) 505 : cluster [DBG] pgmap v379: 560 pgs: 47 creating+peering, 84 unknown, 429 active+clean; 144 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 5.0 KiB/s wr, 4 op/s 2021-01-28T04:00:45.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:45 smithi162 bash[9856]: cluster 2021-01-28T04:00:43.795641+0000 mon.a (mon.0) 895 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2021-01-28T04:00:45.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:45 smithi162 bash[9856]: audit 2021-01-28T04:00:43.822207+0000 mon.a (mon.0) 896 : audit [INF] from='client.? 172.21.15.100:0/2118431073' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32492-12"}]: dispatch 2021-01-28T04:00:45.766 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:45 smithi162 bash[9856]: audit 2021-01-28T04:00:43.831626+0000 mon.c (mon.1) 74 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:45.766 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:45 smithi162 bash[9856]: audit 2021-01-28T04:00:43.832094+0000 mon.a (mon.0) 897 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:45.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:45 smithi100 bash[9834]: audit 2021-01-28T04:00:43.020195+0000 mon.b (mon.2) 64 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:45.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:45 smithi100 bash[9834]: cluster 2021-01-28T04:00:43.516195+0000 mgr.y (mgr.14138) 505 : cluster [DBG] pgmap v379: 560 pgs: 47 creating+peering, 84 unknown, 429 active+clean; 144 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 5.0 KiB/s wr, 4 op/s 2021-01-28T04:00:45.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:45 smithi100 bash[9834]: cluster 2021-01-28T04:00:43.795641+0000 mon.a (mon.0) 895 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2021-01-28T04:00:45.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:45 smithi100 bash[9834]: audit 2021-01-28T04:00:43.822207+0000 mon.a (mon.0) 896 : audit [INF] from='client.? 172.21.15.100:0/2118431073' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32492-12"}]: dispatch 2021-01-28T04:00:45.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:45 smithi100 bash[9834]: audit 2021-01-28T04:00:43.831626+0000 mon.c (mon.1) 74 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:45.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:45 smithi100 bash[9834]: audit 2021-01-28T04:00:43.832094+0000 mon.a (mon.0) 897 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:45.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:45 smithi100 bash[13549]: audit 2021-01-28T04:00:43.020195+0000 mon.b (mon.2) 64 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:45.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:45 smithi100 bash[13549]: cluster 2021-01-28T04:00:43.516195+0000 mgr.y (mgr.14138) 505 : cluster [DBG] pgmap v379: 560 pgs: 47 creating+peering, 84 unknown, 429 active+clean; 144 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 5.0 KiB/s wr, 4 op/s 2021-01-28T04:00:45.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:45 smithi100 bash[13549]: cluster 2021-01-28T04:00:43.795641+0000 mon.a (mon.0) 895 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2021-01-28T04:00:45.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:45 smithi100 bash[13549]: audit 2021-01-28T04:00:43.822207+0000 mon.a (mon.0) 896 : audit [INF] from='client.? 172.21.15.100:0/2118431073' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32492-12"}]: dispatch 2021-01-28T04:00:45.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:45 smithi100 bash[13549]: audit 2021-01-28T04:00:43.831626+0000 mon.c (mon.1) 74 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:45.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:45 smithi100 bash[13549]: audit 2021-01-28T04:00:43.832094+0000 mon.a (mon.0) 897 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:46.256 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: [==========] Running 4 tests from 1 test suite. 2021-01-28T04:00:46.257 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: [----------] Global test environment set-up. 2021-01-28T04:00:46.258 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2021-01-28T04:00:46.258 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2021-01-28T04:00:46.258 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (6619 ms) 2021-01-28T04:00:46.258 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2021-01-28T04:00:46.259 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (51 ms) 2021-01-28T04:00:46.259 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2021-01-28T04:00:46.259 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (20476 ms) 2021-01-28T04:00:46.260 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2021-01-28T04:00:46.260 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: attempt 0 of 20 2021-01-28T04:00:46.260 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: failed to deregister: 2021-01-28T04:00:46.260 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: { 2021-01-28T04:00:46.261 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "epoch": 19, 2021-01-28T04:00:46.261 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "modified": "2021-01-28T04:00:41.514727+0000", 2021-01-28T04:00:46.261 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "services": { 2021-01-28T04:00:46.261 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "laundry": { 2021-01-28T04:00:46.261 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "daemons": { 2021-01-28T04:00:46.262 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "summary": "", 2021-01-28T04:00:46.262 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "close-test-pid32560": { 2021-01-28T04:00:46.262 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "start_epoch": 19, 2021-01-28T04:00:46.262 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "start_stamp": "2021-01-28T04:00:40.777019+0000", 2021-01-28T04:00:46.262 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "gid": 25099, 2021-01-28T04:00:46.263 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "addr": "172.21.15.100:0/2649355208", 2021-01-28T04:00:46.263 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "metadata": { 2021-01-28T04:00:46.263 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "arch": "x86_64", 2021-01-28T04:00:46.263 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "ceph_release": "quincy", 2021-01-28T04:00:46.264 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "ceph_version": "ceph version 17.0.0-184-g507028cb (507028cb839c25d6666833702df6325fd8569096) quincy (dev)", 2021-01-28T04:00:46.264 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "ceph_version_short": "17.0.0-184-g507028cb", 2021-01-28T04:00:46.264 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2021-01-28T04:00:46.264 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "distro": "ubuntu", 2021-01-28T04:00:46.264 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "distro_description": "Ubuntu 20.04.1 LTS", 2021-01-28T04:00:46.265 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "distro_version": "20.04", 2021-01-28T04:00:46.265 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "foo": "bar", 2021-01-28T04:00:46.265 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "hostname": "smithi100", 2021-01-28T04:00:46.265 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "kernel_description": "#73-Ubuntu SMP Mon Jan 18 17:25:17 UTC 2021", 2021-01-28T04:00:46.265 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "kernel_version": "5.4.0-65-generic", 2021-01-28T04:00:46.266 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "mem_swap_kb": "2097148", 2021-01-28T04:00:46.266 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "mem_total_kb": "32771428", 2021-01-28T04:00:46.266 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "os": "Linux", 2021-01-28T04:00:46.266 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "this": "that" 2021-01-28T04:00:46.267 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: }, 2021-01-28T04:00:46.267 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "task_status": {} 2021-01-28T04:00:46.267 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: } 2021-01-28T04:00:46.267 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: } 2021-01-28T04:00:46.267 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: }, 2021-01-28T04:00:46.268 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "rgw": { 2021-01-28T04:00:46.268 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "daemons": { 2021-01-28T04:00:46.268 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "summary": "", 2021-01-28T04:00:46.268 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "realm.zone.a": { 2021-01-28T04:00:46.268 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "start_epoch": 12, 2021-01-28T04:00:46.269 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "start_stamp": "2021-01-28T03:56:21.969200+0000", 2021-01-28T04:00:46.269 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "gid": 14496, 2021-01-28T04:00:46.269 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "addr": "172.21.15.100:0/2550306189", 2021-01-28T04:00:46.269 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "metadata": { 2021-01-28T04:00:46.270 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "arch": "x86_64", 2021-01-28T04:00:46.270 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "ceph_release": "quincy", 2021-01-28T04:00:46.807 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "ceph_version": "ceph version 17.0.0-184-g507028cb (507028cb839c25d66668337 api_watch_notify: Running main() from gmock_main.cc 2021-01-28T04:00:46.808 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2021-01-28T04:00:46.808 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: [----------] Global test environment set-up. 2021-01-28T04:00:46.808 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2021-01-28T04:00:46.808 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2021-01-28T04:00:46.809 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: watch_notify_test_cb 2021-01-28T04:00:46.809 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify (321 ms) 2021-01-28T04:00:46.809 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch2Delete 2021-01-28T04:00:46.809 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2021-01-28T04:00:46.809 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94119064053136 err -107 2021-01-28T04:00:46.810 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch2Delete (1098 ms) 2021-01-28T04:00:46.810 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete 2021-01-28T04:00:46.810 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2021-01-28T04:00:46.810 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94119064059504 err -107 2021-01-28T04:00:46.810 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete (1011 ms) 2021-01-28T04:00:46.811 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2 2021-01-28T04:00:46.811 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: watch_notify2_test_cb from 24811 notify_id 304942678016 cookie 94119064203408 2021-01-28T04:00:46.811 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2 (11 ms) 2021-01-28T04:00:46.812 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchNotify2 2021-01-28T04:00:46.812 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: watch_notify2_test_cb from 24811 notify_id 304942678017 cookie 94119064206560 2021-01-28T04:00:46.812 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchNotify2 (7 ms) 2021-01-28T04:00:46.813 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioNotify 2021-01-28T04:00:46.813 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: watch_notify2_test_cb from 24811 notify_id 304942678016 cookie 94119064213440 2021-01-28T04:00:46.813 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioNotify (10 ms) 2021-01-28T04:00:46.813 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2021-01-28T04:00:46.814 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: watch_notify2_test_cb from 24811 notify_id 304942678016 cookie 94119064216144 2021-01-28T04:00:46.814 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: watch_notify2_test_cb from 24811 notify_id 304942678016 cookie 94119064218432 2021-01-28T04:00:46.814 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Multi (13 ms) 2021-01-28T04:00:46.814 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2021-01-28T04:00:46.814 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: watch_notify2_test_cb from 24811 notify_id 304942678017 cookie 94119064218432 2021-01-28T04:00:46.815 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: watch_notify2_test_cb from 24811 notify_id 309237645314 cookie 94119064218432 2021-01-28T04:00:46.815 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3026 ms) 2021-01-28T04:00:46.815 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch3Timeout 2021-01-28T04:00:46.815 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: waiting up to 64 for osd to time us out ... 2021-01-28T04:00:46.815 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94119064216144 err -107 2021-01-28T04:00:46.816 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: watch_notify2_test_cb from 24811 notify_id 335007449091 cookie 94119064216144 2021-01-28T04:00:46.816 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch3Timeout (5088 ms) 2021-01-28T04:00:46.816 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete2 2021-01-28T04:00:46.816 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: waiting up to 30 for disconnect notification ... 2021-01-28T04:00:46.816 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94119064216144 err -107 2021-01-28T04:00:46.817 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete2 (1009 ms) 2021-01-28T04:00:46.817 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify (11595 ms total) 2021-01-28T04:00:46.817 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: 2021-01-28T04:00:46.817 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC 2021-01-28T04:00:46.817 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotifyEC.WatchNotify 2021-01-28T04:00:46.818 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: watch_notify_test_cb 2021-01-28T04:00:46.818 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: [ OK ] LibRadosWatchNotifyEC.WatchNotify (1267 ms) 2021-01-28T04:00:46.818 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC (1268 ms total) 2021-01-28T04:00:46.819 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: 2021-01-28T04:00:46.819 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: [----------] Global test environment tear-down 2021-01-28T04:00:46.819 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: [==========] 11 tests from 2 test suites ran. (33252 ms total) 2021-01-28T04:00:46.820 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify: [ PASSED ] 11 tests. 2021-01-28T04:00:47.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:46 smithi162 bash[9856]: audit 2021-01-28T04:00:44.023527+0000 mon.b (mon.2) 65 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:47.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:46 smithi162 bash[9856]: audit 2021-01-28T04:00:45.024619+0000 mon.b (mon.2) 66 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:47.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:46 smithi162 bash[9856]: audit 2021-01-28T04:00:45.508653+0000 mon.a (mon.0) 898 : audit [INF] from='client.? 172.21.15.100:0/2118431073' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32492-12"}]': finished 2021-01-28T04:00:47.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:46 smithi162 bash[9856]: audit 2021-01-28T04:00:45.508730+0000 mon.a (mon.0) 899 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:47.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:46 smithi162 bash[9856]: cluster 2021-01-28T04:00:45.508964+0000 mon.a (mon.0) 900 : cluster [DBG] osdmap e88: 8 total, 8 up, 8 in 2021-01-28T04:00:47.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:46 smithi162 bash[9856]: audit 2021-01-28T04:00:45.517403+0000 mon.b (mon.2) 67 : audit [INF] from='client.? 172.21.15.100:0/2305896140' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:47.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:46 smithi162 bash[9856]: cluster 2021-01-28T04:00:45.518727+0000 mgr.y (mgr.14138) 506 : cluster [DBG] pgmap v382: 520 pgs: 23 creating+peering, 127 unknown, 370 active+clean; 144 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 4.2 KiB/s wr, 2 op/s 2021-01-28T04:00:47.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:46 smithi162 bash[9856]: audit 2021-01-28T04:00:45.539798+0000 mon.c (mon.1) 75 : audit [INF] from='client.? 172.21.15.100:0/3045779560' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:47.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:46 smithi162 bash[9856]: audit 2021-01-28T04:00:45.545659+0000 mon.c (mon.1) 76 : audit [INF] from='client.? 172.21.15.100:0/1866317811' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32434-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:47.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:46 smithi162 bash[9856]: audit 2021-01-28T04:00:45.549559+0000 mon.a (mon.0) 901 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:47.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:46 smithi162 bash[9856]: audit 2021-01-28T04:00:45.576366+0000 mon.a (mon.0) 902 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:47.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:46 smithi162 bash[9856]: audit 2021-01-28T04:00:45.576743+0000 mon.a (mon.0) 903 : audit [INF] from='client.? 172.21.15.100:0/2118431073' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32492-12"}]: dispatch 2021-01-28T04:00:47.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:46 smithi162 bash[9856]: audit 2021-01-28T04:00:45.578445+0000 mon.a (mon.0) 904 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32434-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:47.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:46 smithi162 bash[9856]: audit 2021-01-28T04:00:46.025961+0000 mon.b (mon.2) 68 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:47.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:46 smithi162 bash[9856]: audit 2021-01-28T04:00:46.230682+0000 mon.b (mon.2) 69 : audit [DBG] from='client.? 172.21.15.100:0/2373085953' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2021-01-28T04:00:47.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:46 smithi100 bash[9834]: audit 2021-01-28T04:00:44.023527+0000 mon.b (mon.2) 65 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:47.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:46 smithi100 bash[9834]: audit 2021-01-28T04:00:45.024619+0000 mon.b (mon.2) 66 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:47.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:46 smithi100 bash[9834]: audit 2021-01-28T04:00:45.508653+0000 mon.a (mon.0) 898 : audit [INF] from='client.? 172.21.15.100:0/2118431073' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32492-12"}]': finished 2021-01-28T04:00:47.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:46 smithi100 bash[9834]: audit 2021-01-28T04:00:45.508730+0000 mon.a (mon.0) 899 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:47.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:46 smithi100 bash[9834]: cluster 2021-01-28T04:00:45.508964+0000 mon.a (mon.0) 900 : cluster [DBG] osdmap e88: 8 total, 8 up, 8 in 2021-01-28T04:00:47.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:46 smithi100 bash[9834]: audit 2021-01-28T04:00:45.517403+0000 mon.b (mon.2) 67 : audit [INF] from='client.? 172.21.15.100:0/2305896140' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:47.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:46 smithi100 bash[9834]: cluster 2021-01-28T04:00:45.518727+0000 mgr.y (mgr.14138) 506 : cluster [DBG] pgmap v382: 520 pgs: 23 creating+peering, 127 unknown, 370 active+clean; 144 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 4.2 KiB/s wr, 2 op/s 2021-01-28T04:00:47.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:46 smithi100 bash[9834]: audit 2021-01-28T04:00:45.539798+0000 mon.c (mon.1) 75 : audit [INF] from='client.? 172.21.15.100:0/3045779560' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:47.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:46 smithi100 bash[9834]: audit 2021-01-28T04:00:45.545659+0000 mon.c (mon.1) 76 : audit [INF] from='client.? 172.21.15.100:0/1866317811' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32434-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:47.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:46 smithi100 bash[9834]: audit 2021-01-28T04:00:45.549559+0000 mon.a (mon.0) 901 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:47.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:46 smithi100 bash[9834]: audit 2021-01-28T04:00:45.576366+0000 mon.a (mon.0) 902 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:47.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:46 smithi100 bash[9834]: audit 2021-01-28T04:00:45.576743+0000 mon.a (mon.0) 903 : audit [INF] from='client.? 172.21.15.100:0/2118431073' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32492-12"}]: dispatch 2021-01-28T04:00:47.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:46 smithi100 bash[9834]: audit 2021-01-28T04:00:45.578445+0000 mon.a (mon.0) 904 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32434-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:47.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:46 smithi100 bash[9834]: audit 2021-01-28T04:00:46.025961+0000 mon.b (mon.2) 68 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:47.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:46 smithi100 bash[9834]: audit 2021-01-28T04:00:46.230682+0000 mon.b (mon.2) 69 : audit [DBG] from='client.? 172.21.15.100:0/2373085953' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2021-01-28T04:00:47.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:46 smithi100 bash[13549]: audit 2021-01-28T04:00:44.023527+0000 mon.b (mon.2) 65 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:47.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:46 smithi100 bash[13549]: audit 2021-01-28T04:00:45.024619+0000 mon.b (mon.2) 66 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:47.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:46 smithi100 bash[13549]: audit 2021-01-28T04:00:45.508653+0000 mon.a (mon.0) 898 : audit [INF] from='client.? 172.21.15.100:0/2118431073' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32492-12"}]': finished 2021-01-28T04:00:47.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:46 smithi100 bash[13549]: audit 2021-01-28T04:00:45.508730+0000 mon.a (mon.0) 899 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:47.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:46 smithi100 bash[13549]: cluster 2021-01-28T04:00:45.508964+0000 mon.a (mon.0) 900 : cluster [DBG] osdmap e88: 8 total, 8 up, 8 in 2021-01-28T04:00:47.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:46 smithi100 bash[13549]: audit 2021-01-28T04:00:45.517403+0000 mon.b (mon.2) 67 : audit [INF] from='client.? 172.21.15.100:0/2305896140' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:47.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:46 smithi100 bash[13549]: cluster 2021-01-28T04:00:45.518727+0000 mgr.y (mgr.14138) 506 : cluster [DBG] pgmap v382: 520 pgs: 23 creating+peering, 127 unknown, 370 active+clean; 144 MiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 4.2 KiB/s wr, 2 op/s 2021-01-28T04:00:47.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:46 smithi100 bash[13549]: audit 2021-01-28T04:00:45.539798+0000 mon.c (mon.1) 75 : audit [INF] from='client.? 172.21.15.100:0/3045779560' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:47.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:46 smithi100 bash[13549]: audit 2021-01-28T04:00:45.545659+0000 mon.c (mon.1) 76 : audit [INF] from='client.? 172.21.15.100:0/1866317811' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32434-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:47.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:46 smithi100 bash[13549]: audit 2021-01-28T04:00:45.549559+0000 mon.a (mon.0) 901 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:47.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:46 smithi100 bash[13549]: audit 2021-01-28T04:00:45.576366+0000 mon.a (mon.0) 902 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:47.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:46 smithi100 bash[13549]: audit 2021-01-28T04:00:45.576743+0000 mon.a (mon.0) 903 : audit [INF] from='client.? 172.21.15.100:0/2118431073' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32492-12"}]: dispatch 2021-01-28T04:00:47.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:46 smithi100 bash[13549]: audit 2021-01-28T04:00:45.578445+0000 mon.a (mon.0) 904 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32434-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:47.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:46 smithi100 bash[13549]: audit 2021-01-28T04:00:46.025961+0000 mon.b (mon.2) 68 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:47.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:46 smithi100 bash[13549]: audit 2021-01-28T04:00:46.230682+0000 mon.b (mon.2) 69 : audit [DBG] from='client.? 172.21.15.100:0/2373085953' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2021-01-28T04:00:48.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:47 smithi162 bash[9856]: audit 2021-01-28T04:00:46.230322+0000 mgr.y (mgr.14138) 507 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2021-01-28T04:00:48.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:47 smithi162 bash[9856]: audit 2021-01-28T04:00:46.771263+0000 mon.a (mon.0) 905 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:48.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:47 smithi162 bash[9856]: audit 2021-01-28T04:00:46.771475+0000 mon.a (mon.0) 906 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:48.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:47 smithi162 bash[9856]: audit 2021-01-28T04:00:46.771578+0000 mon.a (mon.0) 907 : audit [INF] from='client.? 172.21.15.100:0/2118431073' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32492-12"}]': finished 2021-01-28T04:00:48.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:47 smithi162 bash[9856]: audit 2021-01-28T04:00:46.771669+0000 mon.a (mon.0) 908 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32434-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:48.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:47 smithi162 bash[9856]: cluster 2021-01-28T04:00:46.772098+0000 mon.a (mon.0) 909 : cluster [DBG] osdmap e89: 8 total, 8 up, 8 in 2021-01-28T04:00:48.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:47 smithi162 bash[9856]: audit 2021-01-28T04:00:46.779857+0000 mon.c (mon.1) 77 : audit [INF] from='client.? 172.21.15.100:0/3985313304' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:48.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:47 smithi162 bash[9856]: audit 2021-01-28T04:00:46.780205+0000 mon.c (mon.1) 78 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:48.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:47 smithi162 bash[9856]: audit 2021-01-28T04:00:46.792005+0000 mon.a (mon.0) 910 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:48.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:47 smithi162 bash[9856]: audit 2021-01-28T04:00:46.792476+0000 mon.a (mon.0) 911 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:48.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:47 smithi162 bash[9856]: audit 2021-01-28T04:00:47.027873+0000 mon.b (mon.2) 70 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:48.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:47 smithi162 bash[9856]: cluster 2021-01-28T04:00:47.520562+0000 mgr.y (mgr.14138) 508 : cluster [DBG] pgmap v384: 584 pgs: 48 creating+peering, 110 unknown, 426 active+clean; 144 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 op/s 2021-01-28T04:00:48.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:47 smithi100 bash[9834]: audit 2021-01-28T04:00:46.230322+0000 mgr.y (mgr.14138) 507 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2021-01-28T04:00:48.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:47 smithi100 bash[9834]: audit 2021-01-28T04:00:46.771263+0000 mon.a (mon.0) 905 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:48.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:47 smithi100 bash[9834]: audit 2021-01-28T04:00:46.771475+0000 mon.a (mon.0) 906 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:48.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:47 smithi100 bash[9834]: audit 2021-01-28T04:00:46.771578+0000 mon.a (mon.0) 907 : audit [INF] from='client.? 172.21.15.100:0/2118431073' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32492-12"}]': finished 2021-01-28T04:00:48.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:47 smithi100 bash[9834]: audit 2021-01-28T04:00:46.771669+0000 mon.a (mon.0) 908 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32434-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:48.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:47 smithi100 bash[9834]: cluster 2021-01-28T04:00:46.772098+0000 mon.a (mon.0) 909 : cluster [DBG] osdmap e89: 8 total, 8 up, 8 in 2021-01-28T04:00:48.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:47 smithi100 bash[9834]: audit 2021-01-28T04:00:46.779857+0000 mon.c (mon.1) 77 : audit [INF] from='client.? 172.21.15.100:0/3985313304' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:48.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:47 smithi100 bash[9834]: audit 2021-01-28T04:00:46.780205+0000 mon.c (mon.1) 78 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:48.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:47 smithi100 bash[9834]: audit 2021-01-28T04:00:46.792005+0000 mon.a (mon.0) 910 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:48.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:47 smithi100 bash[9834]: audit 2021-01-28T04:00:46.792476+0000 mon.a (mon.0) 911 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:48.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:47 smithi100 bash[9834]: audit 2021-01-28T04:00:47.027873+0000 mon.b (mon.2) 70 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:48.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:47 smithi100 bash[9834]: cluster 2021-01-28T04:00:47.520562+0000 mgr.y (mgr.14138) 508 : cluster [DBG] pgmap v384: 584 pgs: 48 creating+peering, 110 unknown, 426 active+clean; 144 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 op/s 2021-01-28T04:00:48.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:47 smithi100 bash[13549]: audit 2021-01-28T04:00:46.230322+0000 mgr.y (mgr.14138) 507 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2021-01-28T04:00:48.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:47 smithi100 bash[13549]: audit 2021-01-28T04:00:46.771263+0000 mon.a (mon.0) 905 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:48.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:47 smithi100 bash[13549]: audit 2021-01-28T04:00:46.771475+0000 mon.a (mon.0) 906 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:48.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:47 smithi100 bash[13549]: audit 2021-01-28T04:00:46.771578+0000 mon.a (mon.0) 907 : audit [INF] from='client.? 172.21.15.100:0/2118431073' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32492-12"}]': finished 2021-01-28T04:00:48.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:47 smithi100 bash[13549]: audit 2021-01-28T04:00:46.771669+0000 mon.a (mon.0) 908 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32434-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:48.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:47 smithi100 bash[13549]: cluster 2021-01-28T04:00:46.772098+0000 mon.a (mon.0) 909 : cluster [DBG] osdmap e89: 8 total, 8 up, 8 in 2021-01-28T04:00:48.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:47 smithi100 bash[13549]: audit 2021-01-28T04:00:46.779857+0000 mon.c (mon.1) 77 : audit [INF] from='client.? 172.21.15.100:0/3985313304' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:48.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:47 smithi100 bash[13549]: audit 2021-01-28T04:00:46.780205+0000 mon.c (mon.1) 78 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:48.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:47 smithi100 bash[13549]: audit 2021-01-28T04:00:46.792005+0000 mon.a (mon.0) 910 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:48.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:47 smithi100 bash[13549]: audit 2021-01-28T04:00:46.792476+0000 mon.a (mon.0) 911 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:48.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:47 smithi100 bash[13549]: audit 2021-01-28T04:00:47.027873+0000 mon.b (mon.2) 70 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:48.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:47 smithi100 bash[13549]: cluster 2021-01-28T04:00:47.520562+0000 mgr.y (mgr.14138) 508 : cluster [DBG] pgmap v384: 584 pgs: 48 creating+peering, 110 unknown, 426 active+clean; 144 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 op/s 2021-01-28T04:00:49.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:49 smithi162 bash[9856]: audit 2021-01-28T04:00:47.779099+0000 mon.a (mon.0) 912 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:49.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:49 smithi162 bash[9856]: audit 2021-01-28T04:00:47.779208+0000 mon.a (mon.0) 913 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:49.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:49 smithi162 bash[9856]: cluster 2021-01-28T04:00:47.779425+0000 mon.a (mon.0) 914 : cluster [DBG] osdmap e90: 8 total, 8 up, 8 in 2021-01-28T04:00:49.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:49 smithi162 bash[9856]: audit 2021-01-28T04:00:47.978311+0000 mon.c (mon.1) 79 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-7", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:00:49.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:49 smithi162 bash[9856]: audit 2021-01-28T04:00:48.032915+0000 mon.b (mon.2) 71 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:49.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:49 smithi100 bash[9834]: audit 2021-01-28T04:00:47.779099+0000 mon.a (mon.0) 912 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:49.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:49 smithi100 bash[9834]: audit 2021-01-28T04:00:47.779208+0000 mon.a (mon.0) 913 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:49.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:49 smithi100 bash[9834]: cluster 2021-01-28T04:00:47.779425+0000 mon.a (mon.0) 914 : cluster [DBG] osdmap e90: 8 total, 8 up, 8 in 2021-01-28T04:00:49.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:49 smithi100 bash[9834]: audit 2021-01-28T04:00:47.978311+0000 mon.c (mon.1) 79 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-7", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:00:49.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:49 smithi100 bash[9834]: audit 2021-01-28T04:00:48.032915+0000 mon.b (mon.2) 71 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:49.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:49 smithi100 bash[13549]: audit 2021-01-28T04:00:47.779099+0000 mon.a (mon.0) 912 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:49.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:49 smithi100 bash[13549]: audit 2021-01-28T04:00:47.779208+0000 mon.a (mon.0) 913 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:49.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:49 smithi100 bash[13549]: cluster 2021-01-28T04:00:47.779425+0000 mon.a (mon.0) 914 : cluster [DBG] osdmap e90: 8 total, 8 up, 8 in 2021-01-28T04:00:49.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:49 smithi100 bash[13549]: audit 2021-01-28T04:00:47.978311+0000 mon.c (mon.1) 79 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-7", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:00:49.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:49 smithi100 bash[13549]: audit 2021-01-28T04:00:48.032915+0000 mon.b (mon.2) 71 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:50.012 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 04:00:49 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T04:00:50.086 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 04:00:49 smithi100 bash[10061]: debug 2021-01-28T04:00:49.715+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:00:50.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:50 smithi162 bash[9856]: audit 2021-01-28T04:00:49.035445+0000 mon.b (mon.2) 72 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:50.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:50 smithi162 bash[9856]: cluster 2021-01-28T04:00:49.139329+0000 mon.a (mon.0) 915 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2021-01-28T04:00:50.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:50 smithi162 bash[9856]: audit 2021-01-28T04:00:49.160210+0000 mon.b (mon.2) 73 : audit [INF] from='client.? 172.21.15.100:0/2700952871' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:50.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:50 smithi162 bash[9856]: audit 2021-01-28T04:00:49.184561+0000 mon.a (mon.0) 916 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:50.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:50 smithi162 bash[9856]: audit 2021-01-28T04:00:49.185508+0000 mon.a (mon.0) 917 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-7", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:00:50.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:50 smithi162 bash[9856]: audit 2021-01-28T04:00:50.017468+0000 mon.c (mon.1) 80 : audit [INF] from='client.? 172.21.15.100:0/1700367650' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32511-4"}]: dispatch 2021-01-28T04:00:50.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:50 smithi162 bash[9856]: audit 2021-01-28T04:00:50.022665+0000 mon.a (mon.0) 918 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32511-4"}]: dispatch 2021-01-28T04:00:50.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:50 smithi162 bash[9856]: audit 2021-01-28T04:00:50.039310+0000 mon.b (mon.2) 74 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:50.577 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:50 smithi100 bash[13549]: audit 2021-01-28T04:00:49.035445+0000 mon.b (mon.2) 72 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:50.578 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:50 smithi100 bash[13549]: cluster 2021-01-28T04:00:49.139329+0000 mon.a (mon.0) 915 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2021-01-28T04:00:50.578 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:50 smithi100 bash[13549]: audit 2021-01-28T04:00:49.160210+0000 mon.b (mon.2) 73 : audit [INF] from='client.? 172.21.15.100:0/2700952871' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:50.578 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:50 smithi100 bash[13549]: audit 2021-01-28T04:00:49.184561+0000 mon.a (mon.0) 916 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:50.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:50 smithi100 bash[13549]: audit 2021-01-28T04:00:49.185508+0000 mon.a (mon.0) 917 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-7", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:00:50.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:50 smithi100 bash[13549]: audit 2021-01-28T04:00:50.017468+0000 mon.c (mon.1) 80 : audit [INF] from='client.? 172.21.15.100:0/1700367650' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32511-4"}]: dispatch 2021-01-28T04:00:50.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:50 smithi100 bash[13549]: audit 2021-01-28T04:00:50.022665+0000 mon.a (mon.0) 918 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32511-4"}]: dispatch 2021-01-28T04:00:50.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:50 smithi100 bash[13549]: audit 2021-01-28T04:00:50.039310+0000 mon.b (mon.2) 74 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:50.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:50 smithi100 bash[9834]: audit 2021-01-28T04:00:49.035445+0000 mon.b (mon.2) 72 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:50.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:50 smithi100 bash[9834]: cluster 2021-01-28T04:00:49.139329+0000 mon.a (mon.0) 915 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2021-01-28T04:00:50.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:50 smithi100 bash[9834]: audit 2021-01-28T04:00:49.160210+0000 mon.b (mon.2) 73 : audit [INF] from='client.? 172.21.15.100:0/2700952871' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:50.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:50 smithi100 bash[9834]: audit 2021-01-28T04:00:49.184561+0000 mon.a (mon.0) 916 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:50.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:50 smithi100 bash[9834]: audit 2021-01-28T04:00:49.185508+0000 mon.a (mon.0) 917 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-7", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:00:50.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:50 smithi100 bash[9834]: audit 2021-01-28T04:00:50.017468+0000 mon.c (mon.1) 80 : audit [INF] from='client.? 172.21.15.100:0/1700367650' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32511-4"}]: dispatch 2021-01-28T04:00:50.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:50 smithi100 bash[9834]: audit 2021-01-28T04:00:50.022665+0000 mon.a (mon.0) 918 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32511-4"}]: dispatch 2021-01-28T04:00:50.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:50 smithi100 bash[9834]: audit 2021-01-28T04:00:50.039310+0000 mon.b (mon.2) 74 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:51.158 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_write_operations: Running main() from gmock_main.cc 2021-01-28T04:00:51.159 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_write_operations: [==========] Running 8 tests from 2 test suites. 2021-01-28T04:00:51.159 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_write_operations: [----------] Global test environment set-up. 2021-01-28T04:00:51.159 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps 2021-01-28T04:00:51.160 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_write_operations: [ RUN ] LibradosCWriteOps.NewDelete 2021-01-28T04:00:51.160 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_write_operations: [ OK ] LibradosCWriteOps.NewDelete (0 ms) 2021-01-28T04:00:51.160 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps (0 ms total) 2021-01-28T04:00:51.161 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_write_operations: 2021-01-28T04:00:51.161 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps 2021-01-28T04:00:51.161 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.assertExists 2021-01-28T04:00:51.162 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.assertExists (13070 ms) 2021-01-28T04:00:51.162 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2021-01-28T04:00:51.162 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteOpAssertVersion (6217 ms) 2021-01-28T04:00:51.162 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Xattrs 2021-01-28T04:00:51.163 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Xattrs (4254 ms) 2021-01-28T04:00:51.163 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Write 2021-01-28T04:00:51.163 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Write (3941 ms) 2021-01-28T04:00:51.164 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Exec 2021-01-28T04:00:51.164 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Exec (2734 ms) 2021-01-28T04:00:51.164 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteSame 2021-01-28T04:00:51.165 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteSame (3973 ms) 2021-01-28T04:00:51.165 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.CmpExt 2021-01-28T04:00:51.165 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.CmpExt (3366 ms) 2021-01-28T04:00:51.166 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps (37555 ms total) 2021-01-28T04:00:51.166 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_write_operations: 2021-01-28T04:00:51.167 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_write_operations: [----------] Global test environment tear-down 2021-01-28T04:00:51.167 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_write_operations: [==========] 8 tests from 2 test suites ran. (37556 ms total) 2021-01-28T04:00:51.167 INFO:tasks.workunit.client.0.smithi100.stdout: api_c_write_operations: [ PASSED ] 8 tests. 2021-01-28T04:00:51.451 INFO:tasks.workunit.client.0.smithi100.stdout:02df6325fd8569096) quincy (dev)", 2021-01-28T04:00:51.452 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "ceph_version_short": "17.0.0-184-g507028cb", 2021-01-28T04:00:51.453 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "container_hostname": "smithi100", 2021-01-28T04:00:51.453 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "container_image": "quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096", 2021-01-28T04:00:51.454 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz", 2021-01-28T04:00:51.455 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "distro": "centos", 2021-01-28T04:00:51.455 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "distro_description": "CentOS Linux 8", 2021-01-28T04:00:51.456 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "distro_version": "8", 2021-01-28T04:00:51.456 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "frontend_config#0": "beast port=80", 2021-01-28T04:00:51.457 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "frontend_type#0": "beast", 2021-01-28T04:00:51.458 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "hostname": "smithi100", 2021-01-28T04:00:51.458 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "kernel_description": "#73-Ubuntu SMP Mon Jan 18 17:25:17 UTC 2021", 2021-01-28T04:00:51.459 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "kernel_version": "5.4.0-65-generic", 2021-01-28T04:00:51.460 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "mem_swap_kb": "2097148", 2021-01-28T04:00:51.460 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "mem_total_kb": "32771428", 2021-01-28T04:00:51.461 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "num_handles": "1", 2021-01-28T04:00:51.461 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "os": "Linux", 2021-01-28T04:00:51.461 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "pid": "1", 2021-01-28T04:00:51.461 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "zone_id": "e53076dc-85a9-4192-87da-143df67788de", 2021-01-28T04:00:51.461 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "zone_name": "zone", 2021-01-28T04:00:51.462 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "zonegroup_id": "29ff9088-b567-4547-a48e-10ad7af437c6", 2021-01-28T04:00:51.462 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "zonegroup_name": "default" 2021-01-28T04:00:51.462 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: }, 2021-01-28T04:00:51.462 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: "task_status": {} 2021-01-28T04:00:51.462 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: } 2021-01-28T04:00:51.463 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: } 2021-01-28T04:00:51.463 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: } 2021-01-28T04:00:51.463 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: } 2021-01-28T04:00:51.463 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: } 2021-01-28T04:00:51.463 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: 2021-01-28T04:00:51.464 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: attempt 1 of 20 2021-01-28T04:00:51.464 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (10700 ms) 2021-01-28T04:00:51.464 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (37846 ms total) 2021-01-28T04:00:51.464 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: 2021-01-28T04:00:51.464 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: [----------] Global test environment tear-down 2021-01-28T04:00:51.465 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (37846 ms total) 2021-01-28T04:00:51.465 INFO:tasks.workunit.client.0.smithi100.stdout: api_service_pp: [ PASSED ] 4 tests. 2021-01-28T04:00:51.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:51 smithi162 bash[9856]: cluster 2021-01-28T04:00:49.524190+0000 mgr.y (mgr.14138) 509 : cluster [DBG] pgmap v387: 584 pgs: 49 creating+peering, 63 unknown, 472 active+clean; 144 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2021-01-28T04:00:51.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:51 smithi162 bash[9856]: audit 2021-01-28T04:00:49.719545+0000 mgr.y (mgr.14138) 510 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:00:51.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:51 smithi162 bash[9856]: cluster 2021-01-28T04:00:50.136852+0000 mon.a (mon.0) 919 : cluster [INF] Health check cleared: POOL_FULL (was: 1 pool(s) full) 2021-01-28T04:00:51.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:51 smithi162 bash[9856]: audit 2021-01-28T04:00:50.142098+0000 mon.a (mon.0) 920 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:51.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:51 smithi162 bash[9856]: audit 2021-01-28T04:00:50.142259+0000 mon.a (mon.0) 921 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-7", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:00:51.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:51 smithi162 bash[9856]: audit 2021-01-28T04:00:50.142448+0000 mon.a (mon.0) 922 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32511-4"}]': finished 2021-01-28T04:00:51.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:51 smithi162 bash[9856]: cluster 2021-01-28T04:00:50.142519+0000 mon.a (mon.0) 923 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2021-01-28T04:00:51.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:51 smithi162 bash[9856]: audit 2021-01-28T04:00:50.164579+0000 mon.c (mon.1) 81 : audit [INF] from='client.? 172.21.15.100:0/1700367650' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32511-4", "tierpool": "test-rados-api-smithi100-32511-6"}]: dispatch 2021-01-28T04:00:51.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:51 smithi162 bash[9856]: audit 2021-01-28T04:00:50.169919+0000 mon.c (mon.1) 82 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-7"}]: dispatch 2021-01-28T04:00:51.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:51 smithi162 bash[9856]: audit 2021-01-28T04:00:50.176874+0000 mon.c (mon.1) 83 : audit [INF] from='client.? 172.21.15.100:0/3830634069' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:51.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:51 smithi162 bash[9856]: audit 2021-01-28T04:00:50.193267+0000 mon.a (mon.0) 924 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32511-4", "tierpool": "test-rados-api-smithi100-32511-6"}]: dispatch 2021-01-28T04:00:51.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:51 smithi162 bash[9856]: audit 2021-01-28T04:00:50.193624+0000 mon.a (mon.0) 925 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-7"}]: dispatch 2021-01-28T04:00:51.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:51 smithi162 bash[9856]: audit 2021-01-28T04:00:50.193870+0000 mon.a (mon.0) 926 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:51.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:51 smithi162 bash[9856]: audit 2021-01-28T04:00:51.040664+0000 mon.b (mon.2) 75 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:51.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:51 smithi100 bash[9834]: cluster 2021-01-28T04:00:49.524190+0000 mgr.y (mgr.14138) 509 : cluster [DBG] pgmap v387: 584 pgs: 49 creating+peering, 63 unknown, 472 active+clean; 144 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2021-01-28T04:00:51.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:51 smithi100 bash[9834]: audit 2021-01-28T04:00:49.719545+0000 mgr.y (mgr.14138) 510 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:00:51.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:51 smithi100 bash[9834]: cluster 2021-01-28T04:00:50.136852+0000 mon.a (mon.0) 919 : cluster [INF] Health check cleared: POOL_FULL (was: 1 pool(s) full) 2021-01-28T04:00:51.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:51 smithi100 bash[9834]: audit 2021-01-28T04:00:50.142098+0000 mon.a (mon.0) 920 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:51.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:51 smithi100 bash[9834]: audit 2021-01-28T04:00:50.142259+0000 mon.a (mon.0) 921 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-7", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:00:51.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:51 smithi100 bash[9834]: audit 2021-01-28T04:00:50.142448+0000 mon.a (mon.0) 922 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32511-4"}]': finished 2021-01-28T04:00:51.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:51 smithi100 bash[9834]: cluster 2021-01-28T04:00:50.142519+0000 mon.a (mon.0) 923 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2021-01-28T04:00:51.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:51 smithi100 bash[9834]: audit 2021-01-28T04:00:50.164579+0000 mon.c (mon.1) 81 : audit [INF] from='client.? 172.21.15.100:0/1700367650' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32511-4", "tierpool": "test-rados-api-smithi100-32511-6"}]: dispatch 2021-01-28T04:00:51.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:51 smithi100 bash[9834]: audit 2021-01-28T04:00:50.169919+0000 mon.c (mon.1) 82 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-7"}]: dispatch 2021-01-28T04:00:51.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:51 smithi100 bash[9834]: audit 2021-01-28T04:00:50.176874+0000 mon.c (mon.1) 83 : audit [INF] from='client.? 172.21.15.100:0/3830634069' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:51.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:51 smithi100 bash[9834]: audit 2021-01-28T04:00:50.193267+0000 mon.a (mon.0) 924 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32511-4", "tierpool": "test-rados-api-smithi100-32511-6"}]: dispatch 2021-01-28T04:00:51.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:51 smithi100 bash[9834]: audit 2021-01-28T04:00:50.193624+0000 mon.a (mon.0) 925 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-7"}]: dispatch 2021-01-28T04:00:51.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:51 smithi100 bash[9834]: audit 2021-01-28T04:00:50.193870+0000 mon.a (mon.0) 926 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:51.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:51 smithi100 bash[9834]: audit 2021-01-28T04:00:51.040664+0000 mon.b (mon.2) 75 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:51.592 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:51 smithi100 bash[13549]: cluster 2021-01-28T04:00:49.524190+0000 mgr.y (mgr.14138) 509 : cluster [DBG] pgmap v387: 584 pgs: 49 creating+peering, 63 unknown, 472 active+clean; 144 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2021-01-28T04:00:51.593 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:51 smithi100 bash[13549]: audit 2021-01-28T04:00:49.719545+0000 mgr.y (mgr.14138) 510 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:00:51.593 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:51 smithi100 bash[13549]: cluster 2021-01-28T04:00:50.136852+0000 mon.a (mon.0) 919 : cluster [INF] Health check cleared: POOL_FULL (was: 1 pool(s) full) 2021-01-28T04:00:51.594 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:51 smithi100 bash[13549]: audit 2021-01-28T04:00:50.142098+0000 mon.a (mon.0) 920 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32588-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:51.594 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:51 smithi100 bash[13549]: audit 2021-01-28T04:00:50.142259+0000 mon.a (mon.0) 921 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-7", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:00:51.594 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:51 smithi100 bash[13549]: audit 2021-01-28T04:00:50.142448+0000 mon.a (mon.0) 922 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32511-4"}]': finished 2021-01-28T04:00:51.594 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:51 smithi100 bash[13549]: cluster 2021-01-28T04:00:50.142519+0000 mon.a (mon.0) 923 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2021-01-28T04:00:51.595 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:51 smithi100 bash[13549]: audit 2021-01-28T04:00:50.164579+0000 mon.c (mon.1) 81 : audit [INF] from='client.? 172.21.15.100:0/1700367650' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32511-4", "tierpool": "test-rados-api-smithi100-32511-6"}]: dispatch 2021-01-28T04:00:51.595 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:51 smithi100 bash[13549]: audit 2021-01-28T04:00:50.169919+0000 mon.c (mon.1) 82 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-7"}]: dispatch 2021-01-28T04:00:51.595 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:51 smithi100 bash[13549]: audit 2021-01-28T04:00:50.176874+0000 mon.c (mon.1) 83 : audit [INF] from='client.? 172.21.15.100:0/3830634069' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:51.596 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:51 smithi100 bash[13549]: audit 2021-01-28T04:00:50.193267+0000 mon.a (mon.0) 924 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32511-4", "tierpool": "test-rados-api-smithi100-32511-6"}]: dispatch 2021-01-28T04:00:51.596 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:51 smithi100 bash[13549]: audit 2021-01-28T04:00:50.193624+0000 mon.a (mon.0) 925 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-7"}]: dispatch 2021-01-28T04:00:51.596 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:51 smithi100 bash[13549]: audit 2021-01-28T04:00:50.193870+0000 mon.a (mon.0) 926 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:51.597 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:51 smithi100 bash[13549]: audit 2021-01-28T04:00:51.040664+0000 mon.b (mon.2) 75 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:52.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:52 smithi100 bash[9834]: cluster 2021-01-28T04:00:51.139104+0000 mon.a (mon.0) 927 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:00:52.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:52 smithi100 bash[9834]: audit 2021-01-28T04:00:51.144308+0000 mon.a (mon.0) 928 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32511-4", "tierpool": "test-rados-api-smithi100-32511-6"}]': finished 2021-01-28T04:00:52.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:52 smithi100 bash[9834]: audit 2021-01-28T04:00:51.144411+0000 mon.a (mon.0) 929 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-7"}]': finished 2021-01-28T04:00:52.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:52 smithi100 bash[9834]: audit 2021-01-28T04:00:51.144476+0000 mon.a (mon.0) 930 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:52.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:52 smithi100 bash[9834]: cluster 2021-01-28T04:00:51.144629+0000 mon.a (mon.0) 931 : cluster [DBG] osdmap e93: 8 total, 8 up, 8 in 2021-01-28T04:00:52.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:52 smithi100 bash[9834]: audit 2021-01-28T04:00:51.162179+0000 mon.c (mon.1) 84 : audit [INF] from='client.? 172.21.15.100:0/1700367650' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi100-32511-6", "pool2": "test-rados-api-smithi100-32511-6", "yes_i_really_really_mean_it": true}]: dispatch 2021-01-28T04:00:52.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:52 smithi100 bash[9834]: audit 2021-01-28T04:00:51.163247+0000 mon.a (mon.0) 932 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi100-32511-6", "pool2": "test-rados-api-smithi100-32511-6", "yes_i_really_really_mean_it": true}]: dispatch 2021-01-28T04:00:52.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:52 smithi100 bash[9834]: audit 2021-01-28T04:00:51.339585+0000 mon.c (mon.1) 85 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:00:52.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:52 smithi100 bash[9834]: audit 2021-01-28T04:00:51.340279+0000 mon.a (mon.0) 933 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:00:52.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:52 smithi100 bash[9834]: audit 2021-01-28T04:00:51.403433+0000 mgr.y (mgr.14138) 511 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2021-01-28T04:00:52.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:52 smithi100 bash[9834]: audit 2021-01-28T04:00:51.404266+0000 mon.b (mon.2) 76 : audit [DBG] from='client.? 172.21.15.100:0/3600836021' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2021-01-28T04:00:52.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:52 smithi100 bash[9834]: cluster 2021-01-28T04:00:51.525056+0000 mgr.y (mgr.14138) 512 : cluster [DBG] pgmap v390: 456 pgs: 27 creating+peering, 25 unknown, 404 active+clean; 144 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1022 B/s rd, 0 op/s 2021-01-28T04:00:52.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:52 smithi100 bash[13549]: cluster 2021-01-28T04:00:51.139104+0000 mon.a (mon.0) 927 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:00:52.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:52 smithi100 bash[13549]: audit 2021-01-28T04:00:51.144308+0000 mon.a (mon.0) 928 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32511-4", "tierpool": "test-rados-api-smithi100-32511-6"}]': finished 2021-01-28T04:00:52.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:52 smithi100 bash[13549]: audit 2021-01-28T04:00:51.144411+0000 mon.a (mon.0) 929 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-7"}]': finished 2021-01-28T04:00:52.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:52 smithi100 bash[13549]: audit 2021-01-28T04:00:51.144476+0000 mon.a (mon.0) 930 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:52.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:52 smithi100 bash[13549]: cluster 2021-01-28T04:00:51.144629+0000 mon.a (mon.0) 931 : cluster [DBG] osdmap e93: 8 total, 8 up, 8 in 2021-01-28T04:00:52.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:52 smithi100 bash[13549]: audit 2021-01-28T04:00:51.162179+0000 mon.c (mon.1) 84 : audit [INF] from='client.? 172.21.15.100:0/1700367650' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi100-32511-6", "pool2": "test-rados-api-smithi100-32511-6", "yes_i_really_really_mean_it": true}]: dispatch 2021-01-28T04:00:52.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:52 smithi100 bash[13549]: audit 2021-01-28T04:00:51.163247+0000 mon.a (mon.0) 932 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi100-32511-6", "pool2": "test-rados-api-smithi100-32511-6", "yes_i_really_really_mean_it": true}]: dispatch 2021-01-28T04:00:52.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:52 smithi100 bash[13549]: audit 2021-01-28T04:00:51.339585+0000 mon.c (mon.1) 85 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:00:52.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:52 smithi100 bash[13549]: audit 2021-01-28T04:00:51.340279+0000 mon.a (mon.0) 933 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:00:52.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:52 smithi100 bash[13549]: audit 2021-01-28T04:00:51.403433+0000 mgr.y (mgr.14138) 511 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2021-01-28T04:00:52.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:52 smithi100 bash[13549]: audit 2021-01-28T04:00:51.404266+0000 mon.b (mon.2) 76 : audit [DBG] from='client.? 172.21.15.100:0/3600836021' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2021-01-28T04:00:52.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:52 smithi100 bash[13549]: cluster 2021-01-28T04:00:51.525056+0000 mgr.y (mgr.14138) 512 : cluster [DBG] pgmap v390: 456 pgs: 27 creating+peering, 25 unknown, 404 active+clean; 144 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1022 B/s rd, 0 op/s 2021-01-28T04:00:53.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:52 smithi162 bash[9856]: cluster 2021-01-28T04:00:51.139104+0000 mon.a (mon.0) 927 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:00:53.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:52 smithi162 bash[9856]: audit 2021-01-28T04:00:51.144308+0000 mon.a (mon.0) 928 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32511-4", "tierpool": "test-rados-api-smithi100-32511-6"}]': finished 2021-01-28T04:00:53.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:52 smithi162 bash[9856]: audit 2021-01-28T04:00:51.144411+0000 mon.a (mon.0) 929 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-7"}]': finished 2021-01-28T04:00:53.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:52 smithi162 bash[9856]: audit 2021-01-28T04:00:51.144476+0000 mon.a (mon.0) 930 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:53.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:52 smithi162 bash[9856]: cluster 2021-01-28T04:00:51.144629+0000 mon.a (mon.0) 931 : cluster [DBG] osdmap e93: 8 total, 8 up, 8 in 2021-01-28T04:00:53.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:52 smithi162 bash[9856]: audit 2021-01-28T04:00:51.162179+0000 mon.c (mon.1) 84 : audit [INF] from='client.? 172.21.15.100:0/1700367650' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi100-32511-6", "pool2": "test-rados-api-smithi100-32511-6", "yes_i_really_really_mean_it": true}]: dispatch 2021-01-28T04:00:53.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:52 smithi162 bash[9856]: audit 2021-01-28T04:00:51.163247+0000 mon.a (mon.0) 932 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi100-32511-6", "pool2": "test-rados-api-smithi100-32511-6", "yes_i_really_really_mean_it": true}]: dispatch 2021-01-28T04:00:53.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:52 smithi162 bash[9856]: audit 2021-01-28T04:00:51.339585+0000 mon.c (mon.1) 85 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:00:53.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:52 smithi162 bash[9856]: audit 2021-01-28T04:00:51.340279+0000 mon.a (mon.0) 933 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:00:53.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:52 smithi162 bash[9856]: audit 2021-01-28T04:00:51.403433+0000 mgr.y (mgr.14138) 511 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2021-01-28T04:00:53.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:52 smithi162 bash[9856]: audit 2021-01-28T04:00:51.404266+0000 mon.b (mon.2) 76 : audit [DBG] from='client.? 172.21.15.100:0/3600836021' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2021-01-28T04:00:53.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:52 smithi162 bash[9856]: cluster 2021-01-28T04:00:51.525056+0000 mgr.y (mgr.14138) 512 : cluster [DBG] pgmap v390: 456 pgs: 27 creating+peering, 25 unknown, 404 active+clean; 144 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1022 B/s rd, 0 op/s 2021-01-28T04:00:53.534 INFO:tasks.workunit.client.0.smithi100.stdout:_watch_notify_pp: flushed 2021-01-28T04:00:53.535 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3011 ms) 2021-01-28T04:00:53.535 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2021-01-28T04:00:53.535 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: trying... 2021-01-28T04:00:53.535 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: handle_notify cookie 94678221260544 notify_id 356482285573 notifier_gid 25024 2021-01-28T04:00:53.536 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: timed out 2021-01-28T04:00:53.536 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: flushing 2021-01-28T04:00:53.536 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: flushed 2021-01-28T04:00:53.536 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3009 ms) 2021-01-28T04:00:53.536 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2021-01-28T04:00:53.537 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: List watches 2021-01-28T04:00:53.537 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: notify2 2021-01-28T04:00:53.537 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: handle_notify cookie 94678221260544 notify_id 373662154758 notifier_gid 25024 2021-01-28T04:00:53.537 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: notify2 done 2021-01-28T04:00:53.538 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: watch_check 2021-01-28T04:00:53.538 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: unwatch2 2021-01-28T04:00:53.538 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: flushing 2021-01-28T04:00:53.538 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: done 2021-01-28T04:00:53.538 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3163 ms) 2021-01-28T04:00:53.539 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2021-01-28T04:00:53.539 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: List watches 2021-01-28T04:00:53.539 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: notify2 2021-01-28T04:00:53.539 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: handle_notify cookie 94678221260544 notify_id 382252089351 notifier_gid 25024 2021-01-28T04:00:53.540 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: notify2 done 2021-01-28T04:00:53.540 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: watch_check 2021-01-28T04:00:53.540 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: unwatch2 2021-01-28T04:00:53.541 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: flushing 2021-01-28T04:00:53.541 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: done 2021-01-28T04:00:53.541 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3034 ms) 2021-01-28T04:00:53.541 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (17601 ms total) 2021-01-28T04:00:53.542 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: 2021-01-28T04:00:53.542 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [----------] Global test environment tear-down 2021-01-28T04:00:53.542 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [==========] 16 tests from 2 test suites ran. (39972 ms total) 2021-01-28T04:00:53.543 INFO:tasks.workunit.client.0.smithi100.stdout: api_watch_notify_pp: [ PASSED ] 16 tests. 2021-01-28T04:00:54.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:54 smithi162 bash[9856]: audit 2021-01-28T04:00:52.046055+0000 mon.b (mon.2) 77 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:54.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:54 smithi162 bash[9856]: cluster 2021-01-28T04:00:52.495133+0000 mon.a (mon.0) 934 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:00:54.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:54 smithi162 bash[9856]: audit 2021-01-28T04:00:52.542456+0000 mon.a (mon.0) 935 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi100-32511-6", "pool2": "test-rados-api-smithi100-32511-6", "yes_i_really_really_mean_it": true}]': finished 2021-01-28T04:00:54.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:54 smithi162 bash[9856]: audit 2021-01-28T04:00:52.545030+0000 mon.a (mon.0) 936 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:00:54.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:54 smithi162 bash[9856]: cluster 2021-01-28T04:00:52.545178+0000 mon.a (mon.0) 937 : cluster [DBG] osdmap e94: 8 total, 8 up, 8 in 2021-01-28T04:00:54.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:54 smithi162 bash[9856]: audit 2021-01-28T04:00:52.552503+0000 mon.c (mon.1) 86 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-7"}]: dispatch 2021-01-28T04:00:54.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:54 smithi162 bash[9856]: audit 2021-01-28T04:00:52.554884+0000 mon.a (mon.0) 938 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-7"}]: dispatch 2021-01-28T04:00:54.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:54 smithi162 bash[9856]: audit 2021-01-28T04:00:52.555035+0000 mon.b (mon.2) 78 : audit [INF] from='client.? 172.21.15.100:0/1457804550' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:54.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:54 smithi162 bash[9856]: audit 2021-01-28T04:00:52.555136+0000 mon.a (mon.0) 939 : audit [INF] from='client.? 172.21.15.100:0/2312323062' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:54.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:54 smithi162 bash[9856]: audit 2021-01-28T04:00:52.555545+0000 mon.a (mon.0) 940 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:54.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:54 smithi162 bash[9856]: audit 2021-01-28T04:00:53.047364+0000 mon.b (mon.2) 79 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:54.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:54 smithi100 bash[9834]: audit 2021-01-28T04:00:52.046055+0000 mon.b (mon.2) 77 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:54.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:54 smithi100 bash[9834]: cluster 2021-01-28T04:00:52.495133+0000 mon.a (mon.0) 934 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:00:54.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:54 smithi100 bash[9834]: audit 2021-01-28T04:00:52.542456+0000 mon.a (mon.0) 935 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi100-32511-6", "pool2": "test-rados-api-smithi100-32511-6", "yes_i_really_really_mean_it": true}]': finished 2021-01-28T04:00:54.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:54 smithi100 bash[9834]: audit 2021-01-28T04:00:52.545030+0000 mon.a (mon.0) 936 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:00:54.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:54 smithi100 bash[9834]: cluster 2021-01-28T04:00:52.545178+0000 mon.a (mon.0) 937 : cluster [DBG] osdmap e94: 8 total, 8 up, 8 in 2021-01-28T04:00:54.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:54 smithi100 bash[9834]: audit 2021-01-28T04:00:52.552503+0000 mon.c (mon.1) 86 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-7"}]: dispatch 2021-01-28T04:00:54.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:54 smithi100 bash[9834]: audit 2021-01-28T04:00:52.554884+0000 mon.a (mon.0) 938 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-7"}]: dispatch 2021-01-28T04:00:54.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:54 smithi100 bash[9834]: audit 2021-01-28T04:00:52.555035+0000 mon.b (mon.2) 78 : audit [INF] from='client.? 172.21.15.100:0/1457804550' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:54.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:54 smithi100 bash[9834]: audit 2021-01-28T04:00:52.555136+0000 mon.a (mon.0) 939 : audit [INF] from='client.? 172.21.15.100:0/2312323062' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:54.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:54 smithi100 bash[9834]: audit 2021-01-28T04:00:52.555545+0000 mon.a (mon.0) 940 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:54.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:54 smithi100 bash[9834]: audit 2021-01-28T04:00:53.047364+0000 mon.b (mon.2) 79 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:54.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:54 smithi100 bash[13549]: audit 2021-01-28T04:00:52.046055+0000 mon.b (mon.2) 77 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:54.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:54 smithi100 bash[13549]: cluster 2021-01-28T04:00:52.495133+0000 mon.a (mon.0) 934 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:00:54.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:54 smithi100 bash[13549]: audit 2021-01-28T04:00:52.542456+0000 mon.a (mon.0) 935 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi100-32511-6", "pool2": "test-rados-api-smithi100-32511-6", "yes_i_really_really_mean_it": true}]': finished 2021-01-28T04:00:54.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:54 smithi100 bash[13549]: audit 2021-01-28T04:00:52.545030+0000 mon.a (mon.0) 936 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:00:54.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:54 smithi100 bash[13549]: cluster 2021-01-28T04:00:52.545178+0000 mon.a (mon.0) 937 : cluster [DBG] osdmap e94: 8 total, 8 up, 8 in 2021-01-28T04:00:54.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:54 smithi100 bash[13549]: audit 2021-01-28T04:00:52.552503+0000 mon.c (mon.1) 86 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-7"}]: dispatch 2021-01-28T04:00:54.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:54 smithi100 bash[13549]: audit 2021-01-28T04:00:52.554884+0000 mon.a (mon.0) 938 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-7"}]: dispatch 2021-01-28T04:00:54.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:54 smithi100 bash[13549]: audit 2021-01-28T04:00:52.555035+0000 mon.b (mon.2) 78 : audit [INF] from='client.? 172.21.15.100:0/1457804550' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:54.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:54 smithi100 bash[13549]: audit 2021-01-28T04:00:52.555136+0000 mon.a (mon.0) 939 : audit [INF] from='client.? 172.21.15.100:0/2312323062' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:54.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:54 smithi100 bash[13549]: audit 2021-01-28T04:00:52.555545+0000 mon.a (mon.0) 940 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:54.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:54 smithi100 bash[13549]: audit 2021-01-28T04:00:53.047364+0000 mon.b (mon.2) 79 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:56.262 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:55 smithi162 bash[9856]: audit 2021-01-28T04:00:53.509151+0000 mon.a (mon.0) 941 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-7"}]': finished 2021-01-28T04:00:56.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:55 smithi162 bash[9856]: audit 2021-01-28T04:00:53.509328+0000 mon.a (mon.0) 942 : audit [INF] from='client.? 172.21.15.100:0/2312323062' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:56.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:55 smithi162 bash[9856]: audit 2021-01-28T04:00:53.509421+0000 mon.a (mon.0) 943 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:56.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:55 smithi162 bash[9856]: cluster 2021-01-28T04:00:53.509642+0000 mon.a (mon.0) 944 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2021-01-28T04:00:56.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:55 smithi162 bash[9856]: cluster 2021-01-28T04:00:53.527875+0000 mgr.y (mgr.14138) 513 : cluster [DBG] pgmap v393: 484 pgs: 16 creating+peering, 80 unknown, 388 active+clean; 144 MiB data, 641 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:00:56.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:55 smithi162 bash[9856]: audit 2021-01-28T04:00:53.541491+0000 mon.a (mon.0) 945 : audit [INF] from='client.? 172.21.15.100:0/988595926' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:56.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:55 smithi162 bash[9856]: audit 2021-01-28T04:00:54.048593+0000 mon.b (mon.2) 80 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:56.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:55 smithi162 bash[9856]: audit 2021-01-28T04:00:54.526997+0000 mon.a (mon.0) 946 : audit [INF] from='client.? 172.21.15.100:0/988595926' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:56.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:55 smithi162 bash[9856]: cluster 2021-01-28T04:00:54.527231+0000 mon.a (mon.0) 947 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2021-01-28T04:00:56.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:55 smithi162 bash[9856]: audit 2021-01-28T04:00:54.554685+0000 mon.b (mon.2) 81 : audit [INF] from='client.? 172.21.15.100:0/1457804550' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32364-8", "tierpool":"test-rados-api-smithi100-32364-8-cache", "force_nonempty":""}]: dispatch 2021-01-28T04:00:56.266 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:55 smithi162 bash[9856]: audit 2021-01-28T04:00:54.650660+0000 mon.b (mon.2) 82 : audit [INF] from='client.? 172.21.15.100:0/731470556' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32381-9"}]: dispatch 2021-01-28T04:00:56.266 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:55 smithi162 bash[9856]: audit 2021-01-28T04:00:55.049837+0000 mon.b (mon.2) 83 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:56.267 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:55 smithi162 bash[9856]: audit 2021-01-28T04:00:55.262929+0000 mon.a (mon.0) 948 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32364-8", "tierpool":"test-rados-api-smithi100-32364-8-cache", "force_nonempty":""}]: dispatch 2021-01-28T04:00:56.267 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:55 smithi162 bash[9856]: audit 2021-01-28T04:00:55.275119+0000 mon.a (mon.0) 949 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32381-9"}]: dispatch 2021-01-28T04:00:56.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:55 smithi100 bash[9834]: audit 2021-01-28T04:00:53.509151+0000 mon.a (mon.0) 941 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-7"}]': finished 2021-01-28T04:00:56.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:55 smithi100 bash[9834]: audit 2021-01-28T04:00:53.509328+0000 mon.a (mon.0) 942 : audit [INF] from='client.? 172.21.15.100:0/2312323062' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:56.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:55 smithi100 bash[9834]: audit 2021-01-28T04:00:53.509421+0000 mon.a (mon.0) 943 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:56.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:55 smithi100 bash[9834]: cluster 2021-01-28T04:00:53.509642+0000 mon.a (mon.0) 944 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2021-01-28T04:00:56.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:55 smithi100 bash[9834]: cluster 2021-01-28T04:00:53.527875+0000 mgr.y (mgr.14138) 513 : cluster [DBG] pgmap v393: 484 pgs: 16 creating+peering, 80 unknown, 388 active+clean; 144 MiB data, 641 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:00:56.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:55 smithi100 bash[9834]: audit 2021-01-28T04:00:53.541491+0000 mon.a (mon.0) 945 : audit [INF] from='client.? 172.21.15.100:0/988595926' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:56.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:55 smithi100 bash[9834]: audit 2021-01-28T04:00:54.048593+0000 mon.b (mon.2) 80 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:56.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:55 smithi100 bash[9834]: audit 2021-01-28T04:00:54.526997+0000 mon.a (mon.0) 946 : audit [INF] from='client.? 172.21.15.100:0/988595926' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:56.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:55 smithi100 bash[9834]: cluster 2021-01-28T04:00:54.527231+0000 mon.a (mon.0) 947 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2021-01-28T04:00:56.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:55 smithi100 bash[9834]: audit 2021-01-28T04:00:54.554685+0000 mon.b (mon.2) 81 : audit [INF] from='client.? 172.21.15.100:0/1457804550' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32364-8", "tierpool":"test-rados-api-smithi100-32364-8-cache", "force_nonempty":""}]: dispatch 2021-01-28T04:00:56.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:55 smithi100 bash[9834]: audit 2021-01-28T04:00:54.650660+0000 mon.b (mon.2) 82 : audit [INF] from='client.? 172.21.15.100:0/731470556' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32381-9"}]: dispatch 2021-01-28T04:00:56.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:55 smithi100 bash[9834]: audit 2021-01-28T04:00:55.049837+0000 mon.b (mon.2) 83 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:56.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:55 smithi100 bash[9834]: audit 2021-01-28T04:00:55.262929+0000 mon.a (mon.0) 948 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32364-8", "tierpool":"test-rados-api-smithi100-32364-8-cache", "force_nonempty":""}]: dispatch 2021-01-28T04:00:56.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:55 smithi100 bash[9834]: audit 2021-01-28T04:00:55.275119+0000 mon.a (mon.0) 949 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32381-9"}]: dispatch 2021-01-28T04:00:56.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:55 smithi100 bash[13549]: audit 2021-01-28T04:00:53.509151+0000 mon.a (mon.0) 941 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-7"}]': finished 2021-01-28T04:00:56.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:55 smithi100 bash[13549]: audit 2021-01-28T04:00:53.509328+0000 mon.a (mon.0) 942 : audit [INF] from='client.? 172.21.15.100:0/2312323062' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:56.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:55 smithi100 bash[13549]: audit 2021-01-28T04:00:53.509421+0000 mon.a (mon.0) 943 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32364-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:56.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:55 smithi100 bash[13549]: cluster 2021-01-28T04:00:53.509642+0000 mon.a (mon.0) 944 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2021-01-28T04:00:56.334 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:55 smithi100 bash[13549]: cluster 2021-01-28T04:00:53.527875+0000 mgr.y (mgr.14138) 513 : cluster [DBG] pgmap v393: 484 pgs: 16 creating+peering, 80 unknown, 388 active+clean; 144 MiB data, 641 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:00:56.334 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:55 smithi100 bash[13549]: audit 2021-01-28T04:00:53.541491+0000 mon.a (mon.0) 945 : audit [INF] from='client.? 172.21.15.100:0/988595926' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:56.334 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:55 smithi100 bash[13549]: audit 2021-01-28T04:00:54.048593+0000 mon.b (mon.2) 80 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:56.335 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:55 smithi100 bash[13549]: audit 2021-01-28T04:00:54.526997+0000 mon.a (mon.0) 946 : audit [INF] from='client.? 172.21.15.100:0/988595926' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:56.335 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:55 smithi100 bash[13549]: cluster 2021-01-28T04:00:54.527231+0000 mon.a (mon.0) 947 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2021-01-28T04:00:56.335 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:55 smithi100 bash[13549]: audit 2021-01-28T04:00:54.554685+0000 mon.b (mon.2) 81 : audit [INF] from='client.? 172.21.15.100:0/1457804550' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32364-8", "tierpool":"test-rados-api-smithi100-32364-8-cache", "force_nonempty":""}]: dispatch 2021-01-28T04:00:56.336 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:55 smithi100 bash[13549]: audit 2021-01-28T04:00:54.650660+0000 mon.b (mon.2) 82 : audit [INF] from='client.? 172.21.15.100:0/731470556' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32381-9"}]: dispatch 2021-01-28T04:00:56.336 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:55 smithi100 bash[13549]: audit 2021-01-28T04:00:55.049837+0000 mon.b (mon.2) 83 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:56.336 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:55 smithi100 bash[13549]: audit 2021-01-28T04:00:55.262929+0000 mon.a (mon.0) 948 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32364-8", "tierpool":"test-rados-api-smithi100-32364-8-cache", "force_nonempty":""}]: dispatch 2021-01-28T04:00:56.336 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:55 smithi100 bash[13549]: audit 2021-01-28T04:00:55.275119+0000 mon.a (mon.0) 949 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32381-9"}]: dispatch 2021-01-28T04:00:57.262 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:56 smithi162 bash[9856]: audit 2021-01-28T04:00:55.278373+0000 mon.b (mon.2) 84 : audit [INF] from='client.? 172.21.15.100:0/731470556' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32381-9"}]: dispatch 2021-01-28T04:00:57.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:56 smithi162 bash[9856]: cluster 2021-01-28T04:00:55.528449+0000 mgr.y (mgr.14138) 514 : cluster [DBG] pgmap v395: 420 pgs: 6 creating+activating, 14 creating+peering, 72 unknown, 328 active+clean; 144 MiB data, 646 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:00:57.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:56 smithi162 bash[9856]: audit 2021-01-28T04:00:55.822432+0000 mon.a (mon.0) 950 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32381-9"}]: dispatch 2021-01-28T04:00:57.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:56 smithi162 bash[9856]: audit 2021-01-28T04:00:55.860108+0000 mon.a (mon.0) 951 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32364-8", "tierpool":"test-rados-api-smithi100-32364-8-cache", "force_nonempty":""}]': finished 2021-01-28T04:00:57.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:56 smithi162 bash[9856]: cluster 2021-01-28T04:00:55.860433+0000 mon.a (mon.0) 952 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2021-01-28T04:00:57.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:56 smithi162 bash[9856]: audit 2021-01-28T04:00:55.870372+0000 mon.c (mon.1) 87 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:57.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:56 smithi162 bash[9856]: audit 2021-01-28T04:00:55.870577+0000 mon.c (mon.1) 88 : audit [INF] from='client.? 172.21.15.100:0/4014598908' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:57.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:56 smithi162 bash[9856]: audit 2021-01-28T04:00:55.871303+0000 mon.b (mon.2) 85 : audit [INF] from='client.? 172.21.15.100:0/731470556' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32381-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:57.266 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:56 smithi162 bash[9856]: audit 2021-01-28T04:00:55.871858+0000 mon.a (mon.0) 953 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:57.266 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:56 smithi162 bash[9856]: audit 2021-01-28T04:00:55.872165+0000 mon.b (mon.2) 86 : audit [INF] from='client.? 172.21.15.100:0/1457804550' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32364-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:57.267 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:56 smithi162 bash[9856]: audit 2021-01-28T04:00:55.872326+0000 mon.a (mon.0) 954 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:57.267 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:56 smithi162 bash[9856]: audit 2021-01-28T04:00:55.884112+0000 mon.a (mon.0) 955 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32381-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:57.268 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:56 smithi162 bash[9856]: audit 2021-01-28T04:00:55.884518+0000 mon.a (mon.0) 956 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32364-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:57.268 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:56 smithi162 bash[9856]: audit 2021-01-28T04:00:56.051121+0000 mon.b (mon.2) 87 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:57.327 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:56 smithi100 bash[9834]: audit 2021-01-28T04:00:55.278373+0000 mon.b (mon.2) 84 : audit [INF] from='client.? 172.21.15.100:0/731470556' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32381-9"}]: dispatch 2021-01-28T04:00:57.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:56 smithi100 bash[9834]: cluster 2021-01-28T04:00:55.528449+0000 mgr.y (mgr.14138) 514 : cluster [DBG] pgmap v395: 420 pgs: 6 creating+activating, 14 creating+peering, 72 unknown, 328 active+clean; 144 MiB data, 646 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:00:57.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:56 smithi100 bash[9834]: audit 2021-01-28T04:00:55.822432+0000 mon.a (mon.0) 950 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32381-9"}]: dispatch 2021-01-28T04:00:57.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:56 smithi100 bash[9834]: audit 2021-01-28T04:00:55.860108+0000 mon.a (mon.0) 951 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32364-8", "tierpool":"test-rados-api-smithi100-32364-8-cache", "force_nonempty":""}]': finished 2021-01-28T04:00:57.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:56 smithi100 bash[9834]: cluster 2021-01-28T04:00:55.860433+0000 mon.a (mon.0) 952 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2021-01-28T04:00:57.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:56 smithi100 bash[9834]: audit 2021-01-28T04:00:55.870372+0000 mon.c (mon.1) 87 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:57.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:56 smithi100 bash[9834]: audit 2021-01-28T04:00:55.870577+0000 mon.c (mon.1) 88 : audit [INF] from='client.? 172.21.15.100:0/4014598908' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:57.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:56 smithi100 bash[9834]: audit 2021-01-28T04:00:55.871303+0000 mon.b (mon.2) 85 : audit [INF] from='client.? 172.21.15.100:0/731470556' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32381-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:57.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:56 smithi100 bash[9834]: audit 2021-01-28T04:00:55.871858+0000 mon.a (mon.0) 953 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:57.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:56 smithi100 bash[9834]: audit 2021-01-28T04:00:55.872165+0000 mon.b (mon.2) 86 : audit [INF] from='client.? 172.21.15.100:0/1457804550' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32364-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:57.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:56 smithi100 bash[9834]: audit 2021-01-28T04:00:55.872326+0000 mon.a (mon.0) 954 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:57.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:56 smithi100 bash[9834]: audit 2021-01-28T04:00:55.884112+0000 mon.a (mon.0) 955 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32381-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:57.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:56 smithi100 bash[9834]: audit 2021-01-28T04:00:55.884518+0000 mon.a (mon.0) 956 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32364-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:57.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:56 smithi100 bash[9834]: audit 2021-01-28T04:00:56.051121+0000 mon.b (mon.2) 87 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:57.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:56 smithi100 bash[13549]: audit 2021-01-28T04:00:55.278373+0000 mon.b (mon.2) 84 : audit [INF] from='client.? 172.21.15.100:0/731470556' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32381-9"}]: dispatch 2021-01-28T04:00:57.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:56 smithi100 bash[13549]: cluster 2021-01-28T04:00:55.528449+0000 mgr.y (mgr.14138) 514 : cluster [DBG] pgmap v395: 420 pgs: 6 creating+activating, 14 creating+peering, 72 unknown, 328 active+clean; 144 MiB data, 646 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:00:57.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:56 smithi100 bash[13549]: audit 2021-01-28T04:00:55.822432+0000 mon.a (mon.0) 950 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32381-9"}]: dispatch 2021-01-28T04:00:57.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:56 smithi100 bash[13549]: audit 2021-01-28T04:00:55.860108+0000 mon.a (mon.0) 951 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32364-8", "tierpool":"test-rados-api-smithi100-32364-8-cache", "force_nonempty":""}]': finished 2021-01-28T04:00:57.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:56 smithi100 bash[13549]: cluster 2021-01-28T04:00:55.860433+0000 mon.a (mon.0) 952 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2021-01-28T04:00:57.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:56 smithi100 bash[13549]: audit 2021-01-28T04:00:55.870372+0000 mon.c (mon.1) 87 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:57.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:56 smithi100 bash[13549]: audit 2021-01-28T04:00:55.870577+0000 mon.c (mon.1) 88 : audit [INF] from='client.? 172.21.15.100:0/4014598908' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:57.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:56 smithi100 bash[13549]: audit 2021-01-28T04:00:55.871303+0000 mon.b (mon.2) 85 : audit [INF] from='client.? 172.21.15.100:0/731470556' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32381-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:57.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:56 smithi100 bash[13549]: audit 2021-01-28T04:00:55.871858+0000 mon.a (mon.0) 953 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:57.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:56 smithi100 bash[13549]: audit 2021-01-28T04:00:55.872165+0000 mon.b (mon.2) 86 : audit [INF] from='client.? 172.21.15.100:0/1457804550' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32364-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:57.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:56 smithi100 bash[13549]: audit 2021-01-28T04:00:55.872326+0000 mon.a (mon.0) 954 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:57.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:56 smithi100 bash[13549]: audit 2021-01-28T04:00:55.884112+0000 mon.a (mon.0) 955 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32381-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:00:57.334 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:56 smithi100 bash[13549]: audit 2021-01-28T04:00:55.884518+0000 mon.a (mon.0) 956 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32364-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:57.334 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:56 smithi100 bash[13549]: audit 2021-01-28T04:00:56.051121+0000 mon.b (mon.2) 87 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:58.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:58 smithi162 bash[9856]: audit 2021-01-28T04:00:56.862212+0000 mon.a (mon.0) 957 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:58.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:58 smithi162 bash[9856]: audit 2021-01-28T04:00:56.862312+0000 mon.a (mon.0) 958 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:58.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:58 smithi162 bash[9856]: audit 2021-01-28T04:00:56.862398+0000 mon.a (mon.0) 959 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32381-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:00:58.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:58 smithi162 bash[9856]: audit 2021-01-28T04:00:56.862468+0000 mon.a (mon.0) 960 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32364-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:58.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:58 smithi162 bash[9856]: cluster 2021-01-28T04:00:56.862700+0000 mon.a (mon.0) 961 : cluster [DBG] osdmap e98: 8 total, 8 up, 8 in 2021-01-28T04:00:58.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:58 smithi162 bash[9856]: audit 2021-01-28T04:00:56.873164+0000 mon.b (mon.2) 88 : audit [INF] from='client.? 172.21.15.100:0/731470556' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32381-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32381-9"}]: dispatch 2021-01-28T04:00:58.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:58 smithi162 bash[9856]: audit 2021-01-28T04:00:56.874252+0000 mon.a (mon.0) 962 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32381-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32381-9"}]: dispatch 2021-01-28T04:00:58.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:58 smithi162 bash[9856]: audit 2021-01-28T04:00:56.876555+0000 mon.b (mon.2) 89 : audit [INF] from='client.? 172.21.15.100:0/1457804550' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32364-8", "tierpool":"test-rados-api-smithi100-32364-8-cache"}]: dispatch 2021-01-28T04:00:58.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:58 smithi162 bash[9856]: audit 2021-01-28T04:00:56.879740+0000 mon.a (mon.0) 963 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32364-8", "tierpool":"test-rados-api-smithi100-32364-8-cache"}]: dispatch 2021-01-28T04:00:58.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:58 smithi162 bash[9856]: audit 2021-01-28T04:00:56.998127+0000 mon.c (mon.1) 89 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-9", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:00:58.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:58 smithi162 bash[9856]: audit 2021-01-28T04:00:57.003324+0000 mon.a (mon.0) 964 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-9", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:00:58.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:58 smithi162 bash[9856]: audit 2021-01-28T04:00:57.052854+0000 mon.b (mon.2) 90 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:58.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:58 smithi100 bash[9834]: audit 2021-01-28T04:00:56.862212+0000 mon.a (mon.0) 957 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:58.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:58 smithi100 bash[9834]: audit 2021-01-28T04:00:56.862312+0000 mon.a (mon.0) 958 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:58.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:58 smithi100 bash[9834]: audit 2021-01-28T04:00:56.862398+0000 mon.a (mon.0) 959 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32381-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:00:58.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:58 smithi100 bash[9834]: audit 2021-01-28T04:00:56.862468+0000 mon.a (mon.0) 960 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32364-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:58.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:58 smithi100 bash[9834]: cluster 2021-01-28T04:00:56.862700+0000 mon.a (mon.0) 961 : cluster [DBG] osdmap e98: 8 total, 8 up, 8 in 2021-01-28T04:00:58.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:58 smithi100 bash[9834]: audit 2021-01-28T04:00:56.873164+0000 mon.b (mon.2) 88 : audit [INF] from='client.? 172.21.15.100:0/731470556' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32381-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32381-9"}]: dispatch 2021-01-28T04:00:58.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:58 smithi100 bash[9834]: audit 2021-01-28T04:00:56.874252+0000 mon.a (mon.0) 962 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32381-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32381-9"}]: dispatch 2021-01-28T04:00:58.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:58 smithi100 bash[9834]: audit 2021-01-28T04:00:56.876555+0000 mon.b (mon.2) 89 : audit [INF] from='client.? 172.21.15.100:0/1457804550' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32364-8", "tierpool":"test-rados-api-smithi100-32364-8-cache"}]: dispatch 2021-01-28T04:00:58.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:58 smithi100 bash[9834]: audit 2021-01-28T04:00:56.879740+0000 mon.a (mon.0) 963 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32364-8", "tierpool":"test-rados-api-smithi100-32364-8-cache"}]: dispatch 2021-01-28T04:00:58.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:58 smithi100 bash[9834]: audit 2021-01-28T04:00:56.998127+0000 mon.c (mon.1) 89 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-9", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:00:58.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:58 smithi100 bash[9834]: audit 2021-01-28T04:00:57.003324+0000 mon.a (mon.0) 964 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-9", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:00:58.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:58 smithi100 bash[9834]: audit 2021-01-28T04:00:57.052854+0000 mon.b (mon.2) 90 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:58.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:58 smithi100 bash[13549]: audit 2021-01-28T04:00:56.862212+0000 mon.a (mon.0) 957 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:58.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:58 smithi100 bash[13549]: audit 2021-01-28T04:00:56.862312+0000 mon.a (mon.0) 958 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:58.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:58 smithi100 bash[13549]: audit 2021-01-28T04:00:56.862398+0000 mon.a (mon.0) 959 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32381-9", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:00:58.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:58 smithi100 bash[13549]: audit 2021-01-28T04:00:56.862468+0000 mon.a (mon.0) 960 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32364-8-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:58.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:58 smithi100 bash[13549]: cluster 2021-01-28T04:00:56.862700+0000 mon.a (mon.0) 961 : cluster [DBG] osdmap e98: 8 total, 8 up, 8 in 2021-01-28T04:00:58.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:58 smithi100 bash[13549]: audit 2021-01-28T04:00:56.873164+0000 mon.b (mon.2) 88 : audit [INF] from='client.? 172.21.15.100:0/731470556' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32381-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32381-9"}]: dispatch 2021-01-28T04:00:58.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:58 smithi100 bash[13549]: audit 2021-01-28T04:00:56.874252+0000 mon.a (mon.0) 962 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32381-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32381-9"}]: dispatch 2021-01-28T04:00:58.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:58 smithi100 bash[13549]: audit 2021-01-28T04:00:56.876555+0000 mon.b (mon.2) 89 : audit [INF] from='client.? 172.21.15.100:0/1457804550' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32364-8", "tierpool":"test-rados-api-smithi100-32364-8-cache"}]: dispatch 2021-01-28T04:00:58.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:58 smithi100 bash[13549]: audit 2021-01-28T04:00:56.879740+0000 mon.a (mon.0) 963 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32364-8", "tierpool":"test-rados-api-smithi100-32364-8-cache"}]: dispatch 2021-01-28T04:00:58.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:58 smithi100 bash[13549]: audit 2021-01-28T04:00:56.998127+0000 mon.c (mon.1) 89 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-9", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:00:58.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:58 smithi100 bash[13549]: audit 2021-01-28T04:00:57.003324+0000 mon.a (mon.0) 964 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-9", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:00:58.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:58 smithi100 bash[13549]: audit 2021-01-28T04:00:57.052854+0000 mon.b (mon.2) 90 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:59.554 INFO:tasks.workunit.client.0.smithi100.stdout: api_pool: Running main() from gmock_main.cc 2021-01-28T04:00:59.555 INFO:tasks.workunit.client.0.smithi100.stdout: api_pool: [==========] Running 7 tests from 1 test suite. 2021-01-28T04:00:59.555 INFO:tasks.workunit.client.0.smithi100.stdout: api_pool: [----------] Global test environment set-up. 2021-01-28T04:00:59.555 INFO:tasks.workunit.client.0.smithi100.stdout: api_pool: [----------] 7 tests from LibRadosPools 2021-01-28T04:00:59.555 INFO:tasks.workunit.client.0.smithi100.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2021-01-28T04:00:59.555 INFO:tasks.workunit.client.0.smithi100.stdout: api_pool: [ OK ] LibRadosPools.PoolList (12644 ms) 2021-01-28T04:00:59.556 INFO:tasks.workunit.client.0.smithi100.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2021-01-28T04:00:59.556 INFO:tasks.workunit.client.0.smithi100.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (3505 ms) 2021-01-28T04:00:59.556 INFO:tasks.workunit.client.0.smithi100.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2021-01-28T04:00:59.556 INFO:tasks.workunit.client.0.smithi100.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (5470 ms) 2021-01-28T04:00:59.556 INFO:tasks.workunit.client.0.smithi100.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2021-01-28T04:00:59.557 INFO:tasks.workunit.client.0.smithi100.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (4993 ms) 2021-01-28T04:00:59.557 INFO:tasks.workunit.client.0.smithi100.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2021-01-28T04:00:59.557 INFO:tasks.workunit.client.0.smithi100.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (5489 ms) 2021-01-28T04:00:59.557 INFO:tasks.workunit.client.0.smithi100.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2021-01-28T04:00:59.557 INFO:tasks.workunit.client.0.smithi100.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (5559 ms) 2021-01-28T04:00:59.558 INFO:tasks.workunit.client.0.smithi100.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2021-01-28T04:00:59.558 INFO:tasks.workunit.client.0.smithi100.stdout: api_pool: [ OK ] LibRadosPools.PoolGetBaseTier (8395 ms) 2021-01-28T04:00:59.558 INFO:tasks.workunit.client.0.smithi100.stdout: api_pool: [----------] 7 tests from LibRadosPools (46055 ms total) 2021-01-28T04:00:59.558 INFO:tasks.workunit.client.0.smithi100.stdout: api_pool: 2021-01-28T04:00:59.559 INFO:tasks.workunit.client.0.smithi100.stdout: api_pool: [----------] Global test environment tear-down 2021-01-28T04:00:59.559 INFO:tasks.workunit.client.0.smithi100.stdout: api_pool: [==========] 7 tests from 1 test suite ran. (46055 ms total) 2021-01-28T04:00:59.559 INFO:tasks.workunit.client.0.smithi100.stdout: api_pool: [ PASSED ] 7 tests. 2021-01-28T04:00:59.732 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:59 smithi162 bash[9856]: cluster 2021-01-28T04:00:57.529923+0000 mgr.y (mgr.14138) 515 : cluster [DBG] pgmap v398: 452 pgs: 6 creating+activating, 11 creating+peering, 56 unknown, 379 active+clean; 144 MiB data, 652 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:00:59.732 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:59 smithi162 bash[9856]: audit 2021-01-28T04:00:58.054062+0000 mon.b (mon.2) 91 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:59.732 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:59 smithi162 bash[9856]: audit 2021-01-28T04:00:58.412836+0000 mon.a (mon.0) 965 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32364-8", "tierpool":"test-rados-api-smithi100-32364-8-cache"}]': finished 2021-01-28T04:00:59.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:59 smithi162 bash[9856]: audit 2021-01-28T04:00:58.413095+0000 mon.a (mon.0) 966 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-9", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:00:59.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:59 smithi162 bash[9856]: cluster 2021-01-28T04:00:58.413403+0000 mon.a (mon.0) 967 : cluster [DBG] osdmap e99: 8 total, 8 up, 8 in 2021-01-28T04:00:59.733 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:59 smithi162 bash[9856]: audit 2021-01-28T04:00:58.414638+0000 mon.c (mon.1) 90 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-9"}]: dispatch 2021-01-28T04:00:59.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:59 smithi162 bash[9856]: audit 2021-01-28T04:00:58.419870+0000 mon.c (mon.1) 91 : audit [INF] from='client.? 172.21.15.100:0/2402729976' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:59.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:59 smithi162 bash[9856]: audit 2021-01-28T04:00:58.452984+0000 mon.a (mon.0) 968 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-9"}]: dispatch 2021-01-28T04:00:59.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:59 smithi162 bash[9856]: audit 2021-01-28T04:00:58.454546+0000 mon.a (mon.0) 969 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:59.734 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:59 smithi162 bash[9856]: cluster 2021-01-28T04:00:58.500980+0000 mon.a (mon.0) 970 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:00:59.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:59 smithi162 bash[9856]: audit 2021-01-28T04:00:58.510664+0000 mon.a (mon.0) 971 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32381-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32381-9"}]': finished 2021-01-28T04:00:59.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:59 smithi162 bash[9856]: audit 2021-01-28T04:00:58.510869+0000 mon.a (mon.0) 972 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-9"}]': finished 2021-01-28T04:00:59.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:59 smithi162 bash[9856]: audit 2021-01-28T04:00:58.510964+0000 mon.a (mon.0) 973 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-10","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:59.735 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:59 smithi162 bash[9856]: cluster 2021-01-28T04:00:58.511044+0000 mon.a (mon.0) 974 : cluster [DBG] osdmap e100: 8 total, 8 up, 8 in 2021-01-28T04:00:59.736 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:59 smithi162 bash[9856]: audit 2021-01-28T04:00:58.527982+0000 mon.c (mon.1) 92 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-9", "mode": "writeback"}]: dispatch 2021-01-28T04:00:59.736 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:59 smithi162 bash[9856]: audit 2021-01-28T04:00:58.547048+0000 mon.a (mon.0) 975 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-9", "mode": "writeback"}]: dispatch 2021-01-28T04:00:59.736 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:00:59 smithi162 bash[9856]: audit 2021-01-28T04:00:59.055755+0000 mon.b (mon.2) 92 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:59.737 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 04:00:59 smithi100 bash[10061]: debug 2021-01-28T04:00:59.723+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:00:59.737 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:59 smithi100 bash[9834]: cluster 2021-01-28T04:00:57.529923+0000 mgr.y (mgr.14138) 515 : cluster [DBG] pgmap v398: 452 pgs: 6 creating+activating, 11 creating+peering, 56 unknown, 379 active+clean; 144 MiB data, 652 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:00:59.737 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:59 smithi100 bash[9834]: audit 2021-01-28T04:00:58.054062+0000 mon.b (mon.2) 91 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:59.738 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:59 smithi100 bash[9834]: audit 2021-01-28T04:00:58.412836+0000 mon.a (mon.0) 965 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32364-8", "tierpool":"test-rados-api-smithi100-32364-8-cache"}]': finished 2021-01-28T04:00:59.738 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:59 smithi100 bash[9834]: audit 2021-01-28T04:00:58.413095+0000 mon.a (mon.0) 966 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-9", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:00:59.738 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:59 smithi100 bash[9834]: cluster 2021-01-28T04:00:58.413403+0000 mon.a (mon.0) 967 : cluster [DBG] osdmap e99: 8 total, 8 up, 8 in 2021-01-28T04:00:59.738 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:59 smithi100 bash[9834]: audit 2021-01-28T04:00:58.414638+0000 mon.c (mon.1) 90 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-9"}]: dispatch 2021-01-28T04:00:59.739 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:59 smithi100 bash[9834]: audit 2021-01-28T04:00:58.419870+0000 mon.c (mon.1) 91 : audit [INF] from='client.? 172.21.15.100:0/2402729976' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:59.739 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:59 smithi100 bash[9834]: audit 2021-01-28T04:00:58.452984+0000 mon.a (mon.0) 968 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-9"}]: dispatch 2021-01-28T04:00:59.739 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:59 smithi100 bash[9834]: audit 2021-01-28T04:00:58.454546+0000 mon.a (mon.0) 969 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:59.739 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:59 smithi100 bash[9834]: cluster 2021-01-28T04:00:58.500980+0000 mon.a (mon.0) 970 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:00:59.740 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:59 smithi100 bash[9834]: audit 2021-01-28T04:00:58.510664+0000 mon.a (mon.0) 971 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32381-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32381-9"}]': finished 2021-01-28T04:00:59.740 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:59 smithi100 bash[9834]: audit 2021-01-28T04:00:58.510869+0000 mon.a (mon.0) 972 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-9"}]': finished 2021-01-28T04:00:59.740 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:59 smithi100 bash[9834]: audit 2021-01-28T04:00:58.510964+0000 mon.a (mon.0) 973 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-10","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:59.740 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:59 smithi100 bash[9834]: cluster 2021-01-28T04:00:58.511044+0000 mon.a (mon.0) 974 : cluster [DBG] osdmap e100: 8 total, 8 up, 8 in 2021-01-28T04:00:59.740 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:59 smithi100 bash[9834]: audit 2021-01-28T04:00:58.527982+0000 mon.c (mon.1) 92 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-9", "mode": "writeback"}]: dispatch 2021-01-28T04:00:59.741 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:59 smithi100 bash[9834]: audit 2021-01-28T04:00:58.547048+0000 mon.a (mon.0) 975 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-9", "mode": "writeback"}]: dispatch 2021-01-28T04:00:59.741 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:00:59 smithi100 bash[9834]: audit 2021-01-28T04:00:59.055755+0000 mon.b (mon.2) 92 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:59.741 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:59 smithi100 bash[13549]: cluster 2021-01-28T04:00:57.529923+0000 mgr.y (mgr.14138) 515 : cluster [DBG] pgmap v398: 452 pgs: 6 creating+activating, 11 creating+peering, 56 unknown, 379 active+clean; 144 MiB data, 652 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:00:59.741 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:59 smithi100 bash[13549]: audit 2021-01-28T04:00:58.054062+0000 mon.b (mon.2) 91 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:00:59.742 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:59 smithi100 bash[13549]: audit 2021-01-28T04:00:58.412836+0000 mon.a (mon.0) 965 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32364-8", "tierpool":"test-rados-api-smithi100-32364-8-cache"}]': finished 2021-01-28T04:00:59.742 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:59 smithi100 bash[13549]: audit 2021-01-28T04:00:58.413095+0000 mon.a (mon.0) 966 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-9", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:00:59.742 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:59 smithi100 bash[13549]: cluster 2021-01-28T04:00:58.413403+0000 mon.a (mon.0) 967 : cluster [DBG] osdmap e99: 8 total, 8 up, 8 in 2021-01-28T04:00:59.742 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:59 smithi100 bash[13549]: audit 2021-01-28T04:00:58.414638+0000 mon.c (mon.1) 90 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-9"}]: dispatch 2021-01-28T04:00:59.742 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:59 smithi100 bash[13549]: audit 2021-01-28T04:00:58.419870+0000 mon.c (mon.1) 91 : audit [INF] from='client.? 172.21.15.100:0/2402729976' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:59.743 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:59 smithi100 bash[13549]: audit 2021-01-28T04:00:58.452984+0000 mon.a (mon.0) 968 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-9"}]: dispatch 2021-01-28T04:00:59.743 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:59 smithi100 bash[13549]: audit 2021-01-28T04:00:58.454546+0000 mon.a (mon.0) 969 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:00:59.743 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:59 smithi100 bash[13549]: cluster 2021-01-28T04:00:58.500980+0000 mon.a (mon.0) 970 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:00:59.743 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:59 smithi100 bash[13549]: audit 2021-01-28T04:00:58.510664+0000 mon.a (mon.0) 971 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32381-9", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32381-9"}]': finished 2021-01-28T04:00:59.743 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:59 smithi100 bash[13549]: audit 2021-01-28T04:00:58.510869+0000 mon.a (mon.0) 972 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-9"}]': finished 2021-01-28T04:00:59.744 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:59 smithi100 bash[13549]: audit 2021-01-28T04:00:58.510964+0000 mon.a (mon.0) 973 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-10","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:00:59.744 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:59 smithi100 bash[13549]: cluster 2021-01-28T04:00:58.511044+0000 mon.a (mon.0) 974 : cluster [DBG] osdmap e100: 8 total, 8 up, 8 in 2021-01-28T04:00:59.744 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:59 smithi100 bash[13549]: audit 2021-01-28T04:00:58.527982+0000 mon.c (mon.1) 92 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-9", "mode": "writeback"}]: dispatch 2021-01-28T04:00:59.744 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:59 smithi100 bash[13549]: audit 2021-01-28T04:00:58.547048+0000 mon.a (mon.0) 975 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-9", "mode": "writeback"}]: dispatch 2021-01-28T04:00:59.745 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:00:59 smithi100 bash[13549]: audit 2021-01-28T04:00:59.055755+0000 mon.b (mon.2) 92 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:00.013 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 04:00:59 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T04:01:00.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:00 smithi162 bash[9856]: cluster 2021-01-28T04:00:59.508306+0000 mon.a (mon.0) 976 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:01:00.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:00 smithi162 bash[9856]: audit 2021-01-28T04:00:59.514019+0000 mon.a (mon.0) 977 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-9", "mode": "writeback"}]': finished 2021-01-28T04:01:00.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:00 smithi162 bash[9856]: cluster 2021-01-28T04:00:59.514163+0000 mon.a (mon.0) 978 : cluster [DBG] osdmap e101: 8 total, 8 up, 8 in 2021-01-28T04:01:00.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:00 smithi162 bash[9856]: cluster 2021-01-28T04:00:59.530573+0000 mgr.y (mgr.14138) 516 : cluster [DBG] pgmap v402: 396 pgs: 2 creating+peering, 42 unknown, 352 active+clean; 144 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2.2 KiB/s wr, 5 op/s 2021-01-28T04:01:00.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:00 smithi162 bash[9856]: audit 2021-01-28T04:00:59.552362+0000 mon.c (mon.1) 93 : audit [INF] from='client.? 172.21.15.100:0/2721354474' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:00.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:00 smithi162 bash[9856]: audit 2021-01-28T04:00:59.556380+0000 mon.a (mon.0) 979 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:00.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:00 smithi162 bash[9856]: audit 2021-01-28T04:00:59.793031+0000 mon.c (mon.1) 94 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:01:00.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:00 smithi162 bash[9856]: audit 2021-01-28T04:01:00.057405+0000 mon.b (mon.2) 93 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:00.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:00 smithi162 bash[9856]: audit 2021-01-28T04:01:00.170715+0000 mon.c (mon.1) 95 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2021-01-28T04:01:00.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:00 smithi162 bash[9856]: audit 2021-01-28T04:01:00.172273+0000 mon.c (mon.1) 96 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2021-01-28T04:01:00.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:00 smithi162 bash[9856]: audit 2021-01-28T04:01:00.173587+0000 mon.c (mon.1) 97 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2021-01-28T04:01:00.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:00 smithi162 bash[9856]: audit 2021-01-28T04:01:00.174694+0000 mon.c (mon.1) 98 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2021-01-28T04:01:00.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:00 smithi162 bash[9856]: audit 2021-01-28T04:01:00.175838+0000 mon.c (mon.1) 99 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2021-01-28T04:01:00.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:00 smithi162 bash[9856]: audit 2021-01-28T04:01:00.176841+0000 mon.c (mon.1) 100 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2021-01-28T04:01:00.766 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:00 smithi162 bash[9856]: audit 2021-01-28T04:01:00.177790+0000 mon.c (mon.1) 101 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2021-01-28T04:01:00.766 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:00 smithi162 bash[9856]: audit 2021-01-28T04:01:00.178666+0000 mon.c (mon.1) 102 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2021-01-28T04:01:00.766 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:00 smithi162 bash[9856]: audit 2021-01-28T04:01:00.179745+0000 mon.c (mon.1) 103 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2021-01-28T04:01:00.766 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:00 smithi162 bash[9856]: audit 2021-01-28T04:01:00.181202+0000 mon.c (mon.1) 104 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2021-01-28T04:01:00.766 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:00 smithi162 bash[9856]: audit 2021-01-28T04:01:00.211495+0000 mon.a (mon.0) 980 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:01:00.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[9834]: cluster 2021-01-28T04:00:59.508306+0000 mon.a (mon.0) 976 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:01:00.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[9834]: audit 2021-01-28T04:00:59.514019+0000 mon.a (mon.0) 977 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-9", "mode": "writeback"}]': finished 2021-01-28T04:01:00.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[9834]: cluster 2021-01-28T04:00:59.514163+0000 mon.a (mon.0) 978 : cluster [DBG] osdmap e101: 8 total, 8 up, 8 in 2021-01-28T04:01:00.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[9834]: cluster 2021-01-28T04:00:59.530573+0000 mgr.y (mgr.14138) 516 : cluster [DBG] pgmap v402: 396 pgs: 2 creating+peering, 42 unknown, 352 active+clean; 144 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2.2 KiB/s wr, 5 op/s 2021-01-28T04:01:00.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[9834]: audit 2021-01-28T04:00:59.552362+0000 mon.c (mon.1) 93 : audit [INF] from='client.? 172.21.15.100:0/2721354474' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:00.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[9834]: audit 2021-01-28T04:00:59.556380+0000 mon.a (mon.0) 979 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:00.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[9834]: audit 2021-01-28T04:00:59.793031+0000 mon.c (mon.1) 94 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:01:00.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[9834]: audit 2021-01-28T04:01:00.057405+0000 mon.b (mon.2) 93 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:00.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[9834]: audit 2021-01-28T04:01:00.170715+0000 mon.c (mon.1) 95 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2021-01-28T04:01:00.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[9834]: audit 2021-01-28T04:01:00.172273+0000 mon.c (mon.1) 96 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2021-01-28T04:01:00.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[9834]: audit 2021-01-28T04:01:00.173587+0000 mon.c (mon.1) 97 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2021-01-28T04:01:00.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[9834]: audit 2021-01-28T04:01:00.174694+0000 mon.c (mon.1) 98 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2021-01-28T04:01:00.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[9834]: audit 2021-01-28T04:01:00.175838+0000 mon.c (mon.1) 99 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2021-01-28T04:01:00.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[9834]: audit 2021-01-28T04:01:00.176841+0000 mon.c (mon.1) 100 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2021-01-28T04:01:00.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[9834]: audit 2021-01-28T04:01:00.177790+0000 mon.c (mon.1) 101 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2021-01-28T04:01:00.832 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[9834]: audit 2021-01-28T04:01:00.178666+0000 mon.c (mon.1) 102 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2021-01-28T04:01:00.832 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[9834]: audit 2021-01-28T04:01:00.179745+0000 mon.c (mon.1) 103 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2021-01-28T04:01:00.832 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[9834]: audit 2021-01-28T04:01:00.181202+0000 mon.c (mon.1) 104 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2021-01-28T04:01:00.832 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[9834]: audit 2021-01-28T04:01:00.211495+0000 mon.a (mon.0) 980 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:01:00.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[13549]: cluster 2021-01-28T04:00:59.508306+0000 mon.a (mon.0) 976 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:01:00.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[13549]: audit 2021-01-28T04:00:59.514019+0000 mon.a (mon.0) 977 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-9", "mode": "writeback"}]': finished 2021-01-28T04:01:00.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[13549]: cluster 2021-01-28T04:00:59.514163+0000 mon.a (mon.0) 978 : cluster [DBG] osdmap e101: 8 total, 8 up, 8 in 2021-01-28T04:01:00.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[13549]: cluster 2021-01-28T04:00:59.530573+0000 mgr.y (mgr.14138) 516 : cluster [DBG] pgmap v402: 396 pgs: 2 creating+peering, 42 unknown, 352 active+clean; 144 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2.2 KiB/s wr, 5 op/s 2021-01-28T04:01:00.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[13549]: audit 2021-01-28T04:00:59.552362+0000 mon.c (mon.1) 93 : audit [INF] from='client.? 172.21.15.100:0/2721354474' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:00.834 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[13549]: audit 2021-01-28T04:00:59.556380+0000 mon.a (mon.0) 979 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:00.834 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[13549]: audit 2021-01-28T04:00:59.793031+0000 mon.c (mon.1) 94 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:01:00.834 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[13549]: audit 2021-01-28T04:01:00.057405+0000 mon.b (mon.2) 93 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:00.834 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[13549]: audit 2021-01-28T04:01:00.170715+0000 mon.c (mon.1) 95 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2021-01-28T04:01:00.835 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[13549]: audit 2021-01-28T04:01:00.172273+0000 mon.c (mon.1) 96 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2021-01-28T04:01:00.835 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[13549]: audit 2021-01-28T04:01:00.173587+0000 mon.c (mon.1) 97 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2021-01-28T04:01:00.835 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[13549]: audit 2021-01-28T04:01:00.174694+0000 mon.c (mon.1) 98 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2021-01-28T04:01:00.835 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[13549]: audit 2021-01-28T04:01:00.175838+0000 mon.c (mon.1) 99 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2021-01-28T04:01:00.835 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[13549]: audit 2021-01-28T04:01:00.176841+0000 mon.c (mon.1) 100 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2021-01-28T04:01:00.836 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[13549]: audit 2021-01-28T04:01:00.177790+0000 mon.c (mon.1) 101 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2021-01-28T04:01:00.836 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[13549]: audit 2021-01-28T04:01:00.178666+0000 mon.c (mon.1) 102 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2021-01-28T04:01:00.836 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[13549]: audit 2021-01-28T04:01:00.179745+0000 mon.c (mon.1) 103 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2021-01-28T04:01:00.836 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[13549]: audit 2021-01-28T04:01:00.181202+0000 mon.c (mon.1) 104 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2021-01-28T04:01:00.836 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:00 smithi100 bash[13549]: audit 2021-01-28T04:01:00.211495+0000 mon.a (mon.0) 980 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:01:01.565 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 >> 172.21.15.100:0/400957382 conn(0x55fdbe9f4a30 msgr2=0x55fdbe9f6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2021-01-28T04:01:01.565 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc07374700 10 monclient: get_auth_request con 0x55fdbea96b60 auth_method 0 2021-01-28T04:01:01.565 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc07374700 1 --2- 172.21.15.100:0/400957382 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55fdbea96b60 0x55fdbea96fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2021-01-28T04:01:01.565 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 shutdown_connections 2021-01-28T04:01:01.566 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 1 -- 172.21.15.100:0/400957382 wait complete. 2021-01-28T04:01:01.566 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 10 monclient: shutdown 2021-01-28T04:01:01.566 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:00:13.508+0000 7fbc0b19d3c0 20 monclient: shutdown discarding 0 pending message(s) 2021-01-28T04:01:01.566 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (44 ms) 2021-01-28T04:01:01.567 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: [----------] 1 test from LibRadosMiscConnectFailure (44 ms total) 2021-01-28T04:01:01.567 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:01:01.567 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2021-01-28T04:01:01.567 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2021-01-28T04:01:01.568 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: started 0x55fdbe92fb10 2021-01-28T04:01:01.568 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: started 0x55fdbe9d90d0 2021-01-28T04:01:01.568 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: started 2 aios 2021-01-28T04:01:01.568 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: waiting 0x55fdbe92fb10 2021-01-28T04:01:01.568 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: waiting 0x55fdbe9d90d0 2021-01-28T04:01:01.569 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: done. 2021-01-28T04:01:01.569 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (18904 ms) 2021-01-28T04:01:01.569 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (18904 ms total) 2021-01-28T04:01:01.569 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:01:01.569 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2021-01-28T04:01:01.570 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2021-01-28T04:01:01.570 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2021-01-28T04:01:01.570 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2021-01-28T04:01:01.570 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: [ OK ] LibRadosMisc.Exec (97 ms) 2021-01-28T04:01:01.570 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: [ RUN ] LibRadosMisc.WriteSame 2021-01-28T04:01:01.571 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (8 ms) 2021-01-28T04:01:01.571 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2021-01-28T04:01:01.571 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (5 ms) 2021-01-28T04:01:01.571 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2021-01-28T04:01:01.571 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: [ OK ] LibRadosMisc.Applications (4784 ms) 2021-01-28T04:01:01.572 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2021-01-28T04:01:01.572 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2021-01-28T04:01:01.572 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2021-01-28T04:01:01.572 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2021-01-28T04:01:01.572 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2021-01-28T04:01:01.573 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (19497 ms) 2021-01-28T04:01:01.573 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: [----------] 8 tests from LibRadosMisc (24391 ms total) 2021-01-28T04:01:01.573 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: 2021-01-28T04:01:01.573 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: [----------] Global test environment tear-down 2021-01-28T04:01:01.573 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: [==========] 11 tests from 4 test suites ran. (48074 ms total) 2021-01-28T04:01:01.574 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc: [ PASSED ] 11 tests. 2021-01-28T04:01:01.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:01 smithi162 bash[9856]: audit 2021-01-28T04:00:59.729832+0000 mgr.y (mgr.14138) 517 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:01:01.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:01 smithi162 bash[9856]: audit 2021-01-28T04:01:00.171115+0000 mgr.y (mgr.14138) 518 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2021-01-28T04:01:01.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:01 smithi162 bash[9856]: audit 2021-01-28T04:01:00.172643+0000 mgr.y (mgr.14138) 519 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2021-01-28T04:01:01.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:01 smithi162 bash[9856]: audit 2021-01-28T04:01:00.173845+0000 mgr.y (mgr.14138) 520 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2021-01-28T04:01:01.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:01 smithi162 bash[9856]: audit 2021-01-28T04:01:00.174999+0000 mgr.y (mgr.14138) 521 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2021-01-28T04:01:01.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:01 smithi162 bash[9856]: audit 2021-01-28T04:01:00.176122+0000 mgr.y (mgr.14138) 522 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2021-01-28T04:01:01.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:01 smithi162 bash[9856]: audit 2021-01-28T04:01:00.177091+0000 mgr.y (mgr.14138) 523 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2021-01-28T04:01:01.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:01 smithi162 bash[9856]: audit 2021-01-28T04:01:00.178002+0000 mgr.y (mgr.14138) 524 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2021-01-28T04:01:01.766 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:01 smithi162 bash[9856]: audit 2021-01-28T04:01:00.178887+0000 mgr.y (mgr.14138) 525 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2021-01-28T04:01:01.766 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:01 smithi162 bash[9856]: audit 2021-01-28T04:01:00.180387+0000 mgr.y (mgr.14138) 526 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2021-01-28T04:01:01.766 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:01 smithi162 bash[9856]: audit 2021-01-28T04:01:00.181402+0000 mgr.y (mgr.14138) 527 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2021-01-28T04:01:01.766 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:01 smithi162 bash[9856]: cluster 2021-01-28T04:01:00.197075+0000 osd.6 (osd.6) 5 : cluster [DBG] 13.1 deep-scrub ok 2021-01-28T04:01:01.766 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:01 smithi162 bash[9856]: cluster 2021-01-28T04:01:00.463833+0000 osd.2 (osd.2) 4 : cluster [DBG] 13.8 deep-scrub ok 2021-01-28T04:01:01.767 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:01 smithi162 bash[9856]: audit 2021-01-28T04:01:00.523616+0000 mon.a (mon.0) 981 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:01.767 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:01 smithi162 bash[9856]: audit 2021-01-28T04:01:00.523906+0000 mon.a (mon.0) 982 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:01:01.767 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:01 smithi162 bash[9856]: cluster 2021-01-28T04:01:00.523987+0000 mon.a (mon.0) 983 : cluster [DBG] osdmap e102: 8 total, 8 up, 8 in 2021-01-28T04:01:01.767 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:01 smithi162 bash[9856]: audit 2021-01-28T04:01:00.526567+0000 mon.c (mon.1) 105 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-9"}]: dispatch 2021-01-28T04:01:01.768 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:01 smithi162 bash[9856]: audit 2021-01-28T04:01:00.530373+0000 mon.a (mon.0) 984 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-9"}]: dispatch 2021-01-28T04:01:01.768 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:01 smithi162 bash[9856]: audit 2021-01-28T04:01:00.537242+0000 mon.a (mon.0) 985 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:01.768 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:01 smithi162 bash[9856]: audit 2021-01-28T04:01:00.537718+0000 mon.b (mon.2) 94 : audit [INF] from='client.? 172.21.15.100:0/1096362044' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:01.768 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:01 smithi162 bash[9856]: cluster 2021-01-28T04:01:01.047401+0000 osd.4 (osd.4) 5 : cluster [DBG] 13.5 deep-scrub ok 2021-01-28T04:01:01.768 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:01 smithi162 bash[9856]: audit 2021-01-28T04:01:01.059522+0000 mon.b (mon.2) 95 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:01.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[9834]: audit 2021-01-28T04:00:59.729832+0000 mgr.y (mgr.14138) 517 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:01:01.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[9834]: audit 2021-01-28T04:01:00.171115+0000 mgr.y (mgr.14138) 518 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2021-01-28T04:01:01.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[9834]: audit 2021-01-28T04:01:00.172643+0000 mgr.y (mgr.14138) 519 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2021-01-28T04:01:01.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[9834]: audit 2021-01-28T04:01:00.173845+0000 mgr.y (mgr.14138) 520 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2021-01-28T04:01:01.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[9834]: audit 2021-01-28T04:01:00.174999+0000 mgr.y (mgr.14138) 521 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2021-01-28T04:01:01.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[9834]: audit 2021-01-28T04:01:00.176122+0000 mgr.y (mgr.14138) 522 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2021-01-28T04:01:01.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[9834]: audit 2021-01-28T04:01:00.177091+0000 mgr.y (mgr.14138) 523 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2021-01-28T04:01:01.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[9834]: audit 2021-01-28T04:01:00.178002+0000 mgr.y (mgr.14138) 524 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2021-01-28T04:01:01.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[9834]: audit 2021-01-28T04:01:00.178887+0000 mgr.y (mgr.14138) 525 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2021-01-28T04:01:01.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[9834]: audit 2021-01-28T04:01:00.180387+0000 mgr.y (mgr.14138) 526 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2021-01-28T04:01:01.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[9834]: audit 2021-01-28T04:01:00.181402+0000 mgr.y (mgr.14138) 527 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2021-01-28T04:01:01.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[9834]: cluster 2021-01-28T04:01:00.197075+0000 osd.6 (osd.6) 5 : cluster [DBG] 13.1 deep-scrub ok 2021-01-28T04:01:01.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[9834]: cluster 2021-01-28T04:01:00.463833+0000 osd.2 (osd.2) 4 : cluster [DBG] 13.8 deep-scrub ok 2021-01-28T04:01:01.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[9834]: audit 2021-01-28T04:01:00.523616+0000 mon.a (mon.0) 981 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:01.832 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[9834]: audit 2021-01-28T04:01:00.523906+0000 mon.a (mon.0) 982 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:01:01.832 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[9834]: cluster 2021-01-28T04:01:00.523987+0000 mon.a (mon.0) 983 : cluster [DBG] osdmap e102: 8 total, 8 up, 8 in 2021-01-28T04:01:01.832 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[9834]: audit 2021-01-28T04:01:00.526567+0000 mon.c (mon.1) 105 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-9"}]: dispatch 2021-01-28T04:01:01.832 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[9834]: audit 2021-01-28T04:01:00.530373+0000 mon.a (mon.0) 984 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-9"}]: dispatch 2021-01-28T04:01:01.833 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[9834]: audit 2021-01-28T04:01:00.537242+0000 mon.a (mon.0) 985 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:01.833 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[9834]: audit 2021-01-28T04:01:00.537718+0000 mon.b (mon.2) 94 : audit [INF] from='client.? 172.21.15.100:0/1096362044' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:01.833 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[9834]: cluster 2021-01-28T04:01:01.047401+0000 osd.4 (osd.4) 5 : cluster [DBG] 13.5 deep-scrub ok 2021-01-28T04:01:01.834 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[9834]: audit 2021-01-28T04:01:01.059522+0000 mon.b (mon.2) 95 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:01.834 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[13549]: audit 2021-01-28T04:00:59.729832+0000 mgr.y (mgr.14138) 517 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:01:01.834 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[13549]: audit 2021-01-28T04:01:00.171115+0000 mgr.y (mgr.14138) 518 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.0"}]: dispatch 2021-01-28T04:01:01.835 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[13549]: audit 2021-01-28T04:01:00.172643+0000 mgr.y (mgr.14138) 519 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.1"}]: dispatch 2021-01-28T04:01:01.835 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[13549]: audit 2021-01-28T04:01:00.173845+0000 mgr.y (mgr.14138) 520 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.2"}]: dispatch 2021-01-28T04:01:01.835 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[13549]: audit 2021-01-28T04:01:00.174999+0000 mgr.y (mgr.14138) 521 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.3"}]: dispatch 2021-01-28T04:01:01.836 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[13549]: audit 2021-01-28T04:01:00.176122+0000 mgr.y (mgr.14138) 522 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.4"}]: dispatch 2021-01-28T04:01:01.836 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[13549]: audit 2021-01-28T04:01:00.177091+0000 mgr.y (mgr.14138) 523 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.5"}]: dispatch 2021-01-28T04:01:01.836 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[13549]: audit 2021-01-28T04:01:00.178002+0000 mgr.y (mgr.14138) 524 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.6"}]: dispatch 2021-01-28T04:01:01.836 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[13549]: audit 2021-01-28T04:01:00.178887+0000 mgr.y (mgr.14138) 525 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.7"}]: dispatch 2021-01-28T04:01:01.837 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[13549]: audit 2021-01-28T04:01:00.180387+0000 mgr.y (mgr.14138) 526 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.8"}]: dispatch 2021-01-28T04:01:01.837 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[13549]: audit 2021-01-28T04:01:00.181402+0000 mgr.y (mgr.14138) 527 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "13.9"}]: dispatch 2021-01-28T04:01:01.837 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[13549]: cluster 2021-01-28T04:01:00.197075+0000 osd.6 (osd.6) 5 : cluster [DBG] 13.1 deep-scrub ok 2021-01-28T04:01:01.837 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[13549]: cluster 2021-01-28T04:01:00.463833+0000 osd.2 (osd.2) 4 : cluster [DBG] 13.8 deep-scrub ok 2021-01-28T04:01:01.838 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[13549]: audit 2021-01-28T04:01:00.523616+0000 mon.a (mon.0) 981 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:01.838 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[13549]: audit 2021-01-28T04:01:00.523906+0000 mon.a (mon.0) 982 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:01:01.838 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[13549]: cluster 2021-01-28T04:01:00.523987+0000 mon.a (mon.0) 983 : cluster [DBG] osdmap e102: 8 total, 8 up, 8 in 2021-01-28T04:01:01.838 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[13549]: audit 2021-01-28T04:01:00.526567+0000 mon.c (mon.1) 105 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-9"}]: dispatch 2021-01-28T04:01:01.839 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[13549]: audit 2021-01-28T04:01:00.530373+0000 mon.a (mon.0) 984 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-9"}]: dispatch 2021-01-28T04:01:01.839 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[13549]: audit 2021-01-28T04:01:00.537242+0000 mon.a (mon.0) 985 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:01.839 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[13549]: audit 2021-01-28T04:01:00.537718+0000 mon.b (mon.2) 94 : audit [INF] from='client.? 172.21.15.100:0/1096362044' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:01.839 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[13549]: cluster 2021-01-28T04:01:01.047401+0000 osd.4 (osd.4) 5 : cluster [DBG] 13.5 deep-scrub ok 2021-01-28T04:01:01.839 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:01 smithi100 bash[13549]: audit 2021-01-28T04:01:01.059522+0000 mon.b (mon.2) 95 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:02.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:02 smithi162 bash[9856]: cluster 2021-01-28T04:01:01.285890+0000 osd.6 (osd.6) 6 : cluster [DBG] 13.4 deep-scrub ok 2021-01-28T04:01:02.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:02 smithi162 bash[9856]: cluster 2021-01-28T04:01:01.520245+0000 mon.a (mon.0) 986 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:01:02.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:02 smithi162 bash[9856]: audit 2021-01-28T04:01:01.536824+0000 mon.a (mon.0) 987 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-9"}]': finished 2021-01-28T04:01:02.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:02 smithi162 bash[9856]: audit 2021-01-28T04:01:01.537076+0000 mon.a (mon.0) 988 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:02.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:02 smithi162 bash[9856]: cluster 2021-01-28T04:01:01.537281+0000 mon.a (mon.0) 989 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2021-01-28T04:01:02.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:02 smithi162 bash[9856]: audit 2021-01-28T04:01:02.061534+0000 mon.b (mon.2) 96 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:02.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:02 smithi100 bash[13549]: cluster 2021-01-28T04:01:01.285890+0000 osd.6 (osd.6) 6 : cluster [DBG] 13.4 deep-scrub ok 2021-01-28T04:01:02.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:02 smithi100 bash[13549]: cluster 2021-01-28T04:01:01.520245+0000 mon.a (mon.0) 986 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:01:02.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:02 smithi100 bash[13549]: audit 2021-01-28T04:01:01.536824+0000 mon.a (mon.0) 987 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-9"}]': finished 2021-01-28T04:01:02.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:02 smithi100 bash[13549]: audit 2021-01-28T04:01:01.537076+0000 mon.a (mon.0) 988 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:02.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:02 smithi100 bash[13549]: cluster 2021-01-28T04:01:01.537281+0000 mon.a (mon.0) 989 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2021-01-28T04:01:02.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:02 smithi100 bash[13549]: audit 2021-01-28T04:01:02.061534+0000 mon.b (mon.2) 96 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:02.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:02 smithi100 bash[9834]: cluster 2021-01-28T04:01:01.285890+0000 osd.6 (osd.6) 6 : cluster [DBG] 13.4 deep-scrub ok 2021-01-28T04:01:02.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:02 smithi100 bash[9834]: cluster 2021-01-28T04:01:01.520245+0000 mon.a (mon.0) 986 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:01:02.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:02 smithi100 bash[9834]: audit 2021-01-28T04:01:01.536824+0000 mon.a (mon.0) 987 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-9"}]': finished 2021-01-28T04:01:02.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:02 smithi100 bash[9834]: audit 2021-01-28T04:01:01.537076+0000 mon.a (mon.0) 988 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:02.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:02 smithi100 bash[9834]: cluster 2021-01-28T04:01:01.537281+0000 mon.a (mon.0) 989 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2021-01-28T04:01:02.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:02 smithi100 bash[9834]: audit 2021-01-28T04:01:02.061534+0000 mon.b (mon.2) 96 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:03.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:03 smithi100 bash[9834]: cluster 2021-01-28T04:01:01.532054+0000 mgr.y (mgr.14138) 528 : cluster [DBG] pgmap v405: 364 pgs: 5 creating+peering, 35 unknown, 324 active+clean; 144 MiB data, 693 MiB used, 715 GiB / 715 GiB avail; 281 B/s rd, 0 op/s 2021-01-28T04:01:03.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:03 smithi100 bash[9834]: cluster 2021-01-28T04:01:02.540896+0000 mon.a (mon.0) 990 : cluster [DBG] osdmap e104: 8 total, 8 up, 8 in 2021-01-28T04:01:03.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:03 smithi100 bash[9834]: audit 2021-01-28T04:01:02.544471+0000 mon.c (mon.1) 106 : audit [INF] from='client.? 172.21.15.100:0/2196513207' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:03.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:03 smithi100 bash[9834]: audit 2021-01-28T04:01:02.546965+0000 mon.a (mon.0) 991 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:03.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:03 smithi100 bash[9834]: audit 2021-01-28T04:01:03.063547+0000 mon.b (mon.2) 97 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:03.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:03 smithi100 bash[13549]: cluster 2021-01-28T04:01:01.532054+0000 mgr.y (mgr.14138) 528 : cluster [DBG] pgmap v405: 364 pgs: 5 creating+peering, 35 unknown, 324 active+clean; 144 MiB data, 693 MiB used, 715 GiB / 715 GiB avail; 281 B/s rd, 0 op/s 2021-01-28T04:01:03.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:03 smithi100 bash[13549]: cluster 2021-01-28T04:01:02.540896+0000 mon.a (mon.0) 990 : cluster [DBG] osdmap e104: 8 total, 8 up, 8 in 2021-01-28T04:01:03.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:03 smithi100 bash[13549]: audit 2021-01-28T04:01:02.544471+0000 mon.c (mon.1) 106 : audit [INF] from='client.? 172.21.15.100:0/2196513207' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:03.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:03 smithi100 bash[13549]: audit 2021-01-28T04:01:02.546965+0000 mon.a (mon.0) 991 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:03.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:03 smithi100 bash[13549]: audit 2021-01-28T04:01:03.063547+0000 mon.b (mon.2) 97 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:04.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:03 smithi162 bash[9856]: cluster 2021-01-28T04:01:01.532054+0000 mgr.y (mgr.14138) 528 : cluster [DBG] pgmap v405: 364 pgs: 5 creating+peering, 35 unknown, 324 active+clean; 144 MiB data, 693 MiB used, 715 GiB / 715 GiB avail; 281 B/s rd, 0 op/s 2021-01-28T04:01:04.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:03 smithi162 bash[9856]: cluster 2021-01-28T04:01:02.540896+0000 mon.a (mon.0) 990 : cluster [DBG] osdmap e104: 8 total, 8 up, 8 in 2021-01-28T04:01:04.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:03 smithi162 bash[9856]: audit 2021-01-28T04:01:02.544471+0000 mon.c (mon.1) 106 : audit [INF] from='client.? 172.21.15.100:0/2196513207' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:04.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:03 smithi162 bash[9856]: audit 2021-01-28T04:01:02.546965+0000 mon.a (mon.0) 991 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:04.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:03 smithi162 bash[9856]: audit 2021-01-28T04:01:03.063547+0000 mon.b (mon.2) 97 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:04.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:04 smithi100 bash[9834]: cluster 2021-01-28T04:01:03.117673+0000 osd.4 (osd.4) 6 : cluster [DBG] 13.6 deep-scrub ok 2021-01-28T04:01:04.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:04 smithi100 bash[9834]: audit 2021-01-28T04:01:03.523662+0000 mon.a (mon.0) 992 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:04.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:04 smithi100 bash[9834]: audit 2021-01-28T04:01:03.525866+0000 mon.c (mon.1) 107 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:04.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:04 smithi100 bash[9834]: cluster 2021-01-28T04:01:03.526061+0000 mon.a (mon.0) 993 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2021-01-28T04:01:04.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:04 smithi100 bash[9834]: cluster 2021-01-28T04:01:03.532820+0000 mgr.y (mgr.14138) 529 : cluster [DBG] pgmap v408: 396 pgs: 7 creating+peering, 91 unknown, 298 active+clean; 192 MiB data, 824 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 12 MiB/s wr, 3 op/s 2021-01-28T04:01:04.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:04 smithi100 bash[9834]: audit 2021-01-28T04:01:03.539989+0000 mon.a (mon.0) 994 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:04.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:04 smithi100 bash[9834]: audit 2021-01-28T04:01:03.540368+0000 mon.a (mon.0) 995 : audit [INF] from='client.? 172.21.15.100:0/1632066379' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:04.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:04 smithi100 bash[9834]: cluster 2021-01-28T04:01:03.808279+0000 osd.5 (osd.5) 5 : cluster [DBG] 13.2 deep-scrub ok 2021-01-28T04:01:04.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:04 smithi100 bash[9834]: audit 2021-01-28T04:01:04.065395+0000 mon.b (mon.2) 98 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:04.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:04 smithi100 bash[9834]: cluster 2021-01-28T04:01:04.511941+0000 mon.a (mon.0) 996 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:01:04.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:04 smithi100 bash[9834]: audit 2021-01-28T04:01:04.520801+0000 mon.a (mon.0) 997 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:04.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:04 smithi100 bash[9834]: audit 2021-01-28T04:01:04.521223+0000 mon.a (mon.0) 998 : audit [INF] from='client.? 172.21.15.100:0/1632066379' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-12","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:04.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:04 smithi100 bash[9834]: cluster 2021-01-28T04:01:04.523350+0000 mon.a (mon.0) 999 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2021-01-28T04:01:04.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:04 smithi100 bash[13549]: cluster 2021-01-28T04:01:03.117673+0000 osd.4 (osd.4) 6 : cluster [DBG] 13.6 deep-scrub ok 2021-01-28T04:01:04.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:04 smithi100 bash[13549]: audit 2021-01-28T04:01:03.523662+0000 mon.a (mon.0) 992 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:04.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:04 smithi100 bash[13549]: audit 2021-01-28T04:01:03.525866+0000 mon.c (mon.1) 107 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:04.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:04 smithi100 bash[13549]: cluster 2021-01-28T04:01:03.526061+0000 mon.a (mon.0) 993 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2021-01-28T04:01:04.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:04 smithi100 bash[13549]: cluster 2021-01-28T04:01:03.532820+0000 mgr.y (mgr.14138) 529 : cluster [DBG] pgmap v408: 396 pgs: 7 creating+peering, 91 unknown, 298 active+clean; 192 MiB data, 824 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 12 MiB/s wr, 3 op/s 2021-01-28T04:01:04.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:04 smithi100 bash[13549]: audit 2021-01-28T04:01:03.539989+0000 mon.a (mon.0) 994 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:04.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:04 smithi100 bash[13549]: audit 2021-01-28T04:01:03.540368+0000 mon.a (mon.0) 995 : audit [INF] from='client.? 172.21.15.100:0/1632066379' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:04.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:04 smithi100 bash[13549]: cluster 2021-01-28T04:01:03.808279+0000 osd.5 (osd.5) 5 : cluster [DBG] 13.2 deep-scrub ok 2021-01-28T04:01:04.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:04 smithi100 bash[13549]: audit 2021-01-28T04:01:04.065395+0000 mon.b (mon.2) 98 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:04.834 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:04 smithi100 bash[13549]: cluster 2021-01-28T04:01:04.511941+0000 mon.a (mon.0) 996 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:01:04.834 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:04 smithi100 bash[13549]: audit 2021-01-28T04:01:04.520801+0000 mon.a (mon.0) 997 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:04.834 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:04 smithi100 bash[13549]: audit 2021-01-28T04:01:04.521223+0000 mon.a (mon.0) 998 : audit [INF] from='client.? 172.21.15.100:0/1632066379' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-12","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:04.834 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:04 smithi100 bash[13549]: cluster 2021-01-28T04:01:04.523350+0000 mon.a (mon.0) 999 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2021-01-28T04:01:05.012 INFO:journalctl@ceph.osd.6.smithi162.stdout:Jan 28 04:01:04 smithi162 bash[17572]: debug 2021-01-28T04:01:04.521+0000 7f403f92c700 -1 osd.6 pg_epoch: 106 pg[67.3( v 105'3 (0'0,105'3] local-lis/les=88/89 n=2 ec=88/88 lis/c=88/88 les/c/f=89/89/0 sis=88) [6,3,0] r=0 lpr=88 crt=105'3 lcod 104'1 mlcod 104'1 active+clean+snaptrim trimq=[11~1] ps=[a~3]] removing snap head 2021-01-28T04:01:05.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:04 smithi162 bash[9856]: cluster 2021-01-28T04:01:03.117673+0000 osd.4 (osd.4) 6 : cluster [DBG] 13.6 deep-scrub ok 2021-01-28T04:01:05.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:04 smithi162 bash[9856]: audit 2021-01-28T04:01:03.523662+0000 mon.a (mon.0) 992 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:05.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:04 smithi162 bash[9856]: audit 2021-01-28T04:01:03.525866+0000 mon.c (mon.1) 107 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:05.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:04 smithi162 bash[9856]: cluster 2021-01-28T04:01:03.526061+0000 mon.a (mon.0) 993 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2021-01-28T04:01:05.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:04 smithi162 bash[9856]: cluster 2021-01-28T04:01:03.532820+0000 mgr.y (mgr.14138) 529 : cluster [DBG] pgmap v408: 396 pgs: 7 creating+peering, 91 unknown, 298 active+clean; 192 MiB data, 824 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 12 MiB/s wr, 3 op/s 2021-01-28T04:01:05.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:04 smithi162 bash[9856]: audit 2021-01-28T04:01:03.539989+0000 mon.a (mon.0) 994 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:05.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:04 smithi162 bash[9856]: audit 2021-01-28T04:01:03.540368+0000 mon.a (mon.0) 995 : audit [INF] from='client.? 172.21.15.100:0/1632066379' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:05.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:04 smithi162 bash[9856]: cluster 2021-01-28T04:01:03.808279+0000 osd.5 (osd.5) 5 : cluster [DBG] 13.2 deep-scrub ok 2021-01-28T04:01:05.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:04 smithi162 bash[9856]: audit 2021-01-28T04:01:04.065395+0000 mon.b (mon.2) 98 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:05.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:04 smithi162 bash[9856]: cluster 2021-01-28T04:01:04.511941+0000 mon.a (mon.0) 996 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:01:05.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:04 smithi162 bash[9856]: audit 2021-01-28T04:01:04.520801+0000 mon.a (mon.0) 997 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:05.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:04 smithi162 bash[9856]: audit 2021-01-28T04:01:04.521223+0000 mon.a (mon.0) 998 : audit [INF] from='client.? 172.21.15.100:0/1632066379' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-12","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:05.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:04 smithi162 bash[9856]: cluster 2021-01-28T04:01:04.523350+0000 mon.a (mon.0) 999 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2021-01-28T04:01:05.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:05 smithi100 bash[9834]: audit 2021-01-28T04:01:05.067430+0000 mon.b (mon.2) 99 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:05.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:05 smithi100 bash[9834]: cluster 2021-01-28T04:01:05.534344+0000 mgr.y (mgr.14138) 530 : cluster [DBG] pgmap v411: 364 pgs: 5 creating+peering, 59 unknown, 300 active+clean; 216 MiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 18 MiB/s wr, 5 op/s 2021-01-28T04:01:05.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:05 smithi100 bash[9834]: cluster 2021-01-28T04:01:05.540760+0000 mon.a (mon.0) 1000 : cluster [DBG] osdmap e107: 8 total, 8 up, 8 in 2021-01-28T04:01:05.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:05 smithi100 bash[9834]: audit 2021-01-28T04:01:05.544803+0000 mon.b (mon.2) 100 : audit [INF] from='client.? 172.21.15.100:0/2747139451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:05.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:05 smithi100 bash[13549]: audit 2021-01-28T04:01:05.067430+0000 mon.b (mon.2) 99 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:05.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:05 smithi100 bash[13549]: cluster 2021-01-28T04:01:05.534344+0000 mgr.y (mgr.14138) 530 : cluster [DBG] pgmap v411: 364 pgs: 5 creating+peering, 59 unknown, 300 active+clean; 216 MiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 18 MiB/s wr, 5 op/s 2021-01-28T04:01:05.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:05 smithi100 bash[13549]: cluster 2021-01-28T04:01:05.540760+0000 mon.a (mon.0) 1000 : cluster [DBG] osdmap e107: 8 total, 8 up, 8 in 2021-01-28T04:01:05.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:05 smithi100 bash[13549]: audit 2021-01-28T04:01:05.544803+0000 mon.b (mon.2) 100 : audit [INF] from='client.? 172.21.15.100:0/2747139451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:06.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:05 smithi162 bash[9856]: audit 2021-01-28T04:01:05.067430+0000 mon.b (mon.2) 99 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:06.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:05 smithi162 bash[9856]: cluster 2021-01-28T04:01:05.534344+0000 mgr.y (mgr.14138) 530 : cluster [DBG] pgmap v411: 364 pgs: 5 creating+peering, 59 unknown, 300 active+clean; 216 MiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 18 MiB/s wr, 5 op/s 2021-01-28T04:01:06.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:05 smithi162 bash[9856]: cluster 2021-01-28T04:01:05.540760+0000 mon.a (mon.0) 1000 : cluster [DBG] osdmap e107: 8 total, 8 up, 8 in 2021-01-28T04:01:06.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:05 smithi162 bash[9856]: audit 2021-01-28T04:01:05.544803+0000 mon.b (mon.2) 100 : audit [INF] from='client.? 172.21.15.100:0/2747139451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:06.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:06 smithi100 bash[9834]: audit 2021-01-28T04:01:05.546478+0000 mon.a (mon.0) 1001 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:06.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:06 smithi100 bash[9834]: audit 2021-01-28T04:01:05.587410+0000 mon.c (mon.1) 108 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-11", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:01:06.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:06 smithi100 bash[9834]: cluster 2021-01-28T04:01:05.862779+0000 osd.5 (osd.5) 6 : cluster [DBG] 13.9 deep-scrub ok 2021-01-28T04:01:06.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:06 smithi100 bash[9834]: audit 2021-01-28T04:01:05.998378+0000 mon.a (mon.0) 1002 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-11", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:01:06.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:06 smithi100 bash[9834]: audit 2021-01-28T04:01:06.069346+0000 mon.b (mon.2) 101 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:06.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:06 smithi100 bash[9834]: audit 2021-01-28T04:01:06.548317+0000 mon.a (mon.0) 1003 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:06.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:06 smithi100 bash[9834]: audit 2021-01-28T04:01:06.548626+0000 mon.a (mon.0) 1004 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-11", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:01:06.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:06 smithi100 bash[9834]: cluster 2021-01-28T04:01:06.548736+0000 mon.a (mon.0) 1005 : cluster [DBG] osdmap e108: 8 total, 8 up, 8 in 2021-01-28T04:01:06.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:06 smithi100 bash[9834]: audit 2021-01-28T04:01:06.552546+0000 mon.b (mon.2) 102 : audit [INF] from='client.? 172.21.15.100:0/673975101' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:06.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:06 smithi100 bash[9834]: audit 2021-01-28T04:01:06.553857+0000 mon.a (mon.0) 1006 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-11"}]: dispatch 2021-01-28T04:01:06.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:06 smithi100 bash[13549]: audit 2021-01-28T04:01:05.546478+0000 mon.a (mon.0) 1001 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:06.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:06 smithi100 bash[13549]: audit 2021-01-28T04:01:05.587410+0000 mon.c (mon.1) 108 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-11", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:01:06.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:06 smithi100 bash[13549]: cluster 2021-01-28T04:01:05.862779+0000 osd.5 (osd.5) 6 : cluster [DBG] 13.9 deep-scrub ok 2021-01-28T04:01:06.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:06 smithi100 bash[13549]: audit 2021-01-28T04:01:05.998378+0000 mon.a (mon.0) 1002 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-11", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:01:06.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:06 smithi100 bash[13549]: audit 2021-01-28T04:01:06.069346+0000 mon.b (mon.2) 101 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:06.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:06 smithi100 bash[13549]: audit 2021-01-28T04:01:06.548317+0000 mon.a (mon.0) 1003 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:06.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:06 smithi100 bash[13549]: audit 2021-01-28T04:01:06.548626+0000 mon.a (mon.0) 1004 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-11", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:01:06.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:06 smithi100 bash[13549]: cluster 2021-01-28T04:01:06.548736+0000 mon.a (mon.0) 1005 : cluster [DBG] osdmap e108: 8 total, 8 up, 8 in 2021-01-28T04:01:06.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:06 smithi100 bash[13549]: audit 2021-01-28T04:01:06.552546+0000 mon.b (mon.2) 102 : audit [INF] from='client.? 172.21.15.100:0/673975101' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:06.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:06 smithi100 bash[13549]: audit 2021-01-28T04:01:06.553857+0000 mon.a (mon.0) 1006 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-11"}]: dispatch 2021-01-28T04:01:07.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:06 smithi162 bash[9856]: audit 2021-01-28T04:01:05.546478+0000 mon.a (mon.0) 1001 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:07.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:06 smithi162 bash[9856]: audit 2021-01-28T04:01:05.587410+0000 mon.c (mon.1) 108 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-11", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:01:07.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:06 smithi162 bash[9856]: cluster 2021-01-28T04:01:05.862779+0000 osd.5 (osd.5) 6 : cluster [DBG] 13.9 deep-scrub ok 2021-01-28T04:01:07.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:06 smithi162 bash[9856]: audit 2021-01-28T04:01:05.998378+0000 mon.a (mon.0) 1002 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-11", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:01:07.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:06 smithi162 bash[9856]: audit 2021-01-28T04:01:06.069346+0000 mon.b (mon.2) 101 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:07.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:06 smithi162 bash[9856]: audit 2021-01-28T04:01:06.548317+0000 mon.a (mon.0) 1003 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:07.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:06 smithi162 bash[9856]: audit 2021-01-28T04:01:06.548626+0000 mon.a (mon.0) 1004 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-11", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:01:07.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:06 smithi162 bash[9856]: cluster 2021-01-28T04:01:06.548736+0000 mon.a (mon.0) 1005 : cluster [DBG] osdmap e108: 8 total, 8 up, 8 in 2021-01-28T04:01:07.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:06 smithi162 bash[9856]: audit 2021-01-28T04:01:06.552546+0000 mon.b (mon.2) 102 : audit [INF] from='client.? 172.21.15.100:0/673975101' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:07.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:06 smithi162 bash[9856]: audit 2021-01-28T04:01:06.553857+0000 mon.a (mon.0) 1006 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-11"}]: dispatch 2021-01-28T04:01:08.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:07 smithi162 bash[9856]: audit 2021-01-28T04:01:06.551629+0000 mon.c (mon.1) 109 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-11"}]: dispatch 2021-01-28T04:01:08.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:07 smithi162 bash[9856]: audit 2021-01-28T04:01:06.554237+0000 mon.a (mon.0) 1007 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:08.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:07 smithi162 bash[9856]: audit 2021-01-28T04:01:07.071387+0000 mon.b (mon.2) 103 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:08.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:07 smithi162 bash[9856]: audit 2021-01-28T04:01:07.547118+0000 mon.a (mon.0) 1008 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-11"}]': finished 2021-01-28T04:01:08.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:07 smithi162 bash[9856]: audit 2021-01-28T04:01:07.547330+0000 mon.a (mon.0) 1009 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:08.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:07 smithi162 bash[9856]: cluster 2021-01-28T04:01:07.547994+0000 mon.a (mon.0) 1010 : cluster [DBG] osdmap e109: 8 total, 8 up, 8 in 2021-01-28T04:01:08.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:07 smithi162 bash[9856]: audit 2021-01-28T04:01:07.557572+0000 mon.a (mon.0) 1011 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-11", "mode": "writeback"}]: dispatch 2021-01-28T04:01:08.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:07 smithi100 bash[9834]: audit 2021-01-28T04:01:06.551629+0000 mon.c (mon.1) 109 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-11"}]: dispatch 2021-01-28T04:01:08.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:07 smithi100 bash[9834]: audit 2021-01-28T04:01:06.554237+0000 mon.a (mon.0) 1007 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:08.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:07 smithi100 bash[9834]: audit 2021-01-28T04:01:07.071387+0000 mon.b (mon.2) 103 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:08.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:07 smithi100 bash[9834]: audit 2021-01-28T04:01:07.547118+0000 mon.a (mon.0) 1008 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-11"}]': finished 2021-01-28T04:01:08.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:07 smithi100 bash[9834]: audit 2021-01-28T04:01:07.547330+0000 mon.a (mon.0) 1009 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:08.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:07 smithi100 bash[9834]: cluster 2021-01-28T04:01:07.547994+0000 mon.a (mon.0) 1010 : cluster [DBG] osdmap e109: 8 total, 8 up, 8 in 2021-01-28T04:01:08.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:07 smithi100 bash[9834]: audit 2021-01-28T04:01:07.557572+0000 mon.a (mon.0) 1011 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-11", "mode": "writeback"}]: dispatch 2021-01-28T04:01:08.079 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:07 smithi100 bash[13549]: audit 2021-01-28T04:01:06.551629+0000 mon.c (mon.1) 109 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-11"}]: dispatch 2021-01-28T04:01:08.079 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:07 smithi100 bash[13549]: audit 2021-01-28T04:01:06.554237+0000 mon.a (mon.0) 1007 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:08.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:07 smithi100 bash[13549]: audit 2021-01-28T04:01:07.071387+0000 mon.b (mon.2) 103 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:08.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:07 smithi100 bash[13549]: audit 2021-01-28T04:01:07.547118+0000 mon.a (mon.0) 1008 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-11"}]': finished 2021-01-28T04:01:08.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:07 smithi100 bash[13549]: audit 2021-01-28T04:01:07.547330+0000 mon.a (mon.0) 1009 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:08.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:07 smithi100 bash[13549]: cluster 2021-01-28T04:01:07.547994+0000 mon.a (mon.0) 1010 : cluster [DBG] osdmap e109: 8 total, 8 up, 8 in 2021-01-28T04:01:08.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:07 smithi100 bash[13549]: audit 2021-01-28T04:01:07.557572+0000 mon.a (mon.0) 1011 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-11", "mode": "writeback"}]: dispatch 2021-01-28T04:01:09.262 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:08 smithi162 bash[9856]: cluster 2021-01-28T04:01:07.536239+0000 mgr.y (mgr.14138) 531 : cluster [DBG] pgmap v413: 396 pgs: 26 creating+peering, 44 unknown, 326 active+clean; 216 MiB data, 886 MiB used, 714 GiB / 715 GiB avail; 509 B/s rd, 6.2 MiB/s wr, 3 op/s 2021-01-28T04:01:09.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:08 smithi162 bash[9856]: audit 2021-01-28T04:01:07.556819+0000 mon.c (mon.1) 110 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-11", "mode": "writeback"}]: dispatch 2021-01-28T04:01:09.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:08 smithi162 bash[9856]: audit 2021-01-28T04:01:08.073360+0000 mon.b (mon.2) 104 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:09.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:08 smithi162 bash[9856]: cluster 2021-01-28T04:01:08.511020+0000 mon.a (mon.0) 1012 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:01:09.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:08 smithi162 bash[9856]: audit 2021-01-28T04:01:08.523900+0000 mon.a (mon.0) 1013 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-11", "mode": "writeback"}]': finished 2021-01-28T04:01:09.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:08 smithi162 bash[9856]: cluster 2021-01-28T04:01:08.524064+0000 mon.a (mon.0) 1014 : cluster [DBG] osdmap e110: 8 total, 8 up, 8 in 2021-01-28T04:01:09.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:08 smithi162 bash[9856]: audit 2021-01-28T04:01:08.530021+0000 mon.c (mon.1) 111 : audit [INF] from='client.? 172.21.15.100:0/999943667' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:09.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:08 smithi162 bash[9856]: audit 2021-01-28T04:01:08.535692+0000 mon.b (mon.2) 105 : audit [INF] from='client.? 172.21.15.100:0/731470556' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32381-9"}]: dispatch 2021-01-28T04:01:09.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:08 smithi162 bash[9856]: audit 2021-01-28T04:01:08.540582+0000 mon.a (mon.0) 1015 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:09.266 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:08 smithi162 bash[9856]: audit 2021-01-28T04:01:08.541646+0000 mon.a (mon.0) 1016 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32381-9"}]: dispatch 2021-01-28T04:01:09.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:08 smithi100 bash[9834]: cluster 2021-01-28T04:01:07.536239+0000 mgr.y (mgr.14138) 531 : cluster [DBG] pgmap v413: 396 pgs: 26 creating+peering, 44 unknown, 326 active+clean; 216 MiB data, 886 MiB used, 714 GiB / 715 GiB avail; 509 B/s rd, 6.2 MiB/s wr, 3 op/s 2021-01-28T04:01:09.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:08 smithi100 bash[9834]: audit 2021-01-28T04:01:07.556819+0000 mon.c (mon.1) 110 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-11", "mode": "writeback"}]: dispatch 2021-01-28T04:01:09.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:08 smithi100 bash[9834]: audit 2021-01-28T04:01:08.073360+0000 mon.b (mon.2) 104 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:09.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:08 smithi100 bash[9834]: cluster 2021-01-28T04:01:08.511020+0000 mon.a (mon.0) 1012 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:01:09.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:08 smithi100 bash[9834]: audit 2021-01-28T04:01:08.523900+0000 mon.a (mon.0) 1013 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-11", "mode": "writeback"}]': finished 2021-01-28T04:01:09.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:08 smithi100 bash[9834]: cluster 2021-01-28T04:01:08.524064+0000 mon.a (mon.0) 1014 : cluster [DBG] osdmap e110: 8 total, 8 up, 8 in 2021-01-28T04:01:09.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:08 smithi100 bash[9834]: audit 2021-01-28T04:01:08.530021+0000 mon.c (mon.1) 111 : audit [INF] from='client.? 172.21.15.100:0/999943667' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:09.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:08 smithi100 bash[9834]: audit 2021-01-28T04:01:08.535692+0000 mon.b (mon.2) 105 : audit [INF] from='client.? 172.21.15.100:0/731470556' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32381-9"}]: dispatch 2021-01-28T04:01:09.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:08 smithi100 bash[9834]: audit 2021-01-28T04:01:08.540582+0000 mon.a (mon.0) 1015 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:09.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:08 smithi100 bash[9834]: audit 2021-01-28T04:01:08.541646+0000 mon.a (mon.0) 1016 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32381-9"}]: dispatch 2021-01-28T04:01:09.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:08 smithi100 bash[13549]: cluster 2021-01-28T04:01:07.536239+0000 mgr.y (mgr.14138) 531 : cluster [DBG] pgmap v413: 396 pgs: 26 creating+peering, 44 unknown, 326 active+clean; 216 MiB data, 886 MiB used, 714 GiB / 715 GiB avail; 509 B/s rd, 6.2 MiB/s wr, 3 op/s 2021-01-28T04:01:09.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:08 smithi100 bash[13549]: audit 2021-01-28T04:01:07.556819+0000 mon.c (mon.1) 110 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-11", "mode": "writeback"}]: dispatch 2021-01-28T04:01:09.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:08 smithi100 bash[13549]: audit 2021-01-28T04:01:08.073360+0000 mon.b (mon.2) 104 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:09.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:08 smithi100 bash[13549]: cluster 2021-01-28T04:01:08.511020+0000 mon.a (mon.0) 1012 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:01:09.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:08 smithi100 bash[13549]: audit 2021-01-28T04:01:08.523900+0000 mon.a (mon.0) 1013 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-11", "mode": "writeback"}]': finished 2021-01-28T04:01:09.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:08 smithi100 bash[13549]: cluster 2021-01-28T04:01:08.524064+0000 mon.a (mon.0) 1014 : cluster [DBG] osdmap e110: 8 total, 8 up, 8 in 2021-01-28T04:01:09.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:08 smithi100 bash[13549]: audit 2021-01-28T04:01:08.530021+0000 mon.c (mon.1) 111 : audit [INF] from='client.? 172.21.15.100:0/999943667' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:09.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:08 smithi100 bash[13549]: audit 2021-01-28T04:01:08.535692+0000 mon.b (mon.2) 105 : audit [INF] from='client.? 172.21.15.100:0/731470556' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32381-9"}]: dispatch 2021-01-28T04:01:09.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:08 smithi100 bash[13549]: audit 2021-01-28T04:01:08.540582+0000 mon.a (mon.0) 1015 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:09.334 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:08 smithi100 bash[13549]: audit 2021-01-28T04:01:08.541646+0000 mon.a (mon.0) 1016 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32381-9"}]: dispatch 2021-01-28T04:01:09.827 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 04:01:09 smithi100 bash[10061]: debug 2021-01-28T04:01:09.735+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:01:09.828 INFO:journalctl@ceph.osd.3.smithi100.stdout:Jan 28 04:01:09 smithi100 bash[24240]: debug 2021-01-28T04:01:09.523+0000 7ff10d1a1700 -1 osd.3 pg_epoch: 111 pg[85.18( v 110'4 (0'0,110'4] local-lis/les=105/106 n=4 ec=105/105 lis/c=105/105 les/c/f=106/106/0 sis=105) [3,0,1] r=0 lpr=105 crt=110'4 lcod 110'3 mlcod 110'3 active+clean+snaptrim trimq=[2~1]] removing snap head 2021-01-28T04:01:09.829 INFO:journalctl@ceph.osd.1.smithi100.stdout:Jan 28 04:01:09 smithi100 bash[19166]: debug 2021-01-28T04:01:09.539+0000 7fb94e91e700 -1 osd.1 pg_epoch: 111 pg[65.18( v 107'6 (0'0,107'6] local-lis/les=87/88 n=4 ec=87/87 lis/c=87/87 les/c/f=88/88/0 sis=87) [1,2,0] r=0 lpr=87 crt=107'6 lcod 107'4 mlcod 107'4 active+clean+snaptrim trimq=[2~1]] removing snap head 2021-01-28T04:01:09.999 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 04:01:09 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T04:01:10.262 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:09 smithi162 bash[9856]: audit 2021-01-28T04:01:09.075179+0000 mon.b (mon.2) 106 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:10.262 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:09 smithi162 bash[9856]: audit 2021-01-28T04:01:09.531348+0000 mon.a (mon.0) 1017 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:10.262 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:09 smithi162 bash[9856]: audit 2021-01-28T04:01:09.531493+0000 mon.a (mon.0) 1018 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32381-9"}]': finished 2021-01-28T04:01:10.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:09 smithi162 bash[9856]: cluster 2021-01-28T04:01:09.531774+0000 mon.a (mon.0) 1019 : cluster [DBG] osdmap e111: 8 total, 8 up, 8 in 2021-01-28T04:01:10.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:09 smithi162 bash[9856]: audit 2021-01-28T04:01:09.534702+0000 mon.a (mon.0) 1020 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32381-9"}]: dispatch 2021-01-28T04:01:10.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:09 smithi162 bash[9856]: audit 2021-01-28T04:01:09.534809+0000 mon.b (mon.2) 107 : audit [INF] from='client.? 172.21.15.100:0/731470556' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32381-9"}]: dispatch 2021-01-28T04:01:10.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:10 smithi162 bash[9856]: audit 2021-01-28T04:01:09.536869+0000 mon.b (mon.2) 108 : audit [INF] from='client.? 172.21.15.100:0/2311371009' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:10.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:10 smithi162 bash[9856]: audit 2021-01-28T04:01:09.540577+0000 mon.a (mon.0) 1021 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:10.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:10 smithi162 bash[9856]: audit 2021-01-28T04:01:09.600343+0000 mon.c (mon.1) 112 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:01:10.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:10 smithi162 bash[9856]: audit 2021-01-28T04:01:09.600746+0000 mon.a (mon.0) 1022 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:01:10.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:09 smithi100 bash[9834]: audit 2021-01-28T04:01:09.075179+0000 mon.b (mon.2) 106 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:10.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:09 smithi100 bash[9834]: audit 2021-01-28T04:01:09.531348+0000 mon.a (mon.0) 1017 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:10.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:09 smithi100 bash[9834]: audit 2021-01-28T04:01:09.531493+0000 mon.a (mon.0) 1018 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32381-9"}]': finished 2021-01-28T04:01:10.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:09 smithi100 bash[9834]: cluster 2021-01-28T04:01:09.531774+0000 mon.a (mon.0) 1019 : cluster [DBG] osdmap e111: 8 total, 8 up, 8 in 2021-01-28T04:01:10.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:09 smithi100 bash[9834]: audit 2021-01-28T04:01:09.534702+0000 mon.a (mon.0) 1020 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32381-9"}]: dispatch 2021-01-28T04:01:10.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:09 smithi100 bash[9834]: audit 2021-01-28T04:01:09.534809+0000 mon.b (mon.2) 107 : audit [INF] from='client.? 172.21.15.100:0/731470556' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32381-9"}]: dispatch 2021-01-28T04:01:10.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:09 smithi100 bash[9834]: audit 2021-01-28T04:01:09.536869+0000 mon.b (mon.2) 108 : audit [INF] from='client.? 172.21.15.100:0/2311371009' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:10.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:09 smithi100 bash[9834]: audit 2021-01-28T04:01:09.540577+0000 mon.a (mon.0) 1021 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:10.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:09 smithi100 bash[9834]: audit 2021-01-28T04:01:09.600343+0000 mon.c (mon.1) 112 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:01:10.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:09 smithi100 bash[9834]: audit 2021-01-28T04:01:09.600746+0000 mon.a (mon.0) 1022 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:01:10.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:09 smithi100 bash[13549]: audit 2021-01-28T04:01:09.075179+0000 mon.b (mon.2) 106 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:10.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:09 smithi100 bash[13549]: audit 2021-01-28T04:01:09.531348+0000 mon.a (mon.0) 1017 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:10.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:09 smithi100 bash[13549]: audit 2021-01-28T04:01:09.531493+0000 mon.a (mon.0) 1018 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32381-9"}]': finished 2021-01-28T04:01:10.334 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:09 smithi100 bash[13549]: cluster 2021-01-28T04:01:09.531774+0000 mon.a (mon.0) 1019 : cluster [DBG] osdmap e111: 8 total, 8 up, 8 in 2021-01-28T04:01:10.334 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:09 smithi100 bash[13549]: audit 2021-01-28T04:01:09.534702+0000 mon.a (mon.0) 1020 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32381-9"}]: dispatch 2021-01-28T04:01:10.334 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:09 smithi100 bash[13549]: audit 2021-01-28T04:01:09.534809+0000 mon.b (mon.2) 107 : audit [INF] from='client.? 172.21.15.100:0/731470556' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32381-9"}]: dispatch 2021-01-28T04:01:10.335 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:09 smithi100 bash[13549]: audit 2021-01-28T04:01:09.536869+0000 mon.b (mon.2) 108 : audit [INF] from='client.? 172.21.15.100:0/2311371009' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:10.335 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:09 smithi100 bash[13549]: audit 2021-01-28T04:01:09.540577+0000 mon.a (mon.0) 1021 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:10.335 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:09 smithi100 bash[13549]: audit 2021-01-28T04:01:09.600343+0000 mon.c (mon.1) 112 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:01:10.336 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:10 smithi100 bash[13549]: audit 2021-01-28T04:01:09.600746+0000 mon.a (mon.0) 1022 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:01:11.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:11 smithi100 bash[9834]: cluster 2021-01-28T04:01:09.536951+0000 mgr.y (mgr.14138) 532 : cluster [DBG] pgmap v417: 388 pgs: 8 creating+peering, 56 unknown, 324 active+clean; 216 MiB data, 890 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 258 KiB/s wr, 4 op/s 2021-01-28T04:01:11.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:11 smithi100 bash[9834]: audit 2021-01-28T04:01:09.738923+0000 mgr.y (mgr.14138) 533 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:01:11.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:11 smithi100 bash[9834]: cluster 2021-01-28T04:01:09.794038+0000 osd.7 (osd.7) 5 : cluster [DBG] 13.0 deep-scrub ok 2021-01-28T04:01:11.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:11 smithi100 bash[9834]: audit 2021-01-28T04:01:10.077193+0000 mon.b (mon.2) 109 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:11.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:11 smithi100 bash[9834]: cluster 2021-01-28T04:01:10.519418+0000 mon.a (mon.0) 1023 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:01:11.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:11 smithi100 bash[9834]: audit 2021-01-28T04:01:10.539118+0000 mon.a (mon.0) 1024 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32381-9"}]': finished 2021-01-28T04:01:11.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:11 smithi100 bash[9834]: audit 2021-01-28T04:01:10.539317+0000 mon.a (mon.0) 1025 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-14","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:11.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:11 smithi100 bash[9834]: audit 2021-01-28T04:01:10.539582+0000 mon.a (mon.0) 1026 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:01:11.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:11 smithi100 bash[9834]: cluster 2021-01-28T04:01:10.539668+0000 mon.a (mon.0) 1027 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2021-01-28T04:01:11.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:11 smithi100 bash[9834]: audit 2021-01-28T04:01:10.544636+0000 mon.c (mon.1) 113 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-11"}]: dispatch 2021-01-28T04:01:11.333 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:11 smithi100 bash[9834]: audit 2021-01-28T04:01:10.549203+0000 mon.a (mon.0) 1028 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-11"}]: dispatch 2021-01-28T04:01:11.333 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:11 smithi100 bash[9834]: audit 2021-01-28T04:01:10.587270+0000 mon.a (mon.0) 1029 : audit [INF] from='client.? 172.21.15.100:0/4157868434' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32381-14"}]: dispatch 2021-01-28T04:01:11.334 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:11 smithi100 bash[9834]: audit 2021-01-28T04:01:10.592773+0000 mon.a (mon.0) 1030 : audit [INF] from='client.? 172.21.15.100:0/4157868434' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32381-14"}]: dispatch 2021-01-28T04:01:11.334 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:11 smithi100 bash[9834]: audit 2021-01-28T04:01:10.596566+0000 mon.a (mon.0) 1031 : audit [INF] from='client.? 172.21.15.100:0/4157868434' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32381-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:11.335 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:11 smithi100 bash[13549]: cluster 2021-01-28T04:01:09.536951+0000 mgr.y (mgr.14138) 532 : cluster [DBG] pgmap v417: 388 pgs: 8 creating+peering, 56 unknown, 324 active+clean; 216 MiB data, 890 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 258 KiB/s wr, 4 op/s 2021-01-28T04:01:11.336 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:11 smithi100 bash[13549]: audit 2021-01-28T04:01:09.738923+0000 mgr.y (mgr.14138) 533 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:01:11.336 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:11 smithi100 bash[13549]: cluster 2021-01-28T04:01:09.794038+0000 osd.7 (osd.7) 5 : cluster [DBG] 13.0 deep-scrub ok 2021-01-28T04:01:11.336 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:11 smithi100 bash[13549]: audit 2021-01-28T04:01:10.077193+0000 mon.b (mon.2) 109 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:11.337 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:11 smithi100 bash[13549]: cluster 2021-01-28T04:01:10.519418+0000 mon.a (mon.0) 1023 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:01:11.337 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:11 smithi100 bash[13549]: audit 2021-01-28T04:01:10.539118+0000 mon.a (mon.0) 1024 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32381-9"}]': finished 2021-01-28T04:01:11.338 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:11 smithi100 bash[13549]: audit 2021-01-28T04:01:10.539317+0000 mon.a (mon.0) 1025 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-14","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:11.338 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:11 smithi100 bash[13549]: audit 2021-01-28T04:01:10.539582+0000 mon.a (mon.0) 1026 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:01:11.339 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:11 smithi100 bash[13549]: cluster 2021-01-28T04:01:10.539668+0000 mon.a (mon.0) 1027 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2021-01-28T04:01:11.339 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:11 smithi100 bash[13549]: audit 2021-01-28T04:01:10.544636+0000 mon.c (mon.1) 113 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-11"}]: dispatch 2021-01-28T04:01:11.340 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:11 smithi100 bash[13549]: audit 2021-01-28T04:01:10.549203+0000 mon.a (mon.0) 1028 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-11"}]: dispatch 2021-01-28T04:01:11.340 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:11 smithi100 bash[13549]: audit 2021-01-28T04:01:10.587270+0000 mon.a (mon.0) 1029 : audit [INF] from='client.? 172.21.15.100:0/4157868434' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32381-14"}]: dispatch 2021-01-28T04:01:11.341 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:11 smithi100 bash[13549]: audit 2021-01-28T04:01:10.592773+0000 mon.a (mon.0) 1030 : audit [INF] from='client.? 172.21.15.100:0/4157868434' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32381-14"}]: dispatch 2021-01-28T04:01:11.341 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:11 smithi100 bash[13549]: audit 2021-01-28T04:01:10.596566+0000 mon.a (mon.0) 1031 : audit [INF] from='client.? 172.21.15.100:0/4157868434' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32381-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:11.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:11 smithi162 bash[9856]: cluster 2021-01-28T04:01:09.536951+0000 mgr.y (mgr.14138) 532 : cluster [DBG] pgmap v417: 388 pgs: 8 creating+peering, 56 unknown, 324 active+clean; 216 MiB data, 890 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 258 KiB/s wr, 4 op/s 2021-01-28T04:01:11.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:11 smithi162 bash[9856]: audit 2021-01-28T04:01:09.738923+0000 mgr.y (mgr.14138) 533 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:01:11.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:11 smithi162 bash[9856]: cluster 2021-01-28T04:01:09.794038+0000 osd.7 (osd.7) 5 : cluster [DBG] 13.0 deep-scrub ok 2021-01-28T04:01:11.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:11 smithi162 bash[9856]: audit 2021-01-28T04:01:10.077193+0000 mon.b (mon.2) 109 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:11.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:11 smithi162 bash[9856]: cluster 2021-01-28T04:01:10.519418+0000 mon.a (mon.0) 1023 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:01:11.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:11 smithi162 bash[9856]: audit 2021-01-28T04:01:10.539118+0000 mon.a (mon.0) 1024 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32381-9"}]': finished 2021-01-28T04:01:11.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:11 smithi162 bash[9856]: audit 2021-01-28T04:01:10.539317+0000 mon.a (mon.0) 1025 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-14","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:11.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:11 smithi162 bash[9856]: audit 2021-01-28T04:01:10.539582+0000 mon.a (mon.0) 1026 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:01:11.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:11 smithi162 bash[9856]: cluster 2021-01-28T04:01:10.539668+0000 mon.a (mon.0) 1027 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2021-01-28T04:01:11.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:11 smithi162 bash[9856]: audit 2021-01-28T04:01:10.544636+0000 mon.c (mon.1) 113 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-11"}]: dispatch 2021-01-28T04:01:11.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:11 smithi162 bash[9856]: audit 2021-01-28T04:01:10.549203+0000 mon.a (mon.0) 1028 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-11"}]: dispatch 2021-01-28T04:01:11.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:11 smithi162 bash[9856]: audit 2021-01-28T04:01:10.587270+0000 mon.a (mon.0) 1029 : audit [INF] from='client.? 172.21.15.100:0/4157868434' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32381-14"}]: dispatch 2021-01-28T04:01:11.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:11 smithi162 bash[9856]: audit 2021-01-28T04:01:10.592773+0000 mon.a (mon.0) 1030 : audit [INF] from='client.? 172.21.15.100:0/4157868434' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32381-14"}]: dispatch 2021-01-28T04:01:11.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:11 smithi162 bash[9856]: audit 2021-01-28T04:01:10.596566+0000 mon.a (mon.0) 1031 : audit [INF] from='client.? 172.21.15.100:0/4157868434' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32381-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:12.327 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:12 smithi100 bash[9834]: cluster 2021-01-28T04:01:10.744742+0000 osd.7 (osd.7) 6 : cluster [DBG] 13.7 deep-scrub ok 2021-01-28T04:01:12.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:12 smithi100 bash[9834]: cluster 2021-01-28T04:01:10.862631+0000 osd.0 (osd.0) 4 : cluster [DBG] 13.3 deep-scrub ok 2021-01-28T04:01:12.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:12 smithi100 bash[9834]: audit 2021-01-28T04:01:11.079110+0000 mon.b (mon.2) 110 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:12.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:12 smithi100 bash[9834]: cluster 2021-01-28T04:01:11.532365+0000 mon.a (mon.0) 1032 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:01:12.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:12 smithi100 bash[9834]: audit 2021-01-28T04:01:11.542583+0000 mon.a (mon.0) 1033 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-11"}]': finished 2021-01-28T04:01:12.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:12 smithi100 bash[9834]: audit 2021-01-28T04:01:11.543464+0000 mon.a (mon.0) 1034 : audit [INF] from='client.? 172.21.15.100:0/4157868434' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32381-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:01:12.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:12 smithi100 bash[9834]: cluster 2021-01-28T04:01:11.544257+0000 mon.a (mon.0) 1035 : cluster [DBG] osdmap e113: 8 total, 8 up, 8 in 2021-01-28T04:01:12.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:12 smithi100 bash[9834]: audit 2021-01-28T04:01:11.548224+0000 mon.a (mon.0) 1036 : audit [INF] from='client.? 172.21.15.100:0/4157868434' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32381-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32381-14"}]: dispatch 2021-01-28T04:01:12.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:12 smithi100 bash[9834]: audit 2021-01-28T04:01:11.550210+0000 mon.a (mon.0) 1037 : audit [INF] from='client.? 172.21.15.100:0/3447679772' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:12.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:12 smithi100 bash[13549]: cluster 2021-01-28T04:01:10.744742+0000 osd.7 (osd.7) 6 : cluster [DBG] 13.7 deep-scrub ok 2021-01-28T04:01:12.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:12 smithi100 bash[13549]: cluster 2021-01-28T04:01:10.862631+0000 osd.0 (osd.0) 4 : cluster [DBG] 13.3 deep-scrub ok 2021-01-28T04:01:12.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:12 smithi100 bash[13549]: audit 2021-01-28T04:01:11.079110+0000 mon.b (mon.2) 110 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:12.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:12 smithi100 bash[13549]: cluster 2021-01-28T04:01:11.532365+0000 mon.a (mon.0) 1032 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:01:12.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:12 smithi100 bash[13549]: audit 2021-01-28T04:01:11.542583+0000 mon.a (mon.0) 1033 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-11"}]': finished 2021-01-28T04:01:12.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:12 smithi100 bash[13549]: audit 2021-01-28T04:01:11.543464+0000 mon.a (mon.0) 1034 : audit [INF] from='client.? 172.21.15.100:0/4157868434' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32381-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:01:12.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:12 smithi100 bash[13549]: cluster 2021-01-28T04:01:11.544257+0000 mon.a (mon.0) 1035 : cluster [DBG] osdmap e113: 8 total, 8 up, 8 in 2021-01-28T04:01:12.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:12 smithi100 bash[13549]: audit 2021-01-28T04:01:11.548224+0000 mon.a (mon.0) 1036 : audit [INF] from='client.? 172.21.15.100:0/4157868434' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32381-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32381-14"}]: dispatch 2021-01-28T04:01:12.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:12 smithi100 bash[13549]: audit 2021-01-28T04:01:11.550210+0000 mon.a (mon.0) 1037 : audit [INF] from='client.? 172.21.15.100:0/3447679772' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:12.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:12 smithi162 bash[9856]: cluster 2021-01-28T04:01:10.744742+0000 osd.7 (osd.7) 6 : cluster [DBG] 13.7 deep-scrub ok 2021-01-28T04:01:12.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:12 smithi162 bash[9856]: cluster 2021-01-28T04:01:10.862631+0000 osd.0 (osd.0) 4 : cluster [DBG] 13.3 deep-scrub ok 2021-01-28T04:01:12.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:12 smithi162 bash[9856]: audit 2021-01-28T04:01:11.079110+0000 mon.b (mon.2) 110 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:12.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:12 smithi162 bash[9856]: cluster 2021-01-28T04:01:11.532365+0000 mon.a (mon.0) 1032 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:01:12.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:12 smithi162 bash[9856]: audit 2021-01-28T04:01:11.542583+0000 mon.a (mon.0) 1033 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-11"}]': finished 2021-01-28T04:01:12.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:12 smithi162 bash[9856]: audit 2021-01-28T04:01:11.543464+0000 mon.a (mon.0) 1034 : audit [INF] from='client.? 172.21.15.100:0/4157868434' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32381-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:01:12.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:12 smithi162 bash[9856]: cluster 2021-01-28T04:01:11.544257+0000 mon.a (mon.0) 1035 : cluster [DBG] osdmap e113: 8 total, 8 up, 8 in 2021-01-28T04:01:12.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:12 smithi162 bash[9856]: audit 2021-01-28T04:01:11.548224+0000 mon.a (mon.0) 1036 : audit [INF] from='client.? 172.21.15.100:0/4157868434' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32381-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32381-14"}]: dispatch 2021-01-28T04:01:12.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:12 smithi162 bash[9856]: audit 2021-01-28T04:01:11.550210+0000 mon.a (mon.0) 1037 : audit [INF] from='client.? 172.21.15.100:0/3447679772' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:13.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:13 smithi162 bash[9856]: cluster 2021-01-28T04:01:11.538110+0000 mgr.y (mgr.14138) 534 : cluster [DBG] pgmap v420: 356 pgs: 32 unknown, 324 active+clean; 216 MiB data, 890 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 768 B/s wr, 2 op/s 2021-01-28T04:01:13.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:13 smithi162 bash[9856]: audit 2021-01-28T04:01:12.080752+0000 mon.b (mon.2) 111 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:13.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:13 smithi162 bash[9856]: audit 2021-01-28T04:01:12.986746+0000 mon.a (mon.0) 1038 : audit [INF] from='client.? 172.21.15.100:0/3447679772' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-10","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:13.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:13 smithi162 bash[9856]: cluster 2021-01-28T04:01:12.987035+0000 mon.a (mon.0) 1039 : cluster [DBG] osdmap e114: 8 total, 8 up, 8 in 2021-01-28T04:01:13.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:13 smithi162 bash[9856]: audit 2021-01-28T04:01:12.988927+0000 mon.a (mon.0) 1040 : audit [INF] from='client.? 172.21.15.100:0/2670149676' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:13.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:13 smithi100 bash[9834]: cluster 2021-01-28T04:01:11.538110+0000 mgr.y (mgr.14138) 534 : cluster [DBG] pgmap v420: 356 pgs: 32 unknown, 324 active+clean; 216 MiB data, 890 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 768 B/s wr, 2 op/s 2021-01-28T04:01:13.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:13 smithi100 bash[9834]: audit 2021-01-28T04:01:12.080752+0000 mon.b (mon.2) 111 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:13.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:13 smithi100 bash[9834]: audit 2021-01-28T04:01:12.986746+0000 mon.a (mon.0) 1038 : audit [INF] from='client.? 172.21.15.100:0/3447679772' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-10","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:13.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:13 smithi100 bash[9834]: cluster 2021-01-28T04:01:12.987035+0000 mon.a (mon.0) 1039 : cluster [DBG] osdmap e114: 8 total, 8 up, 8 in 2021-01-28T04:01:13.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:13 smithi100 bash[9834]: audit 2021-01-28T04:01:12.988927+0000 mon.a (mon.0) 1040 : audit [INF] from='client.? 172.21.15.100:0/2670149676' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:13.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:13 smithi100 bash[13549]: cluster 2021-01-28T04:01:11.538110+0000 mgr.y (mgr.14138) 534 : cluster [DBG] pgmap v420: 356 pgs: 32 unknown, 324 active+clean; 216 MiB data, 890 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 768 B/s wr, 2 op/s 2021-01-28T04:01:13.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:13 smithi100 bash[13549]: audit 2021-01-28T04:01:12.080752+0000 mon.b (mon.2) 111 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:13.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:13 smithi100 bash[13549]: audit 2021-01-28T04:01:12.986746+0000 mon.a (mon.0) 1038 : audit [INF] from='client.? 172.21.15.100:0/3447679772' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-10","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:13.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:13 smithi100 bash[13549]: cluster 2021-01-28T04:01:12.987035+0000 mon.a (mon.0) 1039 : cluster [DBG] osdmap e114: 8 total, 8 up, 8 in 2021-01-28T04:01:13.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:13 smithi100 bash[13549]: audit 2021-01-28T04:01:12.988927+0000 mon.a (mon.0) 1040 : audit [INF] from='client.? 172.21.15.100:0/2670149676' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:14.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:14 smithi162 bash[9856]: audit 2021-01-28T04:01:13.082586+0000 mon.b (mon.2) 112 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:14.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:14 smithi162 bash[9856]: audit 2021-01-28T04:01:13.524762+0000 mon.a (mon.0) 1041 : audit [INF] from='client.? 172.21.15.100:0/4157868434' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32381-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32381-14"}]': finished 2021-01-28T04:01:14.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:14 smithi162 bash[9856]: audit 2021-01-28T04:01:13.525151+0000 mon.a (mon.0) 1042 : audit [INF] from='client.? 172.21.15.100:0/2670149676' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:14.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:14 smithi162 bash[9856]: cluster 2021-01-28T04:01:13.525584+0000 mon.a (mon.0) 1043 : cluster [DBG] osdmap e115: 8 total, 8 up, 8 in 2021-01-28T04:01:14.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:14 smithi162 bash[9856]: audit 2021-01-28T04:01:13.535395+0000 mon.c (mon.1) 114 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:14.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:14 smithi162 bash[9856]: audit 2021-01-28T04:01:13.546268+0000 mon.a (mon.0) 1044 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:14.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:14 smithi162 bash[9856]: audit 2021-01-28T04:01:14.084207+0000 mon.b (mon.2) 113 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:14.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:14 smithi100 bash[9834]: audit 2021-01-28T04:01:13.082586+0000 mon.b (mon.2) 112 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:14.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:14 smithi100 bash[9834]: audit 2021-01-28T04:01:13.524762+0000 mon.a (mon.0) 1041 : audit [INF] from='client.? 172.21.15.100:0/4157868434' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32381-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32381-14"}]': finished 2021-01-28T04:01:14.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:14 smithi100 bash[9834]: audit 2021-01-28T04:01:13.525151+0000 mon.a (mon.0) 1042 : audit [INF] from='client.? 172.21.15.100:0/2670149676' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:14.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:14 smithi100 bash[9834]: cluster 2021-01-28T04:01:13.525584+0000 mon.a (mon.0) 1043 : cluster [DBG] osdmap e115: 8 total, 8 up, 8 in 2021-01-28T04:01:14.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:14 smithi100 bash[9834]: audit 2021-01-28T04:01:13.535395+0000 mon.c (mon.1) 114 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:14.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:14 smithi100 bash[9834]: audit 2021-01-28T04:01:13.546268+0000 mon.a (mon.0) 1044 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:14.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:14 smithi100 bash[9834]: audit 2021-01-28T04:01:14.084207+0000 mon.b (mon.2) 113 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:14.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:14 smithi100 bash[13549]: audit 2021-01-28T04:01:13.082586+0000 mon.b (mon.2) 112 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:14.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:14 smithi100 bash[13549]: audit 2021-01-28T04:01:13.524762+0000 mon.a (mon.0) 1041 : audit [INF] from='client.? 172.21.15.100:0/4157868434' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32381-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32381-14"}]': finished 2021-01-28T04:01:14.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:14 smithi100 bash[13549]: audit 2021-01-28T04:01:13.525151+0000 mon.a (mon.0) 1042 : audit [INF] from='client.? 172.21.15.100:0/2670149676' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:14.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:14 smithi100 bash[13549]: cluster 2021-01-28T04:01:13.525584+0000 mon.a (mon.0) 1043 : cluster [DBG] osdmap e115: 8 total, 8 up, 8 in 2021-01-28T04:01:14.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:14 smithi100 bash[13549]: audit 2021-01-28T04:01:13.535395+0000 mon.c (mon.1) 114 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:14.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:14 smithi100 bash[13549]: audit 2021-01-28T04:01:13.546268+0000 mon.a (mon.0) 1044 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:14.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:14 smithi100 bash[13549]: audit 2021-01-28T04:01:14.084207+0000 mon.b (mon.2) 113 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:15.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:15 smithi162 bash[9856]: cluster 2021-01-28T04:01:13.539275+0000 mgr.y (mgr.14138) 535 : cluster [DBG] pgmap v423: 364 pgs: 5 creating+peering, 67 unknown, 292 active+clean; 216 MiB data, 897 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2021-01-28T04:01:15.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:15 smithi162 bash[9856]: audit 2021-01-28T04:01:14.548885+0000 mon.a (mon.0) 1045 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:15.762 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:15 smithi162 bash[9856]: cluster 2021-01-28T04:01:14.549505+0000 mon.a (mon.0) 1046 : cluster [DBG] osdmap e116: 8 total, 8 up, 8 in 2021-01-28T04:01:15.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:15 smithi162 bash[9856]: audit 2021-01-28T04:01:14.557258+0000 mon.a (mon.0) 1047 : audit [INF] from='client.? 172.21.15.100:0/404553720' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:15.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:15 smithi162 bash[9856]: audit 2021-01-28T04:01:15.085984+0000 mon.b (mon.2) 114 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:15.827 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:15 smithi100 bash[13549]: cluster 2021-01-28T04:01:13.539275+0000 mgr.y (mgr.14138) 535 : cluster [DBG] pgmap v423: 364 pgs: 5 creating+peering, 67 unknown, 292 active+clean; 216 MiB data, 897 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2021-01-28T04:01:15.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:15 smithi100 bash[13549]: audit 2021-01-28T04:01:14.548885+0000 mon.a (mon.0) 1045 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:15.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:15 smithi100 bash[13549]: cluster 2021-01-28T04:01:14.549505+0000 mon.a (mon.0) 1046 : cluster [DBG] osdmap e116: 8 total, 8 up, 8 in 2021-01-28T04:01:15.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:15 smithi100 bash[13549]: audit 2021-01-28T04:01:14.557258+0000 mon.a (mon.0) 1047 : audit [INF] from='client.? 172.21.15.100:0/404553720' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:15.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:15 smithi100 bash[13549]: audit 2021-01-28T04:01:15.085984+0000 mon.b (mon.2) 114 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:15.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:15 smithi100 bash[9834]: cluster 2021-01-28T04:01:13.539275+0000 mgr.y (mgr.14138) 535 : cluster [DBG] pgmap v423: 364 pgs: 5 creating+peering, 67 unknown, 292 active+clean; 216 MiB data, 897 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2021-01-28T04:01:15.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:15 smithi100 bash[9834]: audit 2021-01-28T04:01:14.548885+0000 mon.a (mon.0) 1045 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:15.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:15 smithi100 bash[9834]: cluster 2021-01-28T04:01:14.549505+0000 mon.a (mon.0) 1046 : cluster [DBG] osdmap e116: 8 total, 8 up, 8 in 2021-01-28T04:01:15.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:15 smithi100 bash[9834]: audit 2021-01-28T04:01:14.557258+0000 mon.a (mon.0) 1047 : audit [INF] from='client.? 172.21.15.100:0/404553720' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:15.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:15 smithi100 bash[9834]: audit 2021-01-28T04:01:15.085984+0000 mon.b (mon.2) 114 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:16.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:16 smithi100 bash[9834]: cluster 2021-01-28T04:01:15.540202+0000 mgr.y (mgr.14138) 536 : cluster [DBG] pgmap v425: 364 pgs: 15 creating+peering, 57 unknown, 292 active+clean; 216 MiB data, 898 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2021-01-28T04:01:16.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:16 smithi100 bash[9834]: audit 2021-01-28T04:01:15.554855+0000 mon.a (mon.0) 1048 : audit [INF] from='client.? 172.21.15.100:0/404553720' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:16.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:16 smithi100 bash[9834]: cluster 2021-01-28T04:01:15.555923+0000 mon.a (mon.0) 1049 : cluster [DBG] osdmap e117: 8 total, 8 up, 8 in 2021-01-28T04:01:16.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:16 smithi100 bash[9834]: audit 2021-01-28T04:01:15.559733+0000 mon.a (mon.0) 1050 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:16.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:16 smithi100 bash[9834]: audit 2021-01-28T04:01:15.560108+0000 mon.b (mon.2) 115 : audit [INF] from='client.? 172.21.15.100:0/85014255' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:16.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:16 smithi100 bash[9834]: audit 2021-01-28T04:01:16.087924+0000 mon.b (mon.2) 116 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:16.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:16 smithi100 bash[13549]: cluster 2021-01-28T04:01:15.540202+0000 mgr.y (mgr.14138) 536 : cluster [DBG] pgmap v425: 364 pgs: 15 creating+peering, 57 unknown, 292 active+clean; 216 MiB data, 898 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2021-01-28T04:01:16.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:16 smithi100 bash[13549]: audit 2021-01-28T04:01:15.554855+0000 mon.a (mon.0) 1048 : audit [INF] from='client.? 172.21.15.100:0/404553720' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:16.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:16 smithi100 bash[13549]: cluster 2021-01-28T04:01:15.555923+0000 mon.a (mon.0) 1049 : cluster [DBG] osdmap e117: 8 total, 8 up, 8 in 2021-01-28T04:01:16.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:16 smithi100 bash[13549]: audit 2021-01-28T04:01:15.559733+0000 mon.a (mon.0) 1050 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:16.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:16 smithi100 bash[13549]: audit 2021-01-28T04:01:15.560108+0000 mon.b (mon.2) 115 : audit [INF] from='client.? 172.21.15.100:0/85014255' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:16.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:16 smithi100 bash[13549]: audit 2021-01-28T04:01:16.087924+0000 mon.b (mon.2) 116 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:17.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:16 smithi162 bash[9856]: cluster 2021-01-28T04:01:15.540202+0000 mgr.y (mgr.14138) 536 : cluster [DBG] pgmap v425: 364 pgs: 15 creating+peering, 57 unknown, 292 active+clean; 216 MiB data, 898 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2021-01-28T04:01:17.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:16 smithi162 bash[9856]: audit 2021-01-28T04:01:15.554855+0000 mon.a (mon.0) 1048 : audit [INF] from='client.? 172.21.15.100:0/404553720' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:17.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:16 smithi162 bash[9856]: cluster 2021-01-28T04:01:15.555923+0000 mon.a (mon.0) 1049 : cluster [DBG] osdmap e117: 8 total, 8 up, 8 in 2021-01-28T04:01:17.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:16 smithi162 bash[9856]: audit 2021-01-28T04:01:15.559733+0000 mon.a (mon.0) 1050 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:17.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:16 smithi162 bash[9856]: audit 2021-01-28T04:01:15.560108+0000 mon.b (mon.2) 115 : audit [INF] from='client.? 172.21.15.100:0/85014255' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:17.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:16 smithi162 bash[9856]: audit 2021-01-28T04:01:16.087924+0000 mon.b (mon.2) 116 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:18.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:17 smithi162 bash[9856]: audit 2021-01-28T04:01:16.566366+0000 mon.a (mon.0) 1051 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-16","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:18.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:17 smithi162 bash[9856]: cluster 2021-01-28T04:01:16.566884+0000 mon.a (mon.0) 1052 : cluster [DBG] osdmap e118: 8 total, 8 up, 8 in 2021-01-28T04:01:18.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:17 smithi162 bash[9856]: audit 2021-01-28T04:01:17.089884+0000 mon.b (mon.2) 117 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:18.077 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:17 smithi100 bash[9834]: audit 2021-01-28T04:01:16.566366+0000 mon.a (mon.0) 1051 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-16","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:18.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:17 smithi100 bash[9834]: cluster 2021-01-28T04:01:16.566884+0000 mon.a (mon.0) 1052 : cluster [DBG] osdmap e118: 8 total, 8 up, 8 in 2021-01-28T04:01:18.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:17 smithi100 bash[9834]: audit 2021-01-28T04:01:17.089884+0000 mon.b (mon.2) 117 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:18.078 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:17 smithi100 bash[13549]: audit 2021-01-28T04:01:16.566366+0000 mon.a (mon.0) 1051 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-16","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:18.079 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:17 smithi100 bash[13549]: cluster 2021-01-28T04:01:16.566884+0000 mon.a (mon.0) 1052 : cluster [DBG] osdmap e118: 8 total, 8 up, 8 in 2021-01-28T04:01:18.079 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:17 smithi100 bash[13549]: audit 2021-01-28T04:01:17.089884+0000 mon.b (mon.2) 117 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:19.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:18 smithi162 bash[9856]: cluster 2021-01-28T04:01:17.541956+0000 mgr.y (mgr.14138) 537 : cluster [DBG] pgmap v428: 364 pgs: 18 creating+peering, 21 unknown, 325 active+clean; 216 MiB data, 894 MiB used, 714 GiB / 715 GiB avail; 19 KiB/s wr, 18 op/s 2021-01-28T04:01:19.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:18 smithi162 bash[9856]: cluster 2021-01-28T04:01:17.575826+0000 mon.a (mon.0) 1053 : cluster [DBG] osdmap e119: 8 total, 8 up, 8 in 2021-01-28T04:01:19.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:18 smithi162 bash[9856]: audit 2021-01-28T04:01:17.599178+0000 mon.c (mon.1) 115 : audit [INF] from='client.? 172.21.15.100:0/1633341420' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:19.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:18 smithi162 bash[9856]: audit 2021-01-28T04:01:17.599949+0000 mon.a (mon.0) 1054 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:19.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:18 smithi162 bash[9856]: audit 2021-01-28T04:01:18.091675+0000 mon.b (mon.2) 118 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:19.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:18 smithi162 bash[9856]: audit 2021-01-28T04:01:18.533452+0000 mon.a (mon.0) 1055 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-12","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:19.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:18 smithi162 bash[9856]: cluster 2021-01-28T04:01:18.533855+0000 mon.a (mon.0) 1056 : cluster [DBG] osdmap e120: 8 total, 8 up, 8 in 2021-01-28T04:01:19.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:18 smithi162 bash[9856]: audit 2021-01-28T04:01:18.539142+0000 mon.c (mon.1) 116 : audit [INF] from='client.? 172.21.15.100:0/2694274575' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:19.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:18 smithi162 bash[9856]: audit 2021-01-28T04:01:18.561694+0000 mon.a (mon.0) 1057 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:19.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:18 smithi100 bash[9834]: cluster 2021-01-28T04:01:17.541956+0000 mgr.y (mgr.14138) 537 : cluster [DBG] pgmap v428: 364 pgs: 18 creating+peering, 21 unknown, 325 active+clean; 216 MiB data, 894 MiB used, 714 GiB / 715 GiB avail; 19 KiB/s wr, 18 op/s 2021-01-28T04:01:19.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:18 smithi100 bash[9834]: cluster 2021-01-28T04:01:17.575826+0000 mon.a (mon.0) 1053 : cluster [DBG] osdmap e119: 8 total, 8 up, 8 in 2021-01-28T04:01:19.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:18 smithi100 bash[9834]: audit 2021-01-28T04:01:17.599178+0000 mon.c (mon.1) 115 : audit [INF] from='client.? 172.21.15.100:0/1633341420' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:19.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:18 smithi100 bash[9834]: audit 2021-01-28T04:01:17.599949+0000 mon.a (mon.0) 1054 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:19.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:18 smithi100 bash[9834]: audit 2021-01-28T04:01:18.091675+0000 mon.b (mon.2) 118 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:19.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:18 smithi100 bash[9834]: audit 2021-01-28T04:01:18.533452+0000 mon.a (mon.0) 1055 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-12","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:19.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:18 smithi100 bash[9834]: cluster 2021-01-28T04:01:18.533855+0000 mon.a (mon.0) 1056 : cluster [DBG] osdmap e120: 8 total, 8 up, 8 in 2021-01-28T04:01:19.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:18 smithi100 bash[9834]: audit 2021-01-28T04:01:18.539142+0000 mon.c (mon.1) 116 : audit [INF] from='client.? 172.21.15.100:0/2694274575' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:19.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:18 smithi100 bash[9834]: audit 2021-01-28T04:01:18.561694+0000 mon.a (mon.0) 1057 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:19.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:18 smithi100 bash[13549]: cluster 2021-01-28T04:01:17.541956+0000 mgr.y (mgr.14138) 537 : cluster [DBG] pgmap v428: 364 pgs: 18 creating+peering, 21 unknown, 325 active+clean; 216 MiB data, 894 MiB used, 714 GiB / 715 GiB avail; 19 KiB/s wr, 18 op/s 2021-01-28T04:01:19.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:18 smithi100 bash[13549]: cluster 2021-01-28T04:01:17.575826+0000 mon.a (mon.0) 1053 : cluster [DBG] osdmap e119: 8 total, 8 up, 8 in 2021-01-28T04:01:19.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:18 smithi100 bash[13549]: audit 2021-01-28T04:01:17.599178+0000 mon.c (mon.1) 115 : audit [INF] from='client.? 172.21.15.100:0/1633341420' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:19.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:18 smithi100 bash[13549]: audit 2021-01-28T04:01:17.599949+0000 mon.a (mon.0) 1054 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:19.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:18 smithi100 bash[13549]: audit 2021-01-28T04:01:18.091675+0000 mon.b (mon.2) 118 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:19.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:18 smithi100 bash[13549]: audit 2021-01-28T04:01:18.533452+0000 mon.a (mon.0) 1055 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-12","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:19.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:18 smithi100 bash[13549]: cluster 2021-01-28T04:01:18.533855+0000 mon.a (mon.0) 1056 : cluster [DBG] osdmap e120: 8 total, 8 up, 8 in 2021-01-28T04:01:19.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:18 smithi100 bash[13549]: audit 2021-01-28T04:01:18.539142+0000 mon.c (mon.1) 116 : audit [INF] from='client.? 172.21.15.100:0/2694274575' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:19.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:18 smithi100 bash[13549]: audit 2021-01-28T04:01:18.561694+0000 mon.a (mon.0) 1057 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:20.012 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 04:01:19 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T04:01:20.020 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 04:01:19 smithi100 bash[10061]: debug 2021-01-28T04:01:19.742+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:01:20.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:20 smithi100 bash[9834]: audit 2021-01-28T04:01:18.894261+0000 mon.c (mon.1) 117 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-13", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:01:20.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:20 smithi100 bash[9834]: audit 2021-01-28T04:01:18.895086+0000 mon.a (mon.0) 1058 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-13", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:01:20.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:20 smithi100 bash[9834]: audit 2021-01-28T04:01:19.093445+0000 mon.b (mon.2) 119 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:20.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:20 smithi100 bash[9834]: audit 2021-01-28T04:01:19.532844+0000 mon.a (mon.0) 1059 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:20.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:20 smithi100 bash[9834]: audit 2021-01-28T04:01:19.533904+0000 mon.a (mon.0) 1060 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-13", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:01:20.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:20 smithi100 bash[9834]: cluster 2021-01-28T04:01:19.534116+0000 mon.a (mon.0) 1061 : cluster [DBG] osdmap e121: 8 total, 8 up, 8 in 2021-01-28T04:01:20.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:20 smithi100 bash[9834]: audit 2021-01-28T04:01:19.535836+0000 mon.c (mon.1) 118 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-13"}]: dispatch 2021-01-28T04:01:20.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:20 smithi100 bash[9834]: audit 2021-01-28T04:01:19.550616+0000 mon.a (mon.0) 1062 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-13"}]: dispatch 2021-01-28T04:01:20.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:20 smithi100 bash[13549]: audit 2021-01-28T04:01:18.894261+0000 mon.c (mon.1) 117 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-13", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:01:20.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:20 smithi100 bash[13549]: audit 2021-01-28T04:01:18.895086+0000 mon.a (mon.0) 1058 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-13", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:01:20.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:20 smithi100 bash[13549]: audit 2021-01-28T04:01:19.093445+0000 mon.b (mon.2) 119 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:20.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:20 smithi100 bash[13549]: audit 2021-01-28T04:01:19.532844+0000 mon.a (mon.0) 1059 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:20.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:20 smithi100 bash[13549]: audit 2021-01-28T04:01:19.533904+0000 mon.a (mon.0) 1060 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-13", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:01:20.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:20 smithi100 bash[13549]: cluster 2021-01-28T04:01:19.534116+0000 mon.a (mon.0) 1061 : cluster [DBG] osdmap e121: 8 total, 8 up, 8 in 2021-01-28T04:01:20.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:20 smithi100 bash[13549]: audit 2021-01-28T04:01:19.535836+0000 mon.c (mon.1) 118 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-13"}]: dispatch 2021-01-28T04:01:20.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:20 smithi100 bash[13549]: audit 2021-01-28T04:01:19.550616+0000 mon.a (mon.0) 1062 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-13"}]: dispatch 2021-01-28T04:01:20.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:20 smithi162 bash[9856]: audit 2021-01-28T04:01:18.894261+0000 mon.c (mon.1) 117 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-13", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:01:20.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:20 smithi162 bash[9856]: audit 2021-01-28T04:01:18.895086+0000 mon.a (mon.0) 1058 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-13", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:01:20.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:20 smithi162 bash[9856]: audit 2021-01-28T04:01:19.093445+0000 mon.b (mon.2) 119 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:20.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:20 smithi162 bash[9856]: audit 2021-01-28T04:01:19.532844+0000 mon.a (mon.0) 1059 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:20.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:20 smithi162 bash[9856]: audit 2021-01-28T04:01:19.533904+0000 mon.a (mon.0) 1060 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-13", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:01:20.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:20 smithi162 bash[9856]: cluster 2021-01-28T04:01:19.534116+0000 mon.a (mon.0) 1061 : cluster [DBG] osdmap e121: 8 total, 8 up, 8 in 2021-01-28T04:01:20.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:20 smithi162 bash[9856]: audit 2021-01-28T04:01:19.535836+0000 mon.c (mon.1) 118 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-13"}]: dispatch 2021-01-28T04:01:20.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:20 smithi162 bash[9856]: audit 2021-01-28T04:01:19.550616+0000 mon.a (mon.0) 1062 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-13"}]: dispatch 2021-01-28T04:01:21.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:21 smithi100 bash[9834]: cluster 2021-01-28T04:01:19.542672+0000 mgr.y (mgr.14138) 538 : cluster [DBG] pgmap v432: 364 pgs: 12 creating+peering, 20 unknown, 332 active+clean; 216 MiB data, 912 MiB used, 714 GiB / 715 GiB avail; 3.3 KiB/s rd, 95 KiB/s wr, 91 op/s 2021-01-28T04:01:21.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:21 smithi100 bash[9834]: audit 2021-01-28T04:01:19.746878+0000 mgr.y (mgr.14138) 539 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:01:21.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:21 smithi100 bash[9834]: audit 2021-01-28T04:01:20.095414+0000 mon.b (mon.2) 120 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:21.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:21 smithi100 bash[9834]: cluster 2021-01-28T04:01:20.528417+0000 mon.a (mon.0) 1063 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:01:21.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:21 smithi100 bash[9834]: audit 2021-01-28T04:01:20.535746+0000 mon.a (mon.0) 1064 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-13"}]': finished 2021-01-28T04:01:21.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:21 smithi100 bash[9834]: cluster 2021-01-28T04:01:20.536166+0000 mon.a (mon.0) 1065 : cluster [DBG] osdmap e122: 8 total, 8 up, 8 in 2021-01-28T04:01:21.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:21 smithi100 bash[9834]: audit 2021-01-28T04:01:20.537699+0000 mon.c (mon.1) 119 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-13", "mode": "writeback"}]: dispatch 2021-01-28T04:01:21.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:21 smithi100 bash[9834]: audit 2021-01-28T04:01:20.545183+0000 mon.a (mon.0) 1066 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-13", "mode": "writeback"}]: dispatch 2021-01-28T04:01:21.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:21 smithi100 bash[9834]: audit 2021-01-28T04:01:20.545713+0000 mon.a (mon.0) 1067 : audit [INF] from='client.? 172.21.15.100:0/1015111770' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:21.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:21 smithi100 bash[13549]: cluster 2021-01-28T04:01:19.542672+0000 mgr.y (mgr.14138) 538 : cluster [DBG] pgmap v432: 364 pgs: 12 creating+peering, 20 unknown, 332 active+clean; 216 MiB data, 912 MiB used, 714 GiB / 715 GiB avail; 3.3 KiB/s rd, 95 KiB/s wr, 91 op/s 2021-01-28T04:01:21.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:21 smithi100 bash[13549]: audit 2021-01-28T04:01:19.746878+0000 mgr.y (mgr.14138) 539 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:01:21.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:21 smithi100 bash[13549]: audit 2021-01-28T04:01:20.095414+0000 mon.b (mon.2) 120 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:21.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:21 smithi100 bash[13549]: cluster 2021-01-28T04:01:20.528417+0000 mon.a (mon.0) 1063 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:01:21.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:21 smithi100 bash[13549]: audit 2021-01-28T04:01:20.535746+0000 mon.a (mon.0) 1064 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-13"}]': finished 2021-01-28T04:01:21.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:21 smithi100 bash[13549]: cluster 2021-01-28T04:01:20.536166+0000 mon.a (mon.0) 1065 : cluster [DBG] osdmap e122: 8 total, 8 up, 8 in 2021-01-28T04:01:21.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:21 smithi100 bash[13549]: audit 2021-01-28T04:01:20.537699+0000 mon.c (mon.1) 119 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-13", "mode": "writeback"}]: dispatch 2021-01-28T04:01:21.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:21 smithi100 bash[13549]: audit 2021-01-28T04:01:20.545183+0000 mon.a (mon.0) 1066 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-13", "mode": "writeback"}]: dispatch 2021-01-28T04:01:21.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:21 smithi100 bash[13549]: audit 2021-01-28T04:01:20.545713+0000 mon.a (mon.0) 1067 : audit [INF] from='client.? 172.21.15.100:0/1015111770' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:21.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:21 smithi162 bash[9856]: cluster 2021-01-28T04:01:19.542672+0000 mgr.y (mgr.14138) 538 : cluster [DBG] pgmap v432: 364 pgs: 12 creating+peering, 20 unknown, 332 active+clean; 216 MiB data, 912 MiB used, 714 GiB / 715 GiB avail; 3.3 KiB/s rd, 95 KiB/s wr, 91 op/s 2021-01-28T04:01:21.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:21 smithi162 bash[9856]: audit 2021-01-28T04:01:19.746878+0000 mgr.y (mgr.14138) 539 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:01:21.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:21 smithi162 bash[9856]: audit 2021-01-28T04:01:20.095414+0000 mon.b (mon.2) 120 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:21.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:21 smithi162 bash[9856]: cluster 2021-01-28T04:01:20.528417+0000 mon.a (mon.0) 1063 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:01:21.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:21 smithi162 bash[9856]: audit 2021-01-28T04:01:20.535746+0000 mon.a (mon.0) 1064 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-13"}]': finished 2021-01-28T04:01:21.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:21 smithi162 bash[9856]: cluster 2021-01-28T04:01:20.536166+0000 mon.a (mon.0) 1065 : cluster [DBG] osdmap e122: 8 total, 8 up, 8 in 2021-01-28T04:01:21.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:21 smithi162 bash[9856]: audit 2021-01-28T04:01:20.537699+0000 mon.c (mon.1) 119 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-13", "mode": "writeback"}]: dispatch 2021-01-28T04:01:21.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:21 smithi162 bash[9856]: audit 2021-01-28T04:01:20.545183+0000 mon.a (mon.0) 1066 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-13", "mode": "writeback"}]: dispatch 2021-01-28T04:01:21.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:21 smithi162 bash[9856]: audit 2021-01-28T04:01:20.545713+0000 mon.a (mon.0) 1067 : audit [INF] from='client.? 172.21.15.100:0/1015111770' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:22.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:22 smithi100 bash[9834]: audit 2021-01-28T04:01:21.097205+0000 mon.b (mon.2) 121 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:22.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:22 smithi100 bash[9834]: cluster 2021-01-28T04:01:21.543534+0000 mon.a (mon.0) 1068 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:01:22.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:22 smithi100 bash[9834]: audit 2021-01-28T04:01:21.553582+0000 mon.a (mon.0) 1069 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-13", "mode": "writeback"}]': finished 2021-01-28T04:01:22.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:22 smithi100 bash[9834]: audit 2021-01-28T04:01:21.553772+0000 mon.a (mon.0) 1070 : audit [INF] from='client.? 172.21.15.100:0/1015111770' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:22.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:22 smithi100 bash[9834]: cluster 2021-01-28T04:01:21.554113+0000 mon.a (mon.0) 1071 : cluster [DBG] osdmap e123: 8 total, 8 up, 8 in 2021-01-28T04:01:22.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:22 smithi100 bash[9834]: audit 2021-01-28T04:01:21.557981+0000 mon.c (mon.1) 120 : audit [INF] from='client.? 172.21.15.100:0/330169456' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:22.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:22 smithi100 bash[9834]: audit 2021-01-28T04:01:21.561015+0000 mon.a (mon.0) 1072 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:22.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:22 smithi100 bash[13549]: audit 2021-01-28T04:01:21.097205+0000 mon.b (mon.2) 121 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:22.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:22 smithi100 bash[13549]: cluster 2021-01-28T04:01:21.543534+0000 mon.a (mon.0) 1068 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:01:22.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:22 smithi100 bash[13549]: audit 2021-01-28T04:01:21.553582+0000 mon.a (mon.0) 1069 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-13", "mode": "writeback"}]': finished 2021-01-28T04:01:22.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:22 smithi100 bash[13549]: audit 2021-01-28T04:01:21.553772+0000 mon.a (mon.0) 1070 : audit [INF] from='client.? 172.21.15.100:0/1015111770' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:22.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:22 smithi100 bash[13549]: cluster 2021-01-28T04:01:21.554113+0000 mon.a (mon.0) 1071 : cluster [DBG] osdmap e123: 8 total, 8 up, 8 in 2021-01-28T04:01:22.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:22 smithi100 bash[13549]: audit 2021-01-28T04:01:21.557981+0000 mon.c (mon.1) 120 : audit [INF] from='client.? 172.21.15.100:0/330169456' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:22.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:22 smithi100 bash[13549]: audit 2021-01-28T04:01:21.561015+0000 mon.a (mon.0) 1072 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:22.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:22 smithi162 bash[9856]: audit 2021-01-28T04:01:21.097205+0000 mon.b (mon.2) 121 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:22.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:22 smithi162 bash[9856]: cluster 2021-01-28T04:01:21.543534+0000 mon.a (mon.0) 1068 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:01:22.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:22 smithi162 bash[9856]: audit 2021-01-28T04:01:21.553582+0000 mon.a (mon.0) 1069 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-13", "mode": "writeback"}]': finished 2021-01-28T04:01:22.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:22 smithi162 bash[9856]: audit 2021-01-28T04:01:21.553772+0000 mon.a (mon.0) 1070 : audit [INF] from='client.? 172.21.15.100:0/1015111770' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:22.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:22 smithi162 bash[9856]: cluster 2021-01-28T04:01:21.554113+0000 mon.a (mon.0) 1071 : cluster [DBG] osdmap e123: 8 total, 8 up, 8 in 2021-01-28T04:01:22.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:22 smithi162 bash[9856]: audit 2021-01-28T04:01:21.557981+0000 mon.c (mon.1) 120 : audit [INF] from='client.? 172.21.15.100:0/330169456' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:22.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:22 smithi162 bash[9856]: audit 2021-01-28T04:01:21.561015+0000 mon.a (mon.0) 1072 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:23.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:23 smithi100 bash[9834]: cluster 2021-01-28T04:01:21.544015+0000 mgr.y (mgr.14138) 540 : cluster [DBG] pgmap v434: 364 pgs: 4 creating+peering, 28 unknown, 332 active+clean; 216 MiB data, 897 MiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 91 KiB/s wr, 87 op/s 2021-01-28T04:01:23.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:23 smithi100 bash[9834]: audit 2021-01-28T04:01:22.098955+0000 mon.b (mon.2) 122 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:23.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:23 smithi100 bash[9834]: audit 2021-01-28T04:01:22.556638+0000 mon.a (mon.0) 1073 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-18","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:23.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:23 smithi100 bash[9834]: cluster 2021-01-28T04:01:22.557132+0000 mon.a (mon.0) 1074 : cluster [DBG] osdmap e124: 8 total, 8 up, 8 in 2021-01-28T04:01:23.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:23 smithi100 bash[9834]: audit 2021-01-28T04:01:22.563141+0000 mon.a (mon.0) 1075 : audit [INF] from='client.? 172.21.15.100:0/4157868434' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32381-14"}]: dispatch 2021-01-28T04:01:23.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:23 smithi100 bash[13549]: cluster 2021-01-28T04:01:21.544015+0000 mgr.y (mgr.14138) 540 : cluster [DBG] pgmap v434: 364 pgs: 4 creating+peering, 28 unknown, 332 active+clean; 216 MiB data, 897 MiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 91 KiB/s wr, 87 op/s 2021-01-28T04:01:23.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:23 smithi100 bash[13549]: audit 2021-01-28T04:01:22.098955+0000 mon.b (mon.2) 122 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:23.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:23 smithi100 bash[13549]: audit 2021-01-28T04:01:22.556638+0000 mon.a (mon.0) 1073 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-18","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:23.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:23 smithi100 bash[13549]: cluster 2021-01-28T04:01:22.557132+0000 mon.a (mon.0) 1074 : cluster [DBG] osdmap e124: 8 total, 8 up, 8 in 2021-01-28T04:01:23.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:23 smithi100 bash[13549]: audit 2021-01-28T04:01:22.563141+0000 mon.a (mon.0) 1075 : audit [INF] from='client.? 172.21.15.100:0/4157868434' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32381-14"}]: dispatch 2021-01-28T04:01:23.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:23 smithi162 bash[9856]: cluster 2021-01-28T04:01:21.544015+0000 mgr.y (mgr.14138) 540 : cluster [DBG] pgmap v434: 364 pgs: 4 creating+peering, 28 unknown, 332 active+clean; 216 MiB data, 897 MiB used, 714 GiB / 715 GiB avail; 3.2 KiB/s rd, 91 KiB/s wr, 87 op/s 2021-01-28T04:01:23.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:23 smithi162 bash[9856]: audit 2021-01-28T04:01:22.098955+0000 mon.b (mon.2) 122 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:23.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:23 smithi162 bash[9856]: audit 2021-01-28T04:01:22.556638+0000 mon.a (mon.0) 1073 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-18","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:23.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:23 smithi162 bash[9856]: cluster 2021-01-28T04:01:22.557132+0000 mon.a (mon.0) 1074 : cluster [DBG] osdmap e124: 8 total, 8 up, 8 in 2021-01-28T04:01:23.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:23 smithi162 bash[9856]: audit 2021-01-28T04:01:22.563141+0000 mon.a (mon.0) 1075 : audit [INF] from='client.? 172.21.15.100:0/4157868434' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32381-14"}]: dispatch 2021-01-28T04:01:24.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[9834]: audit 2021-01-28T04:01:23.041285+0000 mon.c (mon.1) 121 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.0"}]: dispatch 2021-01-28T04:01:24.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[9834]: audit 2021-01-28T04:01:23.041759+0000 mgr.y (mgr.14138) 541 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.0"}]: dispatch 2021-01-28T04:01:24.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[9834]: audit 2021-01-28T04:01:23.042772+0000 mon.c (mon.1) 122 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.1"}]: dispatch 2021-01-28T04:01:24.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[9834]: audit 2021-01-28T04:01:23.043087+0000 mgr.y (mgr.14138) 542 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.1"}]: dispatch 2021-01-28T04:01:24.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[9834]: audit 2021-01-28T04:01:23.044001+0000 mon.c (mon.1) 123 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.2"}]: dispatch 2021-01-28T04:01:24.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[9834]: audit 2021-01-28T04:01:23.044339+0000 mgr.y (mgr.14138) 543 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.2"}]: dispatch 2021-01-28T04:01:24.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[9834]: audit 2021-01-28T04:01:23.045200+0000 mon.c (mon.1) 124 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.3"}]: dispatch 2021-01-28T04:01:24.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[9834]: audit 2021-01-28T04:01:23.045493+0000 mgr.y (mgr.14138) 544 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.3"}]: dispatch 2021-01-28T04:01:24.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[9834]: audit 2021-01-28T04:01:23.046192+0000 mon.c (mon.1) 125 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.4"}]: dispatch 2021-01-28T04:01:24.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[9834]: audit 2021-01-28T04:01:23.046482+0000 mgr.y (mgr.14138) 545 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.4"}]: dispatch 2021-01-28T04:01:24.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[9834]: audit 2021-01-28T04:01:23.047278+0000 mon.c (mon.1) 126 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.5"}]: dispatch 2021-01-28T04:01:24.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[9834]: audit 2021-01-28T04:01:23.047616+0000 mgr.y (mgr.14138) 546 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.5"}]: dispatch 2021-01-28T04:01:24.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[9834]: audit 2021-01-28T04:01:23.048446+0000 mon.c (mon.1) 127 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.6"}]: dispatch 2021-01-28T04:01:24.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[9834]: audit 2021-01-28T04:01:23.048678+0000 mgr.y (mgr.14138) 547 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.6"}]: dispatch 2021-01-28T04:01:24.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[9834]: audit 2021-01-28T04:01:23.049457+0000 mon.c (mon.1) 128 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.7"}]: dispatch 2021-01-28T04:01:24.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[9834]: audit 2021-01-28T04:01:23.049705+0000 mgr.y (mgr.14138) 548 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.7"}]: dispatch 2021-01-28T04:01:24.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[9834]: audit 2021-01-28T04:01:23.050361+0000 mon.c (mon.1) 129 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.8"}]: dispatch 2021-01-28T04:01:24.333 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[9834]: audit 2021-01-28T04:01:23.050592+0000 mgr.y (mgr.14138) 549 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.8"}]: dispatch 2021-01-28T04:01:24.333 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[9834]: audit 2021-01-28T04:01:23.051258+0000 mon.c (mon.1) 130 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.9"}]: dispatch 2021-01-28T04:01:24.333 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[9834]: audit 2021-01-28T04:01:23.051523+0000 mgr.y (mgr.14138) 550 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.9"}]: dispatch 2021-01-28T04:01:24.333 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[9834]: cluster 2021-01-28T04:01:23.069165+0000 osd.6 (osd.6) 7 : cluster [DBG] 94.3 scrub ok 2021-01-28T04:01:24.333 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[9834]: audit 2021-01-28T04:01:23.100805+0000 mon.b (mon.2) 123 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:24.334 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[9834]: cluster 2021-01-28T04:01:23.339229+0000 osd.2 (osd.2) 5 : cluster [DBG] 94.2 scrub ok 2021-01-28T04:01:24.334 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[9834]: audit 2021-01-28T04:01:23.564206+0000 mon.a (mon.0) 1076 : audit [INF] from='client.? 172.21.15.100:0/4157868434' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32381-14"}]': finished 2021-01-28T04:01:24.334 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[9834]: cluster 2021-01-28T04:01:23.564591+0000 mon.a (mon.0) 1077 : cluster [DBG] osdmap e125: 8 total, 8 up, 8 in 2021-01-28T04:01:24.334 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[9834]: audit 2021-01-28T04:01:23.571970+0000 mon.a (mon.0) 1078 : audit [INF] from='client.? 172.21.15.100:0/4157868434' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32381-14"}]: dispatch 2021-01-28T04:01:24.335 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[9834]: audit 2021-01-28T04:01:23.581764+0000 mon.a (mon.0) 1079 : audit [INF] from='client.? 172.21.15.100:0/1399908927' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:24.335 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[13549]: audit 2021-01-28T04:01:23.041285+0000 mon.c (mon.1) 121 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.0"}]: dispatch 2021-01-28T04:01:24.335 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[13549]: audit 2021-01-28T04:01:23.041759+0000 mgr.y (mgr.14138) 541 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.0"}]: dispatch 2021-01-28T04:01:24.335 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[13549]: audit 2021-01-28T04:01:23.042772+0000 mon.c (mon.1) 122 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.1"}]: dispatch 2021-01-28T04:01:24.336 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[13549]: audit 2021-01-28T04:01:23.043087+0000 mgr.y (mgr.14138) 542 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.1"}]: dispatch 2021-01-28T04:01:24.336 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[13549]: audit 2021-01-28T04:01:23.044001+0000 mon.c (mon.1) 123 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.2"}]: dispatch 2021-01-28T04:01:24.336 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[13549]: audit 2021-01-28T04:01:23.044339+0000 mgr.y (mgr.14138) 543 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.2"}]: dispatch 2021-01-28T04:01:24.336 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[13549]: audit 2021-01-28T04:01:23.045200+0000 mon.c (mon.1) 124 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.3"}]: dispatch 2021-01-28T04:01:24.337 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[13549]: audit 2021-01-28T04:01:23.045493+0000 mgr.y (mgr.14138) 544 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.3"}]: dispatch 2021-01-28T04:01:24.337 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[13549]: audit 2021-01-28T04:01:23.046192+0000 mon.c (mon.1) 125 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.4"}]: dispatch 2021-01-28T04:01:24.337 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[13549]: audit 2021-01-28T04:01:23.046482+0000 mgr.y (mgr.14138) 545 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.4"}]: dispatch 2021-01-28T04:01:24.337 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[13549]: audit 2021-01-28T04:01:23.047278+0000 mon.c (mon.1) 126 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.5"}]: dispatch 2021-01-28T04:01:24.337 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[13549]: audit 2021-01-28T04:01:23.047616+0000 mgr.y (mgr.14138) 546 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.5"}]: dispatch 2021-01-28T04:01:24.338 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[13549]: audit 2021-01-28T04:01:23.048446+0000 mon.c (mon.1) 127 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.6"}]: dispatch 2021-01-28T04:01:24.338 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[13549]: audit 2021-01-28T04:01:23.048678+0000 mgr.y (mgr.14138) 547 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.6"}]: dispatch 2021-01-28T04:01:24.338 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[13549]: audit 2021-01-28T04:01:23.049457+0000 mon.c (mon.1) 128 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.7"}]: dispatch 2021-01-28T04:01:24.338 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[13549]: audit 2021-01-28T04:01:23.049705+0000 mgr.y (mgr.14138) 548 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.7"}]: dispatch 2021-01-28T04:01:24.338 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[13549]: audit 2021-01-28T04:01:23.050361+0000 mon.c (mon.1) 129 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.8"}]: dispatch 2021-01-28T04:01:24.339 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[13549]: audit 2021-01-28T04:01:23.050592+0000 mgr.y (mgr.14138) 549 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.8"}]: dispatch 2021-01-28T04:01:24.339 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[13549]: audit 2021-01-28T04:01:23.051258+0000 mon.c (mon.1) 130 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.9"}]: dispatch 2021-01-28T04:01:24.339 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[13549]: audit 2021-01-28T04:01:23.051523+0000 mgr.y (mgr.14138) 550 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.9"}]: dispatch 2021-01-28T04:01:24.339 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[13549]: cluster 2021-01-28T04:01:23.069165+0000 osd.6 (osd.6) 7 : cluster [DBG] 94.3 scrub ok 2021-01-28T04:01:24.339 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[13549]: audit 2021-01-28T04:01:23.100805+0000 mon.b (mon.2) 123 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:24.340 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[13549]: cluster 2021-01-28T04:01:23.339229+0000 osd.2 (osd.2) 5 : cluster [DBG] 94.2 scrub ok 2021-01-28T04:01:24.340 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[13549]: audit 2021-01-28T04:01:23.564206+0000 mon.a (mon.0) 1076 : audit [INF] from='client.? 172.21.15.100:0/4157868434' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32381-14"}]': finished 2021-01-28T04:01:24.340 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[13549]: cluster 2021-01-28T04:01:23.564591+0000 mon.a (mon.0) 1077 : cluster [DBG] osdmap e125: 8 total, 8 up, 8 in 2021-01-28T04:01:24.340 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[13549]: audit 2021-01-28T04:01:23.571970+0000 mon.a (mon.0) 1078 : audit [INF] from='client.? 172.21.15.100:0/4157868434' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32381-14"}]: dispatch 2021-01-28T04:01:24.341 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:24 smithi100 bash[13549]: audit 2021-01-28T04:01:23.581764+0000 mon.a (mon.0) 1079 : audit [INF] from='client.? 172.21.15.100:0/1399908927' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:24.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:24 smithi162 bash[9856]: audit 2021-01-28T04:01:23.041285+0000 mon.c (mon.1) 121 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.0"}]: dispatch 2021-01-28T04:01:24.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:24 smithi162 bash[9856]: audit 2021-01-28T04:01:23.041759+0000 mgr.y (mgr.14138) 541 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.0"}]: dispatch 2021-01-28T04:01:24.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:24 smithi162 bash[9856]: audit 2021-01-28T04:01:23.042772+0000 mon.c (mon.1) 122 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.1"}]: dispatch 2021-01-28T04:01:24.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:24 smithi162 bash[9856]: audit 2021-01-28T04:01:23.043087+0000 mgr.y (mgr.14138) 542 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.1"}]: dispatch 2021-01-28T04:01:24.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:24 smithi162 bash[9856]: audit 2021-01-28T04:01:23.044001+0000 mon.c (mon.1) 123 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.2"}]: dispatch 2021-01-28T04:01:24.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:24 smithi162 bash[9856]: audit 2021-01-28T04:01:23.044339+0000 mgr.y (mgr.14138) 543 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.2"}]: dispatch 2021-01-28T04:01:24.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:24 smithi162 bash[9856]: audit 2021-01-28T04:01:23.045200+0000 mon.c (mon.1) 124 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.3"}]: dispatch 2021-01-28T04:01:24.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:24 smithi162 bash[9856]: audit 2021-01-28T04:01:23.045493+0000 mgr.y (mgr.14138) 544 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.3"}]: dispatch 2021-01-28T04:01:24.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:24 smithi162 bash[9856]: audit 2021-01-28T04:01:23.046192+0000 mon.c (mon.1) 125 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.4"}]: dispatch 2021-01-28T04:01:24.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:24 smithi162 bash[9856]: audit 2021-01-28T04:01:23.046482+0000 mgr.y (mgr.14138) 545 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.4"}]: dispatch 2021-01-28T04:01:24.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:24 smithi162 bash[9856]: audit 2021-01-28T04:01:23.047278+0000 mon.c (mon.1) 126 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.5"}]: dispatch 2021-01-28T04:01:24.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:24 smithi162 bash[9856]: audit 2021-01-28T04:01:23.047616+0000 mgr.y (mgr.14138) 546 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.5"}]: dispatch 2021-01-28T04:01:24.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:24 smithi162 bash[9856]: audit 2021-01-28T04:01:23.048446+0000 mon.c (mon.1) 127 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.6"}]: dispatch 2021-01-28T04:01:24.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:24 smithi162 bash[9856]: audit 2021-01-28T04:01:23.048678+0000 mgr.y (mgr.14138) 547 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.6"}]: dispatch 2021-01-28T04:01:24.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:24 smithi162 bash[9856]: audit 2021-01-28T04:01:23.049457+0000 mon.c (mon.1) 128 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.7"}]: dispatch 2021-01-28T04:01:24.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:24 smithi162 bash[9856]: audit 2021-01-28T04:01:23.049705+0000 mgr.y (mgr.14138) 548 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.7"}]: dispatch 2021-01-28T04:01:24.518 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:24 smithi162 bash[9856]: audit 2021-01-28T04:01:23.050361+0000 mon.c (mon.1) 129 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.8"}]: dispatch 2021-01-28T04:01:24.518 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:24 smithi162 bash[9856]: audit 2021-01-28T04:01:23.050592+0000 mgr.y (mgr.14138) 549 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.8"}]: dispatch 2021-01-28T04:01:24.518 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:24 smithi162 bash[9856]: audit 2021-01-28T04:01:23.051258+0000 mon.c (mon.1) 130 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "94.9"}]: dispatch 2021-01-28T04:01:24.518 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:24 smithi162 bash[9856]: audit 2021-01-28T04:01:23.051523+0000 mgr.y (mgr.14138) 550 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "94.9"}]: dispatch 2021-01-28T04:01:24.519 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:24 smithi162 bash[9856]: cluster 2021-01-28T04:01:23.069165+0000 osd.6 (osd.6) 7 : cluster [DBG] 94.3 scrub ok 2021-01-28T04:01:24.519 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:24 smithi162 bash[9856]: audit 2021-01-28T04:01:23.100805+0000 mon.b (mon.2) 123 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:24.519 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:24 smithi162 bash[9856]: cluster 2021-01-28T04:01:23.339229+0000 osd.2 (osd.2) 5 : cluster [DBG] 94.2 scrub ok 2021-01-28T04:01:24.519 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:24 smithi162 bash[9856]: audit 2021-01-28T04:01:23.564206+0000 mon.a (mon.0) 1076 : audit [INF] from='client.? 172.21.15.100:0/4157868434' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32381-14"}]': finished 2021-01-28T04:01:24.519 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:24 smithi162 bash[9856]: cluster 2021-01-28T04:01:23.564591+0000 mon.a (mon.0) 1077 : cluster [DBG] osdmap e125: 8 total, 8 up, 8 in 2021-01-28T04:01:24.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:24 smithi162 bash[9856]: audit 2021-01-28T04:01:23.571970+0000 mon.a (mon.0) 1078 : audit [INF] from='client.? 172.21.15.100:0/4157868434' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32381-14"}]: dispatch 2021-01-28T04:01:24.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:24 smithi162 bash[9856]: audit 2021-01-28T04:01:23.581764+0000 mon.a (mon.0) 1079 : audit [INF] from='client.? 172.21.15.100:0/1399908927' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:24.577 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: Running main() from gmock_main.cc 2021-01-28T04:01:24.578 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [==========] Running 12 tests from 4 test suites. 2021-01-28T04:01:24.578 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [----------] Global test environment set-up. 2021-01-28T04:01:24.578 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots 2021-01-28T04:01:24.579 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapList 2021-01-28T04:01:24.579 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapList (5484 ms) 2021-01-28T04:01:24.579 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapRemove 2021-01-28T04:01:24.579 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapRemove (4135 ms) 2021-01-28T04:01:24.579 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.Rollback 2021-01-28T04:01:24.580 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [ OK ] LibRadosSnapshots.Rollback (2882 ms) 2021-01-28T04:01:24.580 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapGetName 2021-01-28T04:01:24.580 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapGetName (2966 ms) 2021-01-28T04:01:24.580 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots (15467 ms total) 2021-01-28T04:01:24.581 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: 2021-01-28T04:01:24.581 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManaged 2021-01-28T04:01:24.581 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Snap 2021-01-28T04:01:24.581 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Snap (5069 ms) 2021-01-28T04:01:24.582 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2021-01-28T04:01:24.582 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Rollback (5672 ms) 2021-01-28T04:01:24.582 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManaged (10741 ms total) 2021-01-28T04:01:24.582 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: 2021-01-28T04:01:24.583 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC 2021-01-28T04:01:24.583 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapList 2021-01-28T04:01:24.583 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapList (2998 ms) 2021-01-28T04:01:24.583 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapRemove 2021-01-28T04:01:24.583 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapRemove (1987 ms) 2021-01-28T04:01:24.584 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.Rollback 2021-01-28T04:01:24.584 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.Rollback (2017 ms) 2021-01-28T04:01:24.584 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapGetName 2021-01-28T04:01:24.584 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapGetName (2008 ms) 2021-01-28T04:01:24.584 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC (9010 ms total) 2021-01-28T04:01:24.585 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: 2021-01-28T04:01:24.585 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2021-01-28T04:01:24.585 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2021-01-28T04:01:24.586 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Snap (4072 ms) 2021-01-28T04:01:24.586 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2021-01-28T04:01:24.586 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Rollback (3966 ms) 2021-01-28T04:01:24.586 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC (8038 ms total) 2021-01-28T04:01:24.586 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: 2021-01-28T04:01:24.587 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [----------] Global test environment tear-down 2021-01-28T04:01:24.587 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [==========] 12 tests from 4 test suites ran. (71070 ms total) 2021-01-28T04:01:24.587 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots: [ PASSED ] 12 tests. 2021-01-28T04:01:25.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:25 smithi100 bash[9834]: cluster 2021-01-28T04:01:23.545670+0000 mgr.y (mgr.14138) 551 : cluster [DBG] pgmap v437: 356 pgs: 14 creating+peering, 9 unknown, 333 active+clean; 216 MiB data, 871 MiB used, 714 GiB / 715 GiB avail; 10 KiB/s rd, 25 KiB/s wr, 50 op/s 2021-01-28T04:01:25.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:25 smithi100 bash[9834]: audit 2021-01-28T04:01:24.102755+0000 mon.b (mon.2) 124 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:25.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:25 smithi100 bash[9834]: cluster 2021-01-28T04:01:24.356442+0000 osd.1 (osd.1) 3 : cluster [DBG] 94.0 scrub ok 2021-01-28T04:01:25.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:25 smithi100 bash[9834]: audit 2021-01-28T04:01:24.567804+0000 mon.a (mon.0) 1080 : audit [INF] from='client.? 172.21.15.100:0/4157868434' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32381-14"}]': finished 2021-01-28T04:01:25.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:25 smithi100 bash[9834]: audit 2021-01-28T04:01:24.568652+0000 mon.a (mon.0) 1081 : audit [INF] from='client.? 172.21.15.100:0/1399908927' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-14","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:25.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:25 smithi100 bash[9834]: cluster 2021-01-28T04:01:24.569623+0000 mon.a (mon.0) 1082 : cluster [DBG] osdmap e126: 8 total, 8 up, 8 in 2021-01-28T04:01:25.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:25 smithi100 bash[9834]: audit 2021-01-28T04:01:24.573692+0000 mon.a (mon.0) 1083 : audit [INF] from='client.? 172.21.15.100:0/3147170695' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:25.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:25 smithi100 bash[13549]: cluster 2021-01-28T04:01:23.545670+0000 mgr.y (mgr.14138) 551 : cluster [DBG] pgmap v437: 356 pgs: 14 creating+peering, 9 unknown, 333 active+clean; 216 MiB data, 871 MiB used, 714 GiB / 715 GiB avail; 10 KiB/s rd, 25 KiB/s wr, 50 op/s 2021-01-28T04:01:25.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:25 smithi100 bash[13549]: audit 2021-01-28T04:01:24.102755+0000 mon.b (mon.2) 124 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:25.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:25 smithi100 bash[13549]: cluster 2021-01-28T04:01:24.356442+0000 osd.1 (osd.1) 3 : cluster [DBG] 94.0 scrub ok 2021-01-28T04:01:25.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:25 smithi100 bash[13549]: audit 2021-01-28T04:01:24.567804+0000 mon.a (mon.0) 1080 : audit [INF] from='client.? 172.21.15.100:0/4157868434' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32381-14"}]': finished 2021-01-28T04:01:25.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:25 smithi100 bash[13549]: audit 2021-01-28T04:01:24.568652+0000 mon.a (mon.0) 1081 : audit [INF] from='client.? 172.21.15.100:0/1399908927' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-14","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:25.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:25 smithi100 bash[13549]: cluster 2021-01-28T04:01:24.569623+0000 mon.a (mon.0) 1082 : cluster [DBG] osdmap e126: 8 total, 8 up, 8 in 2021-01-28T04:01:25.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:25 smithi100 bash[13549]: audit 2021-01-28T04:01:24.573692+0000 mon.a (mon.0) 1083 : audit [INF] from='client.? 172.21.15.100:0/3147170695' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:25.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:25 smithi162 bash[9856]: cluster 2021-01-28T04:01:23.545670+0000 mgr.y (mgr.14138) 551 : cluster [DBG] pgmap v437: 356 pgs: 14 creating+peering, 9 unknown, 333 active+clean; 216 MiB data, 871 MiB used, 714 GiB / 715 GiB avail; 10 KiB/s rd, 25 KiB/s wr, 50 op/s 2021-01-28T04:01:25.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:25 smithi162 bash[9856]: audit 2021-01-28T04:01:24.102755+0000 mon.b (mon.2) 124 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:25.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:25 smithi162 bash[9856]: cluster 2021-01-28T04:01:24.356442+0000 osd.1 (osd.1) 3 : cluster [DBG] 94.0 scrub ok 2021-01-28T04:01:25.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:25 smithi162 bash[9856]: audit 2021-01-28T04:01:24.567804+0000 mon.a (mon.0) 1080 : audit [INF] from='client.? 172.21.15.100:0/4157868434' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32381-14"}]': finished 2021-01-28T04:01:25.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:25 smithi162 bash[9856]: audit 2021-01-28T04:01:24.568652+0000 mon.a (mon.0) 1081 : audit [INF] from='client.? 172.21.15.100:0/1399908927' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-14","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:25.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:25 smithi162 bash[9856]: cluster 2021-01-28T04:01:24.569623+0000 mon.a (mon.0) 1082 : cluster [DBG] osdmap e126: 8 total, 8 up, 8 in 2021-01-28T04:01:25.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:25 smithi162 bash[9856]: audit 2021-01-28T04:01:24.573692+0000 mon.a (mon.0) 1083 : audit [INF] from='client.? 172.21.15.100:0/3147170695' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:26.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:26 smithi100 bash[9834]: audit 2021-01-28T04:01:25.104463+0000 mon.b (mon.2) 125 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:26.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:26 smithi100 bash[9834]: cluster 2021-01-28T04:01:25.313375+0000 osd.1 (osd.1) 4 : cluster [DBG] 94.4 scrub ok 2021-01-28T04:01:26.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:26 smithi100 bash[9834]: cluster 2021-01-28T04:01:25.424363+0000 osd.2 (osd.2) 6 : cluster [DBG] 94.6 scrub ok 2021-01-28T04:01:26.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:26 smithi100 bash[9834]: audit 2021-01-28T04:01:25.569483+0000 mon.a (mon.0) 1084 : audit [INF] from='client.? 172.21.15.100:0/3147170695' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-19","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:26.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:26 smithi100 bash[9834]: cluster 2021-01-28T04:01:25.570543+0000 mon.a (mon.0) 1085 : cluster [DBG] osdmap e127: 8 total, 8 up, 8 in 2021-01-28T04:01:26.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:26 smithi100 bash[9834]: audit 2021-01-28T04:01:25.639522+0000 mon.c (mon.1) 131 : audit [INF] from='client.? 172.21.15.100:0/3965779027' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32434-14"}]: dispatch 2021-01-28T04:01:26.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:26 smithi100 bash[9834]: audit 2021-01-28T04:01:26.065729+0000 mon.a (mon.0) 1086 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32434-14"}]: dispatch 2021-01-28T04:01:26.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:26 smithi100 bash[9834]: audit 2021-01-28T04:01:26.066595+0000 mon.c (mon.1) 132 : audit [INF] from='client.? 172.21.15.100:0/3965779027' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32434-14"}]: dispatch 2021-01-28T04:01:26.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:26 smithi100 bash[9834]: audit 2021-01-28T04:01:26.066972+0000 mon.a (mon.0) 1087 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32434-14"}]: dispatch 2021-01-28T04:01:26.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:26 smithi100 bash[13549]: audit 2021-01-28T04:01:25.104463+0000 mon.b (mon.2) 125 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:26.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:26 smithi100 bash[13549]: cluster 2021-01-28T04:01:25.313375+0000 osd.1 (osd.1) 4 : cluster [DBG] 94.4 scrub ok 2021-01-28T04:01:26.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:26 smithi100 bash[13549]: cluster 2021-01-28T04:01:25.424363+0000 osd.2 (osd.2) 6 : cluster [DBG] 94.6 scrub ok 2021-01-28T04:01:26.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:26 smithi100 bash[13549]: audit 2021-01-28T04:01:25.569483+0000 mon.a (mon.0) 1084 : audit [INF] from='client.? 172.21.15.100:0/3147170695' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-19","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:26.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:26 smithi100 bash[13549]: cluster 2021-01-28T04:01:25.570543+0000 mon.a (mon.0) 1085 : cluster [DBG] osdmap e127: 8 total, 8 up, 8 in 2021-01-28T04:01:26.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:26 smithi100 bash[13549]: audit 2021-01-28T04:01:25.639522+0000 mon.c (mon.1) 131 : audit [INF] from='client.? 172.21.15.100:0/3965779027' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32434-14"}]: dispatch 2021-01-28T04:01:26.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:26 smithi100 bash[13549]: audit 2021-01-28T04:01:26.065729+0000 mon.a (mon.0) 1086 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32434-14"}]: dispatch 2021-01-28T04:01:26.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:26 smithi100 bash[13549]: audit 2021-01-28T04:01:26.066595+0000 mon.c (mon.1) 132 : audit [INF] from='client.? 172.21.15.100:0/3965779027' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32434-14"}]: dispatch 2021-01-28T04:01:26.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:26 smithi100 bash[13549]: audit 2021-01-28T04:01:26.066972+0000 mon.a (mon.0) 1087 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32434-14"}]: dispatch 2021-01-28T04:01:26.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:26 smithi162 bash[9856]: audit 2021-01-28T04:01:25.104463+0000 mon.b (mon.2) 125 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:26.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:26 smithi162 bash[9856]: cluster 2021-01-28T04:01:25.313375+0000 osd.1 (osd.1) 4 : cluster [DBG] 94.4 scrub ok 2021-01-28T04:01:26.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:26 smithi162 bash[9856]: cluster 2021-01-28T04:01:25.424363+0000 osd.2 (osd.2) 6 : cluster [DBG] 94.6 scrub ok 2021-01-28T04:01:26.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:26 smithi162 bash[9856]: audit 2021-01-28T04:01:25.569483+0000 mon.a (mon.0) 1084 : audit [INF] from='client.? 172.21.15.100:0/3147170695' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-19","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:26.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:26 smithi162 bash[9856]: cluster 2021-01-28T04:01:25.570543+0000 mon.a (mon.0) 1085 : cluster [DBG] osdmap e127: 8 total, 8 up, 8 in 2021-01-28T04:01:26.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:26 smithi162 bash[9856]: audit 2021-01-28T04:01:25.639522+0000 mon.c (mon.1) 131 : audit [INF] from='client.? 172.21.15.100:0/3965779027' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32434-14"}]: dispatch 2021-01-28T04:01:26.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:26 smithi162 bash[9856]: audit 2021-01-28T04:01:26.065729+0000 mon.a (mon.0) 1086 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32434-14"}]: dispatch 2021-01-28T04:01:26.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:26 smithi162 bash[9856]: audit 2021-01-28T04:01:26.066595+0000 mon.c (mon.1) 132 : audit [INF] from='client.? 172.21.15.100:0/3965779027' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32434-14"}]: dispatch 2021-01-28T04:01:26.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:26 smithi162 bash[9856]: audit 2021-01-28T04:01:26.066972+0000 mon.a (mon.0) 1087 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32434-14"}]: dispatch 2021-01-28T04:01:27.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:27 smithi100 bash[9834]: cluster 2021-01-28T04:01:25.546721+0000 mgr.y (mgr.14138) 552 : cluster [DBG] pgmap v440: 388 pgs: 7 creating+peering, 57 unknown, 324 active+clean; 216 MiB data, 858 MiB used, 714 GiB / 715 GiB avail; 41 KiB/s rd, 15 KiB/s wr, 78 op/s 2021-01-28T04:01:27.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:27 smithi100 bash[9834]: cluster 2021-01-28T04:01:25.635391+0000 osd.7 (osd.7) 7 : cluster [DBG] 94.1 scrub ok 2021-01-28T04:01:27.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:27 smithi100 bash[9834]: cluster 2021-01-28T04:01:25.903646+0000 osd.0 (osd.0) 5 : cluster [DBG] 94.5 scrub ok 2021-01-28T04:01:27.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:27 smithi100 bash[9834]: audit 2021-01-28T04:01:26.067623+0000 mon.c (mon.1) 133 : audit [INF] from='client.? 172.21.15.100:0/3965779027' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32434-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:27.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:27 smithi100 bash[9834]: audit 2021-01-28T04:01:26.068302+0000 mon.a (mon.0) 1088 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32434-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:27.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:27 smithi100 bash[9834]: audit 2021-01-28T04:01:26.106099+0000 mon.b (mon.2) 126 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:27.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:27 smithi100 bash[9834]: audit 2021-01-28T04:01:26.577092+0000 mon.a (mon.0) 1089 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32434-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:01:27.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:27 smithi100 bash[9834]: cluster 2021-01-28T04:01:26.577772+0000 mon.a (mon.0) 1090 : cluster [DBG] osdmap e128: 8 total, 8 up, 8 in 2021-01-28T04:01:27.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:27 smithi100 bash[9834]: audit 2021-01-28T04:01:26.579088+0000 mon.c (mon.1) 134 : audit [INF] from='client.? 172.21.15.100:0/3965779027' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32434-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32434-14"}]: dispatch 2021-01-28T04:01:27.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:27 smithi100 bash[9834]: audit 2021-01-28T04:01:26.579402+0000 mon.c (mon.1) 135 : audit [INF] from='client.? 172.21.15.100:0/2739319228' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:27.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:27 smithi100 bash[9834]: audit 2021-01-28T04:01:26.587837+0000 mon.a (mon.0) 1091 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32434-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32434-14"}]: dispatch 2021-01-28T04:01:27.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:27 smithi100 bash[9834]: audit 2021-01-28T04:01:26.588656+0000 mon.a (mon.0) 1092 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:27.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:27 smithi100 bash[13549]: cluster 2021-01-28T04:01:25.546721+0000 mgr.y (mgr.14138) 552 : cluster [DBG] pgmap v440: 388 pgs: 7 creating+peering, 57 unknown, 324 active+clean; 216 MiB data, 858 MiB used, 714 GiB / 715 GiB avail; 41 KiB/s rd, 15 KiB/s wr, 78 op/s 2021-01-28T04:01:27.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:27 smithi100 bash[13549]: cluster 2021-01-28T04:01:25.635391+0000 osd.7 (osd.7) 7 : cluster [DBG] 94.1 scrub ok 2021-01-28T04:01:27.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:27 smithi100 bash[13549]: cluster 2021-01-28T04:01:25.903646+0000 osd.0 (osd.0) 5 : cluster [DBG] 94.5 scrub ok 2021-01-28T04:01:27.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:27 smithi100 bash[13549]: audit 2021-01-28T04:01:26.067623+0000 mon.c (mon.1) 133 : audit [INF] from='client.? 172.21.15.100:0/3965779027' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32434-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:27.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:27 smithi100 bash[13549]: audit 2021-01-28T04:01:26.068302+0000 mon.a (mon.0) 1088 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32434-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:27.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:27 smithi100 bash[13549]: audit 2021-01-28T04:01:26.106099+0000 mon.b (mon.2) 126 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:27.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:27 smithi100 bash[13549]: audit 2021-01-28T04:01:26.577092+0000 mon.a (mon.0) 1089 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32434-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:01:27.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:27 smithi100 bash[13549]: cluster 2021-01-28T04:01:26.577772+0000 mon.a (mon.0) 1090 : cluster [DBG] osdmap e128: 8 total, 8 up, 8 in 2021-01-28T04:01:27.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:27 smithi100 bash[13549]: audit 2021-01-28T04:01:26.579088+0000 mon.c (mon.1) 134 : audit [INF] from='client.? 172.21.15.100:0/3965779027' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32434-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32434-14"}]: dispatch 2021-01-28T04:01:27.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:27 smithi100 bash[13549]: audit 2021-01-28T04:01:26.579402+0000 mon.c (mon.1) 135 : audit [INF] from='client.? 172.21.15.100:0/2739319228' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:27.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:27 smithi100 bash[13549]: audit 2021-01-28T04:01:26.587837+0000 mon.a (mon.0) 1091 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32434-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32434-14"}]: dispatch 2021-01-28T04:01:27.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:27 smithi100 bash[13549]: audit 2021-01-28T04:01:26.588656+0000 mon.a (mon.0) 1092 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:27.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:27 smithi162 bash[9856]: cluster 2021-01-28T04:01:25.546721+0000 mgr.y (mgr.14138) 552 : cluster [DBG] pgmap v440: 388 pgs: 7 creating+peering, 57 unknown, 324 active+clean; 216 MiB data, 858 MiB used, 714 GiB / 715 GiB avail; 41 KiB/s rd, 15 KiB/s wr, 78 op/s 2021-01-28T04:01:27.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:27 smithi162 bash[9856]: cluster 2021-01-28T04:01:25.635391+0000 osd.7 (osd.7) 7 : cluster [DBG] 94.1 scrub ok 2021-01-28T04:01:27.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:27 smithi162 bash[9856]: cluster 2021-01-28T04:01:25.903646+0000 osd.0 (osd.0) 5 : cluster [DBG] 94.5 scrub ok 2021-01-28T04:01:27.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:27 smithi162 bash[9856]: audit 2021-01-28T04:01:26.067623+0000 mon.c (mon.1) 133 : audit [INF] from='client.? 172.21.15.100:0/3965779027' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32434-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:27.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:27 smithi162 bash[9856]: audit 2021-01-28T04:01:26.068302+0000 mon.a (mon.0) 1088 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32434-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:27.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:27 smithi162 bash[9856]: audit 2021-01-28T04:01:26.106099+0000 mon.b (mon.2) 126 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:27.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:27 smithi162 bash[9856]: audit 2021-01-28T04:01:26.577092+0000 mon.a (mon.0) 1089 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32434-14", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:01:27.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:27 smithi162 bash[9856]: cluster 2021-01-28T04:01:26.577772+0000 mon.a (mon.0) 1090 : cluster [DBG] osdmap e128: 8 total, 8 up, 8 in 2021-01-28T04:01:27.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:27 smithi162 bash[9856]: audit 2021-01-28T04:01:26.579088+0000 mon.c (mon.1) 134 : audit [INF] from='client.? 172.21.15.100:0/3965779027' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32434-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32434-14"}]: dispatch 2021-01-28T04:01:27.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:27 smithi162 bash[9856]: audit 2021-01-28T04:01:26.579402+0000 mon.c (mon.1) 135 : audit [INF] from='client.? 172.21.15.100:0/2739319228' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:27.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:27 smithi162 bash[9856]: audit 2021-01-28T04:01:26.587837+0000 mon.a (mon.0) 1091 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32434-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32434-14"}]: dispatch 2021-01-28T04:01:27.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:27 smithi162 bash[9856]: audit 2021-01-28T04:01:26.588656+0000 mon.a (mon.0) 1092 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:28.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:28 smithi162 bash[9856]: audit 2021-01-28T04:01:27.107785+0000 mon.b (mon.2) 127 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:28.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:28 smithi162 bash[9856]: cluster 2021-01-28T04:01:27.476668+0000 osd.2 (osd.2) 7 : cluster [DBG] 94.7 scrub ok 2021-01-28T04:01:28.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:28 smithi162 bash[9856]: audit 2021-01-28T04:01:28.006878+0000 mon.a (mon.0) 1093 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:28.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:28 smithi162 bash[9856]: cluster 2021-01-28T04:01:28.007541+0000 mon.a (mon.0) 1094 : cluster [DBG] osdmap e129: 8 total, 8 up, 8 in 2021-01-28T04:01:28.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:28 smithi162 bash[9856]: audit 2021-01-28T04:01:28.009378+0000 mon.c (mon.1) 136 : audit [INF] from='client.? 172.21.15.100:0/705282608' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:28.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:28 smithi162 bash[9856]: audit 2021-01-28T04:01:28.014439+0000 mon.a (mon.0) 1095 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:28.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:28 smithi100 bash[9834]: audit 2021-01-28T04:01:27.107785+0000 mon.b (mon.2) 127 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:28.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:28 smithi100 bash[9834]: cluster 2021-01-28T04:01:27.476668+0000 osd.2 (osd.2) 7 : cluster [DBG] 94.7 scrub ok 2021-01-28T04:01:28.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:28 smithi100 bash[9834]: audit 2021-01-28T04:01:28.006878+0000 mon.a (mon.0) 1093 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:28.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:28 smithi100 bash[9834]: cluster 2021-01-28T04:01:28.007541+0000 mon.a (mon.0) 1094 : cluster [DBG] osdmap e129: 8 total, 8 up, 8 in 2021-01-28T04:01:28.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:28 smithi100 bash[9834]: audit 2021-01-28T04:01:28.009378+0000 mon.c (mon.1) 136 : audit [INF] from='client.? 172.21.15.100:0/705282608' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:28.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:28 smithi100 bash[9834]: audit 2021-01-28T04:01:28.014439+0000 mon.a (mon.0) 1095 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:28.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:28 smithi100 bash[13549]: audit 2021-01-28T04:01:27.107785+0000 mon.b (mon.2) 127 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:28.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:28 smithi100 bash[13549]: cluster 2021-01-28T04:01:27.476668+0000 osd.2 (osd.2) 7 : cluster [DBG] 94.7 scrub ok 2021-01-28T04:01:28.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:28 smithi100 bash[13549]: audit 2021-01-28T04:01:28.006878+0000 mon.a (mon.0) 1093 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:28.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:28 smithi100 bash[13549]: cluster 2021-01-28T04:01:28.007541+0000 mon.a (mon.0) 1094 : cluster [DBG] osdmap e129: 8 total, 8 up, 8 in 2021-01-28T04:01:28.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:28 smithi100 bash[13549]: audit 2021-01-28T04:01:28.009378+0000 mon.c (mon.1) 136 : audit [INF] from='client.? 172.21.15.100:0/705282608' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:28.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:28 smithi100 bash[13549]: audit 2021-01-28T04:01:28.014439+0000 mon.a (mon.0) 1095 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:29.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:29 smithi162 bash[9856]: cluster 2021-01-28T04:01:27.548451+0000 mgr.y (mgr.14138) 553 : cluster [DBG] pgmap v443: 324 pgs: 11 creating+peering, 21 unknown, 292 active+clean; 216 MiB data, 865 MiB used, 714 GiB / 715 GiB avail; 42 KiB/s rd, 52 op/s 2021-01-28T04:01:29.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:29 smithi162 bash[9856]: audit 2021-01-28T04:01:28.109634+0000 mon.b (mon.2) 128 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:29.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:29 smithi162 bash[9856]: cluster 2021-01-28T04:01:28.523807+0000 mon.a (mon.0) 1096 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:01:29.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:29 smithi162 bash[9856]: audit 2021-01-28T04:01:28.585879+0000 mon.a (mon.0) 1097 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32434-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32434-14"}]': finished 2021-01-28T04:01:29.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:29 smithi162 bash[9856]: audit 2021-01-28T04:01:28.586484+0000 mon.a (mon.0) 1098 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-20","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:29.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:29 smithi162 bash[9856]: cluster 2021-01-28T04:01:28.586752+0000 mon.a (mon.0) 1099 : cluster [DBG] osdmap e130: 8 total, 8 up, 8 in 2021-01-28T04:01:29.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:29 smithi100 bash[9834]: cluster 2021-01-28T04:01:27.548451+0000 mgr.y (mgr.14138) 553 : cluster [DBG] pgmap v443: 324 pgs: 11 creating+peering, 21 unknown, 292 active+clean; 216 MiB data, 865 MiB used, 714 GiB / 715 GiB avail; 42 KiB/s rd, 52 op/s 2021-01-28T04:01:29.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:29 smithi100 bash[9834]: audit 2021-01-28T04:01:28.109634+0000 mon.b (mon.2) 128 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:29.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:29 smithi100 bash[9834]: cluster 2021-01-28T04:01:28.523807+0000 mon.a (mon.0) 1096 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:01:29.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:29 smithi100 bash[9834]: audit 2021-01-28T04:01:28.585879+0000 mon.a (mon.0) 1097 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32434-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32434-14"}]': finished 2021-01-28T04:01:29.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:29 smithi100 bash[9834]: audit 2021-01-28T04:01:28.586484+0000 mon.a (mon.0) 1098 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-20","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:29.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:29 smithi100 bash[9834]: cluster 2021-01-28T04:01:28.586752+0000 mon.a (mon.0) 1099 : cluster [DBG] osdmap e130: 8 total, 8 up, 8 in 2021-01-28T04:01:29.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:29 smithi100 bash[13549]: cluster 2021-01-28T04:01:27.548451+0000 mgr.y (mgr.14138) 553 : cluster [DBG] pgmap v443: 324 pgs: 11 creating+peering, 21 unknown, 292 active+clean; 216 MiB data, 865 MiB used, 714 GiB / 715 GiB avail; 42 KiB/s rd, 52 op/s 2021-01-28T04:01:29.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:29 smithi100 bash[13549]: audit 2021-01-28T04:01:28.109634+0000 mon.b (mon.2) 128 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:29.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:29 smithi100 bash[13549]: cluster 2021-01-28T04:01:28.523807+0000 mon.a (mon.0) 1096 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:01:29.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:29 smithi100 bash[13549]: audit 2021-01-28T04:01:28.585879+0000 mon.a (mon.0) 1097 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32434-14", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32434-14"}]': finished 2021-01-28T04:01:29.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:29 smithi100 bash[13549]: audit 2021-01-28T04:01:28.586484+0000 mon.a (mon.0) 1098 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-20","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:29.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:29 smithi100 bash[13549]: cluster 2021-01-28T04:01:28.586752+0000 mon.a (mon.0) 1099 : cluster [DBG] osdmap e130: 8 total, 8 up, 8 in 2021-01-28T04:01:30.012 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 04:01:29 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T04:01:30.077 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 04:01:29 smithi100 bash[10061]: debug 2021-01-28T04:01:29.754+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:01:30.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:30 smithi162 bash[9856]: cluster 2021-01-28T04:01:28.936139+0000 osd.0 (osd.0) 6 : cluster [DBG] 94.8 scrub ok 2021-01-28T04:01:30.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:30 smithi162 bash[9856]: audit 2021-01-28T04:01:29.111456+0000 mon.b (mon.2) 129 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:30.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:30 smithi162 bash[9856]: cluster 2021-01-28T04:01:29.588283+0000 mon.a (mon.0) 1100 : cluster [DBG] osdmap e131: 8 total, 8 up, 8 in 2021-01-28T04:01:30.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:30 smithi162 bash[9856]: audit 2021-01-28T04:01:29.594263+0000 mon.a (mon.0) 1101 : audit [INF] from='client.? 172.21.15.100:0/2086033004' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:30.577 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:30 smithi100 bash[13549]: cluster 2021-01-28T04:01:28.936139+0000 osd.0 (osd.0) 6 : cluster [DBG] 94.8 scrub ok 2021-01-28T04:01:30.578 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:30 smithi100 bash[13549]: audit 2021-01-28T04:01:29.111456+0000 mon.b (mon.2) 129 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:30.578 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:30 smithi100 bash[13549]: cluster 2021-01-28T04:01:29.588283+0000 mon.a (mon.0) 1100 : cluster [DBG] osdmap e131: 8 total, 8 up, 8 in 2021-01-28T04:01:30.578 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:30 smithi100 bash[13549]: audit 2021-01-28T04:01:29.594263+0000 mon.a (mon.0) 1101 : audit [INF] from='client.? 172.21.15.100:0/2086033004' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:30.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:30 smithi100 bash[9834]: cluster 2021-01-28T04:01:28.936139+0000 osd.0 (osd.0) 6 : cluster [DBG] 94.8 scrub ok 2021-01-28T04:01:30.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:30 smithi100 bash[9834]: audit 2021-01-28T04:01:29.111456+0000 mon.b (mon.2) 129 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:30.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:30 smithi100 bash[9834]: cluster 2021-01-28T04:01:29.588283+0000 mon.a (mon.0) 1100 : cluster [DBG] osdmap e131: 8 total, 8 up, 8 in 2021-01-28T04:01:30.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:30 smithi100 bash[9834]: audit 2021-01-28T04:01:29.594263+0000 mon.a (mon.0) 1101 : audit [INF] from='client.? 172.21.15.100:0/2086033004' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:31.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:31 smithi162 bash[9856]: cluster 2021-01-28T04:01:29.550035+0000 mgr.y (mgr.14138) 554 : cluster [DBG] pgmap v446: 332 pgs: 12 creating+peering, 24 unknown, 296 active+clean; 216 MiB data, 867 MiB used, 714 GiB / 715 GiB avail; 14 KiB/s rd, 16 op/s 2021-01-28T04:01:31.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:31 smithi162 bash[9856]: audit 2021-01-28T04:01:29.758183+0000 mgr.y (mgr.14138) 555 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:01:31.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:31 smithi162 bash[9856]: audit 2021-01-28T04:01:30.113245+0000 mon.b (mon.2) 130 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:31.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:31 smithi162 bash[9856]: audit 2021-01-28T04:01:30.201357+0000 mon.c (mon.1) 137 : audit [DBG] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2021-01-28T04:01:31.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:31 smithi162 bash[9856]: audit 2021-01-28T04:01:30.202443+0000 mon.c (mon.1) 138 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:31.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:31 smithi162 bash[9856]: audit 2021-01-28T04:01:30.203251+0000 mon.a (mon.0) 1102 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:31.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:31 smithi162 bash[9856]: audit 2021-01-28T04:01:30.597004+0000 mon.a (mon.0) 1103 : audit [INF] from='client.? 172.21.15.100:0/2086033004' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-16","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:31.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:31 smithi162 bash[9856]: audit 2021-01-28T04:01:30.598789+0000 mon.a (mon.0) 1104 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-1","app": "app1","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:31.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:31 smithi162 bash[9856]: cluster 2021-01-28T04:01:30.598911+0000 mon.a (mon.0) 1105 : cluster [DBG] osdmap e132: 8 total, 8 up, 8 in 2021-01-28T04:01:31.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:31 smithi162 bash[9856]: audit 2021-01-28T04:01:30.602411+0000 mon.c (mon.1) 139 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-1","app": "app2"}]: dispatch 2021-01-28T04:01:31.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:31 smithi162 bash[9856]: audit 2021-01-28T04:01:30.603218+0000 mon.c (mon.1) 140 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:31.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:31 smithi162 bash[9856]: audit 2021-01-28T04:01:30.605966+0000 mon.a (mon.0) 1106 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:31.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:31 smithi162 bash[9856]: audit 2021-01-28T04:01:30.606934+0000 mon.a (mon.0) 1107 : audit [INF] from='client.? 172.21.15.100:0/4046369390' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:31.578 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:31 smithi100 bash[13549]: cluster 2021-01-28T04:01:29.550035+0000 mgr.y (mgr.14138) 554 : cluster [DBG] pgmap v446: 332 pgs: 12 creating+peering, 24 unknown, 296 active+clean; 216 MiB data, 867 MiB used, 714 GiB / 715 GiB avail; 14 KiB/s rd, 16 op/s 2021-01-28T04:01:31.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:31 smithi100 bash[13549]: audit 2021-01-28T04:01:29.758183+0000 mgr.y (mgr.14138) 555 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:01:31.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:31 smithi100 bash[13549]: audit 2021-01-28T04:01:30.113245+0000 mon.b (mon.2) 130 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:31.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:31 smithi100 bash[13549]: audit 2021-01-28T04:01:30.201357+0000 mon.c (mon.1) 137 : audit [DBG] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2021-01-28T04:01:31.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:31 smithi100 bash[13549]: audit 2021-01-28T04:01:30.202443+0000 mon.c (mon.1) 138 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:31.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:31 smithi100 bash[13549]: audit 2021-01-28T04:01:30.203251+0000 mon.a (mon.0) 1102 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:31.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:31 smithi100 bash[13549]: audit 2021-01-28T04:01:30.597004+0000 mon.a (mon.0) 1103 : audit [INF] from='client.? 172.21.15.100:0/2086033004' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-16","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:31.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:31 smithi100 bash[13549]: audit 2021-01-28T04:01:30.598789+0000 mon.a (mon.0) 1104 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-1","app": "app1","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:31.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:31 smithi100 bash[13549]: cluster 2021-01-28T04:01:30.598911+0000 mon.a (mon.0) 1105 : cluster [DBG] osdmap e132: 8 total, 8 up, 8 in 2021-01-28T04:01:31.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:31 smithi100 bash[13549]: audit 2021-01-28T04:01:30.602411+0000 mon.c (mon.1) 139 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-1","app": "app2"}]: dispatch 2021-01-28T04:01:31.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:31 smithi100 bash[13549]: audit 2021-01-28T04:01:30.603218+0000 mon.c (mon.1) 140 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:31.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:31 smithi100 bash[13549]: audit 2021-01-28T04:01:30.605966+0000 mon.a (mon.0) 1106 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:31.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:31 smithi100 bash[13549]: audit 2021-01-28T04:01:30.606934+0000 mon.a (mon.0) 1107 : audit [INF] from='client.? 172.21.15.100:0/4046369390' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:31.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:31 smithi100 bash[9834]: cluster 2021-01-28T04:01:29.550035+0000 mgr.y (mgr.14138) 554 : cluster [DBG] pgmap v446: 332 pgs: 12 creating+peering, 24 unknown, 296 active+clean; 216 MiB data, 867 MiB used, 714 GiB / 715 GiB avail; 14 KiB/s rd, 16 op/s 2021-01-28T04:01:31.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:31 smithi100 bash[9834]: audit 2021-01-28T04:01:29.758183+0000 mgr.y (mgr.14138) 555 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:01:31.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:31 smithi100 bash[9834]: audit 2021-01-28T04:01:30.113245+0000 mon.b (mon.2) 130 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:31.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:31 smithi100 bash[9834]: audit 2021-01-28T04:01:30.201357+0000 mon.c (mon.1) 137 : audit [DBG] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2021-01-28T04:01:31.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:31 smithi100 bash[9834]: audit 2021-01-28T04:01:30.202443+0000 mon.c (mon.1) 138 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:31.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:31 smithi100 bash[9834]: audit 2021-01-28T04:01:30.203251+0000 mon.a (mon.0) 1102 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:31.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:31 smithi100 bash[9834]: audit 2021-01-28T04:01:30.597004+0000 mon.a (mon.0) 1103 : audit [INF] from='client.? 172.21.15.100:0/2086033004' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-16","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:31.584 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:31 smithi100 bash[9834]: audit 2021-01-28T04:01:30.598789+0000 mon.a (mon.0) 1104 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-1","app": "app1","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:31.584 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:31 smithi100 bash[9834]: cluster 2021-01-28T04:01:30.598911+0000 mon.a (mon.0) 1105 : cluster [DBG] osdmap e132: 8 total, 8 up, 8 in 2021-01-28T04:01:31.584 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:31 smithi100 bash[9834]: audit 2021-01-28T04:01:30.602411+0000 mon.c (mon.1) 139 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-1","app": "app2"}]: dispatch 2021-01-28T04:01:31.584 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:31 smithi100 bash[9834]: audit 2021-01-28T04:01:30.603218+0000 mon.c (mon.1) 140 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:31.584 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:31 smithi100 bash[9834]: audit 2021-01-28T04:01:30.605966+0000 mon.a (mon.0) 1106 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:31.585 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:31 smithi100 bash[9834]: audit 2021-01-28T04:01:30.606934+0000 mon.a (mon.0) 1107 : audit [INF] from='client.? 172.21.15.100:0/4046369390' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:32.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:32 smithi162 bash[9856]: cluster 2021-01-28T04:01:30.871158+0000 osd.0 (osd.0) 7 : cluster [DBG] 94.9 scrub ok 2021-01-28T04:01:32.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:32 smithi162 bash[9856]: audit 2021-01-28T04:01:31.114983+0000 mon.b (mon.2) 131 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:32.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:32 smithi162 bash[9856]: audit 2021-01-28T04:01:31.594309+0000 mon.a (mon.0) 1108 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-1","app": "app2","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:32.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:32 smithi162 bash[9856]: audit 2021-01-28T04:01:31.594510+0000 mon.a (mon.0) 1109 : audit [INF] from='client.? 172.21.15.100:0/4046369390' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-21","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:32.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:32 smithi162 bash[9856]: cluster 2021-01-28T04:01:31.595074+0000 mon.a (mon.0) 1110 : cluster [DBG] osdmap e133: 8 total, 8 up, 8 in 2021-01-28T04:01:32.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:32 smithi162 bash[9856]: audit 2021-01-28T04:01:31.601268+0000 mon.c (mon.1) 141 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32315-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2021-01-28T04:01:32.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:32 smithi162 bash[9856]: audit 2021-01-28T04:01:31.602116+0000 mon.c (mon.1) 142 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32315-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-01-28T04:01:32.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:32 smithi162 bash[9856]: audit 2021-01-28T04:01:31.602761+0000 mon.a (mon.0) 1111 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32315-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-01-28T04:01:32.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:32 smithi100 bash[9834]: cluster 2021-01-28T04:01:30.871158+0000 osd.0 (osd.0) 7 : cluster [DBG] 94.9 scrub ok 2021-01-28T04:01:32.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:32 smithi100 bash[9834]: audit 2021-01-28T04:01:31.114983+0000 mon.b (mon.2) 131 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:32.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:32 smithi100 bash[9834]: audit 2021-01-28T04:01:31.594309+0000 mon.a (mon.0) 1108 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-1","app": "app2","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:32.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:32 smithi100 bash[9834]: audit 2021-01-28T04:01:31.594510+0000 mon.a (mon.0) 1109 : audit [INF] from='client.? 172.21.15.100:0/4046369390' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-21","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:32.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:32 smithi100 bash[9834]: cluster 2021-01-28T04:01:31.595074+0000 mon.a (mon.0) 1110 : cluster [DBG] osdmap e133: 8 total, 8 up, 8 in 2021-01-28T04:01:32.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:32 smithi100 bash[9834]: audit 2021-01-28T04:01:31.601268+0000 mon.c (mon.1) 141 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32315-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2021-01-28T04:01:32.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:32 smithi100 bash[9834]: audit 2021-01-28T04:01:31.602116+0000 mon.c (mon.1) 142 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32315-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-01-28T04:01:32.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:32 smithi100 bash[9834]: audit 2021-01-28T04:01:31.602761+0000 mon.a (mon.0) 1111 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32315-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-01-28T04:01:32.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:32 smithi100 bash[13549]: cluster 2021-01-28T04:01:30.871158+0000 osd.0 (osd.0) 7 : cluster [DBG] 94.9 scrub ok 2021-01-28T04:01:32.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:32 smithi100 bash[13549]: audit 2021-01-28T04:01:31.114983+0000 mon.b (mon.2) 131 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:32.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:32 smithi100 bash[13549]: audit 2021-01-28T04:01:31.594309+0000 mon.a (mon.0) 1108 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-1","app": "app2","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:32.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:32 smithi100 bash[13549]: audit 2021-01-28T04:01:31.594510+0000 mon.a (mon.0) 1109 : audit [INF] from='client.? 172.21.15.100:0/4046369390' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-21","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:32.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:32 smithi100 bash[13549]: cluster 2021-01-28T04:01:31.595074+0000 mon.a (mon.0) 1110 : cluster [DBG] osdmap e133: 8 total, 8 up, 8 in 2021-01-28T04:01:32.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:32 smithi100 bash[13549]: audit 2021-01-28T04:01:31.601268+0000 mon.c (mon.1) 141 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32315-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2021-01-28T04:01:32.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:32 smithi100 bash[13549]: audit 2021-01-28T04:01:31.602116+0000 mon.c (mon.1) 142 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32315-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-01-28T04:01:32.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:32 smithi100 bash[13549]: audit 2021-01-28T04:01:31.602761+0000 mon.a (mon.0) 1111 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32315-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2021-01-28T04:01:33.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:33 smithi162 bash[9856]: cluster 2021-01-28T04:01:31.551270+0000 mgr.y (mgr.14138) 556 : cluster [DBG] pgmap v449: 364 pgs: 4 creating+peering, 60 unknown, 300 active+clean; 216 MiB data, 868 MiB used, 714 GiB / 715 GiB avail; 2.5 KiB/s rd, 2 op/s 2021-01-28T04:01:33.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:33 smithi162 bash[9856]: audit 2021-01-28T04:01:32.117157+0000 mon.b (mon.2) 132 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:33.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:33 smithi162 bash[9856]: audit 2021-01-28T04:01:32.602599+0000 mon.a (mon.0) 1112 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32315-1","app":"app1","key":"key1","value":"value1"}]': finished 2021-01-28T04:01:33.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:33 smithi162 bash[9856]: cluster 2021-01-28T04:01:32.602773+0000 mon.a (mon.0) 1113 : cluster [DBG] osdmap e134: 8 total, 8 up, 8 in 2021-01-28T04:01:33.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:33 smithi162 bash[9856]: audit 2021-01-28T04:01:32.609432+0000 mon.c (mon.1) 143 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32315-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-01-28T04:01:33.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:33 smithi162 bash[9856]: audit 2021-01-28T04:01:32.611199+0000 mon.a (mon.0) 1114 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32315-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-01-28T04:01:33.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:33 smithi162 bash[9856]: audit 2021-01-28T04:01:32.616271+0000 mon.a (mon.0) 1115 : audit [INF] from='client.? 172.21.15.100:0/3333977986' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:33.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:33 smithi100 bash[9834]: cluster 2021-01-28T04:01:31.551270+0000 mgr.y (mgr.14138) 556 : cluster [DBG] pgmap v449: 364 pgs: 4 creating+peering, 60 unknown, 300 active+clean; 216 MiB data, 868 MiB used, 714 GiB / 715 GiB avail; 2.5 KiB/s rd, 2 op/s 2021-01-28T04:01:33.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:33 smithi100 bash[9834]: audit 2021-01-28T04:01:32.117157+0000 mon.b (mon.2) 132 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:33.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:33 smithi100 bash[9834]: audit 2021-01-28T04:01:32.602599+0000 mon.a (mon.0) 1112 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32315-1","app":"app1","key":"key1","value":"value1"}]': finished 2021-01-28T04:01:33.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:33 smithi100 bash[9834]: cluster 2021-01-28T04:01:32.602773+0000 mon.a (mon.0) 1113 : cluster [DBG] osdmap e134: 8 total, 8 up, 8 in 2021-01-28T04:01:33.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:33 smithi100 bash[9834]: audit 2021-01-28T04:01:32.609432+0000 mon.c (mon.1) 143 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32315-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-01-28T04:01:33.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:33 smithi100 bash[9834]: audit 2021-01-28T04:01:32.611199+0000 mon.a (mon.0) 1114 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32315-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-01-28T04:01:33.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:33 smithi100 bash[9834]: audit 2021-01-28T04:01:32.616271+0000 mon.a (mon.0) 1115 : audit [INF] from='client.? 172.21.15.100:0/3333977986' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:33.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:33 smithi100 bash[13549]: cluster 2021-01-28T04:01:31.551270+0000 mgr.y (mgr.14138) 556 : cluster [DBG] pgmap v449: 364 pgs: 4 creating+peering, 60 unknown, 300 active+clean; 216 MiB data, 868 MiB used, 714 GiB / 715 GiB avail; 2.5 KiB/s rd, 2 op/s 2021-01-28T04:01:33.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:33 smithi100 bash[13549]: audit 2021-01-28T04:01:32.117157+0000 mon.b (mon.2) 132 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:33.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:33 smithi100 bash[13549]: audit 2021-01-28T04:01:32.602599+0000 mon.a (mon.0) 1112 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32315-1","app":"app1","key":"key1","value":"value1"}]': finished 2021-01-28T04:01:33.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:33 smithi100 bash[13549]: cluster 2021-01-28T04:01:32.602773+0000 mon.a (mon.0) 1113 : cluster [DBG] osdmap e134: 8 total, 8 up, 8 in 2021-01-28T04:01:33.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:33 smithi100 bash[13549]: audit 2021-01-28T04:01:32.609432+0000 mon.c (mon.1) 143 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32315-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-01-28T04:01:33.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:33 smithi100 bash[13549]: audit 2021-01-28T04:01:32.611199+0000 mon.a (mon.0) 1114 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32315-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2021-01-28T04:01:33.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:33 smithi100 bash[13549]: audit 2021-01-28T04:01:32.616271+0000 mon.a (mon.0) 1115 : audit [INF] from='client.? 172.21.15.100:0/3333977986' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:34.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:34 smithi162 bash[9856]: audit 2021-01-28T04:01:33.122572+0000 mon.b (mon.2) 133 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:34.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:34 smithi162 bash[9856]: audit 2021-01-28T04:01:33.607280+0000 mon.a (mon.0) 1116 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32315-1","app":"app1","key":"key2","value":"value2"}]': finished 2021-01-28T04:01:34.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:34 smithi162 bash[9856]: audit 2021-01-28T04:01:33.607590+0000 mon.a (mon.0) 1117 : audit [INF] from='client.? 172.21.15.100:0/3333977986' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:34.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:34 smithi162 bash[9856]: cluster 2021-01-28T04:01:33.608258+0000 mon.a (mon.0) 1118 : cluster [DBG] osdmap e135: 8 total, 8 up, 8 in 2021-01-28T04:01:34.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:34 smithi162 bash[9856]: audit 2021-01-28T04:01:33.610188+0000 mon.c (mon.1) 144 : audit [INF] from='client.? 172.21.15.100:0/2003394992' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:34.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:34 smithi162 bash[9856]: audit 2021-01-28T04:01:33.611265+0000 mon.c (mon.1) 145 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi100-32315-1","app":"app1","key":"key1"}]: dispatch 2021-01-28T04:01:34.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:34 smithi162 bash[9856]: audit 2021-01-28T04:01:33.614361+0000 mon.a (mon.0) 1119 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:34.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:34 smithi162 bash[9856]: audit 2021-01-28T04:01:33.615384+0000 mon.a (mon.0) 1120 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi100-32315-1","app":"app1","key":"key1"}]: dispatch 2021-01-28T04:01:34.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:34 smithi100 bash[9834]: audit 2021-01-28T04:01:33.122572+0000 mon.b (mon.2) 133 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:34.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:34 smithi100 bash[9834]: audit 2021-01-28T04:01:33.607280+0000 mon.a (mon.0) 1116 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32315-1","app":"app1","key":"key2","value":"value2"}]': finished 2021-01-28T04:01:34.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:34 smithi100 bash[9834]: audit 2021-01-28T04:01:33.607590+0000 mon.a (mon.0) 1117 : audit [INF] from='client.? 172.21.15.100:0/3333977986' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:34.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:34 smithi100 bash[9834]: cluster 2021-01-28T04:01:33.608258+0000 mon.a (mon.0) 1118 : cluster [DBG] osdmap e135: 8 total, 8 up, 8 in 2021-01-28T04:01:34.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:34 smithi100 bash[9834]: audit 2021-01-28T04:01:33.610188+0000 mon.c (mon.1) 144 : audit [INF] from='client.? 172.21.15.100:0/2003394992' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:34.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:34 smithi100 bash[9834]: audit 2021-01-28T04:01:33.611265+0000 mon.c (mon.1) 145 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi100-32315-1","app":"app1","key":"key1"}]: dispatch 2021-01-28T04:01:34.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:34 smithi100 bash[9834]: audit 2021-01-28T04:01:33.614361+0000 mon.a (mon.0) 1119 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:34.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:34 smithi100 bash[9834]: audit 2021-01-28T04:01:33.615384+0000 mon.a (mon.0) 1120 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi100-32315-1","app":"app1","key":"key1"}]: dispatch 2021-01-28T04:01:34.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:34 smithi100 bash[13549]: audit 2021-01-28T04:01:33.122572+0000 mon.b (mon.2) 133 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:34.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:34 smithi100 bash[13549]: audit 2021-01-28T04:01:33.607280+0000 mon.a (mon.0) 1116 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test-rados-api-smithi100-32315-1","app":"app1","key":"key2","value":"value2"}]': finished 2021-01-28T04:01:34.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:34 smithi100 bash[13549]: audit 2021-01-28T04:01:33.607590+0000 mon.a (mon.0) 1117 : audit [INF] from='client.? 172.21.15.100:0/3333977986' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:34.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:34 smithi100 bash[13549]: cluster 2021-01-28T04:01:33.608258+0000 mon.a (mon.0) 1118 : cluster [DBG] osdmap e135: 8 total, 8 up, 8 in 2021-01-28T04:01:34.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:34 smithi100 bash[13549]: audit 2021-01-28T04:01:33.610188+0000 mon.c (mon.1) 144 : audit [INF] from='client.? 172.21.15.100:0/2003394992' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:34.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:34 smithi100 bash[13549]: audit 2021-01-28T04:01:33.611265+0000 mon.c (mon.1) 145 : audit [INF] from='client.? 172.21.15.100:0/4086931102' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi100-32315-1","app":"app1","key":"key1"}]: dispatch 2021-01-28T04:01:34.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:34 smithi100 bash[13549]: audit 2021-01-28T04:01:33.614361+0000 mon.a (mon.0) 1119 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:34.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:34 smithi100 bash[13549]: audit 2021-01-28T04:01:33.615384+0000 mon.a (mon.0) 1120 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi100-32315-1","app":"app1","key":"key1"}]: dispatch 2021-01-28T04:01:35.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:35 smithi162 bash[9856]: cluster 2021-01-28T04:01:33.552634+0000 mgr.y (mgr.14138) 557 : cluster [DBG] pgmap v452: 332 pgs: 15 creating+peering, 19 unknown, 298 active+clean; 216 MiB data, 878 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2021-01-28T04:01:35.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:35 smithi162 bash[9856]: audit 2021-01-28T04:01:34.125614+0000 mon.b (mon.2) 134 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:35.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:35 smithi162 bash[9856]: cluster 2021-01-28T04:01:34.528820+0000 mon.a (mon.0) 1121 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:01:35.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:35 smithi162 bash[9856]: audit 2021-01-28T04:01:34.605547+0000 mon.a (mon.0) 1122 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-22","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:35.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:35 smithi162 bash[9856]: audit 2021-01-28T04:01:34.605703+0000 mon.a (mon.0) 1123 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi100-32315-1","app":"app1","key":"key1"}]': finished 2021-01-28T04:01:35.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:35 smithi162 bash[9856]: cluster 2021-01-28T04:01:34.606010+0000 mon.a (mon.0) 1124 : cluster [DBG] osdmap e136: 8 total, 8 up, 8 in 2021-01-28T04:01:35.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:35 smithi100 bash[9834]: cluster 2021-01-28T04:01:33.552634+0000 mgr.y (mgr.14138) 557 : cluster [DBG] pgmap v452: 332 pgs: 15 creating+peering, 19 unknown, 298 active+clean; 216 MiB data, 878 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2021-01-28T04:01:35.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:35 smithi100 bash[9834]: audit 2021-01-28T04:01:34.125614+0000 mon.b (mon.2) 134 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:35.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:35 smithi100 bash[9834]: cluster 2021-01-28T04:01:34.528820+0000 mon.a (mon.0) 1121 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:01:35.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:35 smithi100 bash[9834]: audit 2021-01-28T04:01:34.605547+0000 mon.a (mon.0) 1122 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-22","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:35.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:35 smithi100 bash[9834]: audit 2021-01-28T04:01:34.605703+0000 mon.a (mon.0) 1123 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi100-32315-1","app":"app1","key":"key1"}]': finished 2021-01-28T04:01:35.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:35 smithi100 bash[9834]: cluster 2021-01-28T04:01:34.606010+0000 mon.a (mon.0) 1124 : cluster [DBG] osdmap e136: 8 total, 8 up, 8 in 2021-01-28T04:01:35.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:35 smithi100 bash[13549]: cluster 2021-01-28T04:01:33.552634+0000 mgr.y (mgr.14138) 557 : cluster [DBG] pgmap v452: 332 pgs: 15 creating+peering, 19 unknown, 298 active+clean; 216 MiB data, 878 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2021-01-28T04:01:35.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:35 smithi100 bash[13549]: audit 2021-01-28T04:01:34.125614+0000 mon.b (mon.2) 134 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:35.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:35 smithi100 bash[13549]: cluster 2021-01-28T04:01:34.528820+0000 mon.a (mon.0) 1121 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:01:35.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:35 smithi100 bash[13549]: audit 2021-01-28T04:01:34.605547+0000 mon.a (mon.0) 1122 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-22","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:35.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:35 smithi100 bash[13549]: audit 2021-01-28T04:01:34.605703+0000 mon.a (mon.0) 1123 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"test-rados-api-smithi100-32315-1","app":"app1","key":"key1"}]': finished 2021-01-28T04:01:35.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:35 smithi100 bash[13549]: cluster 2021-01-28T04:01:34.606010+0000 mon.a (mon.0) 1124 : cluster [DBG] osdmap e136: 8 total, 8 up, 8 in 2021-01-28T04:01:35.624 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [==========] Running 31 tests from 7 test suites. 2021-01-28T04:01:35.624 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [----------] Global test environment set-up. 2021-01-28T04:01:35.624 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion 2021-01-28T04:01:35.625 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ RUN ] LibRadosMiscVersion.VersionPP 2021-01-28T04:01:35.625 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2021-01-28T04:01:35.625 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2021-01-28T04:01:35.625 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: 2021-01-28T04:01:35.625 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP 2021-01-28T04:01:35.626 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: seed 32315 2021-01-28T04:01:35.626 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WaitOSDMapPP 2021-01-28T04:01:35.626 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WaitOSDMapPP (4 ms) 2021-01-28T04:01:35.626 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNamePP 2021-01-28T04:01:35.626 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNamePP (407 ms) 2021-01-28T04:01:35.627 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongLocatorPP 2021-01-28T04:01:35.627 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongLocatorPP (17 ms) 2021-01-28T04:01:35.627 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNSpacePP 2021-01-28T04:01:35.627 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNSpacePP (13 ms) 2021-01-28T04:01:35.628 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongAttrNamePP 2021-01-28T04:01:35.628 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongAttrNamePP (11 ms) 2021-01-28T04:01:35.628 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.ExecPP 2021-01-28T04:01:35.628 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.ExecPP (3 ms) 2021-01-28T04:01:35.628 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BadFlagsPP 2021-01-28T04:01:35.629 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BadFlagsPP (3 ms) 2021-01-28T04:01:35.629 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate1PP 2021-01-28T04:01:35.629 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate1PP (10 ms) 2021-01-28T04:01:35.629 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate2PP 2021-01-28T04:01:35.630 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate2PP (5 ms) 2021-01-28T04:01:35.630 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigObjectPP 2021-01-28T04:01:35.630 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigObjectPP (17 ms) 2021-01-28T04:01:35.630 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AioOperatePP 2021-01-28T04:01:35.631 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AioOperatePP (2 ms) 2021-01-28T04:01:35.631 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertExistsPP 2021-01-28T04:01:35.631 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertExistsPP (11 ms) 2021-01-28T04:01:35.631 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertVersionPP 2021-01-28T04:01:35.631 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertVersionPP (13 ms) 2021-01-28T04:01:35.632 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigAttrPP 2021-01-28T04:01:35.632 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: osd_max_attr_size = 0 2021-01-28T04:01:35.632 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: osd_max_attr_size == 0; skipping test 2021-01-28T04:01:35.632 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigAttrPP (3555 ms) 2021-01-28T04:01:35.632 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyPP 2021-01-28T04:01:35.633 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyPP (589 ms) 2021-01-28T04:01:35.633 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyScrubPP 2021-01-28T04:01:35.633 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: waiting for initial deep scrubs... 2021-01-28T04:01:35.633 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: done waiting, doing copies 2021-01-28T04:01:35.633 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: waiting for final deep scrubs... 2021-01-28T04:01:35.634 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: done waiting 2021-01-28T04:01:35.634 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyScrubPP (60883 ms) 2021-01-28T04:01:35.634 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WriteSamePP 2021-01-28T04:01:35.634 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WriteSamePP (11 ms) 2021-01-28T04:01:35.635 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CmpExtPP 2021-01-28T04:01:35.635 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CmpExtPP (6 ms) 2021-01-28T04:01:35.635 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Applications 2021-01-28T04:01:35.635 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Applications (4418 ms) 2021-01-28T04:01:35.635 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatOSD 2021-01-28T04:01:35.636 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2021-01-28T04:01:35.636 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatClient 2021-01-28T04:01:35.636 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2021-01-28T04:01:35.636 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Conf 2021-01-28T04:01:35.636 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Conf (0 ms) 2021-01-28T04:01:36.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:36 smithi162 bash[9856]: audit 2021-01-28T04:01:35.129427+0000 mon.b (mon.2) 135 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:36.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:36 smithi162 bash[9856]: cluster 2021-01-28T04:01:35.610973+0000 mon.a (mon.0) 1125 : cluster [DBG] osdmap e137: 8 total, 8 up, 8 in 2021-01-28T04:01:36.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:36 smithi162 bash[9856]: audit 2021-01-28T04:01:35.616296+0000 mon.c (mon.1) 146 : audit [INF] from='client.? 172.21.15.100:0/2004094804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:36.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:36 smithi162 bash[9856]: audit 2021-01-28T04:01:35.617120+0000 mon.a (mon.0) 1126 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:36.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:36 smithi162 bash[9856]: audit 2021-01-28T04:01:35.656139+0000 mon.c (mon.1) 147 : audit [INF] from='client.? 172.21.15.100:0/2981776383' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32315-24"}]: dispatch 2021-01-28T04:01:36.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:36 smithi162 bash[9856]: audit 2021-01-28T04:01:35.656940+0000 mon.a (mon.0) 1127 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32315-24"}]: dispatch 2021-01-28T04:01:36.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:36 smithi162 bash[9856]: audit 2021-01-28T04:01:35.659873+0000 mon.c (mon.1) 148 : audit [INF] from='client.? 172.21.15.100:0/2981776383' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32315-24"}]: dispatch 2021-01-28T04:01:36.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:36 smithi162 bash[9856]: audit 2021-01-28T04:01:35.660320+0000 mon.a (mon.0) 1128 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32315-24"}]: dispatch 2021-01-28T04:01:36.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:36 smithi162 bash[9856]: audit 2021-01-28T04:01:35.661095+0000 mon.c (mon.1) 149 : audit [INF] from='client.? 172.21.15.100:0/2981776383' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32315-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:36.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:36 smithi162 bash[9856]: audit 2021-01-28T04:01:35.661403+0000 mon.a (mon.0) 1129 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32315-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:36.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:36 smithi162 bash[9856]: audit 2021-01-28T04:01:36.094446+0000 mon.a (mon.0) 1130 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:01:36.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:36 smithi162 bash[9856]: audit 2021-01-28T04:01:36.094971+0000 mon.a (mon.0) 1131 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:01:36.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:36 smithi100 bash[9834]: audit 2021-01-28T04:01:35.129427+0000 mon.b (mon.2) 135 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:36.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:36 smithi100 bash[9834]: cluster 2021-01-28T04:01:35.610973+0000 mon.a (mon.0) 1125 : cluster [DBG] osdmap e137: 8 total, 8 up, 8 in 2021-01-28T04:01:36.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:36 smithi100 bash[9834]: audit 2021-01-28T04:01:35.616296+0000 mon.c (mon.1) 146 : audit [INF] from='client.? 172.21.15.100:0/2004094804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:36.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:36 smithi100 bash[9834]: audit 2021-01-28T04:01:35.617120+0000 mon.a (mon.0) 1126 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:36.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:36 smithi100 bash[9834]: audit 2021-01-28T04:01:35.656139+0000 mon.c (mon.1) 147 : audit [INF] from='client.? 172.21.15.100:0/2981776383' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32315-24"}]: dispatch 2021-01-28T04:01:36.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:36 smithi100 bash[9834]: audit 2021-01-28T04:01:35.656940+0000 mon.a (mon.0) 1127 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32315-24"}]: dispatch 2021-01-28T04:01:36.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:36 smithi100 bash[9834]: audit 2021-01-28T04:01:35.659873+0000 mon.c (mon.1) 148 : audit [INF] from='client.? 172.21.15.100:0/2981776383' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32315-24"}]: dispatch 2021-01-28T04:01:36.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:36 smithi100 bash[9834]: audit 2021-01-28T04:01:35.660320+0000 mon.a (mon.0) 1128 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32315-24"}]: dispatch 2021-01-28T04:01:36.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:36 smithi100 bash[9834]: audit 2021-01-28T04:01:35.661095+0000 mon.c (mon.1) 149 : audit [INF] from='client.? 172.21.15.100:0/2981776383' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32315-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:36.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:36 smithi100 bash[9834]: audit 2021-01-28T04:01:35.661403+0000 mon.a (mon.0) 1129 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32315-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:36.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:36 smithi100 bash[9834]: audit 2021-01-28T04:01:36.094446+0000 mon.a (mon.0) 1130 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:01:36.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:36 smithi100 bash[9834]: audit 2021-01-28T04:01:36.094971+0000 mon.a (mon.0) 1131 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:01:36.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:36 smithi100 bash[13549]: audit 2021-01-28T04:01:35.129427+0000 mon.b (mon.2) 135 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:36.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:36 smithi100 bash[13549]: cluster 2021-01-28T04:01:35.610973+0000 mon.a (mon.0) 1125 : cluster [DBG] osdmap e137: 8 total, 8 up, 8 in 2021-01-28T04:01:36.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:36 smithi100 bash[13549]: audit 2021-01-28T04:01:35.616296+0000 mon.c (mon.1) 146 : audit [INF] from='client.? 172.21.15.100:0/2004094804' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:36.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:36 smithi100 bash[13549]: audit 2021-01-28T04:01:35.617120+0000 mon.a (mon.0) 1126 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:36.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:36 smithi100 bash[13549]: audit 2021-01-28T04:01:35.656139+0000 mon.c (mon.1) 147 : audit [INF] from='client.? 172.21.15.100:0/2981776383' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32315-24"}]: dispatch 2021-01-28T04:01:36.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:36 smithi100 bash[13549]: audit 2021-01-28T04:01:35.656940+0000 mon.a (mon.0) 1127 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32315-24"}]: dispatch 2021-01-28T04:01:36.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:36 smithi100 bash[13549]: audit 2021-01-28T04:01:35.659873+0000 mon.c (mon.1) 148 : audit [INF] from='client.? 172.21.15.100:0/2981776383' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32315-24"}]: dispatch 2021-01-28T04:01:36.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:36 smithi100 bash[13549]: audit 2021-01-28T04:01:35.660320+0000 mon.a (mon.0) 1128 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32315-24"}]: dispatch 2021-01-28T04:01:36.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:36 smithi100 bash[13549]: audit 2021-01-28T04:01:35.661095+0000 mon.c (mon.1) 149 : audit [INF] from='client.? 172.21.15.100:0/2981776383' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32315-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:36.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:36 smithi100 bash[13549]: audit 2021-01-28T04:01:35.661403+0000 mon.a (mon.0) 1129 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32315-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:36.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:36 smithi100 bash[13549]: audit 2021-01-28T04:01:36.094446+0000 mon.a (mon.0) 1130 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:01:36.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:36 smithi100 bash[13549]: audit 2021-01-28T04:01:36.094971+0000 mon.a (mon.0) 1131 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:01:37.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:37 smithi162 bash[9856]: cluster 2021-01-28T04:01:35.553564+0000 mgr.y (mgr.14138) 558 : cluster [DBG] pgmap v455: 332 pgs: 2 creating+peering, 30 unknown, 300 active+clean; 216 MiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2021-01-28T04:01:37.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:37 smithi162 bash[9856]: audit 2021-01-28T04:01:36.131418+0000 mon.b (mon.2) 136 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:37.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:37 smithi162 bash[9856]: audit 2021-01-28T04:01:36.618293+0000 mon.a (mon.0) 1132 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-18","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:37.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:37 smithi162 bash[9856]: audit 2021-01-28T04:01:36.620482+0000 mon.a (mon.0) 1133 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32315-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:01:37.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:37 smithi162 bash[9856]: cluster 2021-01-28T04:01:36.620750+0000 mon.a (mon.0) 1134 : cluster [DBG] osdmap e138: 8 total, 8 up, 8 in 2021-01-28T04:01:37.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:37 smithi162 bash[9856]: audit 2021-01-28T04:01:36.629485+0000 mon.c (mon.1) 150 : audit [INF] from='client.? 172.21.15.100:0/2981776383' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32315-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32315-24"}]: dispatch 2021-01-28T04:01:37.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:37 smithi162 bash[9856]: audit 2021-01-28T04:01:36.630222+0000 mon.c (mon.1) 151 : audit [INF] from='client.? 172.21.15.100:0/3885607038' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:37.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:37 smithi162 bash[9856]: audit 2021-01-28T04:01:36.631573+0000 mon.a (mon.0) 1135 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32315-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32315-24"}]: dispatch 2021-01-28T04:01:37.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:37 smithi162 bash[9856]: audit 2021-01-28T04:01:36.632347+0000 mon.a (mon.0) 1136 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:37.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:37 smithi100 bash[9834]: cluster 2021-01-28T04:01:35.553564+0000 mgr.y (mgr.14138) 558 : cluster [DBG] pgmap v455: 332 pgs: 2 creating+peering, 30 unknown, 300 active+clean; 216 MiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2021-01-28T04:01:37.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:37 smithi100 bash[9834]: audit 2021-01-28T04:01:36.131418+0000 mon.b (mon.2) 136 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:37.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:37 smithi100 bash[9834]: audit 2021-01-28T04:01:36.618293+0000 mon.a (mon.0) 1132 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-18","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:37.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:37 smithi100 bash[9834]: audit 2021-01-28T04:01:36.620482+0000 mon.a (mon.0) 1133 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32315-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:01:37.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:37 smithi100 bash[9834]: cluster 2021-01-28T04:01:36.620750+0000 mon.a (mon.0) 1134 : cluster [DBG] osdmap e138: 8 total, 8 up, 8 in 2021-01-28T04:01:37.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:37 smithi100 bash[9834]: audit 2021-01-28T04:01:36.629485+0000 mon.c (mon.1) 150 : audit [INF] from='client.? 172.21.15.100:0/2981776383' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32315-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32315-24"}]: dispatch 2021-01-28T04:01:37.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:37 smithi100 bash[9834]: audit 2021-01-28T04:01:36.630222+0000 mon.c (mon.1) 151 : audit [INF] from='client.? 172.21.15.100:0/3885607038' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:37.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:37 smithi100 bash[9834]: audit 2021-01-28T04:01:36.631573+0000 mon.a (mon.0) 1135 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32315-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32315-24"}]: dispatch 2021-01-28T04:01:37.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:37 smithi100 bash[9834]: audit 2021-01-28T04:01:36.632347+0000 mon.a (mon.0) 1136 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:37.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:37 smithi100 bash[13549]: cluster 2021-01-28T04:01:35.553564+0000 mgr.y (mgr.14138) 558 : cluster [DBG] pgmap v455: 332 pgs: 2 creating+peering, 30 unknown, 300 active+clean; 216 MiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2021-01-28T04:01:37.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:37 smithi100 bash[13549]: audit 2021-01-28T04:01:36.131418+0000 mon.b (mon.2) 136 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:37.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:37 smithi100 bash[13549]: audit 2021-01-28T04:01:36.618293+0000 mon.a (mon.0) 1132 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-18","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:37.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:37 smithi100 bash[13549]: audit 2021-01-28T04:01:36.620482+0000 mon.a (mon.0) 1133 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32315-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:01:37.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:37 smithi100 bash[13549]: cluster 2021-01-28T04:01:36.620750+0000 mon.a (mon.0) 1134 : cluster [DBG] osdmap e138: 8 total, 8 up, 8 in 2021-01-28T04:01:37.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:37 smithi100 bash[13549]: audit 2021-01-28T04:01:36.629485+0000 mon.c (mon.1) 150 : audit [INF] from='client.? 172.21.15.100:0/2981776383' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32315-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32315-24"}]: dispatch 2021-01-28T04:01:37.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:37 smithi100 bash[13549]: audit 2021-01-28T04:01:36.630222+0000 mon.c (mon.1) 151 : audit [INF] from='client.? 172.21.15.100:0/3885607038' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:37.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:37 smithi100 bash[13549]: audit 2021-01-28T04:01:36.631573+0000 mon.a (mon.0) 1135 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32315-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32315-24"}]: dispatch 2021-01-28T04:01:37.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:37 smithi100 bash[13549]: audit 2021-01-28T04:01:36.632347+0000 mon.a (mon.0) 1136 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:38.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:38 smithi100 bash[9834]: audit 2021-01-28T04:01:37.133479+0000 mon.b (mon.2) 137 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:38.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:38 smithi100 bash[9834]: audit 2021-01-28T04:01:38.050838+0000 mon.a (mon.0) 1137 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-23","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:38.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:38 smithi100 bash[9834]: cluster 2021-01-28T04:01:38.051320+0000 mon.a (mon.0) 1138 : cluster [DBG] osdmap e139: 8 total, 8 up, 8 in 2021-01-28T04:01:38.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:38 smithi100 bash[13549]: audit 2021-01-28T04:01:37.133479+0000 mon.b (mon.2) 137 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:38.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:38 smithi100 bash[13549]: audit 2021-01-28T04:01:38.050838+0000 mon.a (mon.0) 1137 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-23","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:38.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:38 smithi100 bash[13549]: cluster 2021-01-28T04:01:38.051320+0000 mon.a (mon.0) 1138 : cluster [DBG] osdmap e139: 8 total, 8 up, 8 in 2021-01-28T04:01:39.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:38 smithi162 bash[9856]: audit 2021-01-28T04:01:37.133479+0000 mon.b (mon.2) 137 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:39.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:38 smithi162 bash[9856]: audit 2021-01-28T04:01:38.050838+0000 mon.a (mon.0) 1137 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-23","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:39.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:38 smithi162 bash[9856]: cluster 2021-01-28T04:01:38.051320+0000 mon.a (mon.0) 1138 : cluster [DBG] osdmap e139: 8 total, 8 up, 8 in 2021-01-28T04:01:39.771 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:39 smithi100 bash[13549]: cluster 2021-01-28T04:01:37.555226+0000 mgr.y (mgr.14138) 559 : cluster [DBG] pgmap v458: 332 pgs: 12 creating+peering, 41 unknown, 279 active+clean; 35 KiB data, 548 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:01:39.772 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:39 smithi100 bash[13549]: audit 2021-01-28T04:01:38.135270+0000 mon.b (mon.2) 138 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:39.772 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:39 smithi100 bash[13549]: audit 2021-01-28T04:01:38.535745+0000 mon.a (mon.0) 1139 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32315-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32315-24"}]': finished 2021-01-28T04:01:39.772 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:39 smithi100 bash[13549]: cluster 2021-01-28T04:01:38.536190+0000 mon.a (mon.0) 1140 : cluster [DBG] osdmap e140: 8 total, 8 up, 8 in 2021-01-28T04:01:39.773 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:39 smithi100 bash[13549]: audit 2021-01-28T04:01:38.537513+0000 mon.c (mon.1) 152 : audit [INF] from='client.? 172.21.15.100:0/3965779027' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32434-14"}]: dispatch 2021-01-28T04:01:39.773 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:39 smithi100 bash[13549]: audit 2021-01-28T04:01:38.548845+0000 mon.c (mon.1) 153 : audit [INF] from='client.? 172.21.15.100:0/2513147156' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:39.774 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:39 smithi100 bash[13549]: audit 2021-01-28T04:01:38.554012+0000 mon.a (mon.0) 1141 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32434-14"}]: dispatch 2021-01-28T04:01:39.774 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:39 smithi100 bash[13549]: audit 2021-01-28T04:01:38.992554+0000 mon.a (mon.0) 1142 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:39.775 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:39 smithi100 bash[13549]: audit 2021-01-28T04:01:39.137069+0000 mon.b (mon.2) 139 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:39.775 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:39 smithi100 bash[9834]: cluster 2021-01-28T04:01:37.555226+0000 mgr.y (mgr.14138) 559 : cluster [DBG] pgmap v458: 332 pgs: 12 creating+peering, 41 unknown, 279 active+clean; 35 KiB data, 548 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:01:39.776 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:39 smithi100 bash[9834]: audit 2021-01-28T04:01:38.135270+0000 mon.b (mon.2) 138 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:39.776 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:39 smithi100 bash[9834]: audit 2021-01-28T04:01:38.535745+0000 mon.a (mon.0) 1139 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32315-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32315-24"}]': finished 2021-01-28T04:01:39.776 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:39 smithi100 bash[9834]: cluster 2021-01-28T04:01:38.536190+0000 mon.a (mon.0) 1140 : cluster [DBG] osdmap e140: 8 total, 8 up, 8 in 2021-01-28T04:01:39.777 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:39 smithi100 bash[9834]: audit 2021-01-28T04:01:38.537513+0000 mon.c (mon.1) 152 : audit [INF] from='client.? 172.21.15.100:0/3965779027' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32434-14"}]: dispatch 2021-01-28T04:01:39.777 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:39 smithi100 bash[9834]: audit 2021-01-28T04:01:38.548845+0000 mon.c (mon.1) 153 : audit [INF] from='client.? 172.21.15.100:0/2513147156' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:39.778 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:39 smithi100 bash[9834]: audit 2021-01-28T04:01:38.554012+0000 mon.a (mon.0) 1141 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32434-14"}]: dispatch 2021-01-28T04:01:39.778 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:39 smithi100 bash[9834]: audit 2021-01-28T04:01:38.992554+0000 mon.a (mon.0) 1142 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:39.779 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:39 smithi100 bash[9834]: audit 2021-01-28T04:01:39.137069+0000 mon.b (mon.2) 139 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:40.012 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 04:01:39 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T04:01:40.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:39 smithi162 bash[9856]: cluster 2021-01-28T04:01:37.555226+0000 mgr.y (mgr.14138) 559 : cluster [DBG] pgmap v458: 332 pgs: 12 creating+peering, 41 unknown, 279 active+clean; 35 KiB data, 548 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:01:40.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:39 smithi162 bash[9856]: audit 2021-01-28T04:01:38.135270+0000 mon.b (mon.2) 138 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:40.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:39 smithi162 bash[9856]: audit 2021-01-28T04:01:38.535745+0000 mon.a (mon.0) 1139 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32315-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32315-24"}]': finished 2021-01-28T04:01:40.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:39 smithi162 bash[9856]: cluster 2021-01-28T04:01:38.536190+0000 mon.a (mon.0) 1140 : cluster [DBG] osdmap e140: 8 total, 8 up, 8 in 2021-01-28T04:01:40.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:39 smithi162 bash[9856]: audit 2021-01-28T04:01:38.537513+0000 mon.c (mon.1) 152 : audit [INF] from='client.? 172.21.15.100:0/3965779027' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32434-14"}]: dispatch 2021-01-28T04:01:40.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:39 smithi162 bash[9856]: audit 2021-01-28T04:01:38.548845+0000 mon.c (mon.1) 153 : audit [INF] from='client.? 172.21.15.100:0/2513147156' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:40.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:39 smithi162 bash[9856]: audit 2021-01-28T04:01:38.554012+0000 mon.a (mon.0) 1141 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32434-14"}]: dispatch 2021-01-28T04:01:40.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:39 smithi162 bash[9856]: audit 2021-01-28T04:01:38.992554+0000 mon.a (mon.0) 1142 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:40.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:39 smithi162 bash[9856]: audit 2021-01-28T04:01:39.137069+0000 mon.b (mon.2) 139 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:40.077 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 04:01:39 smithi100 bash[10061]: debug 2021-01-28T04:01:39.766+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:01:40.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:40 smithi100 bash[9834]: audit 2021-01-28T04:01:39.535964+0000 mon.a (mon.0) 1143 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32434-14"}]': finished 2021-01-28T04:01:40.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:40 smithi100 bash[9834]: audit 2021-01-28T04:01:39.536203+0000 mon.a (mon.0) 1144 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-19","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:40.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:40 smithi100 bash[9834]: cluster 2021-01-28T04:01:39.536380+0000 mon.a (mon.0) 1145 : cluster [DBG] osdmap e141: 8 total, 8 up, 8 in 2021-01-28T04:01:40.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:40 smithi100 bash[9834]: audit 2021-01-28T04:01:39.537769+0000 mon.c (mon.1) 154 : audit [INF] from='client.? 172.21.15.100:0/3965779027' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32434-14"}]: dispatch 2021-01-28T04:01:40.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:40 smithi100 bash[9834]: audit 2021-01-28T04:01:39.538437+0000 mon.c (mon.1) 155 : audit [INF] from='client.? 172.21.15.100:0/2981776383' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:40.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:40 smithi100 bash[9834]: audit 2021-01-28T04:01:39.547033+0000 mon.c (mon.1) 156 : audit [INF] from='client.? 172.21.15.100:0/4139992538' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:40.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:40 smithi100 bash[9834]: audit 2021-01-28T04:01:39.550279+0000 mon.a (mon.0) 1146 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32434-14"}]: dispatch 2021-01-28T04:01:40.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:40 smithi100 bash[9834]: audit 2021-01-28T04:01:39.550676+0000 mon.a (mon.0) 1147 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:40.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:40 smithi100 bash[9834]: audit 2021-01-28T04:01:39.551137+0000 mon.a (mon.0) 1148 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:40.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:40 smithi100 bash[9834]: audit 2021-01-28T04:01:40.138945+0000 mon.b (mon.2) 140 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:40.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:40 smithi100 bash[13549]: audit 2021-01-28T04:01:39.535964+0000 mon.a (mon.0) 1143 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32434-14"}]': finished 2021-01-28T04:01:40.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:40 smithi100 bash[13549]: audit 2021-01-28T04:01:39.536203+0000 mon.a (mon.0) 1144 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-19","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:40.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:40 smithi100 bash[13549]: cluster 2021-01-28T04:01:39.536380+0000 mon.a (mon.0) 1145 : cluster [DBG] osdmap e141: 8 total, 8 up, 8 in 2021-01-28T04:01:40.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:40 smithi100 bash[13549]: audit 2021-01-28T04:01:39.537769+0000 mon.c (mon.1) 154 : audit [INF] from='client.? 172.21.15.100:0/3965779027' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32434-14"}]: dispatch 2021-01-28T04:01:40.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:40 smithi100 bash[13549]: audit 2021-01-28T04:01:39.538437+0000 mon.c (mon.1) 155 : audit [INF] from='client.? 172.21.15.100:0/2981776383' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:40.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:40 smithi100 bash[13549]: audit 2021-01-28T04:01:39.547033+0000 mon.c (mon.1) 156 : audit [INF] from='client.? 172.21.15.100:0/4139992538' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:40.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:40 smithi100 bash[13549]: audit 2021-01-28T04:01:39.550279+0000 mon.a (mon.0) 1146 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32434-14"}]: dispatch 2021-01-28T04:01:40.834 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:40 smithi100 bash[13549]: audit 2021-01-28T04:01:39.550676+0000 mon.a (mon.0) 1147 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:40.834 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:40 smithi100 bash[13549]: audit 2021-01-28T04:01:39.551137+0000 mon.a (mon.0) 1148 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:40.834 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:40 smithi100 bash[13549]: audit 2021-01-28T04:01:40.138945+0000 mon.b (mon.2) 140 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:41.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:40 smithi162 bash[9856]: audit 2021-01-28T04:01:39.535964+0000 mon.a (mon.0) 1143 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32434-14"}]': finished 2021-01-28T04:01:41.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:40 smithi162 bash[9856]: audit 2021-01-28T04:01:39.536203+0000 mon.a (mon.0) 1144 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-19","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:41.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:40 smithi162 bash[9856]: cluster 2021-01-28T04:01:39.536380+0000 mon.a (mon.0) 1145 : cluster [DBG] osdmap e141: 8 total, 8 up, 8 in 2021-01-28T04:01:41.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:40 smithi162 bash[9856]: audit 2021-01-28T04:01:39.537769+0000 mon.c (mon.1) 154 : audit [INF] from='client.? 172.21.15.100:0/3965779027' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32434-14"}]: dispatch 2021-01-28T04:01:41.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:40 smithi162 bash[9856]: audit 2021-01-28T04:01:39.538437+0000 mon.c (mon.1) 155 : audit [INF] from='client.? 172.21.15.100:0/2981776383' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:41.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:40 smithi162 bash[9856]: audit 2021-01-28T04:01:39.547033+0000 mon.c (mon.1) 156 : audit [INF] from='client.? 172.21.15.100:0/4139992538' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:41.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:40 smithi162 bash[9856]: audit 2021-01-28T04:01:39.550279+0000 mon.a (mon.0) 1146 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32434-14"}]: dispatch 2021-01-28T04:01:41.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:40 smithi162 bash[9856]: audit 2021-01-28T04:01:39.550676+0000 mon.a (mon.0) 1147 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:41.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:40 smithi162 bash[9856]: audit 2021-01-28T04:01:39.551137+0000 mon.a (mon.0) 1148 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:41.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:40 smithi162 bash[9856]: audit 2021-01-28T04:01:40.138945+0000 mon.b (mon.2) 140 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:42.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:41 smithi162 bash[9856]: cluster 2021-01-28T04:01:39.555919+0000 mgr.y (mgr.14138) 560 : cluster [DBG] pgmap v462: 364 pgs: 14 creating+peering, 90 unknown, 260 active+clean; 35 KiB data, 318 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2021-01-28T04:01:42.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:41 smithi162 bash[9856]: audit 2021-01-28T04:01:39.769599+0000 mgr.y (mgr.14138) 561 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:01:42.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:41 smithi162 bash[9856]: cluster 2021-01-28T04:01:40.535602+0000 mon.a (mon.0) 1149 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:01:42.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:41 smithi162 bash[9856]: audit 2021-01-28T04:01:40.545225+0000 mon.a (mon.0) 1150 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32434-14"}]': finished 2021-01-28T04:01:42.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:41 smithi162 bash[9856]: audit 2021-01-28T04:01:40.545537+0000 mon.a (mon.0) 1151 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-24","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:42.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:41 smithi162 bash[9856]: audit 2021-01-28T04:01:40.545697+0000 mon.a (mon.0) 1152 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-24","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:42.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:41 smithi162 bash[9856]: cluster 2021-01-28T04:01:40.545906+0000 mon.a (mon.0) 1153 : cluster [DBG] osdmap e142: 8 total, 8 up, 8 in 2021-01-28T04:01:42.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:41 smithi162 bash[9856]: audit 2021-01-28T04:01:40.580223+0000 mon.c (mon.1) 157 : audit [INF] from='client.? 172.21.15.100:0/2981776383' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:42.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:41 smithi162 bash[9856]: audit 2021-01-28T04:01:40.580753+0000 mon.a (mon.0) 1154 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:42.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:41 smithi162 bash[9856]: audit 2021-01-28T04:01:40.621439+0000 mon.c (mon.1) 158 : audit [INF] from='client.? 172.21.15.100:0/1998200160' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32434-19"}]: dispatch 2021-01-28T04:01:42.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:41 smithi162 bash[9856]: audit 2021-01-28T04:01:41.025092+0000 mon.a (mon.0) 1155 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32434-19"}]: dispatch 2021-01-28T04:01:42.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:41 smithi162 bash[9856]: audit 2021-01-28T04:01:41.026053+0000 mon.c (mon.1) 159 : audit [INF] from='client.? 172.21.15.100:0/1998200160' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32434-19"}]: dispatch 2021-01-28T04:01:42.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:41 smithi162 bash[9856]: audit 2021-01-28T04:01:41.027828+0000 mon.a (mon.0) 1156 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32434-19"}]: dispatch 2021-01-28T04:01:42.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:41 smithi162 bash[9856]: audit 2021-01-28T04:01:41.028358+0000 mon.c (mon.1) 160 : audit [INF] from='client.? 172.21.15.100:0/1998200160' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32434-19", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:42.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:41 smithi162 bash[9856]: audit 2021-01-28T04:01:41.028685+0000 mon.a (mon.0) 1157 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32434-19", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:42.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:41 smithi162 bash[9856]: audit 2021-01-28T04:01:41.140881+0000 mon.b (mon.2) 141 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:42.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:41 smithi100 bash[9834]: cluster 2021-01-28T04:01:39.555919+0000 mgr.y (mgr.14138) 560 : cluster [DBG] pgmap v462: 364 pgs: 14 creating+peering, 90 unknown, 260 active+clean; 35 KiB data, 318 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2021-01-28T04:01:42.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:41 smithi100 bash[9834]: audit 2021-01-28T04:01:39.769599+0000 mgr.y (mgr.14138) 561 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:01:42.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:41 smithi100 bash[9834]: cluster 2021-01-28T04:01:40.535602+0000 mon.a (mon.0) 1149 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:01:42.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:41 smithi100 bash[9834]: audit 2021-01-28T04:01:40.545225+0000 mon.a (mon.0) 1150 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32434-14"}]': finished 2021-01-28T04:01:42.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:41 smithi100 bash[9834]: audit 2021-01-28T04:01:40.545537+0000 mon.a (mon.0) 1151 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-24","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:42.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:41 smithi100 bash[9834]: audit 2021-01-28T04:01:40.545697+0000 mon.a (mon.0) 1152 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-24","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:42.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:41 smithi100 bash[9834]: cluster 2021-01-28T04:01:40.545906+0000 mon.a (mon.0) 1153 : cluster [DBG] osdmap e142: 8 total, 8 up, 8 in 2021-01-28T04:01:42.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:41 smithi100 bash[9834]: audit 2021-01-28T04:01:40.580223+0000 mon.c (mon.1) 157 : audit [INF] from='client.? 172.21.15.100:0/2981776383' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:42.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:41 smithi100 bash[9834]: audit 2021-01-28T04:01:40.580753+0000 mon.a (mon.0) 1154 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:42.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:41 smithi100 bash[9834]: audit 2021-01-28T04:01:40.621439+0000 mon.c (mon.1) 158 : audit [INF] from='client.? 172.21.15.100:0/1998200160' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32434-19"}]: dispatch 2021-01-28T04:01:42.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:41 smithi100 bash[9834]: audit 2021-01-28T04:01:41.025092+0000 mon.a (mon.0) 1155 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32434-19"}]: dispatch 2021-01-28T04:01:42.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:41 smithi100 bash[9834]: audit 2021-01-28T04:01:41.026053+0000 mon.c (mon.1) 159 : audit [INF] from='client.? 172.21.15.100:0/1998200160' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32434-19"}]: dispatch 2021-01-28T04:01:42.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:41 smithi100 bash[9834]: audit 2021-01-28T04:01:41.027828+0000 mon.a (mon.0) 1156 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32434-19"}]: dispatch 2021-01-28T04:01:42.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:41 smithi100 bash[9834]: audit 2021-01-28T04:01:41.028358+0000 mon.c (mon.1) 160 : audit [INF] from='client.? 172.21.15.100:0/1998200160' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32434-19", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:42.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:41 smithi100 bash[9834]: audit 2021-01-28T04:01:41.028685+0000 mon.a (mon.0) 1157 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32434-19", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:42.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:41 smithi100 bash[9834]: audit 2021-01-28T04:01:41.140881+0000 mon.b (mon.2) 141 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:42.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:41 smithi100 bash[13549]: cluster 2021-01-28T04:01:39.555919+0000 mgr.y (mgr.14138) 560 : cluster [DBG] pgmap v462: 364 pgs: 14 creating+peering, 90 unknown, 260 active+clean; 35 KiB data, 318 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2021-01-28T04:01:42.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:41 smithi100 bash[13549]: audit 2021-01-28T04:01:39.769599+0000 mgr.y (mgr.14138) 561 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:01:42.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:41 smithi100 bash[13549]: cluster 2021-01-28T04:01:40.535602+0000 mon.a (mon.0) 1149 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:01:42.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:41 smithi100 bash[13549]: audit 2021-01-28T04:01:40.545225+0000 mon.a (mon.0) 1150 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32434-14"}]': finished 2021-01-28T04:01:42.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:41 smithi100 bash[13549]: audit 2021-01-28T04:01:40.545537+0000 mon.a (mon.0) 1151 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-24","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:42.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:41 smithi100 bash[13549]: audit 2021-01-28T04:01:40.545697+0000 mon.a (mon.0) 1152 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32155-24","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:42.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:41 smithi100 bash[13549]: cluster 2021-01-28T04:01:40.545906+0000 mon.a (mon.0) 1153 : cluster [DBG] osdmap e142: 8 total, 8 up, 8 in 2021-01-28T04:01:42.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:41 smithi100 bash[13549]: audit 2021-01-28T04:01:40.580223+0000 mon.c (mon.1) 157 : audit [INF] from='client.? 172.21.15.100:0/2981776383' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:42.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:41 smithi100 bash[13549]: audit 2021-01-28T04:01:40.580753+0000 mon.a (mon.0) 1154 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:42.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:41 smithi100 bash[13549]: audit 2021-01-28T04:01:40.621439+0000 mon.c (mon.1) 158 : audit [INF] from='client.? 172.21.15.100:0/1998200160' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32434-19"}]: dispatch 2021-01-28T04:01:42.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:41 smithi100 bash[13549]: audit 2021-01-28T04:01:41.025092+0000 mon.a (mon.0) 1155 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32434-19"}]: dispatch 2021-01-28T04:01:42.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:41 smithi100 bash[13549]: audit 2021-01-28T04:01:41.026053+0000 mon.c (mon.1) 159 : audit [INF] from='client.? 172.21.15.100:0/1998200160' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32434-19"}]: dispatch 2021-01-28T04:01:42.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:41 smithi100 bash[13549]: audit 2021-01-28T04:01:41.027828+0000 mon.a (mon.0) 1156 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32434-19"}]: dispatch 2021-01-28T04:01:42.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:41 smithi100 bash[13549]: audit 2021-01-28T04:01:41.028358+0000 mon.c (mon.1) 160 : audit [INF] from='client.? 172.21.15.100:0/1998200160' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32434-19", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:42.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:41 smithi100 bash[13549]: audit 2021-01-28T04:01:41.028685+0000 mon.a (mon.0) 1157 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32434-19", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:42.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:41 smithi100 bash[13549]: audit 2021-01-28T04:01:41.140881+0000 mon.b (mon.2) 141 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:43.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:43 smithi162 bash[9856]: cluster 2021-01-28T04:01:41.557206+0000 mgr.y (mgr.14138) 562 : cluster [DBG] pgmap v464: 332 pgs: 3 creating+peering, 62 unknown, 267 active+clean; 35 KiB data, 247 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:01:43.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:43 smithi162 bash[9856]: audit 2021-01-28T04:01:41.564398+0000 mon.a (mon.0) 1158 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-25","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:43.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:43 smithi162 bash[9856]: audit 2021-01-28T04:01:41.564779+0000 mon.a (mon.0) 1159 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32434-19", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:01:43.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:43 smithi162 bash[9856]: cluster 2021-01-28T04:01:41.564997+0000 mon.a (mon.0) 1160 : cluster [DBG] osdmap e143: 8 total, 8 up, 8 in 2021-01-28T04:01:43.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:43 smithi162 bash[9856]: audit 2021-01-28T04:01:41.568372+0000 mon.c (mon.1) 161 : audit [INF] from='client.? 172.21.15.100:0/1998200160' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32434-19", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32434-19"}]: dispatch 2021-01-28T04:01:43.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:43 smithi162 bash[9856]: audit 2021-01-28T04:01:41.570217+0000 mon.c (mon.1) 162 : audit [INF] from='client.? 172.21.15.100:0/2867074795' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:43.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:43 smithi162 bash[9856]: audit 2021-01-28T04:01:41.598277+0000 mon.a (mon.0) 1161 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32434-19", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32434-19"}]: dispatch 2021-01-28T04:01:43.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:43 smithi162 bash[9856]: audit 2021-01-28T04:01:41.599157+0000 mon.a (mon.0) 1162 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:43.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:43 smithi162 bash[9856]: audit 2021-01-28T04:01:41.607229+0000 mon.c (mon.1) 163 : audit [INF] from='client.? 172.21.15.100:0/3541219689' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-25"}]: dispatch 2021-01-28T04:01:43.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:43 smithi162 bash[9856]: audit 2021-01-28T04:01:41.607770+0000 mon.a (mon.0) 1163 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-25"}]: dispatch 2021-01-28T04:01:43.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:43 smithi162 bash[9856]: audit 2021-01-28T04:01:41.608669+0000 mon.c (mon.1) 164 : audit [INF] from='client.? 172.21.15.100:0/3541219689' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-25"}]: dispatch 2021-01-28T04:01:43.266 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:43 smithi162 bash[9856]: audit 2021-01-28T04:01:41.609058+0000 mon.a (mon.0) 1164 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-25"}]: dispatch 2021-01-28T04:01:43.266 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:43 smithi162 bash[9856]: audit 2021-01-28T04:01:41.609556+0000 mon.c (mon.1) 165 : audit [INF] from='client.? 172.21.15.100:0/3541219689' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-25", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:43.266 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:43 smithi162 bash[9856]: audit 2021-01-28T04:01:41.609851+0000 mon.a (mon.0) 1165 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-25", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:43.266 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:43 smithi162 bash[9856]: audit 2021-01-28T04:01:42.142781+0000 mon.b (mon.2) 142 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:43.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:42 smithi100 bash[9834]: cluster 2021-01-28T04:01:41.557206+0000 mgr.y (mgr.14138) 562 : cluster [DBG] pgmap v464: 332 pgs: 3 creating+peering, 62 unknown, 267 active+clean; 35 KiB data, 247 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:01:43.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:43 smithi100 bash[9834]: audit 2021-01-28T04:01:41.564398+0000 mon.a (mon.0) 1158 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-25","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:43.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:43 smithi100 bash[9834]: audit 2021-01-28T04:01:41.564779+0000 mon.a (mon.0) 1159 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32434-19", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:01:43.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:43 smithi100 bash[9834]: cluster 2021-01-28T04:01:41.564997+0000 mon.a (mon.0) 1160 : cluster [DBG] osdmap e143: 8 total, 8 up, 8 in 2021-01-28T04:01:43.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:43 smithi100 bash[9834]: audit 2021-01-28T04:01:41.568372+0000 mon.c (mon.1) 161 : audit [INF] from='client.? 172.21.15.100:0/1998200160' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32434-19", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32434-19"}]: dispatch 2021-01-28T04:01:43.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:43 smithi100 bash[9834]: audit 2021-01-28T04:01:41.570217+0000 mon.c (mon.1) 162 : audit [INF] from='client.? 172.21.15.100:0/2867074795' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:43.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:43 smithi100 bash[9834]: audit 2021-01-28T04:01:41.598277+0000 mon.a (mon.0) 1161 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32434-19", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32434-19"}]: dispatch 2021-01-28T04:01:43.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:43 smithi100 bash[9834]: audit 2021-01-28T04:01:41.599157+0000 mon.a (mon.0) 1162 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:43.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:43 smithi100 bash[9834]: audit 2021-01-28T04:01:41.607229+0000 mon.c (mon.1) 163 : audit [INF] from='client.? 172.21.15.100:0/3541219689' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-25"}]: dispatch 2021-01-28T04:01:43.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:43 smithi100 bash[9834]: audit 2021-01-28T04:01:41.607770+0000 mon.a (mon.0) 1163 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-25"}]: dispatch 2021-01-28T04:01:43.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:43 smithi100 bash[9834]: audit 2021-01-28T04:01:41.608669+0000 mon.c (mon.1) 164 : audit [INF] from='client.? 172.21.15.100:0/3541219689' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-25"}]: dispatch 2021-01-28T04:01:43.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:43 smithi100 bash[9834]: audit 2021-01-28T04:01:41.609058+0000 mon.a (mon.0) 1164 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-25"}]: dispatch 2021-01-28T04:01:43.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:43 smithi100 bash[9834]: audit 2021-01-28T04:01:41.609556+0000 mon.c (mon.1) 165 : audit [INF] from='client.? 172.21.15.100:0/3541219689' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-25", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:43.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:43 smithi100 bash[9834]: audit 2021-01-28T04:01:41.609851+0000 mon.a (mon.0) 1165 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-25", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:43.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:43 smithi100 bash[9834]: audit 2021-01-28T04:01:42.142781+0000 mon.b (mon.2) 142 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:43.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:43 smithi100 bash[13549]: cluster 2021-01-28T04:01:41.557206+0000 mgr.y (mgr.14138) 562 : cluster [DBG] pgmap v464: 332 pgs: 3 creating+peering, 62 unknown, 267 active+clean; 35 KiB data, 247 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:01:43.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:43 smithi100 bash[13549]: audit 2021-01-28T04:01:41.564398+0000 mon.a (mon.0) 1158 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-25","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:43.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:43 smithi100 bash[13549]: audit 2021-01-28T04:01:41.564779+0000 mon.a (mon.0) 1159 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32434-19", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:01:43.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:43 smithi100 bash[13549]: cluster 2021-01-28T04:01:41.564997+0000 mon.a (mon.0) 1160 : cluster [DBG] osdmap e143: 8 total, 8 up, 8 in 2021-01-28T04:01:43.334 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:43 smithi100 bash[13549]: audit 2021-01-28T04:01:41.568372+0000 mon.c (mon.1) 161 : audit [INF] from='client.? 172.21.15.100:0/1998200160' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32434-19", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32434-19"}]: dispatch 2021-01-28T04:01:43.334 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:43 smithi100 bash[13549]: audit 2021-01-28T04:01:41.570217+0000 mon.c (mon.1) 162 : audit [INF] from='client.? 172.21.15.100:0/2867074795' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:43.334 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:43 smithi100 bash[13549]: audit 2021-01-28T04:01:41.598277+0000 mon.a (mon.0) 1161 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32434-19", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32434-19"}]: dispatch 2021-01-28T04:01:43.335 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:43 smithi100 bash[13549]: audit 2021-01-28T04:01:41.599157+0000 mon.a (mon.0) 1162 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:43.335 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:43 smithi100 bash[13549]: audit 2021-01-28T04:01:41.607229+0000 mon.c (mon.1) 163 : audit [INF] from='client.? 172.21.15.100:0/3541219689' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-25"}]: dispatch 2021-01-28T04:01:43.336 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:43 smithi100 bash[13549]: audit 2021-01-28T04:01:41.607770+0000 mon.a (mon.0) 1163 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-25"}]: dispatch 2021-01-28T04:01:43.336 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:43 smithi100 bash[13549]: audit 2021-01-28T04:01:41.608669+0000 mon.c (mon.1) 164 : audit [INF] from='client.? 172.21.15.100:0/3541219689' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-25"}]: dispatch 2021-01-28T04:01:43.336 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:43 smithi100 bash[13549]: audit 2021-01-28T04:01:41.609058+0000 mon.a (mon.0) 1164 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-25"}]: dispatch 2021-01-28T04:01:43.337 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:43 smithi100 bash[13549]: audit 2021-01-28T04:01:41.609556+0000 mon.c (mon.1) 165 : audit [INF] from='client.? 172.21.15.100:0/3541219689' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-25", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:43.337 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:43 smithi100 bash[13549]: audit 2021-01-28T04:01:41.609851+0000 mon.a (mon.0) 1165 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-25", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:43.338 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:43 smithi100 bash[13549]: audit 2021-01-28T04:01:42.142781+0000 mon.b (mon.2) 142 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:44.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:44 smithi100 bash[9834]: audit 2021-01-28T04:01:42.995979+0000 mon.a (mon.0) 1166 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-20","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:44.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:44 smithi100 bash[9834]: audit 2021-01-28T04:01:42.996209+0000 mon.a (mon.0) 1167 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-25", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:01:44.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:44 smithi100 bash[9834]: cluster 2021-01-28T04:01:42.996354+0000 mon.a (mon.0) 1168 : cluster [DBG] osdmap e144: 8 total, 8 up, 8 in 2021-01-28T04:01:44.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:44 smithi100 bash[9834]: audit 2021-01-28T04:01:42.997196+0000 mon.c (mon.1) 166 : audit [INF] from='client.? 172.21.15.100:0/3541219689' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-25", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-25"}]: dispatch 2021-01-28T04:01:44.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:44 smithi100 bash[9834]: audit 2021-01-28T04:01:43.007546+0000 mon.a (mon.0) 1169 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-25", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-25"}]: dispatch 2021-01-28T04:01:44.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:44 smithi100 bash[9834]: audit 2021-01-28T04:01:43.144793+0000 mon.b (mon.2) 143 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:44.329 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:44 smithi100 bash[13549]: audit 2021-01-28T04:01:42.995979+0000 mon.a (mon.0) 1166 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-20","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:44.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:44 smithi100 bash[13549]: audit 2021-01-28T04:01:42.996209+0000 mon.a (mon.0) 1167 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-25", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:01:44.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:44 smithi100 bash[13549]: cluster 2021-01-28T04:01:42.996354+0000 mon.a (mon.0) 1168 : cluster [DBG] osdmap e144: 8 total, 8 up, 8 in 2021-01-28T04:01:44.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:44 smithi100 bash[13549]: audit 2021-01-28T04:01:42.997196+0000 mon.c (mon.1) 166 : audit [INF] from='client.? 172.21.15.100:0/3541219689' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-25", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-25"}]: dispatch 2021-01-28T04:01:44.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:44 smithi100 bash[13549]: audit 2021-01-28T04:01:43.007546+0000 mon.a (mon.0) 1169 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-25", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-25"}]: dispatch 2021-01-28T04:01:44.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:44 smithi100 bash[13549]: audit 2021-01-28T04:01:43.144793+0000 mon.b (mon.2) 143 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:44.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:44 smithi162 bash[9856]: audit 2021-01-28T04:01:42.995979+0000 mon.a (mon.0) 1166 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-20","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:44.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:44 smithi162 bash[9856]: audit 2021-01-28T04:01:42.996209+0000 mon.a (mon.0) 1167 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-25", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:01:44.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:44 smithi162 bash[9856]: cluster 2021-01-28T04:01:42.996354+0000 mon.a (mon.0) 1168 : cluster [DBG] osdmap e144: 8 total, 8 up, 8 in 2021-01-28T04:01:44.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:44 smithi162 bash[9856]: audit 2021-01-28T04:01:42.997196+0000 mon.c (mon.1) 166 : audit [INF] from='client.? 172.21.15.100:0/3541219689' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-25", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-25"}]: dispatch 2021-01-28T04:01:44.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:44 smithi162 bash[9856]: audit 2021-01-28T04:01:43.007546+0000 mon.a (mon.0) 1169 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-25", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-25"}]: dispatch 2021-01-28T04:01:44.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:44 smithi162 bash[9856]: audit 2021-01-28T04:01:43.144793+0000 mon.b (mon.2) 143 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:45.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:45 smithi100 bash[9834]: cluster 2021-01-28T04:01:43.558770+0000 mgr.y (mgr.14138) 563 : cluster [DBG] pgmap v467: 300 pgs: 3 creating+activating, 13 creating+peering, 13 unknown, 271 active+clean; 35 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:01:45.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:45 smithi100 bash[9834]: audit 2021-01-28T04:01:43.580459+0000 mon.a (mon.0) 1170 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32434-19", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32434-19"}]': finished 2021-01-28T04:01:45.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:45 smithi100 bash[9834]: cluster 2021-01-28T04:01:44.006346+0000 mon.a (mon.0) 1171 : cluster [DBG] osdmap e145: 8 total, 8 up, 8 in 2021-01-28T04:01:45.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:45 smithi100 bash[9834]: audit 2021-01-28T04:01:44.008739+0000 mon.c (mon.1) 167 : audit [INF] from='client.? 172.21.15.100:0/2981776383' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32315-24"}]: dispatch 2021-01-28T04:01:45.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:45 smithi100 bash[9834]: audit 2021-01-28T04:01:44.017101+0000 mon.a (mon.0) 1172 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32315-24"}]: dispatch 2021-01-28T04:01:45.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:45 smithi100 bash[9834]: audit 2021-01-28T04:01:44.146662+0000 mon.b (mon.2) 144 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:45.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:45 smithi100 bash[9834]: audit 2021-01-28T04:01:44.583825+0000 mon.a (mon.0) 1173 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-25", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-25"}]': finished 2021-01-28T04:01:45.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:45 smithi100 bash[9834]: audit 2021-01-28T04:01:44.584399+0000 mon.a (mon.0) 1174 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32315-24"}]': finished 2021-01-28T04:01:45.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:45 smithi100 bash[9834]: cluster 2021-01-28T04:01:44.584732+0000 mon.a (mon.0) 1175 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2021-01-28T04:01:45.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:45 smithi100 bash[9834]: audit 2021-01-28T04:01:44.589972+0000 mon.c (mon.1) 168 : audit [INF] from='client.? 172.21.15.100:0/2981776383' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32315-24"}]: dispatch 2021-01-28T04:01:45.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:45 smithi100 bash[9834]: audit 2021-01-28T04:01:44.591513+0000 mon.c (mon.1) 169 : audit [INF] from='client.? 172.21.15.100:0/2084323255' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:45.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:45 smithi100 bash[9834]: audit 2021-01-28T04:01:44.600966+0000 mon.a (mon.0) 1176 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32315-24"}]: dispatch 2021-01-28T04:01:45.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:45 smithi100 bash[9834]: audit 2021-01-28T04:01:44.601883+0000 mon.a (mon.0) 1177 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:45.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:45 smithi100 bash[13549]: cluster 2021-01-28T04:01:43.558770+0000 mgr.y (mgr.14138) 563 : cluster [DBG] pgmap v467: 300 pgs: 3 creating+activating, 13 creating+peering, 13 unknown, 271 active+clean; 35 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:01:45.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:45 smithi100 bash[13549]: audit 2021-01-28T04:01:43.580459+0000 mon.a (mon.0) 1170 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32434-19", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32434-19"}]': finished 2021-01-28T04:01:45.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:45 smithi100 bash[13549]: cluster 2021-01-28T04:01:44.006346+0000 mon.a (mon.0) 1171 : cluster [DBG] osdmap e145: 8 total, 8 up, 8 in 2021-01-28T04:01:45.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:45 smithi100 bash[13549]: audit 2021-01-28T04:01:44.008739+0000 mon.c (mon.1) 167 : audit [INF] from='client.? 172.21.15.100:0/2981776383' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32315-24"}]: dispatch 2021-01-28T04:01:45.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:45 smithi100 bash[13549]: audit 2021-01-28T04:01:44.017101+0000 mon.a (mon.0) 1172 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32315-24"}]: dispatch 2021-01-28T04:01:45.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:45 smithi100 bash[13549]: audit 2021-01-28T04:01:44.146662+0000 mon.b (mon.2) 144 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:45.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:45 smithi100 bash[13549]: audit 2021-01-28T04:01:44.583825+0000 mon.a (mon.0) 1173 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-25", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-25"}]': finished 2021-01-28T04:01:45.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:45 smithi100 bash[13549]: audit 2021-01-28T04:01:44.584399+0000 mon.a (mon.0) 1174 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32315-24"}]': finished 2021-01-28T04:01:45.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:45 smithi100 bash[13549]: cluster 2021-01-28T04:01:44.584732+0000 mon.a (mon.0) 1175 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2021-01-28T04:01:45.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:45 smithi100 bash[13549]: audit 2021-01-28T04:01:44.589972+0000 mon.c (mon.1) 168 : audit [INF] from='client.? 172.21.15.100:0/2981776383' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32315-24"}]: dispatch 2021-01-28T04:01:45.334 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:45 smithi100 bash[13549]: audit 2021-01-28T04:01:44.591513+0000 mon.c (mon.1) 169 : audit [INF] from='client.? 172.21.15.100:0/2084323255' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:45.334 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:45 smithi100 bash[13549]: audit 2021-01-28T04:01:44.600966+0000 mon.a (mon.0) 1176 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32315-24"}]: dispatch 2021-01-28T04:01:45.334 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:45 smithi100 bash[13549]: audit 2021-01-28T04:01:44.601883+0000 mon.a (mon.0) 1177 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:45.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:45 smithi162 bash[9856]: cluster 2021-01-28T04:01:43.558770+0000 mgr.y (mgr.14138) 563 : cluster [DBG] pgmap v467: 300 pgs: 3 creating+activating, 13 creating+peering, 13 unknown, 271 active+clean; 35 KiB data, 253 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:01:45.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:45 smithi162 bash[9856]: audit 2021-01-28T04:01:43.580459+0000 mon.a (mon.0) 1170 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32434-19", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32434-19"}]': finished 2021-01-28T04:01:45.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:45 smithi162 bash[9856]: cluster 2021-01-28T04:01:44.006346+0000 mon.a (mon.0) 1171 : cluster [DBG] osdmap e145: 8 total, 8 up, 8 in 2021-01-28T04:01:45.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:45 smithi162 bash[9856]: audit 2021-01-28T04:01:44.008739+0000 mon.c (mon.1) 167 : audit [INF] from='client.? 172.21.15.100:0/2981776383' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32315-24"}]: dispatch 2021-01-28T04:01:45.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:45 smithi162 bash[9856]: audit 2021-01-28T04:01:44.017101+0000 mon.a (mon.0) 1172 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32315-24"}]: dispatch 2021-01-28T04:01:45.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:45 smithi162 bash[9856]: audit 2021-01-28T04:01:44.146662+0000 mon.b (mon.2) 144 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:45.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:45 smithi162 bash[9856]: audit 2021-01-28T04:01:44.583825+0000 mon.a (mon.0) 1173 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-25", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-25"}]': finished 2021-01-28T04:01:45.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:45 smithi162 bash[9856]: audit 2021-01-28T04:01:44.584399+0000 mon.a (mon.0) 1174 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32315-24"}]': finished 2021-01-28T04:01:45.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:45 smithi162 bash[9856]: cluster 2021-01-28T04:01:44.584732+0000 mon.a (mon.0) 1175 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2021-01-28T04:01:45.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:45 smithi162 bash[9856]: audit 2021-01-28T04:01:44.589972+0000 mon.c (mon.1) 168 : audit [INF] from='client.? 172.21.15.100:0/2981776383' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32315-24"}]: dispatch 2021-01-28T04:01:45.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:45 smithi162 bash[9856]: audit 2021-01-28T04:01:44.591513+0000 mon.c (mon.1) 169 : audit [INF] from='client.? 172.21.15.100:0/2084323255' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:45.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:45 smithi162 bash[9856]: audit 2021-01-28T04:01:44.600966+0000 mon.a (mon.0) 1176 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32315-24"}]: dispatch 2021-01-28T04:01:45.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:45 smithi162 bash[9856]: audit 2021-01-28T04:01:44.601883+0000 mon.a (mon.0) 1177 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:46.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:46 smithi162 bash[9856]: audit 2021-01-28T04:01:45.148491+0000 mon.b (mon.2) 145 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:46.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:46 smithi162 bash[9856]: audit 2021-01-28T04:01:45.590702+0000 mon.a (mon.0) 1178 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32315-24"}]': finished 2021-01-28T04:01:46.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:46 smithi162 bash[9856]: audit 2021-01-28T04:01:45.590902+0000 mon.a (mon.0) 1179 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-21","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:46.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:46 smithi162 bash[9856]: cluster 2021-01-28T04:01:45.591642+0000 mon.a (mon.0) 1180 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2021-01-28T04:01:46.577 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:46 smithi100 bash[9834]: audit 2021-01-28T04:01:45.148491+0000 mon.b (mon.2) 145 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:46.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:46 smithi100 bash[9834]: audit 2021-01-28T04:01:45.590702+0000 mon.a (mon.0) 1178 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32315-24"}]': finished 2021-01-28T04:01:46.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:46 smithi100 bash[9834]: audit 2021-01-28T04:01:45.590902+0000 mon.a (mon.0) 1179 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-21","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:46.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:46 smithi100 bash[9834]: cluster 2021-01-28T04:01:45.591642+0000 mon.a (mon.0) 1180 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2021-01-28T04:01:46.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:46 smithi100 bash[13549]: audit 2021-01-28T04:01:45.148491+0000 mon.b (mon.2) 145 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:46.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:46 smithi100 bash[13549]: audit 2021-01-28T04:01:45.590702+0000 mon.a (mon.0) 1178 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32315-24"}]': finished 2021-01-28T04:01:46.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:46 smithi100 bash[13549]: audit 2021-01-28T04:01:45.590902+0000 mon.a (mon.0) 1179 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-21","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:46.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:46 smithi100 bash[13549]: cluster 2021-01-28T04:01:45.591642+0000 mon.a (mon.0) 1180 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2021-01-28T04:01:47.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:47 smithi162 bash[9856]: cluster 2021-01-28T04:01:45.559817+0000 mgr.y (mgr.14138) 564 : cluster [DBG] pgmap v470: 308 pgs: 1 creating+peering, 47 unknown, 260 active+clean; 35 KiB data, 258 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:01:47.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:47 smithi162 bash[9856]: audit 2021-01-28T04:01:46.150443+0000 mon.b (mon.2) 146 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:47.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:47 smithi162 bash[9856]: cluster 2021-01-28T04:01:46.591675+0000 mon.a (mon.0) 1181 : cluster [DBG] osdmap e148: 8 total, 8 up, 8 in 2021-01-28T04:01:47.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:47 smithi162 bash[9856]: audit 2021-01-28T04:01:46.598314+0000 mon.c (mon.1) 170 : audit [INF] from='client.? 172.21.15.100:0/3541219689' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-25"}]: dispatch 2021-01-28T04:01:47.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:47 smithi162 bash[9856]: audit 2021-01-28T04:01:46.599338+0000 mon.a (mon.0) 1182 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-25"}]: dispatch 2021-01-28T04:01:47.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:47 smithi162 bash[9856]: audit 2021-01-28T04:01:46.607864+0000 mon.c (mon.1) 171 : audit [INF] from='client.? 172.21.15.100:0/2701281356' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:47.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:47 smithi162 bash[9856]: audit 2021-01-28T04:01:46.608485+0000 mon.a (mon.0) 1183 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:47.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:47 smithi100 bash[9834]: cluster 2021-01-28T04:01:45.559817+0000 mgr.y (mgr.14138) 564 : cluster [DBG] pgmap v470: 308 pgs: 1 creating+peering, 47 unknown, 260 active+clean; 35 KiB data, 258 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:01:47.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:47 smithi100 bash[9834]: audit 2021-01-28T04:01:46.150443+0000 mon.b (mon.2) 146 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:47.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:47 smithi100 bash[9834]: cluster 2021-01-28T04:01:46.591675+0000 mon.a (mon.0) 1181 : cluster [DBG] osdmap e148: 8 total, 8 up, 8 in 2021-01-28T04:01:47.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:47 smithi100 bash[9834]: audit 2021-01-28T04:01:46.598314+0000 mon.c (mon.1) 170 : audit [INF] from='client.? 172.21.15.100:0/3541219689' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-25"}]: dispatch 2021-01-28T04:01:47.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:47 smithi100 bash[9834]: audit 2021-01-28T04:01:46.599338+0000 mon.a (mon.0) 1182 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-25"}]: dispatch 2021-01-28T04:01:47.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:47 smithi100 bash[9834]: audit 2021-01-28T04:01:46.607864+0000 mon.c (mon.1) 171 : audit [INF] from='client.? 172.21.15.100:0/2701281356' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:47.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:47 smithi100 bash[9834]: audit 2021-01-28T04:01:46.608485+0000 mon.a (mon.0) 1183 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:47.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:47 smithi100 bash[13549]: cluster 2021-01-28T04:01:45.559817+0000 mgr.y (mgr.14138) 564 : cluster [DBG] pgmap v470: 308 pgs: 1 creating+peering, 47 unknown, 260 active+clean; 35 KiB data, 258 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:01:47.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:47 smithi100 bash[13549]: audit 2021-01-28T04:01:46.150443+0000 mon.b (mon.2) 146 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:47.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:47 smithi100 bash[13549]: cluster 2021-01-28T04:01:46.591675+0000 mon.a (mon.0) 1181 : cluster [DBG] osdmap e148: 8 total, 8 up, 8 in 2021-01-28T04:01:47.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:47 smithi100 bash[13549]: audit 2021-01-28T04:01:46.598314+0000 mon.c (mon.1) 170 : audit [INF] from='client.? 172.21.15.100:0/3541219689' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-25"}]: dispatch 2021-01-28T04:01:47.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:47 smithi100 bash[13549]: audit 2021-01-28T04:01:46.599338+0000 mon.a (mon.0) 1182 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-25"}]: dispatch 2021-01-28T04:01:47.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:47 smithi100 bash[13549]: audit 2021-01-28T04:01:46.607864+0000 mon.c (mon.1) 171 : audit [INF] from='client.? 172.21.15.100:0/2701281356' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:47.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:47 smithi100 bash[13549]: audit 2021-01-28T04:01:46.608485+0000 mon.a (mon.0) 1183 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:48.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:48 smithi162 bash[9856]: audit 2021-01-28T04:01:47.152258+0000 mon.b (mon.2) 147 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:48.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:48 smithi162 bash[9856]: audit 2021-01-28T04:01:47.593260+0000 mon.a (mon.0) 1184 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-25"}]': finished 2021-01-28T04:01:48.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:48 smithi162 bash[9856]: audit 2021-01-28T04:01:47.593458+0000 mon.a (mon.0) 1185 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-27","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:48.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:48 smithi162 bash[9856]: cluster 2021-01-28T04:01:47.593710+0000 mon.a (mon.0) 1186 : cluster [DBG] osdmap e149: 8 total, 8 up, 8 in 2021-01-28T04:01:48.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:48 smithi162 bash[9856]: audit 2021-01-28T04:01:47.598350+0000 mon.c (mon.1) 172 : audit [INF] from='client.? 172.21.15.100:0/3541219689' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-25"}]: dispatch 2021-01-28T04:01:48.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:48 smithi162 bash[9856]: audit 2021-01-28T04:01:47.599060+0000 mon.a (mon.0) 1187 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-25"}]: dispatch 2021-01-28T04:01:48.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:48 smithi162 bash[9856]: audit 2021-01-28T04:01:47.602024+0000 mon.c (mon.1) 173 : audit [INF] from='client.? 172.21.15.100:0/3597312098' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:48.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:48 smithi162 bash[9856]: audit 2021-01-28T04:01:47.604052+0000 mon.a (mon.0) 1188 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:48.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:48 smithi100 bash[9834]: audit 2021-01-28T04:01:47.152258+0000 mon.b (mon.2) 147 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:48.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:48 smithi100 bash[9834]: audit 2021-01-28T04:01:47.593260+0000 mon.a (mon.0) 1184 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-25"}]': finished 2021-01-28T04:01:48.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:48 smithi100 bash[9834]: audit 2021-01-28T04:01:47.593458+0000 mon.a (mon.0) 1185 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-27","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:48.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:48 smithi100 bash[9834]: cluster 2021-01-28T04:01:47.593710+0000 mon.a (mon.0) 1186 : cluster [DBG] osdmap e149: 8 total, 8 up, 8 in 2021-01-28T04:01:48.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:48 smithi100 bash[9834]: audit 2021-01-28T04:01:47.598350+0000 mon.c (mon.1) 172 : audit [INF] from='client.? 172.21.15.100:0/3541219689' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-25"}]: dispatch 2021-01-28T04:01:48.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:48 smithi100 bash[9834]: audit 2021-01-28T04:01:47.599060+0000 mon.a (mon.0) 1187 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-25"}]: dispatch 2021-01-28T04:01:48.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:48 smithi100 bash[9834]: audit 2021-01-28T04:01:47.602024+0000 mon.c (mon.1) 173 : audit [INF] from='client.? 172.21.15.100:0/3597312098' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:48.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:48 smithi100 bash[9834]: audit 2021-01-28T04:01:47.604052+0000 mon.a (mon.0) 1188 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:48.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:48 smithi100 bash[13549]: audit 2021-01-28T04:01:47.152258+0000 mon.b (mon.2) 147 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:48.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:48 smithi100 bash[13549]: audit 2021-01-28T04:01:47.593260+0000 mon.a (mon.0) 1184 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-25"}]': finished 2021-01-28T04:01:48.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:48 smithi100 bash[13549]: audit 2021-01-28T04:01:47.593458+0000 mon.a (mon.0) 1185 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-27","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:48.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:48 smithi100 bash[13549]: cluster 2021-01-28T04:01:47.593710+0000 mon.a (mon.0) 1186 : cluster [DBG] osdmap e149: 8 total, 8 up, 8 in 2021-01-28T04:01:48.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:48 smithi100 bash[13549]: audit 2021-01-28T04:01:47.598350+0000 mon.c (mon.1) 172 : audit [INF] from='client.? 172.21.15.100:0/3541219689' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-25"}]: dispatch 2021-01-28T04:01:48.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:48 smithi100 bash[13549]: audit 2021-01-28T04:01:47.599060+0000 mon.a (mon.0) 1187 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-25"}]: dispatch 2021-01-28T04:01:48.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:48 smithi100 bash[13549]: audit 2021-01-28T04:01:47.602024+0000 mon.c (mon.1) 173 : audit [INF] from='client.? 172.21.15.100:0/3597312098' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:48.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:48 smithi100 bash[13549]: audit 2021-01-28T04:01:47.604052+0000 mon.a (mon.0) 1188 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:49.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:49 smithi162 bash[9856]: cluster 2021-01-28T04:01:47.561506+0000 mgr.y (mgr.14138) 565 : cluster [DBG] pgmap v473: 300 pgs: 13 creating+peering, 22 unknown, 265 active+clean; 35 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:01:49.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:49 smithi162 bash[9856]: audit 2021-01-28T04:01:48.154062+0000 mon.b (mon.2) 148 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:49.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:49 smithi162 bash[9856]: audit 2021-01-28T04:01:48.600628+0000 mon.a (mon.0) 1189 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-25"}]': finished 2021-01-28T04:01:49.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:49 smithi162 bash[9856]: audit 2021-01-28T04:01:48.600919+0000 mon.a (mon.0) 1190 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-22","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:49.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:49 smithi162 bash[9856]: cluster 2021-01-28T04:01:48.601401+0000 mon.a (mon.0) 1191 : cluster [DBG] osdmap e150: 8 total, 8 up, 8 in 2021-01-28T04:01:49.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:49 smithi162 bash[9856]: audit 2021-01-28T04:01:48.642763+0000 mon.c (mon.1) 174 : audit [INF] from='client.? 172.21.15.100:0/856197522' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-26"}]: dispatch 2021-01-28T04:01:49.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:49 smithi162 bash[9856]: audit 2021-01-28T04:01:48.643840+0000 mon.a (mon.0) 1192 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-26"}]: dispatch 2021-01-28T04:01:49.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:49 smithi162 bash[9856]: audit 2021-01-28T04:01:48.649159+0000 mon.c (mon.1) 175 : audit [INF] from='client.? 172.21.15.100:0/856197522' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-26"}]: dispatch 2021-01-28T04:01:49.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:49 smithi162 bash[9856]: audit 2021-01-28T04:01:48.649923+0000 mon.a (mon.0) 1193 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-26"}]: dispatch 2021-01-28T04:01:49.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:49 smithi162 bash[9856]: audit 2021-01-28T04:01:48.653118+0000 mon.c (mon.1) 176 : audit [INF] from='client.? 172.21.15.100:0/856197522' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:49.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:49 smithi162 bash[9856]: audit 2021-01-28T04:01:48.653912+0000 mon.a (mon.0) 1194 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:49.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:49 smithi100 bash[9834]: cluster 2021-01-28T04:01:47.561506+0000 mgr.y (mgr.14138) 565 : cluster [DBG] pgmap v473: 300 pgs: 13 creating+peering, 22 unknown, 265 active+clean; 35 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:01:49.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:49 smithi100 bash[9834]: audit 2021-01-28T04:01:48.154062+0000 mon.b (mon.2) 148 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:49.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:49 smithi100 bash[9834]: audit 2021-01-28T04:01:48.600628+0000 mon.a (mon.0) 1189 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-25"}]': finished 2021-01-28T04:01:49.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:49 smithi100 bash[9834]: audit 2021-01-28T04:01:48.600919+0000 mon.a (mon.0) 1190 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-22","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:49.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:49 smithi100 bash[9834]: cluster 2021-01-28T04:01:48.601401+0000 mon.a (mon.0) 1191 : cluster [DBG] osdmap e150: 8 total, 8 up, 8 in 2021-01-28T04:01:49.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:49 smithi100 bash[9834]: audit 2021-01-28T04:01:48.642763+0000 mon.c (mon.1) 174 : audit [INF] from='client.? 172.21.15.100:0/856197522' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-26"}]: dispatch 2021-01-28T04:01:49.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:49 smithi100 bash[9834]: audit 2021-01-28T04:01:48.643840+0000 mon.a (mon.0) 1192 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-26"}]: dispatch 2021-01-28T04:01:49.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:49 smithi100 bash[9834]: audit 2021-01-28T04:01:48.649159+0000 mon.c (mon.1) 175 : audit [INF] from='client.? 172.21.15.100:0/856197522' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-26"}]: dispatch 2021-01-28T04:01:49.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:49 smithi100 bash[9834]: audit 2021-01-28T04:01:48.649923+0000 mon.a (mon.0) 1193 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-26"}]: dispatch 2021-01-28T04:01:49.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:49 smithi100 bash[9834]: audit 2021-01-28T04:01:48.653118+0000 mon.c (mon.1) 176 : audit [INF] from='client.? 172.21.15.100:0/856197522' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:49.584 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:49 smithi100 bash[9834]: audit 2021-01-28T04:01:48.653912+0000 mon.a (mon.0) 1194 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:49.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:49 smithi100 bash[13549]: cluster 2021-01-28T04:01:47.561506+0000 mgr.y (mgr.14138) 565 : cluster [DBG] pgmap v473: 300 pgs: 13 creating+peering, 22 unknown, 265 active+clean; 35 KiB data, 260 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:01:49.585 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:49 smithi100 bash[13549]: audit 2021-01-28T04:01:48.154062+0000 mon.b (mon.2) 148 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:49.585 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:49 smithi100 bash[13549]: audit 2021-01-28T04:01:48.600628+0000 mon.a (mon.0) 1189 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-25"}]': finished 2021-01-28T04:01:49.586 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:49 smithi100 bash[13549]: audit 2021-01-28T04:01:48.600919+0000 mon.a (mon.0) 1190 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-22","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:49.586 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:49 smithi100 bash[13549]: cluster 2021-01-28T04:01:48.601401+0000 mon.a (mon.0) 1191 : cluster [DBG] osdmap e150: 8 total, 8 up, 8 in 2021-01-28T04:01:49.587 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:49 smithi100 bash[13549]: audit 2021-01-28T04:01:48.642763+0000 mon.c (mon.1) 174 : audit [INF] from='client.? 172.21.15.100:0/856197522' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-26"}]: dispatch 2021-01-28T04:01:49.587 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:49 smithi100 bash[13549]: audit 2021-01-28T04:01:48.643840+0000 mon.a (mon.0) 1192 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-26"}]: dispatch 2021-01-28T04:01:49.588 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:49 smithi100 bash[13549]: audit 2021-01-28T04:01:48.649159+0000 mon.c (mon.1) 175 : audit [INF] from='client.? 172.21.15.100:0/856197522' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-26"}]: dispatch 2021-01-28T04:01:49.588 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:49 smithi100 bash[13549]: audit 2021-01-28T04:01:48.649923+0000 mon.a (mon.0) 1193 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-26"}]: dispatch 2021-01-28T04:01:49.589 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:49 smithi100 bash[13549]: audit 2021-01-28T04:01:48.653118+0000 mon.c (mon.1) 176 : audit [INF] from='client.? 172.21.15.100:0/856197522' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:49.589 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:49 smithi100 bash[13549]: audit 2021-01-28T04:01:48.653912+0000 mon.a (mon.0) 1194 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:50.077 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 04:01:49 smithi100 bash[10061]: debug 2021-01-28T04:01:49.777+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:01:50.115 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 04:01:49 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T04:01:50.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:50 smithi162 bash[9856]: audit 2021-01-28T04:01:49.155907+0000 mon.b (mon.2) 149 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:50.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:50 smithi162 bash[9856]: audit 2021-01-28T04:01:49.605033+0000 mon.a (mon.0) 1195 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:01:50.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:50 smithi162 bash[9856]: cluster 2021-01-28T04:01:49.605291+0000 mon.a (mon.0) 1196 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2021-01-28T04:01:50.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:50 smithi162 bash[9856]: audit 2021-01-28T04:01:49.608148+0000 mon.c (mon.1) 177 : audit [INF] from='client.? 172.21.15.100:0/856197522' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-26"}]: dispatch 2021-01-28T04:01:50.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:50 smithi162 bash[9856]: audit 2021-01-28T04:01:49.609533+0000 mon.c (mon.1) 178 : audit [INF] from='client.? 172.21.15.100:0/943272400' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:50.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:50 smithi162 bash[9856]: audit 2021-01-28T04:01:49.614729+0000 mon.a (mon.0) 1197 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-26"}]: dispatch 2021-01-28T04:01:50.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:50 smithi162 bash[9856]: audit 2021-01-28T04:01:49.615727+0000 mon.a (mon.0) 1198 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:50.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:50 smithi100 bash[9834]: audit 2021-01-28T04:01:49.155907+0000 mon.b (mon.2) 149 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:50.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:50 smithi100 bash[9834]: audit 2021-01-28T04:01:49.605033+0000 mon.a (mon.0) 1195 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:01:50.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:50 smithi100 bash[9834]: cluster 2021-01-28T04:01:49.605291+0000 mon.a (mon.0) 1196 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2021-01-28T04:01:50.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:50 smithi100 bash[9834]: audit 2021-01-28T04:01:49.608148+0000 mon.c (mon.1) 177 : audit [INF] from='client.? 172.21.15.100:0/856197522' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-26"}]: dispatch 2021-01-28T04:01:50.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:50 smithi100 bash[9834]: audit 2021-01-28T04:01:49.609533+0000 mon.c (mon.1) 178 : audit [INF] from='client.? 172.21.15.100:0/943272400' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:50.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:50 smithi100 bash[9834]: audit 2021-01-28T04:01:49.614729+0000 mon.a (mon.0) 1197 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-26"}]: dispatch 2021-01-28T04:01:50.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:50 smithi100 bash[9834]: audit 2021-01-28T04:01:49.615727+0000 mon.a (mon.0) 1198 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:50.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:50 smithi100 bash[13549]: audit 2021-01-28T04:01:49.155907+0000 mon.b (mon.2) 149 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:50.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:50 smithi100 bash[13549]: audit 2021-01-28T04:01:49.605033+0000 mon.a (mon.0) 1195 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-26", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:01:50.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:50 smithi100 bash[13549]: cluster 2021-01-28T04:01:49.605291+0000 mon.a (mon.0) 1196 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2021-01-28T04:01:50.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:50 smithi100 bash[13549]: audit 2021-01-28T04:01:49.608148+0000 mon.c (mon.1) 177 : audit [INF] from='client.? 172.21.15.100:0/856197522' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-26"}]: dispatch 2021-01-28T04:01:50.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:50 smithi100 bash[13549]: audit 2021-01-28T04:01:49.609533+0000 mon.c (mon.1) 178 : audit [INF] from='client.? 172.21.15.100:0/943272400' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:50.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:50 smithi100 bash[13549]: audit 2021-01-28T04:01:49.614729+0000 mon.a (mon.0) 1197 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-26"}]: dispatch 2021-01-28T04:01:50.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:50 smithi100 bash[13549]: audit 2021-01-28T04:01:49.615727+0000 mon.a (mon.0) 1198 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:51.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:51 smithi162 bash[9856]: cluster 2021-01-28T04:01:49.563082+0000 mgr.y (mgr.14138) 566 : cluster [DBG] pgmap v476: 300 pgs: 14 creating+peering, 14 unknown, 272 active+clean; 35 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.2 KiB/s wr, 2 op/s 2021-01-28T04:01:51.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:51 smithi162 bash[9856]: audit 2021-01-28T04:01:49.780982+0000 mgr.y (mgr.14138) 567 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:01:51.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:51 smithi162 bash[9856]: audit 2021-01-28T04:01:50.157832+0000 mon.b (mon.2) 150 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:51.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:51 smithi162 bash[9856]: audit 2021-01-28T04:01:51.015510+0000 mon.a (mon.0) 1199 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-30","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:51.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:51 smithi162 bash[9856]: cluster 2021-01-28T04:01:51.016358+0000 mon.a (mon.0) 1200 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2021-01-28T04:01:51.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:51 smithi162 bash[9856]: audit 2021-01-28T04:01:51.017802+0000 mon.c (mon.1) 179 : audit [INF] from='client.? 172.21.15.100:0/3302238349' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:51.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:51 smithi162 bash[9856]: audit 2021-01-28T04:01:51.023743+0000 mon.a (mon.0) 1201 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:51.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:51 smithi100 bash[9834]: cluster 2021-01-28T04:01:49.563082+0000 mgr.y (mgr.14138) 566 : cluster [DBG] pgmap v476: 300 pgs: 14 creating+peering, 14 unknown, 272 active+clean; 35 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.2 KiB/s wr, 2 op/s 2021-01-28T04:01:51.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:51 smithi100 bash[9834]: audit 2021-01-28T04:01:49.780982+0000 mgr.y (mgr.14138) 567 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:01:51.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:51 smithi100 bash[9834]: audit 2021-01-28T04:01:50.157832+0000 mon.b (mon.2) 150 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:51.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:51 smithi100 bash[9834]: audit 2021-01-28T04:01:51.015510+0000 mon.a (mon.0) 1199 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-30","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:51.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:51 smithi100 bash[9834]: cluster 2021-01-28T04:01:51.016358+0000 mon.a (mon.0) 1200 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2021-01-28T04:01:51.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:51 smithi100 bash[9834]: audit 2021-01-28T04:01:51.017802+0000 mon.c (mon.1) 179 : audit [INF] from='client.? 172.21.15.100:0/3302238349' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:51.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:51 smithi100 bash[9834]: audit 2021-01-28T04:01:51.023743+0000 mon.a (mon.0) 1201 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:51.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:51 smithi100 bash[13549]: cluster 2021-01-28T04:01:49.563082+0000 mgr.y (mgr.14138) 566 : cluster [DBG] pgmap v476: 300 pgs: 14 creating+peering, 14 unknown, 272 active+clean; 35 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.2 KiB/s wr, 2 op/s 2021-01-28T04:01:51.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:51 smithi100 bash[13549]: audit 2021-01-28T04:01:49.780982+0000 mgr.y (mgr.14138) 567 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:01:51.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:51 smithi100 bash[13549]: audit 2021-01-28T04:01:50.157832+0000 mon.b (mon.2) 150 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:51.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:51 smithi100 bash[13549]: audit 2021-01-28T04:01:51.015510+0000 mon.a (mon.0) 1199 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-30","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:51.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:51 smithi100 bash[13549]: cluster 2021-01-28T04:01:51.016358+0000 mon.a (mon.0) 1200 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2021-01-28T04:01:51.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:51 smithi100 bash[13549]: audit 2021-01-28T04:01:51.017802+0000 mon.c (mon.1) 179 : audit [INF] from='client.? 172.21.15.100:0/3302238349' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:51.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:51 smithi100 bash[13549]: audit 2021-01-28T04:01:51.023743+0000 mon.a (mon.0) 1201 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:52.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:52 smithi162 bash[9856]: audit 2021-01-28T04:01:51.159614+0000 mon.b (mon.2) 151 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:52.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:52 smithi162 bash[9856]: audit 2021-01-28T04:01:51.611267+0000 mon.a (mon.0) 1202 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-26"}]': finished 2021-01-28T04:01:52.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:52 smithi162 bash[9856]: audit 2021-01-28T04:01:51.612332+0000 mon.a (mon.0) 1203 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-23","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:52.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:52 smithi162 bash[9856]: cluster 2021-01-28T04:01:51.612552+0000 mon.a (mon.0) 1204 : cluster [DBG] osdmap e153: 8 total, 8 up, 8 in 2021-01-28T04:01:52.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:52 smithi100 bash[9834]: audit 2021-01-28T04:01:51.159614+0000 mon.b (mon.2) 151 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:52.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:52 smithi100 bash[9834]: audit 2021-01-28T04:01:51.611267+0000 mon.a (mon.0) 1202 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-26"}]': finished 2021-01-28T04:01:52.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:52 smithi100 bash[9834]: audit 2021-01-28T04:01:51.612332+0000 mon.a (mon.0) 1203 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-23","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:52.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:52 smithi100 bash[9834]: cluster 2021-01-28T04:01:51.612552+0000 mon.a (mon.0) 1204 : cluster [DBG] osdmap e153: 8 total, 8 up, 8 in 2021-01-28T04:01:52.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:52 smithi100 bash[13549]: audit 2021-01-28T04:01:51.159614+0000 mon.b (mon.2) 151 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:52.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:52 smithi100 bash[13549]: audit 2021-01-28T04:01:51.611267+0000 mon.a (mon.0) 1202 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-26", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-26"}]': finished 2021-01-28T04:01:52.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:52 smithi100 bash[13549]: audit 2021-01-28T04:01:51.612332+0000 mon.a (mon.0) 1203 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-23","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:52.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:52 smithi100 bash[13549]: cluster 2021-01-28T04:01:51.612552+0000 mon.a (mon.0) 1204 : cluster [DBG] osdmap e153: 8 total, 8 up, 8 in 2021-01-28T04:01:53.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:53 smithi162 bash[9856]: cluster 2021-01-28T04:01:51.564411+0000 mgr.y (mgr.14138) 568 : cluster [DBG] pgmap v479: 332 pgs: 3 creating+peering, 57 unknown, 272 active+clean; 35 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 2 op/s 2021-01-28T04:01:53.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:53 smithi162 bash[9856]: audit 2021-01-28T04:01:52.161379+0000 mon.b (mon.2) 152 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:53.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:53 smithi162 bash[9856]: cluster 2021-01-28T04:01:52.615295+0000 mon.a (mon.0) 1205 : cluster [DBG] osdmap e154: 8 total, 8 up, 8 in 2021-01-28T04:01:53.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:53 smithi162 bash[9856]: audit 2021-01-28T04:01:52.620686+0000 mon.b (mon.2) 153 : audit [INF] from='client.? 172.21.15.100:0/3953516803' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:53.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:53 smithi162 bash[9856]: audit 2021-01-28T04:01:52.621939+0000 mon.a (mon.0) 1206 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:53.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:53 smithi100 bash[9834]: cluster 2021-01-28T04:01:51.564411+0000 mgr.y (mgr.14138) 568 : cluster [DBG] pgmap v479: 332 pgs: 3 creating+peering, 57 unknown, 272 active+clean; 35 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 2 op/s 2021-01-28T04:01:53.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:53 smithi100 bash[9834]: audit 2021-01-28T04:01:52.161379+0000 mon.b (mon.2) 152 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:53.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:53 smithi100 bash[9834]: cluster 2021-01-28T04:01:52.615295+0000 mon.a (mon.0) 1205 : cluster [DBG] osdmap e154: 8 total, 8 up, 8 in 2021-01-28T04:01:53.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:53 smithi100 bash[9834]: audit 2021-01-28T04:01:52.620686+0000 mon.b (mon.2) 153 : audit [INF] from='client.? 172.21.15.100:0/3953516803' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:53.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:53 smithi100 bash[9834]: audit 2021-01-28T04:01:52.621939+0000 mon.a (mon.0) 1206 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:53.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:53 smithi100 bash[13549]: cluster 2021-01-28T04:01:51.564411+0000 mgr.y (mgr.14138) 568 : cluster [DBG] pgmap v479: 332 pgs: 3 creating+peering, 57 unknown, 272 active+clean; 35 KiB data, 262 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 2 op/s 2021-01-28T04:01:53.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:53 smithi100 bash[13549]: audit 2021-01-28T04:01:52.161379+0000 mon.b (mon.2) 152 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:53.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:53 smithi100 bash[13549]: cluster 2021-01-28T04:01:52.615295+0000 mon.a (mon.0) 1205 : cluster [DBG] osdmap e154: 8 total, 8 up, 8 in 2021-01-28T04:01:53.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:53 smithi100 bash[13549]: audit 2021-01-28T04:01:52.620686+0000 mon.b (mon.2) 153 : audit [INF] from='client.? 172.21.15.100:0/3953516803' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:53.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:53 smithi100 bash[13549]: audit 2021-01-28T04:01:52.621939+0000 mon.a (mon.0) 1206 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:54.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:54 smithi162 bash[9856]: audit 2021-01-28T04:01:53.163046+0000 mon.b (mon.2) 154 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:54.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:54 smithi162 bash[9856]: audit 2021-01-28T04:01:53.548889+0000 mon.a (mon.0) 1207 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-33","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:54.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:54 smithi162 bash[9856]: cluster 2021-01-28T04:01:53.550041+0000 mon.a (mon.0) 1208 : cluster [DBG] osdmap e155: 8 total, 8 up, 8 in 2021-01-28T04:01:54.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:54 smithi162 bash[9856]: audit 2021-01-28T04:01:53.554917+0000 mon.c (mon.1) 180 : audit [INF] from='client.? 172.21.15.100:0/856197522' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-26"}]: dispatch 2021-01-28T04:01:54.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:54 smithi162 bash[9856]: audit 2021-01-28T04:01:53.556034+0000 mon.a (mon.0) 1209 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-26"}]: dispatch 2021-01-28T04:01:54.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:54 smithi162 bash[9856]: audit 2021-01-28T04:01:53.556524+0000 mon.b (mon.2) 155 : audit [INF] from='client.? 172.21.15.100:0/2305403167' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:54.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:54 smithi162 bash[9856]: audit 2021-01-28T04:01:53.567981+0000 mon.a (mon.0) 1210 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:54.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:54 smithi100 bash[9834]: audit 2021-01-28T04:01:53.163046+0000 mon.b (mon.2) 154 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:54.574 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:54 smithi100 bash[9834]: audit 2021-01-28T04:01:53.548889+0000 mon.a (mon.0) 1207 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-33","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:54.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:54 smithi100 bash[9834]: cluster 2021-01-28T04:01:53.550041+0000 mon.a (mon.0) 1208 : cluster [DBG] osdmap e155: 8 total, 8 up, 8 in 2021-01-28T04:01:54.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:54 smithi100 bash[9834]: audit 2021-01-28T04:01:53.554917+0000 mon.c (mon.1) 180 : audit [INF] from='client.? 172.21.15.100:0/856197522' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-26"}]: dispatch 2021-01-28T04:01:54.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:54 smithi100 bash[9834]: audit 2021-01-28T04:01:53.556034+0000 mon.a (mon.0) 1209 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-26"}]: dispatch 2021-01-28T04:01:54.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:54 smithi100 bash[9834]: audit 2021-01-28T04:01:53.556524+0000 mon.b (mon.2) 155 : audit [INF] from='client.? 172.21.15.100:0/2305403167' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:54.575 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:54 smithi100 bash[9834]: audit 2021-01-28T04:01:53.567981+0000 mon.a (mon.0) 1210 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:54.576 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:54 smithi100 bash[13549]: audit 2021-01-28T04:01:53.163046+0000 mon.b (mon.2) 154 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:54.576 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:54 smithi100 bash[13549]: audit 2021-01-28T04:01:53.548889+0000 mon.a (mon.0) 1207 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32315-33","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:54.576 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:54 smithi100 bash[13549]: cluster 2021-01-28T04:01:53.550041+0000 mon.a (mon.0) 1208 : cluster [DBG] osdmap e155: 8 total, 8 up, 8 in 2021-01-28T04:01:54.576 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:54 smithi100 bash[13549]: audit 2021-01-28T04:01:53.554917+0000 mon.c (mon.1) 180 : audit [INF] from='client.? 172.21.15.100:0/856197522' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-26"}]: dispatch 2021-01-28T04:01:54.577 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:54 smithi100 bash[13549]: audit 2021-01-28T04:01:53.556034+0000 mon.a (mon.0) 1209 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-26"}]: dispatch 2021-01-28T04:01:54.577 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:54 smithi100 bash[13549]: audit 2021-01-28T04:01:53.556524+0000 mon.b (mon.2) 155 : audit [INF] from='client.? 172.21.15.100:0/2305403167' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:54.577 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:54 smithi100 bash[13549]: audit 2021-01-28T04:01:53.567981+0000 mon.a (mon.0) 1210 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:54.827 INFO:journalctl@ceph.osd.1.smithi100.stdout:Jan 28 04:01:54 smithi100 bash[19166]: debug 2021-01-28T04:01:54.565+0000 7fb94d91c700 -1 osd.1 pg_epoch: 156 pg[117.2s0( v 155'3 (0'0,155'3] local-lis/les=145/146 n=2 ec=145/145 lis/c=145/145 les/c/f=146/146/0 sis=145) [1,5,3]p1(0) r=0 lpr=145 crt=155'3 lcod 154'1 mlcod 154'1 active+clean+snaptrim trimq=[b~1] ps=[2~1,6~2]] removing snap head 2021-01-28T04:01:55.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:55 smithi162 bash[9856]: cluster 2021-01-28T04:01:53.565100+0000 mgr.y (mgr.14138) 569 : cluster [DBG] pgmap v483: 332 pgs: 6 creating+peering, 58 unknown, 268 active+clean; 67 KiB data, 264 MiB used, 715 GiB / 715 GiB avail; 7.3 KiB/s rd, 10 KiB/s wr, 4 op/s 2021-01-28T04:01:55.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:55 smithi162 bash[9856]: audit 2021-01-28T04:01:54.165124+0000 mon.b (mon.2) 156 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:55.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:55 smithi162 bash[9856]: cluster 2021-01-28T04:01:54.542566+0000 mon.a (mon.0) 1211 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:01:55.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:55 smithi162 bash[9856]: audit 2021-01-28T04:01:54.560765+0000 mon.a (mon.0) 1212 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-26"}]': finished 2021-01-28T04:01:55.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:55 smithi162 bash[9856]: audit 2021-01-28T04:01:54.561023+0000 mon.a (mon.0) 1213 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-24","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:55.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:55 smithi162 bash[9856]: cluster 2021-01-28T04:01:54.561514+0000 mon.a (mon.0) 1214 : cluster [DBG] osdmap e156: 8 total, 8 up, 8 in 2021-01-28T04:01:55.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:55 smithi162 bash[9856]: audit 2021-01-28T04:01:54.566124+0000 mon.c (mon.1) 181 : audit [INF] from='client.? 172.21.15.100:0/856197522' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-26"}]: dispatch 2021-01-28T04:01:55.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:55 smithi162 bash[9856]: audit 2021-01-28T04:01:54.567341+0000 mon.a (mon.0) 1215 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-26"}]: dispatch 2021-01-28T04:01:55.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:55 smithi162 bash[9856]: audit 2021-01-28T04:01:54.622035+0000 mon.a (mon.0) 1216 : audit [INF] from='client.? 172.21.15.100:0/3366480354' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32315-36"}]: dispatch 2021-01-28T04:01:55.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:55 smithi162 bash[9856]: audit 2021-01-28T04:01:54.623597+0000 mon.a (mon.0) 1217 : audit [INF] from='client.? 172.21.15.100:0/3366480354' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32315-36"}]: dispatch 2021-01-28T04:01:55.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:55 smithi162 bash[9856]: audit 2021-01-28T04:01:54.628503+0000 mon.a (mon.0) 1218 : audit [INF] from='client.? 172.21.15.100:0/3366480354' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32315-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:55.575 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [----------] 22 tests from LibRadosMi api_aio: Running main() from gmock_main.cc 2021-01-28T04:01:55.576 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [==========] Running 40 tests from 2 test suites. 2021-01-28T04:01:55.576 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [----------] Global test environment set-up. 2021-01-28T04:01:55.577 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [----------] 24 tests from LibRadosAio 2021-01-28T04:01:55.577 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2021-01-28T04:01:55.578 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAio.TooBig (8177 ms) 2021-01-28T04:01:55.578 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2021-01-28T04:01:55.579 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (5104 ms) 2021-01-28T04:01:55.579 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2021-01-28T04:01:55.579 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAio.WaitForSafe (6197 ms) 2021-01-28T04:01:55.580 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip 2021-01-28T04:01:55.580 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip (4260 ms) 2021-01-28T04:01:55.581 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip2 2021-01-28T04:01:55.581 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip2 (2967 ms) 2021-01-28T04:01:55.581 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip3 2021-01-28T04:01:55.582 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip3 (3720 ms) 2021-01-28T04:01:55.582 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripAppend 2021-01-28T04:01:55.583 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAio.RoundTripAppend (3970 ms) 2021-01-28T04:01:55.583 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAio.RemoveTest 2021-01-28T04:01:55.584 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAio.RemoveTest (4761 ms) 2021-01-28T04:01:55.584 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAio.XattrsRoundTrip 2021-01-28T04:01:55.585 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAio.XattrsRoundTrip (4336 ms) 2021-01-28T04:01:55.585 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAio.RmXattr 2021-01-28T04:01:55.586 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAio.RmXattr (2678 ms) 2021-01-28T04:01:55.586 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAio.XattrIter 2021-01-28T04:01:55.587 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAio.XattrIter (2972 ms) 2021-01-28T04:01:55.587 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAio.IsComplete 2021-01-28T04:01:55.587 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAio.IsComplete (2999 ms) 2021-01-28T04:01:55.588 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAio.IsSafe 2021-01-28T04:01:55.588 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAio.IsSafe (2991 ms) 2021-01-28T04:01:55.589 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAio.ReturnValue 2021-01-28T04:01:55.589 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAio.ReturnValue (3012 ms) 2021-01-28T04:01:55.589 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAio.Flush 2021-01-28T04:01:55.590 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAio.Flush (3010 ms) 2021-01-28T04:01:55.590 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAio.FlushAsync 2021-01-28T04:01:55.591 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAio.FlushAsync (3022 ms) 2021-01-28T04:01:55.591 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteFull 2021-01-28T04:01:55.592 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteFull (2961 ms) 2021-01-28T04:01:55.592 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteSame 2021-01-28T04:01:55.593 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteSame (3028 ms) 2021-01-28T04:01:55.593 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStat 2021-01-28T04:01:55.593 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAio.SimpleStat (3017 ms) 2021-01-28T04:01:55.594 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStatNS 2021-01-28T04:01:55.594 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAio.SimpleStatNS (3008 ms) 2021-01-28T04:01:55.598 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAio.StatRemove 2021-01-28T04:01:55.598 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAio.StatRemove (3014 ms) 2021-01-28T04:01:55.598 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAio.ExecuteClass 2021-01-28T04:01:55.598 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAio.ExecuteClass (3008 ms) 2021-01-28T04:01:55.599 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAio.MultiWrite 2021-01-28T04:01:55.599 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAio.MultiWrite (2933 ms) 2021-01-28T04:01:55.599 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAio.AioUnlock 2021-01-28T04:01:55.599 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAio.AioUnlock (3020 ms) 2021-01-28T04:01:55.599 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [----------] 24 tests from LibRadosAio (88165 ms total) 2021-01-28T04:01:55.600 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: 2021-01-28T04:01:55.600 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [----------] 16 tests from LibRadosAioEC 2021-01-28T04:01:55.600 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleWrite 2021-01-28T04:01:55.600 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleWrite (7036 ms) 2021-01-28T04:01:55.600 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAioEC.WaitForComplete 2021-01-28T04:01:55.601 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAioEC.WaitForComplete (6964 ms) 2021-01-28T04:01:55.601 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:55 smithi100 bash[13549]: cluster 2021-01-28T04:01:53.565100+0000 mgr.y (mgr.14138) 569 : cluster [DBG] pgmap v483: 332 pgs: 6 creating+peering, 58 unknown, 268 active+clean; 67 KiB data, 264 MiB used, 715 GiB / 715 GiB avail; 7.3 KiB/s rd, 10 KiB/s wr, 4 op/s 2021-01-28T04:01:55.602 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:55 smithi100 bash[13549]: audit 2021-01-28T04:01:54.165124+0000 mon.b (mon.2) 156 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:55.602 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:55 smithi100 bash[13549]: cluster 2021-01-28T04:01:54.542566+0000 mon.a (mon.0) 1211 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:01:55.602 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:55 smithi100 bash[13549]: audit 2021-01-28T04:01:54.560765+0000 mon.a (mon.0) 1212 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-26"}]': finished 2021-01-28T04:01:55.602 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:55 smithi100 bash[13549]: audit 2021-01-28T04:01:54.561023+0000 mon.a (mon.0) 1213 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-24","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:55.603 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:55 smithi100 bash[13549]: cluster 2021-01-28T04:01:54.561514+0000 mon.a (mon.0) 1214 : cluster [DBG] osdmap e156: 8 total, 8 up, 8 in 2021-01-28T04:01:55.603 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:55 smithi100 bash[13549]: audit 2021-01-28T04:01:54.566124+0000 mon.c (mon.1) 181 : audit [INF] from='client.? 172.21.15.100:0/856197522' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-26"}]: dispatch 2021-01-28T04:01:55.603 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:55 smithi100 bash[13549]: audit 2021-01-28T04:01:54.567341+0000 mon.a (mon.0) 1215 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-26"}]: dispatch 2021-01-28T04:01:55.603 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:55 smithi100 bash[13549]: audit 2021-01-28T04:01:54.622035+0000 mon.a (mon.0) 1216 : audit [INF] from='client.? 172.21.15.100:0/3366480354' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32315-36"}]: dispatch 2021-01-28T04:01:55.603 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:55 smithi100 bash[13549]: audit 2021-01-28T04:01:54.623597+0000 mon.a (mon.0) 1217 : audit [INF] from='client.? 172.21.15.100:0/3366480354' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32315-36"}]: dispatch 2021-01-28T04:01:55.604 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:55 smithi100 bash[13549]: audit 2021-01-28T04:01:54.628503+0000 mon.a (mon.0) 1218 : audit [INF] from='client.? 172.21.15.100:0/3366480354' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32315-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:55.604 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:55 smithi100 bash[9834]: cluster 2021-01-28T04:01:53.565100+0000 mgr.y (mgr.14138) 569 : cluster [DBG] pgmap v483: 332 pgs: 6 creating+peering, 58 unknown, 268 active+clean; 67 KiB data, 264 MiB used, 715 GiB / 715 GiB avail; 7.3 KiB/s rd, 10 KiB/s wr, 4 op/s 2021-01-28T04:01:55.604 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:55 smithi100 bash[9834]: audit 2021-01-28T04:01:54.165124+0000 mon.b (mon.2) 156 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:55.604 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:55 smithi100 bash[9834]: cluster 2021-01-28T04:01:54.542566+0000 mon.a (mon.0) 1211 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:01:55.605 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:55 smithi100 bash[9834]: audit 2021-01-28T04:01:54.560765+0000 mon.a (mon.0) 1212 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-26"}]': finished 2021-01-28T04:01:55.605 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:55 smithi100 bash[9834]: audit 2021-01-28T04:01:54.561023+0000 mon.a (mon.0) 1213 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-24","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:55.605 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:55 smithi100 bash[9834]: cluster 2021-01-28T04:01:54.561514+0000 mon.a (mon.0) 1214 : cluster [DBG] osdmap e156: 8 total, 8 up, 8 in 2021-01-28T04:01:55.605 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:55 smithi100 bash[9834]: audit 2021-01-28T04:01:54.566124+0000 mon.c (mon.1) 181 : audit [INF] from='client.? 172.21.15.100:0/856197522' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-26"}]: dispatch 2021-01-28T04:01:55.605 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:55 smithi100 bash[9834]: audit 2021-01-28T04:01:54.567341+0000 mon.a (mon.0) 1215 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-26"}]: dispatch 2021-01-28T04:01:55.606 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:55 smithi100 bash[9834]: audit 2021-01-28T04:01:54.622035+0000 mon.a (mon.0) 1216 : audit [INF] from='client.? 172.21.15.100:0/3366480354' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32315-36"}]: dispatch 2021-01-28T04:01:55.606 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:55 smithi100 bash[9834]: audit 2021-01-28T04:01:54.623597+0000 mon.a (mon.0) 1217 : audit [INF] from='client.? 172.21.15.100:0/3366480354' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32315-36"}]: dispatch 2021-01-28T04:01:55.606 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:55 smithi100 bash[9834]: audit 2021-01-28T04:01:54.628503+0000 mon.a (mon.0) 1218 : audit [INF] from='client.? 172.21.15.100:0/3366480354' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32315-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:56.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:56 smithi162 bash[9856]: audit 2021-01-28T04:01:55.166818+0000 mon.b (mon.2) 157 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:56.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:56 smithi162 bash[9856]: audit 2021-01-28T04:01:55.561813+0000 mon.a (mon.0) 1219 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-26"}]': finished 2021-01-28T04:01:56.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:56 smithi162 bash[9856]: audit 2021-01-28T04:01:55.562151+0000 mon.a (mon.0) 1220 : audit [INF] from='client.? 172.21.15.100:0/3366480354' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32315-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:01:56.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:56 smithi162 bash[9856]: cluster 2021-01-28T04:01:55.562367+0000 mon.a (mon.0) 1221 : cluster [DBG] osdmap e157: 8 total, 8 up, 8 in 2021-01-28T04:01:56.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:56 smithi162 bash[9856]: audit 2021-01-28T04:01:55.564614+0000 mon.a (mon.0) 1222 : audit [INF] from='client.? 172.21.15.100:0/3366480354' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32315-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32315-36"}]: dispatch 2021-01-28T04:01:56.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:56 smithi162 bash[9856]: audit 2021-01-28T04:01:55.607111+0000 mon.c (mon.1) 182 : audit [INF] from='client.? 172.21.15.100:0/3091285789' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-27"}]: dispatch 2021-01-28T04:01:56.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:56 smithi162 bash[9856]: audit 2021-01-28T04:01:56.038914+0000 mon.a (mon.0) 1223 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-27"}]: dispatch 2021-01-28T04:01:56.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:56 smithi162 bash[9856]: audit 2021-01-28T04:01:56.039935+0000 mon.c (mon.1) 183 : audit [INF] from='client.? 172.21.15.100:0/3091285789' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-27"}]: dispatch 2021-01-28T04:01:56.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:56 smithi162 bash[9856]: audit 2021-01-28T04:01:56.040519+0000 mon.a (mon.0) 1224 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-27"}]: dispatch 2021-01-28T04:01:56.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:56 smithi162 bash[9856]: audit 2021-01-28T04:01:56.041584+0000 mon.c (mon.1) 184 : audit [INF] from='client.? 172.21.15.100:0/3091285789' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:56.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:56 smithi162 bash[9856]: audit 2021-01-28T04:01:56.042108+0000 mon.a (mon.0) 1225 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:56.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:56 smithi100 bash[9834]: audit 2021-01-28T04:01:55.166818+0000 mon.b (mon.2) 157 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:56.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:56 smithi100 bash[9834]: audit 2021-01-28T04:01:55.561813+0000 mon.a (mon.0) 1219 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-26"}]': finished 2021-01-28T04:01:56.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:56 smithi100 bash[9834]: audit 2021-01-28T04:01:55.562151+0000 mon.a (mon.0) 1220 : audit [INF] from='client.? 172.21.15.100:0/3366480354' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32315-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:01:56.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:56 smithi100 bash[9834]: cluster 2021-01-28T04:01:55.562367+0000 mon.a (mon.0) 1221 : cluster [DBG] osdmap e157: 8 total, 8 up, 8 in 2021-01-28T04:01:56.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:56 smithi100 bash[9834]: audit 2021-01-28T04:01:55.564614+0000 mon.a (mon.0) 1222 : audit [INF] from='client.? 172.21.15.100:0/3366480354' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32315-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32315-36"}]: dispatch 2021-01-28T04:01:56.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:56 smithi100 bash[9834]: audit 2021-01-28T04:01:55.607111+0000 mon.c (mon.1) 182 : audit [INF] from='client.? 172.21.15.100:0/3091285789' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-27"}]: dispatch 2021-01-28T04:01:56.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:56 smithi100 bash[9834]: audit 2021-01-28T04:01:56.038914+0000 mon.a (mon.0) 1223 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-27"}]: dispatch 2021-01-28T04:01:56.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:56 smithi100 bash[9834]: audit 2021-01-28T04:01:56.039935+0000 mon.c (mon.1) 183 : audit [INF] from='client.? 172.21.15.100:0/3091285789' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-27"}]: dispatch 2021-01-28T04:01:56.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:56 smithi100 bash[9834]: audit 2021-01-28T04:01:56.040519+0000 mon.a (mon.0) 1224 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-27"}]: dispatch 2021-01-28T04:01:56.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:56 smithi100 bash[9834]: audit 2021-01-28T04:01:56.041584+0000 mon.c (mon.1) 184 : audit [INF] from='client.? 172.21.15.100:0/3091285789' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:56.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:56 smithi100 bash[9834]: audit 2021-01-28T04:01:56.042108+0000 mon.a (mon.0) 1225 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:56.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:56 smithi100 bash[13549]: audit 2021-01-28T04:01:55.166818+0000 mon.b (mon.2) 157 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:56.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:56 smithi100 bash[13549]: audit 2021-01-28T04:01:55.561813+0000 mon.a (mon.0) 1219 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-26"}]': finished 2021-01-28T04:01:56.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:56 smithi100 bash[13549]: audit 2021-01-28T04:01:55.562151+0000 mon.a (mon.0) 1220 : audit [INF] from='client.? 172.21.15.100:0/3366480354' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32315-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:01:56.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:56 smithi100 bash[13549]: cluster 2021-01-28T04:01:55.562367+0000 mon.a (mon.0) 1221 : cluster [DBG] osdmap e157: 8 total, 8 up, 8 in 2021-01-28T04:01:56.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:56 smithi100 bash[13549]: audit 2021-01-28T04:01:55.564614+0000 mon.a (mon.0) 1222 : audit [INF] from='client.? 172.21.15.100:0/3366480354' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32315-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32315-36"}]: dispatch 2021-01-28T04:01:56.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:56 smithi100 bash[13549]: audit 2021-01-28T04:01:55.607111+0000 mon.c (mon.1) 182 : audit [INF] from='client.? 172.21.15.100:0/3091285789' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-27"}]: dispatch 2021-01-28T04:01:56.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:56 smithi100 bash[13549]: audit 2021-01-28T04:01:56.038914+0000 mon.a (mon.0) 1223 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-27"}]: dispatch 2021-01-28T04:01:56.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:56 smithi100 bash[13549]: audit 2021-01-28T04:01:56.039935+0000 mon.c (mon.1) 183 : audit [INF] from='client.? 172.21.15.100:0/3091285789' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-27"}]: dispatch 2021-01-28T04:01:56.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:56 smithi100 bash[13549]: audit 2021-01-28T04:01:56.040519+0000 mon.a (mon.0) 1224 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-27"}]: dispatch 2021-01-28T04:01:56.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:56 smithi100 bash[13549]: audit 2021-01-28T04:01:56.041584+0000 mon.c (mon.1) 184 : audit [INF] from='client.? 172.21.15.100:0/3091285789' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:56.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:56 smithi100 bash[13549]: audit 2021-01-28T04:01:56.042108+0000 mon.a (mon.0) 1225 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:01:57.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:57 smithi162 bash[9856]: cluster 2021-01-28T04:01:55.565874+0000 mgr.y (mgr.14138) 570 : cluster [DBG] pgmap v486: 268 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 260 active+clean; 66 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 7.3 KiB/s rd, 10 KiB/s wr, 4 op/s 2021-01-28T04:01:57.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:57 smithi162 bash[9856]: audit 2021-01-28T04:01:56.168344+0000 mon.b (mon.2) 158 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:57.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:57 smithi162 bash[9856]: audit 2021-01-28T04:01:57.003166+0000 mon.a (mon.0) 1226 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:01:57.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:57 smithi162 bash[9856]: cluster 2021-01-28T04:01:57.003453+0000 mon.a (mon.0) 1227 : cluster [DBG] osdmap e158: 8 total, 8 up, 8 in 2021-01-28T04:01:57.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:57 smithi162 bash[9856]: audit 2021-01-28T04:01:57.004466+0000 mon.c (mon.1) 185 : audit [INF] from='client.? 172.21.15.100:0/3091285789' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-27"}]: dispatch 2021-01-28T04:01:57.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:57 smithi162 bash[9856]: audit 2021-01-28T04:01:57.004760+0000 mon.c (mon.1) 186 : audit [INF] from='client.? 172.21.15.100:0/2035052222' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:57.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:57 smithi162 bash[9856]: audit 2021-01-28T04:01:57.005131+0000 mon.c (mon.1) 187 : audit [INF] from='client.? 172.21.15.100:0/1998200160' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32434-19"}]: dispatch 2021-01-28T04:01:57.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:57 smithi162 bash[9856]: audit 2021-01-28T04:01:57.005197+0000 mon.a (mon.0) 1228 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-27"}]: dispatch 2021-01-28T04:01:57.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:57 smithi162 bash[9856]: audit 2021-01-28T04:01:57.006787+0000 mon.a (mon.0) 1229 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:57.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:57 smithi162 bash[9856]: audit 2021-01-28T04:01:57.007547+0000 mon.a (mon.0) 1230 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32434-19"}]: dispatch 2021-01-28T04:01:57.578 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:57 smithi100 bash[13549]: cluster 2021-01-28T04:01:55.565874+0000 mgr.y (mgr.14138) 570 : cluster [DBG] pgmap v486: 268 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 260 active+clean; 66 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 7.3 KiB/s rd, 10 KiB/s wr, 4 op/s 2021-01-28T04:01:57.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:57 smithi100 bash[13549]: audit 2021-01-28T04:01:56.168344+0000 mon.b (mon.2) 158 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:57.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:57 smithi100 bash[13549]: audit 2021-01-28T04:01:57.003166+0000 mon.a (mon.0) 1226 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:01:57.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:57 smithi100 bash[13549]: cluster 2021-01-28T04:01:57.003453+0000 mon.a (mon.0) 1227 : cluster [DBG] osdmap e158: 8 total, 8 up, 8 in 2021-01-28T04:01:57.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:57 smithi100 bash[13549]: audit 2021-01-28T04:01:57.004466+0000 mon.c (mon.1) 185 : audit [INF] from='client.? 172.21.15.100:0/3091285789' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-27"}]: dispatch 2021-01-28T04:01:57.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:57 smithi100 bash[13549]: audit 2021-01-28T04:01:57.004760+0000 mon.c (mon.1) 186 : audit [INF] from='client.? 172.21.15.100:0/2035052222' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:57.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:57 smithi100 bash[13549]: audit 2021-01-28T04:01:57.005131+0000 mon.c (mon.1) 187 : audit [INF] from='client.? 172.21.15.100:0/1998200160' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32434-19"}]: dispatch 2021-01-28T04:01:57.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:57 smithi100 bash[13549]: audit 2021-01-28T04:01:57.005197+0000 mon.a (mon.0) 1228 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-27"}]: dispatch 2021-01-28T04:01:57.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:57 smithi100 bash[13549]: audit 2021-01-28T04:01:57.006787+0000 mon.a (mon.0) 1229 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:57.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:57 smithi100 bash[13549]: audit 2021-01-28T04:01:57.007547+0000 mon.a (mon.0) 1230 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32434-19"}]: dispatch 2021-01-28T04:01:57.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:57 smithi100 bash[9834]: cluster 2021-01-28T04:01:55.565874+0000 mgr.y (mgr.14138) 570 : cluster [DBG] pgmap v486: 268 pgs: 2 active+clean+snaptrim, 6 active+clean+snaptrim_wait, 260 active+clean; 66 KiB data, 265 MiB used, 715 GiB / 715 GiB avail; 7.3 KiB/s rd, 10 KiB/s wr, 4 op/s 2021-01-28T04:01:57.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:57 smithi100 bash[9834]: audit 2021-01-28T04:01:56.168344+0000 mon.b (mon.2) 158 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:57.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:57 smithi100 bash[9834]: audit 2021-01-28T04:01:57.003166+0000 mon.a (mon.0) 1226 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:01:57.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:57 smithi100 bash[9834]: cluster 2021-01-28T04:01:57.003453+0000 mon.a (mon.0) 1227 : cluster [DBG] osdmap e158: 8 total, 8 up, 8 in 2021-01-28T04:01:57.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:57 smithi100 bash[9834]: audit 2021-01-28T04:01:57.004466+0000 mon.c (mon.1) 185 : audit [INF] from='client.? 172.21.15.100:0/3091285789' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-27"}]: dispatch 2021-01-28T04:01:57.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:57 smithi100 bash[9834]: audit 2021-01-28T04:01:57.004760+0000 mon.c (mon.1) 186 : audit [INF] from='client.? 172.21.15.100:0/2035052222' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:57.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:57 smithi100 bash[9834]: audit 2021-01-28T04:01:57.005131+0000 mon.c (mon.1) 187 : audit [INF] from='client.? 172.21.15.100:0/1998200160' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32434-19"}]: dispatch 2021-01-28T04:01:57.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:57 smithi100 bash[9834]: audit 2021-01-28T04:01:57.005197+0000 mon.a (mon.0) 1228 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-27"}]: dispatch 2021-01-28T04:01:57.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:57 smithi100 bash[9834]: audit 2021-01-28T04:01:57.006787+0000 mon.a (mon.0) 1229 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:01:57.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:57 smithi100 bash[9834]: audit 2021-01-28T04:01:57.007547+0000 mon.a (mon.0) 1230 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32434-19"}]: dispatch 2021-01-28T04:01:58.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:58 smithi162 bash[9856]: audit 2021-01-28T04:01:57.169935+0000 mon.b (mon.2) 159 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:58.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:58 smithi162 bash[9856]: audit 2021-01-28T04:01:57.345415+0000 mon.c (mon.1) 188 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:01:58.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:58 smithi162 bash[9856]: audit 2021-01-28T04:01:57.346180+0000 mon.a (mon.0) 1231 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:01:58.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:58 smithi162 bash[9856]: audit 2021-01-28T04:01:57.578886+0000 mon.a (mon.0) 1232 : audit [INF] from='client.? 172.21.15.100:0/3366480354' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32315-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32315-36"}]': finished 2021-01-28T04:01:58.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:58 smithi162 bash[9856]: audit 2021-01-28T04:01:58.019356+0000 mon.a (mon.0) 1233 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-25","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:58.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:58 smithi162 bash[9856]: audit 2021-01-28T04:01:58.019446+0000 mon.a (mon.0) 1234 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32434-19"}]': finished 2021-01-28T04:01:58.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:58 smithi162 bash[9856]: audit 2021-01-28T04:01:58.019537+0000 mon.a (mon.0) 1235 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:01:58.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:58 smithi162 bash[9856]: cluster 2021-01-28T04:01:58.019580+0000 mon.a (mon.0) 1236 : cluster [DBG] osdmap e159: 8 total, 8 up, 8 in 2021-01-28T04:01:58.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:58 smithi162 bash[9856]: audit 2021-01-28T04:01:58.020970+0000 mon.c (mon.1) 189 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-13"}]: dispatch 2021-01-28T04:01:58.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:58 smithi162 bash[9856]: audit 2021-01-28T04:01:58.022923+0000 mon.c (mon.1) 190 : audit [INF] from='client.? 172.21.15.100:0/1998200160' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32434-19"}]: dispatch 2021-01-28T04:01:58.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:58 smithi162 bash[9856]: audit 2021-01-28T04:01:58.025196+0000 mon.a (mon.0) 1237 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-13"}]: dispatch 2021-01-28T04:01:58.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:58 smithi162 bash[9856]: audit 2021-01-28T04:01:58.025948+0000 mon.a (mon.0) 1238 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32434-19"}]: dispatch 2021-01-28T04:01:58.578 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:58 smithi100 bash[13549]: audit 2021-01-28T04:01:57.169935+0000 mon.b (mon.2) 159 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:58.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:58 smithi100 bash[13549]: audit 2021-01-28T04:01:57.345415+0000 mon.c (mon.1) 188 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:01:58.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:58 smithi100 bash[13549]: audit 2021-01-28T04:01:57.346180+0000 mon.a (mon.0) 1231 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:01:58.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:58 smithi100 bash[13549]: audit 2021-01-28T04:01:57.578886+0000 mon.a (mon.0) 1232 : audit [INF] from='client.? 172.21.15.100:0/3366480354' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32315-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32315-36"}]': finished 2021-01-28T04:01:58.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:58 smithi100 bash[13549]: audit 2021-01-28T04:01:58.019356+0000 mon.a (mon.0) 1233 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-25","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:58.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:58 smithi100 bash[13549]: audit 2021-01-28T04:01:58.019446+0000 mon.a (mon.0) 1234 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32434-19"}]': finished 2021-01-28T04:01:58.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:58 smithi100 bash[13549]: audit 2021-01-28T04:01:58.019537+0000 mon.a (mon.0) 1235 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:01:58.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:58 smithi100 bash[13549]: cluster 2021-01-28T04:01:58.019580+0000 mon.a (mon.0) 1236 : cluster [DBG] osdmap e159: 8 total, 8 up, 8 in 2021-01-28T04:01:58.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:58 smithi100 bash[13549]: audit 2021-01-28T04:01:58.020970+0000 mon.c (mon.1) 189 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-13"}]: dispatch 2021-01-28T04:01:58.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:58 smithi100 bash[13549]: audit 2021-01-28T04:01:58.022923+0000 mon.c (mon.1) 190 : audit [INF] from='client.? 172.21.15.100:0/1998200160' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32434-19"}]: dispatch 2021-01-28T04:01:58.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:58 smithi100 bash[13549]: audit 2021-01-28T04:01:58.025196+0000 mon.a (mon.0) 1237 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-13"}]: dispatch 2021-01-28T04:01:58.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:58 smithi100 bash[13549]: audit 2021-01-28T04:01:58.025948+0000 mon.a (mon.0) 1238 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32434-19"}]: dispatch 2021-01-28T04:01:58.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:58 smithi100 bash[9834]: audit 2021-01-28T04:01:57.169935+0000 mon.b (mon.2) 159 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:58.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:58 smithi100 bash[9834]: audit 2021-01-28T04:01:57.345415+0000 mon.c (mon.1) 188 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:01:58.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:58 smithi100 bash[9834]: audit 2021-01-28T04:01:57.346180+0000 mon.a (mon.0) 1231 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:01:58.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:58 smithi100 bash[9834]: audit 2021-01-28T04:01:57.578886+0000 mon.a (mon.0) 1232 : audit [INF] from='client.? 172.21.15.100:0/3366480354' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32315-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32315-36"}]': finished 2021-01-28T04:01:58.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:58 smithi100 bash[9834]: audit 2021-01-28T04:01:58.019356+0000 mon.a (mon.0) 1233 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-25","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:01:58.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:58 smithi100 bash[9834]: audit 2021-01-28T04:01:58.019446+0000 mon.a (mon.0) 1234 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32434-19"}]': finished 2021-01-28T04:01:58.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:58 smithi100 bash[9834]: audit 2021-01-28T04:01:58.019537+0000 mon.a (mon.0) 1235 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:01:58.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:58 smithi100 bash[9834]: cluster 2021-01-28T04:01:58.019580+0000 mon.a (mon.0) 1236 : cluster [DBG] osdmap e159: 8 total, 8 up, 8 in 2021-01-28T04:01:58.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:58 smithi100 bash[9834]: audit 2021-01-28T04:01:58.020970+0000 mon.c (mon.1) 189 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-13"}]: dispatch 2021-01-28T04:01:58.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:58 smithi100 bash[9834]: audit 2021-01-28T04:01:58.022923+0000 mon.c (mon.1) 190 : audit [INF] from='client.? 172.21.15.100:0/1998200160' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32434-19"}]: dispatch 2021-01-28T04:01:58.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:58 smithi100 bash[9834]: audit 2021-01-28T04:01:58.025196+0000 mon.a (mon.0) 1237 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-13"}]: dispatch 2021-01-28T04:01:58.584 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:58 smithi100 bash[9834]: audit 2021-01-28T04:01:58.025948+0000 mon.a (mon.0) 1238 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32434-19"}]: dispatch 2021-01-28T04:01:58.590 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAioEC.Rou api_snapshots_pp: Running main() from gmock_main.cc 2021-01-28T04:01:58.591 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [==========] Running 18 tests from 4 test suites. 2021-01-28T04:01:58.591 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [----------] Global test environment set-up. 2021-01-28T04:01:58.591 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP 2021-01-28T04:01:58.592 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: seed 32434 2021-01-28T04:01:58.592 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapListPP 2021-01-28T04:01:58.592 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapListPP (5483 ms) 2021-01-28T04:01:58.592 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2021-01-28T04:01:58.592 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapRemovePP (4134 ms) 2021-01-28T04:01:58.593 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.RollbackPP 2021-01-28T04:01:58.593 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.RollbackPP (2885 ms) 2021-01-28T04:01:58.593 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2021-01-28T04:01:58.593 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapGetNamePP (1526 ms) 2021-01-28T04:01:58.593 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2021-01-28T04:01:58.594 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (4176 ms) 2021-01-28T04:01:58.594 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP (18204 ms total) 2021-01-28T04:01:58.594 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: 2021-01-28T04:01:58.595 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [----------] 6 tests from LibRadosSnapshotsSelfManagedPP 2021-01-28T04:01:58.595 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2021-01-28T04:01:58.595 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (4415 ms) 2021-01-28T04:01:58.596 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2021-01-28T04:01:58.596 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (4674 ms) 2021-01-28T04:01:58.596 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2021-01-28T04:01:58.596 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (5658 ms) 2021-01-28T04:01:58.596 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2021-01-28T04:01:58.597 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (4001 ms) 2021-01-28T04:01:58.597 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2021-01-28T04:01:58.597 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (2065 ms) 2021-01-28T04:01:58.597 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2021-01-28T04:01:58.597 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: deleting snap 23 in pool test-rados-api-smithi100-32434-7 2021-01-28T04:01:58.598 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: waiting for snaps to purge 2021-01-28T04:01:58.598 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (17942 ms) 2021-01-28T04:01:58.598 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [----------] 6 tests from LibRadosSnapshotsSelfManagedPP (38755 ms total) 2021-01-28T04:01:58.598 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: 2021-01-28T04:01:58.599 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP 2021-01-28T04:01:58.599 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapListPP 2021-01-28T04:01:58.600 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapListPP (3010 ms) 2021-01-28T04:01:58.600 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2021-01-28T04:01:58.601 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapRemovePP (2009 ms) 2021-01-28T04:01:58.601 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.RollbackPP 2021-01-28T04:01:58.601 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.RollbackPP (2006 ms) 2021-01-28T04:01:58.601 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2021-01-28T04:01:58.602 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapGetNamePP (2437 ms) 2021-01-28T04:01:58.602 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP (9462 ms total) 2021-01-28T04:01:58.603 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: 2021-01-28T04:01:58.603 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2021-01-28T04:01:58.603 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2021-01-28T04:01:58.604 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.SnapPP (4053 ms) 2021-01-28T04:01:58.604 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2021-01-28T04:01:58.605 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (3978 ms) 2021-01-28T04:01:58.605 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2021-01-28T04:01:58.605 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (3950 ms) 2021-01-28T04:01:58.606 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (11981 ms total) 2021-01-28T04:01:58.607 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: 2021-01-28T04:01:58.608 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [----------] Global test environment tear-down 2021-01-28T04:01:58.608 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [==========] 18 tests from 4 test suites ran. (105064 ms total) 2021-01-28T04:01:58.608 INFO:tasks.workunit.client.0.smithi100.stdout: api_snapshots_pp: [ PASSED ] 18 tests. 2021-01-28T04:01:59.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:59 smithi162 bash[9856]: cluster 2021-01-28T04:01:57.567608+0000 mgr.y (mgr.14138) 571 : cluster [DBG] pgmap v488: 292 pgs: 14 creating+peering, 2 active+clean+snaptrim, 18 unknown, 6 active+clean+snaptrim_wait, 252 active+clean; 32 KiB data, 274 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 2 op/s 2021-01-28T04:01:59.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:59 smithi162 bash[9856]: audit 2021-01-28T04:01:58.171494+0000 mon.b (mon.2) 160 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:59.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:59 smithi162 bash[9856]: cluster 2021-01-28T04:01:58.572638+0000 mon.a (mon.0) 1239 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:01:59.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:59 smithi162 bash[9856]: audit 2021-01-28T04:01:58.581406+0000 mon.a (mon.0) 1240 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-27"}]': finished 2021-01-28T04:01:59.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:59 smithi162 bash[9856]: audit 2021-01-28T04:01:58.581908+0000 mon.a (mon.0) 1241 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-13"}]': finished 2021-01-28T04:01:59.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:59 smithi162 bash[9856]: audit 2021-01-28T04:01:58.582089+0000 mon.a (mon.0) 1242 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32434-19"}]': finished 2021-01-28T04:01:59.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:01:59 smithi162 bash[9856]: cluster 2021-01-28T04:01:58.582290+0000 mon.a (mon.0) 1243 : cluster [DBG] osdmap e160: 8 total, 8 up, 8 in 2021-01-28T04:01:59.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:59 smithi100 bash[9834]: cluster 2021-01-28T04:01:57.567608+0000 mgr.y (mgr.14138) 571 : cluster [DBG] pgmap v488: 292 pgs: 14 creating+peering, 2 active+clean+snaptrim, 18 unknown, 6 active+clean+snaptrim_wait, 252 active+clean; 32 KiB data, 274 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 2 op/s 2021-01-28T04:01:59.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:59 smithi100 bash[9834]: audit 2021-01-28T04:01:58.171494+0000 mon.b (mon.2) 160 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:59.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:59 smithi100 bash[9834]: cluster 2021-01-28T04:01:58.572638+0000 mon.a (mon.0) 1239 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:01:59.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:59 smithi100 bash[9834]: audit 2021-01-28T04:01:58.581406+0000 mon.a (mon.0) 1240 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-27"}]': finished 2021-01-28T04:01:59.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:59 smithi100 bash[9834]: audit 2021-01-28T04:01:58.581908+0000 mon.a (mon.0) 1241 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-13"}]': finished 2021-01-28T04:01:59.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:59 smithi100 bash[9834]: audit 2021-01-28T04:01:58.582089+0000 mon.a (mon.0) 1242 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32434-19"}]': finished 2021-01-28T04:01:59.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:01:59 smithi100 bash[9834]: cluster 2021-01-28T04:01:58.582290+0000 mon.a (mon.0) 1243 : cluster [DBG] osdmap e160: 8 total, 8 up, 8 in 2021-01-28T04:01:59.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:59 smithi100 bash[13549]: cluster 2021-01-28T04:01:57.567608+0000 mgr.y (mgr.14138) 571 : cluster [DBG] pgmap v488: 292 pgs: 14 creating+peering, 2 active+clean+snaptrim, 18 unknown, 6 active+clean+snaptrim_wait, 252 active+clean; 32 KiB data, 274 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 2 op/s 2021-01-28T04:01:59.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:59 smithi100 bash[13549]: audit 2021-01-28T04:01:58.171494+0000 mon.b (mon.2) 160 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:01:59.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:59 smithi100 bash[13549]: cluster 2021-01-28T04:01:58.572638+0000 mon.a (mon.0) 1239 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:01:59.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:59 smithi100 bash[13549]: audit 2021-01-28T04:01:58.581406+0000 mon.a (mon.0) 1240 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-27"}]': finished 2021-01-28T04:01:59.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:59 smithi100 bash[13549]: audit 2021-01-28T04:01:58.581908+0000 mon.a (mon.0) 1241 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-13"}]': finished 2021-01-28T04:01:59.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:59 smithi100 bash[13549]: audit 2021-01-28T04:01:58.582089+0000 mon.a (mon.0) 1242 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32434-19"}]': finished 2021-01-28T04:01:59.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:01:59 smithi100 bash[13549]: cluster 2021-01-28T04:01:58.582290+0000 mon.a (mon.0) 1243 : cluster [DBG] osdmap e160: 8 total, 8 up, 8 in 2021-01-28T04:02:00.077 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 04:01:59 smithi100 bash[10061]: debug 2021-01-28T04:01:59.785+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:02:00.167 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 04:01:59 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T04:02:00.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:00 smithi162 bash[9856]: audit 2021-01-28T04:01:59.173021+0000 mon.b (mon.2) 161 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:00.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:00 smithi162 bash[9856]: cluster 2021-01-28T04:01:59.588374+0000 mon.a (mon.0) 1244 : cluster [DBG] osdmap e161: 8 total, 8 up, 8 in 2021-01-28T04:02:00.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:00 smithi162 bash[9856]: audit 2021-01-28T04:01:59.595339+0000 mon.a (mon.0) 1245 : audit [INF] from='client.? 172.21.15.100:0/3366480354' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32315-36"}]: dispatch 2021-01-28T04:02:00.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:00 smithi162 bash[9856]: audit 2021-01-28T04:01:59.595803+0000 mon.a (mon.0) 1246 : audit [INF] from='client.? 172.21.15.100:0/1286049952' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:00.578 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:00 smithi100 bash[13549]: audit 2021-01-28T04:01:59.173021+0000 mon.b (mon.2) 161 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:00.578 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:00 smithi100 bash[13549]: cluster 2021-01-28T04:01:59.588374+0000 mon.a (mon.0) 1244 : cluster [DBG] osdmap e161: 8 total, 8 up, 8 in 2021-01-28T04:02:00.578 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:00 smithi100 bash[13549]: audit 2021-01-28T04:01:59.595339+0000 mon.a (mon.0) 1245 : audit [INF] from='client.? 172.21.15.100:0/3366480354' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32315-36"}]: dispatch 2021-01-28T04:02:00.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:00 smithi100 bash[13549]: audit 2021-01-28T04:01:59.595803+0000 mon.a (mon.0) 1246 : audit [INF] from='client.? 172.21.15.100:0/1286049952' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:00.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:00 smithi100 bash[9834]: audit 2021-01-28T04:01:59.173021+0000 mon.b (mon.2) 161 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:00.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:00 smithi100 bash[9834]: cluster 2021-01-28T04:01:59.588374+0000 mon.a (mon.0) 1244 : cluster [DBG] osdmap e161: 8 total, 8 up, 8 in 2021-01-28T04:02:00.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:00 smithi100 bash[9834]: audit 2021-01-28T04:01:59.595339+0000 mon.a (mon.0) 1245 : audit [INF] from='client.? 172.21.15.100:0/3366480354' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32315-36"}]: dispatch 2021-01-28T04:02:00.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:00 smithi100 bash[9834]: audit 2021-01-28T04:01:59.595803+0000 mon.a (mon.0) 1246 : audit [INF] from='client.? 172.21.15.100:0/1286049952' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:01.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:01 smithi162 bash[9856]: cluster 2021-01-28T04:01:59.569173+0000 mgr.y (mgr.14138) 572 : cluster [DBG] pgmap v491: 276 pgs: 1 creating+activating, 4 creating+peering, 10 unknown, 261 active+clean; 29 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 13 op/s 2021-01-28T04:02:01.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:01 smithi162 bash[9856]: audit 2021-01-28T04:01:59.791254+0000 mgr.y (mgr.14138) 573 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:02:01.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:01 smithi162 bash[9856]: audit 2021-01-28T04:02:00.174618+0000 mon.b (mon.2) 162 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:01.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:01 smithi162 bash[9856]: audit 2021-01-28T04:02:00.589381+0000 mon.a (mon.0) 1247 : audit [INF] from='client.? 172.21.15.100:0/3366480354' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32315-36"}]': finished 2021-01-28T04:02:01.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:01 smithi162 bash[9856]: audit 2021-01-28T04:02:00.589530+0000 mon.a (mon.0) 1248 : audit [INF] from='client.? 172.21.15.100:0/1286049952' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-26","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:01.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:01 smithi162 bash[9856]: cluster 2021-01-28T04:02:00.590036+0000 mon.a (mon.0) 1249 : cluster [DBG] osdmap e162: 8 total, 8 up, 8 in 2021-01-28T04:02:01.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:01 smithi162 bash[9856]: audit 2021-01-28T04:02:00.591699+0000 mon.c (mon.1) 191 : audit [INF] from='client.? 172.21.15.100:0/3091285789' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-27"}]: dispatch 2021-01-28T04:02:01.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:01 smithi162 bash[9856]: audit 2021-01-28T04:02:00.592803+0000 mon.a (mon.0) 1250 : audit [INF] from='client.? 172.21.15.100:0/3366480354' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32315-36"}]: dispatch 2021-01-28T04:02:01.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:01 smithi162 bash[9856]: audit 2021-01-28T04:02:00.595525+0000 mon.a (mon.0) 1251 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-27"}]: dispatch 2021-01-28T04:02:01.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:01 smithi162 bash[9856]: audit 2021-01-28T04:02:00.598119+0000 mon.c (mon.1) 192 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:01.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:01 smithi162 bash[9856]: audit 2021-01-28T04:02:00.598838+0000 mon.a (mon.0) 1252 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:01.578 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:01 smithi100 bash[13549]: cluster 2021-01-28T04:01:59.569173+0000 mgr.y (mgr.14138) 572 : cluster [DBG] pgmap v491: 276 pgs: 1 creating+activating, 4 creating+peering, 10 unknown, 261 active+clean; 29 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 13 op/s 2021-01-28T04:02:01.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:01 smithi100 bash[13549]: audit 2021-01-28T04:01:59.791254+0000 mgr.y (mgr.14138) 573 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:02:01.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:01 smithi100 bash[13549]: audit 2021-01-28T04:02:00.174618+0000 mon.b (mon.2) 162 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:01.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:01 smithi100 bash[13549]: audit 2021-01-28T04:02:00.589381+0000 mon.a (mon.0) 1247 : audit [INF] from='client.? 172.21.15.100:0/3366480354' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32315-36"}]': finished 2021-01-28T04:02:01.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:01 smithi100 bash[13549]: audit 2021-01-28T04:02:00.589530+0000 mon.a (mon.0) 1248 : audit [INF] from='client.? 172.21.15.100:0/1286049952' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-26","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:01.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:01 smithi100 bash[13549]: cluster 2021-01-28T04:02:00.590036+0000 mon.a (mon.0) 1249 : cluster [DBG] osdmap e162: 8 total, 8 up, 8 in 2021-01-28T04:02:01.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:01 smithi100 bash[13549]: audit 2021-01-28T04:02:00.591699+0000 mon.c (mon.1) 191 : audit [INF] from='client.? 172.21.15.100:0/3091285789' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-27"}]: dispatch 2021-01-28T04:02:01.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:01 smithi100 bash[13549]: audit 2021-01-28T04:02:00.592803+0000 mon.a (mon.0) 1250 : audit [INF] from='client.? 172.21.15.100:0/3366480354' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32315-36"}]: dispatch 2021-01-28T04:02:01.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:01 smithi100 bash[13549]: audit 2021-01-28T04:02:00.595525+0000 mon.a (mon.0) 1251 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-27"}]: dispatch 2021-01-28T04:02:01.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:01 smithi100 bash[13549]: audit 2021-01-28T04:02:00.598119+0000 mon.c (mon.1) 192 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:01.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:01 smithi100 bash[13549]: audit 2021-01-28T04:02:00.598838+0000 mon.a (mon.0) 1252 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:01.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:01 smithi100 bash[9834]: cluster 2021-01-28T04:01:59.569173+0000 mgr.y (mgr.14138) 572 : cluster [DBG] pgmap v491: 276 pgs: 1 creating+activating, 4 creating+peering, 10 unknown, 261 active+clean; 29 KiB data, 278 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 13 op/s 2021-01-28T04:02:01.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:01 smithi100 bash[9834]: audit 2021-01-28T04:01:59.791254+0000 mgr.y (mgr.14138) 573 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:02:01.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:01 smithi100 bash[9834]: audit 2021-01-28T04:02:00.174618+0000 mon.b (mon.2) 162 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:01.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:01 smithi100 bash[9834]: audit 2021-01-28T04:02:00.589381+0000 mon.a (mon.0) 1247 : audit [INF] from='client.? 172.21.15.100:0/3366480354' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32315-36"}]': finished 2021-01-28T04:02:01.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:01 smithi100 bash[9834]: audit 2021-01-28T04:02:00.589530+0000 mon.a (mon.0) 1248 : audit [INF] from='client.? 172.21.15.100:0/1286049952' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-26","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:01.584 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:01 smithi100 bash[9834]: cluster 2021-01-28T04:02:00.590036+0000 mon.a (mon.0) 1249 : cluster [DBG] osdmap e162: 8 total, 8 up, 8 in 2021-01-28T04:02:01.584 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:01 smithi100 bash[9834]: audit 2021-01-28T04:02:00.591699+0000 mon.c (mon.1) 191 : audit [INF] from='client.? 172.21.15.100:0/3091285789' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-27"}]: dispatch 2021-01-28T04:02:01.585 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:01 smithi100 bash[9834]: audit 2021-01-28T04:02:00.592803+0000 mon.a (mon.0) 1250 : audit [INF] from='client.? 172.21.15.100:0/3366480354' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32315-36"}]: dispatch 2021-01-28T04:02:01.586 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:01 smithi100 bash[9834]: audit 2021-01-28T04:02:00.595525+0000 mon.a (mon.0) 1251 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-27"}]: dispatch 2021-01-28T04:02:01.586 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:01 smithi100 bash[9834]: audit 2021-01-28T04:02:00.598119+0000 mon.c (mon.1) 192 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:01.586 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:01 smithi100 bash[9834]: audit 2021-01-28T04:02:00.598838+0000 mon.a (mon.0) 1252 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:01.606 INFO:tasks.workunit.client.0.smithi100.stdout:scPP (69979 ms total) 2021-01-28T04:02:01.607 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: 2021-01-28T04:02:01.607 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP 2021-01-28T04:02:01.607 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2021-01-28T04:02:01.607 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ OK ] LibRadosTwoPoolsECPP.CopyFrom (168 ms) 2021-01-28T04:02:01.608 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP (168 ms total) 2021-01-28T04:02:01.608 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: 2021-01-28T04:02:01.608 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2021-01-28T04:02:01.608 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Subset 2021-01-28T04:02:01.609 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Subset (30 ms) 2021-01-28T04:02:01.609 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Chunked 2021-01-28T04:02:01.609 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Chunked (11 ms) 2021-01-28T04:02:01.609 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0 (41 ms total) 2021-01-28T04:02:01.610 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: 2021-01-28T04:02:01.610 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2021-01-28T04:02:01.610 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Subset 2021-01-28T04:02:01.611 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Subset (7 ms) 2021-01-28T04:02:01.611 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Chunked 2021-01-28T04:02:01.611 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Chunked (6 ms) 2021-01-28T04:02:01.612 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1 (13 ms total) 2021-01-28T04:02:01.612 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: 2021-01-28T04:02:01.613 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2021-01-28T04:02:01.613 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Subset 2021-01-28T04:02:01.614 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Subset (71 ms) 2021-01-28T04:02:01.614 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Chunked 2021-01-28T04:02:01.614 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Chunked (8 ms) 2021-01-28T04:02:01.615 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2 (80 ms total) 2021-01-28T04:02:01.615 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: 2021-01-28T04:02:01.615 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP 2021-01-28T04:02:01.615 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ RUN ] LibRadosMiscECPP.CompareExtentRange 2021-01-28T04:02:01.615 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ OK ] LibRadosMiscECPP.CompareExtentRange (600 ms) 2021-01-28T04:02:01.616 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP (600 ms total) 2021-01-28T04:02:01.616 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: 2021-01-28T04:02:01.616 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [----------] Global test environment tear-down 2021-01-28T04:02:01.616 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [==========] 31 tests from 7 test suites ran. (108119 ms total) 2021-01-28T04:02:01.616 INFO:tasks.workunit.client.0.smithi100.stdout: api_misc_pp: [ PASSED ] 31 tests. 2021-01-28T04:02:02.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:02 smithi162 bash[9856]: audit 2021-01-28T04:02:01.176287+0000 mon.b (mon.2) 163 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:02.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:02 smithi162 bash[9856]: audit 2021-01-28T04:02:01.595735+0000 mon.a (mon.0) 1253 : audit [INF] from='client.? 172.21.15.100:0/3366480354' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32315-36"}]': finished 2021-01-28T04:02:02.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:02 smithi162 bash[9856]: audit 2021-01-28T04:02:01.595911+0000 mon.a (mon.0) 1254 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-27"}]': finished 2021-01-28T04:02:02.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:02 smithi162 bash[9856]: audit 2021-01-28T04:02:01.596175+0000 mon.a (mon.0) 1255 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:02.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:02 smithi162 bash[9856]: cluster 2021-01-28T04:02:01.597625+0000 mon.a (mon.0) 1256 : cluster [DBG] osdmap e163: 8 total, 8 up, 8 in 2021-01-28T04:02:02.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:02 smithi162 bash[9856]: audit 2021-01-28T04:02:01.598769+0000 mon.c (mon.1) 193 : audit [INF] from='client.? 172.21.15.100:0/3091285789' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-27"}]: dispatch 2021-01-28T04:02:02.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:02 smithi162 bash[9856]: audit 2021-01-28T04:02:01.599282+0000 mon.a (mon.0) 1257 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-27"}]: dispatch 2021-01-28T04:02:02.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:02 smithi100 bash[9834]: audit 2021-01-28T04:02:01.176287+0000 mon.b (mon.2) 163 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:02.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:02 smithi100 bash[9834]: audit 2021-01-28T04:02:01.595735+0000 mon.a (mon.0) 1253 : audit [INF] from='client.? 172.21.15.100:0/3366480354' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32315-36"}]': finished 2021-01-28T04:02:02.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:02 smithi100 bash[9834]: audit 2021-01-28T04:02:01.595911+0000 mon.a (mon.0) 1254 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-27"}]': finished 2021-01-28T04:02:02.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:02 smithi100 bash[9834]: audit 2021-01-28T04:02:01.596175+0000 mon.a (mon.0) 1255 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:02.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:02 smithi100 bash[9834]: cluster 2021-01-28T04:02:01.597625+0000 mon.a (mon.0) 1256 : cluster [DBG] osdmap e163: 8 total, 8 up, 8 in 2021-01-28T04:02:02.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:02 smithi100 bash[9834]: audit 2021-01-28T04:02:01.598769+0000 mon.c (mon.1) 193 : audit [INF] from='client.? 172.21.15.100:0/3091285789' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-27"}]: dispatch 2021-01-28T04:02:02.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:02 smithi100 bash[9834]: audit 2021-01-28T04:02:01.599282+0000 mon.a (mon.0) 1257 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-27"}]: dispatch 2021-01-28T04:02:02.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:02 smithi100 bash[13549]: audit 2021-01-28T04:02:01.176287+0000 mon.b (mon.2) 163 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:02.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:02 smithi100 bash[13549]: audit 2021-01-28T04:02:01.595735+0000 mon.a (mon.0) 1253 : audit [INF] from='client.? 172.21.15.100:0/3366480354' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32315-36"}]': finished 2021-01-28T04:02:02.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:02 smithi100 bash[13549]: audit 2021-01-28T04:02:01.595911+0000 mon.a (mon.0) 1254 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-27"}]': finished 2021-01-28T04:02:02.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:02 smithi100 bash[13549]: audit 2021-01-28T04:02:01.596175+0000 mon.a (mon.0) 1255 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:02.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:02 smithi100 bash[13549]: cluster 2021-01-28T04:02:01.597625+0000 mon.a (mon.0) 1256 : cluster [DBG] osdmap e163: 8 total, 8 up, 8 in 2021-01-28T04:02:02.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:02 smithi100 bash[13549]: audit 2021-01-28T04:02:01.598769+0000 mon.c (mon.1) 193 : audit [INF] from='client.? 172.21.15.100:0/3091285789' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-27"}]: dispatch 2021-01-28T04:02:02.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:02 smithi100 bash[13549]: audit 2021-01-28T04:02:01.599282+0000 mon.a (mon.0) 1257 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-27"}]: dispatch 2021-01-28T04:02:03.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:03 smithi162 bash[9856]: cluster 2021-01-28T04:02:01.570341+0000 mgr.y (mgr.14138) 574 : cluster [DBG] pgmap v494: 292 pgs: 2 creating+peering, 59 unknown, 231 active+clean; 28 KiB data, 279 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:02:03.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:03 smithi162 bash[9856]: audit 2021-01-28T04:02:02.178249+0000 mon.b (mon.2) 164 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:03.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:03 smithi162 bash[9856]: audit 2021-01-28T04:02:02.599514+0000 mon.a (mon.0) 1258 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-27"}]': finished 2021-01-28T04:02:03.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:03 smithi162 bash[9856]: cluster 2021-01-28T04:02:02.599935+0000 mon.a (mon.0) 1259 : cluster [DBG] osdmap e164: 8 total, 8 up, 8 in 2021-01-28T04:02:03.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:03 smithi162 bash[9856]: audit 2021-01-28T04:02:02.605129+0000 mon.c (mon.1) 194 : audit [INF] from='client.? 172.21.15.100:0/1821582525' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:03.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:03 smithi162 bash[9856]: audit 2021-01-28T04:02:02.606014+0000 mon.a (mon.0) 1260 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:03.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:03 smithi162 bash[9856]: audit 2021-01-28T04:02:02.622620+0000 mon.c (mon.1) 195 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-15", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:03.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:03 smithi162 bash[9856]: audit 2021-01-28T04:02:02.623538+0000 mon.a (mon.0) 1261 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-15", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:03.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:03 smithi162 bash[9856]: audit 2021-01-28T04:02:02.628016+0000 mon.a (mon.0) 1262 : audit [INF] from='client.? 172.21.15.100:0/3294915266' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-28"}]: dispatch 2021-01-28T04:02:03.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:03 smithi162 bash[9856]: audit 2021-01-28T04:02:02.629121+0000 mon.a (mon.0) 1263 : audit [INF] from='client.? 172.21.15.100:0/3294915266' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-28"}]: dispatch 2021-01-28T04:02:03.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:03 smithi162 bash[9856]: audit 2021-01-28T04:02:02.629596+0000 mon.a (mon.0) 1264 : audit [INF] from='client.? 172.21.15.100:0/3294915266' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:03.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:03 smithi162 bash[9856]: audit 2021-01-28T04:02:03.180135+0000 mon.b (mon.2) 165 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:03.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:03 smithi100 bash[9834]: cluster 2021-01-28T04:02:01.570341+0000 mgr.y (mgr.14138) 574 : cluster [DBG] pgmap v494: 292 pgs: 2 creating+peering, 59 unknown, 231 active+clean; 28 KiB data, 279 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:02:03.772 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:03 smithi100 bash[9834]: audit 2021-01-28T04:02:02.178249+0000 mon.b (mon.2) 164 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:03.773 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:03 smithi100 bash[9834]: audit 2021-01-28T04:02:02.599514+0000 mon.a (mon.0) 1258 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-27"}]': finished 2021-01-28T04:02:03.773 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:03 smithi100 bash[9834]: cluster 2021-01-28T04:02:02.599935+0000 mon.a (mon.0) 1259 : cluster [DBG] osdmap e164: 8 total, 8 up, 8 in 2021-01-28T04:02:03.773 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:03 smithi100 bash[9834]: audit 2021-01-28T04:02:02.605129+0000 mon.c (mon.1) 194 : audit [INF] from='client.? 172.21.15.100:0/1821582525' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:03.774 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:03 smithi100 bash[9834]: audit 2021-01-28T04:02:02.606014+0000 mon.a (mon.0) 1260 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:03.774 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:03 smithi100 bash[9834]: audit 2021-01-28T04:02:02.622620+0000 mon.c (mon.1) 195 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-15", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:03.774 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:03 smithi100 bash[9834]: audit 2021-01-28T04:02:02.623538+0000 mon.a (mon.0) 1261 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-15", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:03.775 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:03 smithi100 bash[9834]: audit 2021-01-28T04:02:02.628016+0000 mon.a (mon.0) 1262 : audit [INF] from='client.? 172.21.15.100:0/3294915266' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-28"}]: dispatch 2021-01-28T04:02:03.775 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:03 smithi100 bash[9834]: audit 2021-01-28T04:02:02.629121+0000 mon.a (mon.0) 1263 : audit [INF] from='client.? 172.21.15.100:0/3294915266' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-28"}]: dispatch 2021-01-28T04:02:03.775 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:03 smithi100 bash[9834]: audit 2021-01-28T04:02:02.629596+0000 mon.a (mon.0) 1264 : audit [INF] from='client.? 172.21.15.100:0/3294915266' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:03.775 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:03 smithi100 bash[9834]: audit 2021-01-28T04:02:03.180135+0000 mon.b (mon.2) 165 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:03.776 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:03 smithi100 bash[13549]: cluster 2021-01-28T04:02:01.570341+0000 mgr.y (mgr.14138) 574 : cluster [DBG] pgmap v494: 292 pgs: 2 creating+peering, 59 unknown, 231 active+clean; 28 KiB data, 279 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:02:03.776 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:03 smithi100 bash[13549]: audit 2021-01-28T04:02:02.178249+0000 mon.b (mon.2) 164 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:03.776 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:03 smithi100 bash[13549]: audit 2021-01-28T04:02:02.599514+0000 mon.a (mon.0) 1258 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-27"}]': finished 2021-01-28T04:02:03.776 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:03 smithi100 bash[13549]: cluster 2021-01-28T04:02:02.599935+0000 mon.a (mon.0) 1259 : cluster [DBG] osdmap e164: 8 total, 8 up, 8 in 2021-01-28T04:02:03.777 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:03 smithi100 bash[13549]: audit 2021-01-28T04:02:02.605129+0000 mon.c (mon.1) 194 : audit [INF] from='client.? 172.21.15.100:0/1821582525' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:03.777 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:03 smithi100 bash[13549]: audit 2021-01-28T04:02:02.606014+0000 mon.a (mon.0) 1260 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:03.777 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:03 smithi100 bash[13549]: audit 2021-01-28T04:02:02.622620+0000 mon.c (mon.1) 195 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-15", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:03.777 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:03 smithi100 bash[13549]: audit 2021-01-28T04:02:02.623538+0000 mon.a (mon.0) 1261 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-15", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:03.778 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:03 smithi100 bash[13549]: audit 2021-01-28T04:02:02.628016+0000 mon.a (mon.0) 1262 : audit [INF] from='client.? 172.21.15.100:0/3294915266' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-28"}]: dispatch 2021-01-28T04:02:03.778 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:03 smithi100 bash[13549]: audit 2021-01-28T04:02:02.629121+0000 mon.a (mon.0) 1263 : audit [INF] from='client.? 172.21.15.100:0/3294915266' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-28"}]: dispatch 2021-01-28T04:02:03.778 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:03 smithi100 bash[13549]: audit 2021-01-28T04:02:02.629596+0000 mon.a (mon.0) 1264 : audit [INF] from='client.? 172.21.15.100:0/3294915266' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:03.779 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:03 smithi100 bash[13549]: audit 2021-01-28T04:02:03.180135+0000 mon.b (mon.2) 165 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:04.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:04 smithi162 bash[9856]: cluster 2021-01-28T04:02:03.539632+0000 mon.a (mon.0) 1265 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:02:04.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:04 smithi162 bash[9856]: audit 2021-01-28T04:02:03.551031+0000 mon.a (mon.0) 1266 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-27","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:04.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:04 smithi162 bash[9856]: audit 2021-01-28T04:02:03.552960+0000 mon.a (mon.0) 1267 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-15", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:02:04.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:04 smithi162 bash[9856]: audit 2021-01-28T04:02:03.553138+0000 mon.a (mon.0) 1268 : audit [INF] from='client.? 172.21.15.100:0/3294915266' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:02:04.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:04 smithi162 bash[9856]: cluster 2021-01-28T04:02:03.553255+0000 mon.a (mon.0) 1269 : cluster [DBG] osdmap e165: 8 total, 8 up, 8 in 2021-01-28T04:02:04.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:04 smithi162 bash[9856]: audit 2021-01-28T04:02:03.555138+0000 mon.c (mon.1) 196 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-15"}]: dispatch 2021-01-28T04:02:04.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:04 smithi162 bash[9856]: audit 2021-01-28T04:02:03.558402+0000 mon.a (mon.0) 1270 : audit [INF] from='client.? 172.21.15.100:0/3294915266' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-28"}]: dispatch 2021-01-28T04:02:04.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:04 smithi162 bash[9856]: audit 2021-01-28T04:02:03.560259+0000 mon.a (mon.0) 1271 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-15"}]: dispatch 2021-01-28T04:02:04.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:04 smithi162 bash[9856]: audit 2021-01-28T04:02:04.182164+0000 mon.b (mon.2) 166 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:04.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:04 smithi100 bash[9834]: cluster 2021-01-28T04:02:03.539632+0000 mon.a (mon.0) 1265 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:02:04.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:04 smithi100 bash[9834]: audit 2021-01-28T04:02:03.551031+0000 mon.a (mon.0) 1266 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-27","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:04.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:04 smithi100 bash[9834]: audit 2021-01-28T04:02:03.552960+0000 mon.a (mon.0) 1267 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-15", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:02:04.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:04 smithi100 bash[9834]: audit 2021-01-28T04:02:03.553138+0000 mon.a (mon.0) 1268 : audit [INF] from='client.? 172.21.15.100:0/3294915266' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:02:04.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:04 smithi100 bash[9834]: cluster 2021-01-28T04:02:03.553255+0000 mon.a (mon.0) 1269 : cluster [DBG] osdmap e165: 8 total, 8 up, 8 in 2021-01-28T04:02:04.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:04 smithi100 bash[9834]: audit 2021-01-28T04:02:03.555138+0000 mon.c (mon.1) 196 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-15"}]: dispatch 2021-01-28T04:02:04.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:04 smithi100 bash[9834]: audit 2021-01-28T04:02:03.558402+0000 mon.a (mon.0) 1270 : audit [INF] from='client.? 172.21.15.100:0/3294915266' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-28"}]: dispatch 2021-01-28T04:02:04.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:04 smithi100 bash[9834]: audit 2021-01-28T04:02:03.560259+0000 mon.a (mon.0) 1271 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-15"}]: dispatch 2021-01-28T04:02:04.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:04 smithi100 bash[9834]: audit 2021-01-28T04:02:04.182164+0000 mon.b (mon.2) 166 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:04.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:04 smithi100 bash[13549]: cluster 2021-01-28T04:02:03.539632+0000 mon.a (mon.0) 1265 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:02:04.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:04 smithi100 bash[13549]: audit 2021-01-28T04:02:03.551031+0000 mon.a (mon.0) 1266 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-27","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:04.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:04 smithi100 bash[13549]: audit 2021-01-28T04:02:03.552960+0000 mon.a (mon.0) 1267 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-15", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:02:04.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:04 smithi100 bash[13549]: audit 2021-01-28T04:02:03.553138+0000 mon.a (mon.0) 1268 : audit [INF] from='client.? 172.21.15.100:0/3294915266' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:02:04.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:04 smithi100 bash[13549]: cluster 2021-01-28T04:02:03.553255+0000 mon.a (mon.0) 1269 : cluster [DBG] osdmap e165: 8 total, 8 up, 8 in 2021-01-28T04:02:04.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:04 smithi100 bash[13549]: audit 2021-01-28T04:02:03.555138+0000 mon.c (mon.1) 196 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-15"}]: dispatch 2021-01-28T04:02:04.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:04 smithi100 bash[13549]: audit 2021-01-28T04:02:03.558402+0000 mon.a (mon.0) 1270 : audit [INF] from='client.? 172.21.15.100:0/3294915266' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-28"}]: dispatch 2021-01-28T04:02:04.585 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:04 smithi100 bash[13549]: audit 2021-01-28T04:02:03.560259+0000 mon.a (mon.0) 1271 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-15"}]: dispatch 2021-01-28T04:02:04.585 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:04 smithi100 bash[13549]: audit 2021-01-28T04:02:04.182164+0000 mon.b (mon.2) 166 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:05.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:05 smithi100 bash[9834]: cluster 2021-01-28T04:02:03.571030+0000 mgr.y (mgr.14138) 575 : cluster [DBG] pgmap v498: 292 pgs: 8 creating+peering, 33 unknown, 251 active+clean; 28 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2021-01-28T04:02:05.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:05 smithi100 bash[9834]: audit 2021-01-28T04:02:04.978771+0000 mon.a (mon.0) 1272 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-15"}]': finished 2021-01-28T04:02:05.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:05 smithi100 bash[9834]: cluster 2021-01-28T04:02:04.979040+0000 mon.a (mon.0) 1273 : cluster [DBG] osdmap e166: 8 total, 8 up, 8 in 2021-01-28T04:02:05.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:05 smithi100 bash[9834]: audit 2021-01-28T04:02:04.980120+0000 mon.c (mon.1) 197 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-15", "mode": "writeback"}]: dispatch 2021-01-28T04:02:05.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:05 smithi100 bash[9834]: audit 2021-01-28T04:02:04.981780+0000 mon.a (mon.0) 1274 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-15", "mode": "writeback"}]: dispatch 2021-01-28T04:02:05.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:05 smithi100 bash[9834]: audit 2021-01-28T04:02:05.184061+0000 mon.b (mon.2) 167 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:05.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:05 smithi100 bash[13549]: cluster 2021-01-28T04:02:03.571030+0000 mgr.y (mgr.14138) 575 : cluster [DBG] pgmap v498: 292 pgs: 8 creating+peering, 33 unknown, 251 active+clean; 28 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2021-01-28T04:02:05.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:05 smithi100 bash[13549]: audit 2021-01-28T04:02:04.978771+0000 mon.a (mon.0) 1272 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-15"}]': finished 2021-01-28T04:02:05.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:05 smithi100 bash[13549]: cluster 2021-01-28T04:02:04.979040+0000 mon.a (mon.0) 1273 : cluster [DBG] osdmap e166: 8 total, 8 up, 8 in 2021-01-28T04:02:05.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:05 smithi100 bash[13549]: audit 2021-01-28T04:02:04.980120+0000 mon.c (mon.1) 197 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-15", "mode": "writeback"}]: dispatch 2021-01-28T04:02:05.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:05 smithi100 bash[13549]: audit 2021-01-28T04:02:04.981780+0000 mon.a (mon.0) 1274 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-15", "mode": "writeback"}]: dispatch 2021-01-28T04:02:05.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:05 smithi100 bash[13549]: audit 2021-01-28T04:02:05.184061+0000 mon.b (mon.2) 167 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:06.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:05 smithi162 bash[9856]: cluster 2021-01-28T04:02:03.571030+0000 mgr.y (mgr.14138) 575 : cluster [DBG] pgmap v498: 292 pgs: 8 creating+peering, 33 unknown, 251 active+clean; 28 KiB data, 284 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2021-01-28T04:02:06.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:05 smithi162 bash[9856]: audit 2021-01-28T04:02:04.978771+0000 mon.a (mon.0) 1272 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-15"}]': finished 2021-01-28T04:02:06.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:05 smithi162 bash[9856]: cluster 2021-01-28T04:02:04.979040+0000 mon.a (mon.0) 1273 : cluster [DBG] osdmap e166: 8 total, 8 up, 8 in 2021-01-28T04:02:06.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:05 smithi162 bash[9856]: audit 2021-01-28T04:02:04.980120+0000 mon.c (mon.1) 197 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-15", "mode": "writeback"}]: dispatch 2021-01-28T04:02:06.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:05 smithi162 bash[9856]: audit 2021-01-28T04:02:04.981780+0000 mon.a (mon.0) 1274 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-15", "mode": "writeback"}]: dispatch 2021-01-28T04:02:06.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:05 smithi162 bash[9856]: audit 2021-01-28T04:02:05.184061+0000 mon.b (mon.2) 167 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:07.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:06 smithi162 bash[9856]: cluster 2021-01-28T04:02:05.549544+0000 mon.a (mon.0) 1275 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:02:07.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:06 smithi162 bash[9856]: audit 2021-01-28T04:02:05.561004+0000 mon.a (mon.0) 1276 : audit [INF] from='client.? 172.21.15.100:0/3294915266' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-28"}]': finished 2021-01-28T04:02:07.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:06 smithi162 bash[9856]: audit 2021-01-28T04:02:05.561192+0000 mon.a (mon.0) 1277 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-15", "mode": "writeback"}]': finished 2021-01-28T04:02:07.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:06 smithi162 bash[9856]: cluster 2021-01-28T04:02:05.561455+0000 mon.a (mon.0) 1278 : cluster [DBG] osdmap e167: 8 total, 8 up, 8 in 2021-01-28T04:02:07.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:06 smithi162 bash[9856]: audit 2021-01-28T04:02:05.563137+0000 mon.c (mon.1) 198 : audit [INF] from='client.? 172.21.15.100:0/2254446337' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:07.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:06 smithi162 bash[9856]: audit 2021-01-28T04:02:05.570812+0000 mon.a (mon.0) 1279 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:07.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:06 smithi162 bash[9856]: cluster 2021-01-28T04:02:05.571752+0000 mgr.y (mgr.14138) 576 : cluster [DBG] pgmap v501: 300 pgs: 40 unknown, 2 creating+peering, 258 active+clean; 28 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 514 B/s wr, 1 op/s 2021-01-28T04:02:07.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:06 smithi162 bash[9856]: audit 2021-01-28T04:02:06.185958+0000 mon.b (mon.2) 168 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:07.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:06 smithi162 bash[9856]: audit 2021-01-28T04:02:06.561692+0000 mon.a (mon.0) 1280 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-28","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:07.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:06 smithi162 bash[9856]: cluster 2021-01-28T04:02:06.563074+0000 mon.a (mon.0) 1281 : cluster [DBG] osdmap e168: 8 total, 8 up, 8 in 2021-01-28T04:02:07.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:06 smithi100 bash[9834]: cluster 2021-01-28T04:02:05.549544+0000 mon.a (mon.0) 1275 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:02:07.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:06 smithi100 bash[9834]: audit 2021-01-28T04:02:05.561004+0000 mon.a (mon.0) 1276 : audit [INF] from='client.? 172.21.15.100:0/3294915266' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-28"}]': finished 2021-01-28T04:02:07.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:06 smithi100 bash[9834]: audit 2021-01-28T04:02:05.561192+0000 mon.a (mon.0) 1277 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-15", "mode": "writeback"}]': finished 2021-01-28T04:02:07.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:06 smithi100 bash[9834]: cluster 2021-01-28T04:02:05.561455+0000 mon.a (mon.0) 1278 : cluster [DBG] osdmap e167: 8 total, 8 up, 8 in 2021-01-28T04:02:07.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:06 smithi100 bash[9834]: audit 2021-01-28T04:02:05.563137+0000 mon.c (mon.1) 198 : audit [INF] from='client.? 172.21.15.100:0/2254446337' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:07.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:06 smithi100 bash[9834]: audit 2021-01-28T04:02:05.570812+0000 mon.a (mon.0) 1279 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:07.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:06 smithi100 bash[9834]: cluster 2021-01-28T04:02:05.571752+0000 mgr.y (mgr.14138) 576 : cluster [DBG] pgmap v501: 300 pgs: 40 unknown, 2 creating+peering, 258 active+clean; 28 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 514 B/s wr, 1 op/s 2021-01-28T04:02:07.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:06 smithi100 bash[9834]: audit 2021-01-28T04:02:06.185958+0000 mon.b (mon.2) 168 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:07.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:06 smithi100 bash[9834]: audit 2021-01-28T04:02:06.561692+0000 mon.a (mon.0) 1280 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-28","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:07.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:06 smithi100 bash[9834]: cluster 2021-01-28T04:02:06.563074+0000 mon.a (mon.0) 1281 : cluster [DBG] osdmap e168: 8 total, 8 up, 8 in 2021-01-28T04:02:07.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:06 smithi100 bash[13549]: cluster 2021-01-28T04:02:05.549544+0000 mon.a (mon.0) 1275 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:02:07.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:06 smithi100 bash[13549]: audit 2021-01-28T04:02:05.561004+0000 mon.a (mon.0) 1276 : audit [INF] from='client.? 172.21.15.100:0/3294915266' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-28"}]': finished 2021-01-28T04:02:07.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:06 smithi100 bash[13549]: audit 2021-01-28T04:02:05.561192+0000 mon.a (mon.0) 1277 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-15", "mode": "writeback"}]': finished 2021-01-28T04:02:07.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:06 smithi100 bash[13549]: cluster 2021-01-28T04:02:05.561455+0000 mon.a (mon.0) 1278 : cluster [DBG] osdmap e167: 8 total, 8 up, 8 in 2021-01-28T04:02:07.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:06 smithi100 bash[13549]: audit 2021-01-28T04:02:05.563137+0000 mon.c (mon.1) 198 : audit [INF] from='client.? 172.21.15.100:0/2254446337' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:07.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:06 smithi100 bash[13549]: audit 2021-01-28T04:02:05.570812+0000 mon.a (mon.0) 1279 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:07.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:06 smithi100 bash[13549]: cluster 2021-01-28T04:02:05.571752+0000 mgr.y (mgr.14138) 576 : cluster [DBG] pgmap v501: 300 pgs: 40 unknown, 2 creating+peering, 258 active+clean; 28 KiB data, 289 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 514 B/s wr, 1 op/s 2021-01-28T04:02:07.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:06 smithi100 bash[13549]: audit 2021-01-28T04:02:06.185958+0000 mon.b (mon.2) 168 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:07.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:06 smithi100 bash[13549]: audit 2021-01-28T04:02:06.561692+0000 mon.a (mon.0) 1280 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-28","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:07.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:06 smithi100 bash[13549]: cluster 2021-01-28T04:02:06.563074+0000 mon.a (mon.0) 1281 : cluster [DBG] osdmap e168: 8 total, 8 up, 8 in 2021-01-28T04:02:08.012 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:07 smithi162 bash[9856]: audit 2021-01-28T04:02:06.634710+0000 mon.c (mon.1) 199 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:02:08.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:07 smithi162 bash[9856]: audit 2021-01-28T04:02:06.635163+0000 mon.a (mon.0) 1282 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:02:08.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:07 smithi162 bash[9856]: audit 2021-01-28T04:02:07.187870+0000 mon.b (mon.2) 169 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:08.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:07 smithi100 bash[9834]: audit 2021-01-28T04:02:06.634710+0000 mon.c (mon.1) 199 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:02:08.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:07 smithi100 bash[9834]: audit 2021-01-28T04:02:06.635163+0000 mon.a (mon.0) 1282 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:02:08.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:07 smithi100 bash[9834]: audit 2021-01-28T04:02:07.187870+0000 mon.b (mon.2) 169 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:08.079 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:07 smithi100 bash[13549]: audit 2021-01-28T04:02:06.634710+0000 mon.c (mon.1) 199 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:02:08.079 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:07 smithi100 bash[13549]: audit 2021-01-28T04:02:06.635163+0000 mon.a (mon.0) 1282 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:02:08.079 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:07 smithi100 bash[13549]: audit 2021-01-28T04:02:07.187870+0000 mon.b (mon.2) 169 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:09.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:08 smithi162 bash[9856]: cluster 2021-01-28T04:02:07.573287+0000 mgr.y (mgr.14138) 577 : cluster [DBG] pgmap v503: 300 pgs: 6 creating+peering, 21 unknown, 273 active+clean; 28 KiB data, 295 MiB used, 715 GiB / 715 GiB avail; 508 B/s wr, 0 op/s 2021-01-28T04:02:09.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:08 smithi162 bash[9856]: audit 2021-01-28T04:02:07.598901+0000 mon.a (mon.0) 1283 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:02:09.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:08 smithi162 bash[9856]: cluster 2021-01-28T04:02:07.599107+0000 mon.a (mon.0) 1284 : cluster [DBG] osdmap e169: 8 total, 8 up, 8 in 2021-01-28T04:02:09.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:08 smithi162 bash[9856]: audit 2021-01-28T04:02:07.602124+0000 mon.c (mon.1) 200 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-15"}]: dispatch 2021-01-28T04:02:09.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:08 smithi162 bash[9856]: audit 2021-01-28T04:02:07.602850+0000 mon.a (mon.0) 1285 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-15"}]: dispatch 2021-01-28T04:02:09.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:08 smithi162 bash[9856]: audit 2021-01-28T04:02:07.603239+0000 mon.a (mon.0) 1286 : audit [INF] from='client.? 172.21.15.100:0/3294915266' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-28"}]: dispatch 2021-01-28T04:02:09.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:08 smithi162 bash[9856]: audit 2021-01-28T04:02:08.189617+0000 mon.b (mon.2) 170 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:09.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:08 smithi162 bash[9856]: cluster 2021-01-28T04:02:08.591719+0000 mon.a (mon.0) 1287 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:02:09.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:08 smithi100 bash[9834]: cluster 2021-01-28T04:02:07.573287+0000 mgr.y (mgr.14138) 577 : cluster [DBG] pgmap v503: 300 pgs: 6 creating+peering, 21 unknown, 273 active+clean; 28 KiB data, 295 MiB used, 715 GiB / 715 GiB avail; 508 B/s wr, 0 op/s 2021-01-28T04:02:09.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:08 smithi100 bash[9834]: audit 2021-01-28T04:02:07.598901+0000 mon.a (mon.0) 1283 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:02:09.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:08 smithi100 bash[9834]: cluster 2021-01-28T04:02:07.599107+0000 mon.a (mon.0) 1284 : cluster [DBG] osdmap e169: 8 total, 8 up, 8 in 2021-01-28T04:02:09.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:08 smithi100 bash[9834]: audit 2021-01-28T04:02:07.602124+0000 mon.c (mon.1) 200 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-15"}]: dispatch 2021-01-28T04:02:09.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:08 smithi100 bash[9834]: audit 2021-01-28T04:02:07.602850+0000 mon.a (mon.0) 1285 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-15"}]: dispatch 2021-01-28T04:02:09.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:08 smithi100 bash[9834]: audit 2021-01-28T04:02:07.603239+0000 mon.a (mon.0) 1286 : audit [INF] from='client.? 172.21.15.100:0/3294915266' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-28"}]: dispatch 2021-01-28T04:02:09.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:08 smithi100 bash[9834]: audit 2021-01-28T04:02:08.189617+0000 mon.b (mon.2) 170 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:09.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:08 smithi100 bash[9834]: cluster 2021-01-28T04:02:08.591719+0000 mon.a (mon.0) 1287 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:02:09.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:08 smithi100 bash[13549]: cluster 2021-01-28T04:02:07.573287+0000 mgr.y (mgr.14138) 577 : cluster [DBG] pgmap v503: 300 pgs: 6 creating+peering, 21 unknown, 273 active+clean; 28 KiB data, 295 MiB used, 715 GiB / 715 GiB avail; 508 B/s wr, 0 op/s 2021-01-28T04:02:09.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:08 smithi100 bash[13549]: audit 2021-01-28T04:02:07.598901+0000 mon.a (mon.0) 1283 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:02:09.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:08 smithi100 bash[13549]: cluster 2021-01-28T04:02:07.599107+0000 mon.a (mon.0) 1284 : cluster [DBG] osdmap e169: 8 total, 8 up, 8 in 2021-01-28T04:02:09.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:08 smithi100 bash[13549]: audit 2021-01-28T04:02:07.602124+0000 mon.c (mon.1) 200 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-15"}]: dispatch 2021-01-28T04:02:09.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:08 smithi100 bash[13549]: audit 2021-01-28T04:02:07.602850+0000 mon.a (mon.0) 1285 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-15"}]: dispatch 2021-01-28T04:02:09.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:08 smithi100 bash[13549]: audit 2021-01-28T04:02:07.603239+0000 mon.a (mon.0) 1286 : audit [INF] from='client.? 172.21.15.100:0/3294915266' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-28"}]: dispatch 2021-01-28T04:02:09.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:08 smithi100 bash[13549]: audit 2021-01-28T04:02:08.189617+0000 mon.b (mon.2) 170 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:09.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:08 smithi100 bash[13549]: cluster 2021-01-28T04:02:08.591719+0000 mon.a (mon.0) 1287 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:02:10.061 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 04:02:09 smithi100 bash[10061]: debug 2021-01-28T04:02:09.797+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:02:10.062 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:10 smithi100 bash[9834]: audit 2021-01-28T04:02:08.604809+0000 mon.a (mon.0) 1288 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-15"}]': finished 2021-01-28T04:02:10.062 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:10 smithi100 bash[9834]: audit 2021-01-28T04:02:08.604986+0000 mon.a (mon.0) 1289 : audit [INF] from='client.? 172.21.15.100:0/3294915266' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-28"}]': finished 2021-01-28T04:02:10.063 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:10 smithi100 bash[9834]: cluster 2021-01-28T04:02:08.605155+0000 mon.a (mon.0) 1290 : cluster [DBG] osdmap e170: 8 total, 8 up, 8 in 2021-01-28T04:02:10.063 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:10 smithi100 bash[9834]: audit 2021-01-28T04:02:08.606634+0000 mon.c (mon.1) 201 : audit [INF] from='client.? 172.21.15.100:0/613054981' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:10.063 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:10 smithi100 bash[9834]: audit 2021-01-28T04:02:08.612499+0000 mon.a (mon.0) 1291 : audit [INF] from='client.? 172.21.15.100:0/3294915266' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-28"}]: dispatch 2021-01-28T04:02:10.063 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:10 smithi100 bash[9834]: audit 2021-01-28T04:02:08.612969+0000 mon.a (mon.0) 1292 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:10.064 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 04:02:09 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T04:02:10.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:10 smithi100 bash[9834]: audit 2021-01-28T04:02:09.191541+0000 mon.b (mon.2) 171 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:10.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:10 smithi100 bash[9834]: audit 2021-01-28T04:02:09.604939+0000 mon.a (mon.0) 1293 : audit [INF] from='client.? 172.21.15.100:0/3294915266' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-28"}]': finished 2021-01-28T04:02:10.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:10 smithi100 bash[9834]: audit 2021-01-28T04:02:09.605073+0000 mon.a (mon.0) 1294 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-29","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:10.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:10 smithi100 bash[9834]: cluster 2021-01-28T04:02:09.605263+0000 mon.a (mon.0) 1295 : cluster [DBG] osdmap e171: 8 total, 8 up, 8 in 2021-01-28T04:02:10.329 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:10 smithi100 bash[13549]: audit 2021-01-28T04:02:08.604809+0000 mon.a (mon.0) 1288 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-15"}]': finished 2021-01-28T04:02:10.329 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:10 smithi100 bash[13549]: audit 2021-01-28T04:02:08.604986+0000 mon.a (mon.0) 1289 : audit [INF] from='client.? 172.21.15.100:0/3294915266' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-28"}]': finished 2021-01-28T04:02:10.329 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:10 smithi100 bash[13549]: cluster 2021-01-28T04:02:08.605155+0000 mon.a (mon.0) 1290 : cluster [DBG] osdmap e170: 8 total, 8 up, 8 in 2021-01-28T04:02:10.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:10 smithi100 bash[13549]: audit 2021-01-28T04:02:08.606634+0000 mon.c (mon.1) 201 : audit [INF] from='client.? 172.21.15.100:0/613054981' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:10.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:10 smithi100 bash[13549]: audit 2021-01-28T04:02:08.612499+0000 mon.a (mon.0) 1291 : audit [INF] from='client.? 172.21.15.100:0/3294915266' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-28"}]: dispatch 2021-01-28T04:02:10.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:10 smithi100 bash[13549]: audit 2021-01-28T04:02:08.612969+0000 mon.a (mon.0) 1292 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:10.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:10 smithi100 bash[13549]: audit 2021-01-28T04:02:09.191541+0000 mon.b (mon.2) 171 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:10.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:10 smithi100 bash[13549]: audit 2021-01-28T04:02:09.604939+0000 mon.a (mon.0) 1293 : audit [INF] from='client.? 172.21.15.100:0/3294915266' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-28"}]': finished 2021-01-28T04:02:10.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:10 smithi100 bash[13549]: audit 2021-01-28T04:02:09.605073+0000 mon.a (mon.0) 1294 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-29","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:10.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:10 smithi100 bash[13549]: cluster 2021-01-28T04:02:09.605263+0000 mon.a (mon.0) 1295 : cluster [DBG] osdmap e171: 8 total, 8 up, 8 in 2021-01-28T04:02:10.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:10 smithi162 bash[9856]: audit 2021-01-28T04:02:08.604809+0000 mon.a (mon.0) 1288 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-15"}]': finished 2021-01-28T04:02:10.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:10 smithi162 bash[9856]: audit 2021-01-28T04:02:08.604986+0000 mon.a (mon.0) 1289 : audit [INF] from='client.? 172.21.15.100:0/3294915266' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-28"}]': finished 2021-01-28T04:02:10.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:10 smithi162 bash[9856]: cluster 2021-01-28T04:02:08.605155+0000 mon.a (mon.0) 1290 : cluster [DBG] osdmap e170: 8 total, 8 up, 8 in 2021-01-28T04:02:10.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:10 smithi162 bash[9856]: audit 2021-01-28T04:02:08.606634+0000 mon.c (mon.1) 201 : audit [INF] from='client.? 172.21.15.100:0/613054981' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:10.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:10 smithi162 bash[9856]: audit 2021-01-28T04:02:08.612499+0000 mon.a (mon.0) 1291 : audit [INF] from='client.? 172.21.15.100:0/3294915266' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-28"}]: dispatch 2021-01-28T04:02:10.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:10 smithi162 bash[9856]: audit 2021-01-28T04:02:08.612969+0000 mon.a (mon.0) 1292 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:10.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:10 smithi162 bash[9856]: audit 2021-01-28T04:02:09.191541+0000 mon.b (mon.2) 171 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:10.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:10 smithi162 bash[9856]: audit 2021-01-28T04:02:09.604939+0000 mon.a (mon.0) 1293 : audit [INF] from='client.? 172.21.15.100:0/3294915266' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-28"}]': finished 2021-01-28T04:02:10.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:10 smithi162 bash[9856]: audit 2021-01-28T04:02:09.605073+0000 mon.a (mon.0) 1294 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-29","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:10.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:10 smithi162 bash[9856]: cluster 2021-01-28T04:02:09.605263+0000 mon.a (mon.0) 1295 : cluster [DBG] osdmap e171: 8 total, 8 up, 8 in 2021-01-28T04:02:10.616 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: Running main() from gmock_main.cc 2021-01-28T04:02:10.616 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [==========] Running 53 tests from 4 test suites. 2021-01-28T04:02:10.617 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [----------] Global test environment set-up. 2021-01-28T04:02:10.617 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [----------] 28 tests from LibRadosAio 2021-01-28T04:02:10.617 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ RUN ] LibRadosAio.TooBigPP 2021-01-28T04:02:10.617 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ OK ] LibRadosAio.TooBigPP (11232 ms) 2021-01-28T04:02:10.617 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolQuotaPP 2021-01-28T04:02:10.618 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolQuotaPP (26526 ms) 2021-01-28T04:02:10.618 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleWritePP 2021-01-28T04:02:10.618 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleWritePP (7250 ms) 2021-01-28T04:02:10.618 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ RUN ] LibRadosAio.WaitForSafePP 2021-01-28T04:02:10.619 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ OK ] LibRadosAio.WaitForSafePP (3127 ms) 2021-01-28T04:02:10.619 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP 2021-01-28T04:02:10.619 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP (2984 ms) 2021-01-28T04:02:10.619 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP2 2021-01-28T04:02:10.619 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP2 (3031 ms) 2021-01-28T04:02:10.620 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP3 2021-01-28T04:02:10.620 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP3 (2990 ms) 2021-01-28T04:02:10.620 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripSparseReadPP 2021-01-28T04:02:10.620 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripSparseReadPP (2997 ms) 2021-01-28T04:02:10.620 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsCompletePP 2021-01-28T04:02:10.621 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ OK ] LibRadosAio.IsCompletePP (3025 ms) 2021-01-28T04:02:10.621 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsSafePP 2021-01-28T04:02:10.621 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ OK ] LibRadosAio.IsSafePP (2969 ms) 2021-01-28T04:02:10.621 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ RUN ] LibRadosAio.ReturnValuePP 2021-01-28T04:02:10.621 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ OK ] LibRadosAio.ReturnValuePP (3022 ms) 2021-01-28T04:02:10.622 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushPP 2021-01-28T04:02:10.622 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushPP (3015 ms) 2021-01-28T04:02:10.622 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushAsyncPP 2021-01-28T04:02:10.622 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushAsyncPP (3014 ms) 2021-01-28T04:02:10.623 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP 2021-01-28T04:02:10.623 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP (3010 ms) 2021-01-28T04:02:10.623 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP2 2021-01-28T04:02:10.623 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP2 (3013 ms) 2021-01-28T04:02:10.623 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP 2021-01-28T04:02:10.624 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP (3441 ms) 2021-01-28T04:02:10.624 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP2 2021-01-28T04:02:10.624 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP2 (2500 ms) 2021-01-28T04:02:10.625 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPPNS 2021-01-28T04:02:10.625 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPPNS (3456 ms) 2021-01-28T04:02:10.625 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPP 2021-01-28T04:02:10.625 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPP (2587 ms) 2021-01-28T04:02:10.625 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ RUN ] LibRadosAio.StatRemovePP 2021-01-28T04:02:10.626 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ OK ] LibRadosAio.StatRemovePP (3014 ms) 2021-01-28T04:02:10.626 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ RUN ] LibRadosAio.ExecuteClassPP 2021-01-28T04:02:10.626 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ OK ] LibRadosAio.ExecuteClassPP (3010 ms) 2021-01-28T04:02:10.626 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ RUN ] LibRadosAio.OmapPP 2021-01-28T04:02:10.626 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ OK ] LibRadosAio.OmapPP (2946 ms) 2021-01-28T04:02:10.627 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiWritePP 2021-01-28T04:02:10.627 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiWritePP (3026 ms) 2021-01-28T04:02:10.627 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ RUN ] LibRadosAio.AioUnlockPP 2021-01-28T04:02:10.627 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ OK ] LibRadosAio.AioUnlockPP (3008 ms) 2021-01-28T04:02:10.627 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripAppendPP 2021-01-28T04:02:10.628 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripAppendPP (3381 ms) 2021-01-28T04:02:10.628 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ RUN ] LibRadosAio.RacingRemovePP 2021-01-28T04:02:10.628 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ OK ] LibRadosAio.RacingRemovePP (2622 ms) 2021-01-28T04:02:10.628 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP 2021-01-28T04:02:11.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:11 smithi162 bash[9856]: cluster 2021-01-28T04:02:09.574748+0000 mgr.y (mgr.14138) 578 : cluster [DBG] pgmap v506: 292 pgs: 1 creating+peering, 31 unknown, 260 active+clean; 28 KiB data, 300 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-01-28T04:02:11.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:11 smithi162 bash[9856]: audit 2021-01-28T04:02:09.802559+0000 mgr.y (mgr.14138) 579 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:02:11.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:11 smithi162 bash[9856]: audit 2021-01-28T04:02:10.077707+0000 mon.c (mon.1) 202 : audit [INF] from='client.? 172.21.15.100:0/4105322778' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-29"}]: dispatch 2021-01-28T04:02:11.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:11 smithi162 bash[9856]: audit 2021-01-28T04:02:10.078050+0000 mon.a (mon.0) 1296 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-29"}]: dispatch 2021-01-28T04:02:11.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:11 smithi162 bash[9856]: audit 2021-01-28T04:02:10.078684+0000 mon.c (mon.1) 203 : audit [INF] from='client.? 172.21.15.100:0/4105322778' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-29"}]: dispatch 2021-01-28T04:02:11.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:11 smithi162 bash[9856]: audit 2021-01-28T04:02:10.078943+0000 mon.a (mon.0) 1297 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-29"}]: dispatch 2021-01-28T04:02:11.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:11 smithi162 bash[9856]: audit 2021-01-28T04:02:10.079463+0000 mon.c (mon.1) 204 : audit [INF] from='client.? 172.21.15.100:0/4105322778' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:11.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:11 smithi162 bash[9856]: audit 2021-01-28T04:02:10.079784+0000 mon.a (mon.0) 1298 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:11.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:11 smithi162 bash[9856]: audit 2021-01-28T04:02:10.193398+0000 mon.b (mon.2) 172 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:11.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:11 smithi162 bash[9856]: audit 2021-01-28T04:02:10.607762+0000 mon.a (mon.0) 1299 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:02:11.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:11 smithi162 bash[9856]: cluster 2021-01-28T04:02:10.607958+0000 mon.a (mon.0) 1300 : cluster [DBG] osdmap e172: 8 total, 8 up, 8 in 2021-01-28T04:02:11.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:11 smithi162 bash[9856]: audit 2021-01-28T04:02:10.610353+0000 mon.c (mon.1) 205 : audit [INF] from='client.? 172.21.15.100:0/4105322778' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-29"}]: dispatch 2021-01-28T04:02:11.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:11 smithi162 bash[9856]: audit 2021-01-28T04:02:10.611592+0000 mon.a (mon.0) 1301 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-29"}]: dispatch 2021-01-28T04:02:11.518 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:11 smithi162 bash[9856]: audit 2021-01-28T04:02:10.611731+0000 mon.c (mon.1) 206 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:11.518 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:11 smithi162 bash[9856]: audit 2021-01-28T04:02:10.612442+0000 mon.a (mon.0) 1302 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:11.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:11 smithi100 bash[9834]: cluster 2021-01-28T04:02:09.574748+0000 mgr.y (mgr.14138) 578 : cluster [DBG] pgmap v506: 292 pgs: 1 creating+peering, 31 unknown, 260 active+clean; 28 KiB data, 300 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-01-28T04:02:11.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:11 smithi100 bash[9834]: audit 2021-01-28T04:02:09.802559+0000 mgr.y (mgr.14138) 579 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:02:11.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:11 smithi100 bash[9834]: audit 2021-01-28T04:02:10.077707+0000 mon.c (mon.1) 202 : audit [INF] from='client.? 172.21.15.100:0/4105322778' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-29"}]: dispatch 2021-01-28T04:02:11.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:11 smithi100 bash[9834]: audit 2021-01-28T04:02:10.078050+0000 mon.a (mon.0) 1296 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-29"}]: dispatch 2021-01-28T04:02:11.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:11 smithi100 bash[9834]: audit 2021-01-28T04:02:10.078684+0000 mon.c (mon.1) 203 : audit [INF] from='client.? 172.21.15.100:0/4105322778' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-29"}]: dispatch 2021-01-28T04:02:11.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:11 smithi100 bash[9834]: audit 2021-01-28T04:02:10.078943+0000 mon.a (mon.0) 1297 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-29"}]: dispatch 2021-01-28T04:02:11.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:11 smithi100 bash[9834]: audit 2021-01-28T04:02:10.079463+0000 mon.c (mon.1) 204 : audit [INF] from='client.? 172.21.15.100:0/4105322778' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:11.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:11 smithi100 bash[9834]: audit 2021-01-28T04:02:10.079784+0000 mon.a (mon.0) 1298 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:11.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:11 smithi100 bash[9834]: audit 2021-01-28T04:02:10.193398+0000 mon.b (mon.2) 172 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:11.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:11 smithi100 bash[9834]: audit 2021-01-28T04:02:10.607762+0000 mon.a (mon.0) 1299 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:02:11.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:11 smithi100 bash[9834]: cluster 2021-01-28T04:02:10.607958+0000 mon.a (mon.0) 1300 : cluster [DBG] osdmap e172: 8 total, 8 up, 8 in 2021-01-28T04:02:11.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:11 smithi100 bash[9834]: audit 2021-01-28T04:02:10.610353+0000 mon.c (mon.1) 205 : audit [INF] from='client.? 172.21.15.100:0/4105322778' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-29"}]: dispatch 2021-01-28T04:02:11.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:11 smithi100 bash[9834]: audit 2021-01-28T04:02:10.611592+0000 mon.a (mon.0) 1301 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-29"}]: dispatch 2021-01-28T04:02:11.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:11 smithi100 bash[9834]: audit 2021-01-28T04:02:10.611731+0000 mon.c (mon.1) 206 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:11.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:11 smithi100 bash[9834]: audit 2021-01-28T04:02:10.612442+0000 mon.a (mon.0) 1302 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:11.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:11 smithi100 bash[13549]: cluster 2021-01-28T04:02:09.574748+0000 mgr.y (mgr.14138) 578 : cluster [DBG] pgmap v506: 292 pgs: 1 creating+peering, 31 unknown, 260 active+clean; 28 KiB data, 300 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-01-28T04:02:11.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:11 smithi100 bash[13549]: audit 2021-01-28T04:02:09.802559+0000 mgr.y (mgr.14138) 579 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:02:11.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:11 smithi100 bash[13549]: audit 2021-01-28T04:02:10.077707+0000 mon.c (mon.1) 202 : audit [INF] from='client.? 172.21.15.100:0/4105322778' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-29"}]: dispatch 2021-01-28T04:02:11.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:11 smithi100 bash[13549]: audit 2021-01-28T04:02:10.078050+0000 mon.a (mon.0) 1296 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-29"}]: dispatch 2021-01-28T04:02:11.585 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:11 smithi100 bash[13549]: audit 2021-01-28T04:02:10.078684+0000 mon.c (mon.1) 203 : audit [INF] from='client.? 172.21.15.100:0/4105322778' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-29"}]: dispatch 2021-01-28T04:02:11.585 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:11 smithi100 bash[13549]: audit 2021-01-28T04:02:10.078943+0000 mon.a (mon.0) 1297 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-29"}]: dispatch 2021-01-28T04:02:11.585 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:11 smithi100 bash[13549]: audit 2021-01-28T04:02:10.079463+0000 mon.c (mon.1) 204 : audit [INF] from='client.? 172.21.15.100:0/4105322778' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:11.585 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:11 smithi100 bash[13549]: audit 2021-01-28T04:02:10.079784+0000 mon.a (mon.0) 1298 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:11.586 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:11 smithi100 bash[13549]: audit 2021-01-28T04:02:10.193398+0000 mon.b (mon.2) 172 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:11.586 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:11 smithi100 bash[13549]: audit 2021-01-28T04:02:10.607762+0000 mon.a (mon.0) 1299 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:02:11.586 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:11 smithi100 bash[13549]: cluster 2021-01-28T04:02:10.607958+0000 mon.a (mon.0) 1300 : cluster [DBG] osdmap e172: 8 total, 8 up, 8 in 2021-01-28T04:02:11.587 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:11 smithi100 bash[13549]: audit 2021-01-28T04:02:10.610353+0000 mon.c (mon.1) 205 : audit [INF] from='client.? 172.21.15.100:0/4105322778' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-29"}]: dispatch 2021-01-28T04:02:11.587 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:11 smithi100 bash[13549]: audit 2021-01-28T04:02:10.611592+0000 mon.a (mon.0) 1301 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-29"}]: dispatch 2021-01-28T04:02:11.587 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:11 smithi100 bash[13549]: audit 2021-01-28T04:02:10.611731+0000 mon.c (mon.1) 206 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:11.588 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:11 smithi100 bash[13549]: audit 2021-01-28T04:02:10.612442+0000 mon.a (mon.0) 1302 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:12.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:12 smithi162 bash[9856]: audit 2021-01-28T04:02:11.195299+0000 mon.b (mon.2) 173 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:12.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:12 smithi162 bash[9856]: audit 2021-01-28T04:02:12.029182+0000 mon.a (mon.0) 1303 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:12.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:12 smithi162 bash[9856]: cluster 2021-01-28T04:02:12.029763+0000 mon.a (mon.0) 1304 : cluster [DBG] osdmap e173: 8 total, 8 up, 8 in 2021-01-28T04:02:12.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:12 smithi162 bash[9856]: audit 2021-01-28T04:02:12.038296+0000 mon.a (mon.0) 1305 : audit [INF] from='client.? 172.21.15.100:0/3054608533' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:12.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:12 smithi162 bash[9856]: audit 2021-01-28T04:02:12.038821+0000 mon.c (mon.1) 207 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-17", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:12.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:12 smithi162 bash[9856]: audit 2021-01-28T04:02:12.039328+0000 mon.a (mon.0) 1306 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-17", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:12.578 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:12 smithi100 bash[13549]: audit 2021-01-28T04:02:11.195299+0000 mon.b (mon.2) 173 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:12.578 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:12 smithi100 bash[13549]: audit 2021-01-28T04:02:12.029182+0000 mon.a (mon.0) 1303 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:12.578 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:12 smithi100 bash[13549]: cluster 2021-01-28T04:02:12.029763+0000 mon.a (mon.0) 1304 : cluster [DBG] osdmap e173: 8 total, 8 up, 8 in 2021-01-28T04:02:12.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:12 smithi100 bash[13549]: audit 2021-01-28T04:02:12.038296+0000 mon.a (mon.0) 1305 : audit [INF] from='client.? 172.21.15.100:0/3054608533' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:12.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:12 smithi100 bash[13549]: audit 2021-01-28T04:02:12.038821+0000 mon.c (mon.1) 207 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-17", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:12.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:12 smithi100 bash[13549]: audit 2021-01-28T04:02:12.039328+0000 mon.a (mon.0) 1306 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-17", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:12.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:12 smithi100 bash[9834]: audit 2021-01-28T04:02:11.195299+0000 mon.b (mon.2) 173 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:12.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:12 smithi100 bash[9834]: audit 2021-01-28T04:02:12.029182+0000 mon.a (mon.0) 1303 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:12.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:12 smithi100 bash[9834]: cluster 2021-01-28T04:02:12.029763+0000 mon.a (mon.0) 1304 : cluster [DBG] osdmap e173: 8 total, 8 up, 8 in 2021-01-28T04:02:12.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:12 smithi100 bash[9834]: audit 2021-01-28T04:02:12.038296+0000 mon.a (mon.0) 1305 : audit [INF] from='client.? 172.21.15.100:0/3054608533' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:12.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:12 smithi100 bash[9834]: audit 2021-01-28T04:02:12.038821+0000 mon.c (mon.1) 207 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-17", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:12.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:12 smithi100 bash[9834]: audit 2021-01-28T04:02:12.039328+0000 mon.a (mon.0) 1306 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-17", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:13.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:13 smithi162 bash[9856]: cluster 2021-01-28T04:02:11.575937+0000 mgr.y (mgr.14138) 580 : cluster [DBG] pgmap v509: 260 pgs: 4 creating+peering, 28 unknown, 228 active+clean; 28 KiB data, 300 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:02:13.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:13 smithi162 bash[9856]: audit 2021-01-28T04:02:12.197445+0000 mon.b (mon.2) 174 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:13.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:13 smithi162 bash[9856]: audit 2021-01-28T04:02:12.616507+0000 mon.a (mon.0) 1307 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-29"}]': finished 2021-01-28T04:02:13.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:13 smithi162 bash[9856]: audit 2021-01-28T04:02:12.617963+0000 mon.a (mon.0) 1308 : audit [INF] from='client.? 172.21.15.100:0/3054608533' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-30","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:13.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:13 smithi162 bash[9856]: audit 2021-01-28T04:02:12.618081+0000 mon.a (mon.0) 1309 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-17", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:02:13.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:13 smithi162 bash[9856]: cluster 2021-01-28T04:02:12.618168+0000 mon.a (mon.0) 1310 : cluster [DBG] osdmap e174: 8 total, 8 up, 8 in 2021-01-28T04:02:13.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:13 smithi162 bash[9856]: audit 2021-01-28T04:02:12.621281+0000 mon.c (mon.1) 208 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-17"}]: dispatch 2021-01-28T04:02:13.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:13 smithi162 bash[9856]: audit 2021-01-28T04:02:12.622955+0000 mon.a (mon.0) 1311 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-17"}]: dispatch 2021-01-28T04:02:13.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:13 smithi100 bash[9834]: cluster 2021-01-28T04:02:11.575937+0000 mgr.y (mgr.14138) 580 : cluster [DBG] pgmap v509: 260 pgs: 4 creating+peering, 28 unknown, 228 active+clean; 28 KiB data, 300 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:02:13.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:13 smithi100 bash[9834]: audit 2021-01-28T04:02:12.197445+0000 mon.b (mon.2) 174 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:13.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:13 smithi100 bash[9834]: audit 2021-01-28T04:02:12.616507+0000 mon.a (mon.0) 1307 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-29"}]': finished 2021-01-28T04:02:13.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:13 smithi100 bash[9834]: audit 2021-01-28T04:02:12.617963+0000 mon.a (mon.0) 1308 : audit [INF] from='client.? 172.21.15.100:0/3054608533' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-30","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:13.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:13 smithi100 bash[9834]: audit 2021-01-28T04:02:12.618081+0000 mon.a (mon.0) 1309 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-17", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:02:13.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:13 smithi100 bash[9834]: cluster 2021-01-28T04:02:12.618168+0000 mon.a (mon.0) 1310 : cluster [DBG] osdmap e174: 8 total, 8 up, 8 in 2021-01-28T04:02:13.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:13 smithi100 bash[9834]: audit 2021-01-28T04:02:12.621281+0000 mon.c (mon.1) 208 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-17"}]: dispatch 2021-01-28T04:02:13.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:13 smithi100 bash[9834]: audit 2021-01-28T04:02:12.622955+0000 mon.a (mon.0) 1311 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-17"}]: dispatch 2021-01-28T04:02:13.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:13 smithi100 bash[13549]: cluster 2021-01-28T04:02:11.575937+0000 mgr.y (mgr.14138) 580 : cluster [DBG] pgmap v509: 260 pgs: 4 creating+peering, 28 unknown, 228 active+clean; 28 KiB data, 300 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:02:13.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:13 smithi100 bash[13549]: audit 2021-01-28T04:02:12.197445+0000 mon.b (mon.2) 174 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:13.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:13 smithi100 bash[13549]: audit 2021-01-28T04:02:12.616507+0000 mon.a (mon.0) 1307 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-29"}]': finished 2021-01-28T04:02:13.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:13 smithi100 bash[13549]: audit 2021-01-28T04:02:12.617963+0000 mon.a (mon.0) 1308 : audit [INF] from='client.? 172.21.15.100:0/3054608533' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-30","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:13.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:13 smithi100 bash[13549]: audit 2021-01-28T04:02:12.618081+0000 mon.a (mon.0) 1309 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-17", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:02:13.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:13 smithi100 bash[13549]: cluster 2021-01-28T04:02:12.618168+0000 mon.a (mon.0) 1310 : cluster [DBG] osdmap e174: 8 total, 8 up, 8 in 2021-01-28T04:02:13.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:13 smithi100 bash[13549]: audit 2021-01-28T04:02:12.621281+0000 mon.c (mon.1) 208 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-17"}]: dispatch 2021-01-28T04:02:13.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:13 smithi100 bash[13549]: audit 2021-01-28T04:02:12.622955+0000 mon.a (mon.0) 1311 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-17"}]: dispatch 2021-01-28T04:02:14.098 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:14 smithi162 bash[9856]: audit 2021-01-28T04:02:13.199472+0000 mon.b (mon.2) 175 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:14.098 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:14 smithi162 bash[9856]: audit 2021-01-28T04:02:13.558925+0000 mon.a (mon.0) 1312 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-17"}]': finished 2021-01-28T04:02:14.099 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:14 smithi162 bash[9856]: cluster 2021-01-28T04:02:13.559172+0000 mon.a (mon.0) 1313 : cluster [DBG] osdmap e175: 8 total, 8 up, 8 in 2021-01-28T04:02:14.512 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:14 smithi162 bash[9856]: audit 2021-01-28T04:02:13.562220+0000 mon.c (mon.1) 209 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-17", "mode": "writeback"}]: dispatch 2021-01-28T04:02:14.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:14 smithi162 bash[9856]: audit 2021-01-28T04:02:13.569067+0000 mon.a (mon.0) 1314 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-17", "mode": "writeback"}]: dispatch 2021-01-28T04:02:14.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:14 smithi100 bash[9834]: audit 2021-01-28T04:02:13.199472+0000 mon.b (mon.2) 175 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:14.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:14 smithi100 bash[9834]: audit 2021-01-28T04:02:13.558925+0000 mon.a (mon.0) 1312 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-17"}]': finished 2021-01-28T04:02:14.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:14 smithi100 bash[9834]: cluster 2021-01-28T04:02:13.559172+0000 mon.a (mon.0) 1313 : cluster [DBG] osdmap e175: 8 total, 8 up, 8 in 2021-01-28T04:02:14.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:14 smithi100 bash[9834]: audit 2021-01-28T04:02:13.562220+0000 mon.c (mon.1) 209 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-17", "mode": "writeback"}]: dispatch 2021-01-28T04:02:14.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:14 smithi100 bash[9834]: audit 2021-01-28T04:02:13.569067+0000 mon.a (mon.0) 1314 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-17", "mode": "writeback"}]: dispatch 2021-01-28T04:02:14.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:14 smithi100 bash[13549]: audit 2021-01-28T04:02:13.199472+0000 mon.b (mon.2) 175 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:14.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:14 smithi100 bash[13549]: audit 2021-01-28T04:02:13.558925+0000 mon.a (mon.0) 1312 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-17"}]': finished 2021-01-28T04:02:14.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:14 smithi100 bash[13549]: cluster 2021-01-28T04:02:13.559172+0000 mon.a (mon.0) 1313 : cluster [DBG] osdmap e175: 8 total, 8 up, 8 in 2021-01-28T04:02:14.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:14 smithi100 bash[13549]: audit 2021-01-28T04:02:13.562220+0000 mon.c (mon.1) 209 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-17", "mode": "writeback"}]: dispatch 2021-01-28T04:02:14.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:14 smithi100 bash[13549]: audit 2021-01-28T04:02:13.569067+0000 mon.a (mon.0) 1314 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-17", "mode": "writeback"}]: dispatch 2021-01-28T04:02:15.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:15 smithi162 bash[9856]: cluster 2021-01-28T04:02:13.576638+0000 mgr.y (mgr.14138) 581 : cluster [DBG] pgmap v513: 268 pgs: 5 creating+peering, 15 unknown, 248 active+clean; 28 KiB data, 306 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2021-01-28T04:02:15.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:15 smithi162 bash[9856]: audit 2021-01-28T04:02:14.201562+0000 mon.b (mon.2) 176 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:15.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:15 smithi162 bash[9856]: cluster 2021-01-28T04:02:14.564973+0000 mon.a (mon.0) 1315 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:02:15.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:15 smithi162 bash[9856]: audit 2021-01-28T04:02:14.575904+0000 mon.a (mon.0) 1316 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-17", "mode": "writeback"}]': finished 2021-01-28T04:02:15.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:15 smithi162 bash[9856]: cluster 2021-01-28T04:02:14.576108+0000 mon.a (mon.0) 1317 : cluster [DBG] osdmap e176: 8 total, 8 up, 8 in 2021-01-28T04:02:15.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:15 smithi162 bash[9856]: audit 2021-01-28T04:02:14.579991+0000 mon.c (mon.1) 210 : audit [INF] from='client.? 172.21.15.100:0/4105322778' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-29"}]: dispatch 2021-01-28T04:02:15.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:15 smithi162 bash[9856]: audit 2021-01-28T04:02:14.583458+0000 mon.c (mon.1) 211 : audit [INF] from='client.? 172.21.15.100:0/1133808378' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:15.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:15 smithi162 bash[9856]: audit 2021-01-28T04:02:14.589609+0000 mon.a (mon.0) 1318 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-29"}]: dispatch 2021-01-28T04:02:15.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:15 smithi162 bash[9856]: audit 2021-01-28T04:02:14.590118+0000 mon.a (mon.0) 1319 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:15.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:15 smithi162 bash[9856]: audit 2021-01-28T04:02:14.708778+0000 mon.c (mon.1) 212 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:02:15.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:15 smithi162 bash[9856]: audit 2021-01-28T04:02:14.709607+0000 mon.a (mon.0) 1320 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:02:15.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:15 smithi100 bash[9834]: cluster 2021-01-28T04:02:13.576638+0000 mgr.y (mgr.14138) 581 : cluster [DBG] pgmap v513: 268 pgs: 5 creating+peering, 15 unknown, 248 active+clean; 28 KiB data, 306 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2021-01-28T04:02:15.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:15 smithi100 bash[9834]: audit 2021-01-28T04:02:14.201562+0000 mon.b (mon.2) 176 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:15.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:15 smithi100 bash[9834]: cluster 2021-01-28T04:02:14.564973+0000 mon.a (mon.0) 1315 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:02:15.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:15 smithi100 bash[9834]: audit 2021-01-28T04:02:14.575904+0000 mon.a (mon.0) 1316 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-17", "mode": "writeback"}]': finished 2021-01-28T04:02:15.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:15 smithi100 bash[9834]: cluster 2021-01-28T04:02:14.576108+0000 mon.a (mon.0) 1317 : cluster [DBG] osdmap e176: 8 total, 8 up, 8 in 2021-01-28T04:02:15.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:15 smithi100 bash[9834]: audit 2021-01-28T04:02:14.579991+0000 mon.c (mon.1) 210 : audit [INF] from='client.? 172.21.15.100:0/4105322778' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-29"}]: dispatch 2021-01-28T04:02:15.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:15 smithi100 bash[9834]: audit 2021-01-28T04:02:14.583458+0000 mon.c (mon.1) 211 : audit [INF] from='client.? 172.21.15.100:0/1133808378' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:15.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:15 smithi100 bash[9834]: audit 2021-01-28T04:02:14.589609+0000 mon.a (mon.0) 1318 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-29"}]: dispatch 2021-01-28T04:02:15.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:15 smithi100 bash[9834]: audit 2021-01-28T04:02:14.590118+0000 mon.a (mon.0) 1319 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:15.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:15 smithi100 bash[9834]: audit 2021-01-28T04:02:14.708778+0000 mon.c (mon.1) 212 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:02:15.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:15 smithi100 bash[9834]: audit 2021-01-28T04:02:14.709607+0000 mon.a (mon.0) 1320 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:02:15.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:15 smithi100 bash[13549]: cluster 2021-01-28T04:02:13.576638+0000 mgr.y (mgr.14138) 581 : cluster [DBG] pgmap v513: 268 pgs: 5 creating+peering, 15 unknown, 248 active+clean; 28 KiB data, 306 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2021-01-28T04:02:15.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:15 smithi100 bash[13549]: audit 2021-01-28T04:02:14.201562+0000 mon.b (mon.2) 176 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:15.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:15 smithi100 bash[13549]: cluster 2021-01-28T04:02:14.564973+0000 mon.a (mon.0) 1315 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:02:15.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:15 smithi100 bash[13549]: audit 2021-01-28T04:02:14.575904+0000 mon.a (mon.0) 1316 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-17", "mode": "writeback"}]': finished 2021-01-28T04:02:15.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:15 smithi100 bash[13549]: cluster 2021-01-28T04:02:14.576108+0000 mon.a (mon.0) 1317 : cluster [DBG] osdmap e176: 8 total, 8 up, 8 in 2021-01-28T04:02:15.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:15 smithi100 bash[13549]: audit 2021-01-28T04:02:14.579991+0000 mon.c (mon.1) 210 : audit [INF] from='client.? 172.21.15.100:0/4105322778' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-29"}]: dispatch 2021-01-28T04:02:15.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:15 smithi100 bash[13549]: audit 2021-01-28T04:02:14.583458+0000 mon.c (mon.1) 211 : audit [INF] from='client.? 172.21.15.100:0/1133808378' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:15.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:15 smithi100 bash[13549]: audit 2021-01-28T04:02:14.589609+0000 mon.a (mon.0) 1318 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-29"}]: dispatch 2021-01-28T04:02:15.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:15 smithi100 bash[13549]: audit 2021-01-28T04:02:14.590118+0000 mon.a (mon.0) 1319 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:15.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:15 smithi100 bash[13549]: audit 2021-01-28T04:02:14.708778+0000 mon.c (mon.1) 212 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:02:15.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:15 smithi100 bash[13549]: audit 2021-01-28T04:02:14.709607+0000 mon.a (mon.0) 1320 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:02:16.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:16 smithi162 bash[9856]: audit 2021-01-28T04:02:15.203557+0000 mon.b (mon.2) 177 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:16.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:16 smithi162 bash[9856]: audit 2021-01-28T04:02:15.579025+0000 mon.a (mon.0) 1321 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-29"}]': finished 2021-01-28T04:02:16.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:16 smithi162 bash[9856]: audit 2021-01-28T04:02:15.579376+0000 mon.a (mon.0) 1322 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-31","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:16.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:16 smithi162 bash[9856]: audit 2021-01-28T04:02:15.579659+0000 mon.a (mon.0) 1323 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:02:16.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:16 smithi162 bash[9856]: cluster 2021-01-28T04:02:15.579812+0000 mon.a (mon.0) 1324 : cluster [DBG] osdmap e177: 8 total, 8 up, 8 in 2021-01-28T04:02:16.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:16 smithi162 bash[9856]: audit 2021-01-28T04:02:15.583160+0000 mon.c (mon.1) 213 : audit [INF] from='client.? 172.21.15.100:0/4105322778' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-29"}]: dispatch 2021-01-28T04:02:16.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:16 smithi162 bash[9856]: audit 2021-01-28T04:02:15.586790+0000 mon.a (mon.0) 1325 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-29"}]: dispatch 2021-01-28T04:02:16.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:16 smithi162 bash[9856]: audit 2021-01-28T04:02:15.586904+0000 mon.c (mon.1) 214 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-17"}]: dispatch 2021-01-28T04:02:16.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:16 smithi162 bash[9856]: audit 2021-01-28T04:02:15.587718+0000 mon.a (mon.0) 1326 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-17"}]: dispatch 2021-01-28T04:02:16.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:16 smithi100 bash[9834]: audit 2021-01-28T04:02:15.203557+0000 mon.b (mon.2) 177 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:16.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:16 smithi100 bash[9834]: audit 2021-01-28T04:02:15.579025+0000 mon.a (mon.0) 1321 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-29"}]': finished 2021-01-28T04:02:16.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:16 smithi100 bash[9834]: audit 2021-01-28T04:02:15.579376+0000 mon.a (mon.0) 1322 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-31","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:16.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:16 smithi100 bash[9834]: audit 2021-01-28T04:02:15.579659+0000 mon.a (mon.0) 1323 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:02:16.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:16 smithi100 bash[9834]: cluster 2021-01-28T04:02:15.579812+0000 mon.a (mon.0) 1324 : cluster [DBG] osdmap e177: 8 total, 8 up, 8 in 2021-01-28T04:02:16.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:16 smithi100 bash[9834]: audit 2021-01-28T04:02:15.583160+0000 mon.c (mon.1) 213 : audit [INF] from='client.? 172.21.15.100:0/4105322778' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-29"}]: dispatch 2021-01-28T04:02:16.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:16 smithi100 bash[9834]: audit 2021-01-28T04:02:15.586790+0000 mon.a (mon.0) 1325 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-29"}]: dispatch 2021-01-28T04:02:16.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:16 smithi100 bash[9834]: audit 2021-01-28T04:02:15.586904+0000 mon.c (mon.1) 214 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-17"}]: dispatch 2021-01-28T04:02:16.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:16 smithi100 bash[9834]: audit 2021-01-28T04:02:15.587718+0000 mon.a (mon.0) 1326 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-17"}]: dispatch 2021-01-28T04:02:16.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:16 smithi100 bash[13549]: audit 2021-01-28T04:02:15.203557+0000 mon.b (mon.2) 177 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:16.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:16 smithi100 bash[13549]: audit 2021-01-28T04:02:15.579025+0000 mon.a (mon.0) 1321 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-29"}]': finished 2021-01-28T04:02:16.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:16 smithi100 bash[13549]: audit 2021-01-28T04:02:15.579376+0000 mon.a (mon.0) 1322 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-31","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:16.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:16 smithi100 bash[13549]: audit 2021-01-28T04:02:15.579659+0000 mon.a (mon.0) 1323 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:02:16.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:16 smithi100 bash[13549]: cluster 2021-01-28T04:02:15.579812+0000 mon.a (mon.0) 1324 : cluster [DBG] osdmap e177: 8 total, 8 up, 8 in 2021-01-28T04:02:16.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:16 smithi100 bash[13549]: audit 2021-01-28T04:02:15.583160+0000 mon.c (mon.1) 213 : audit [INF] from='client.? 172.21.15.100:0/4105322778' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-29"}]: dispatch 2021-01-28T04:02:16.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:16 smithi100 bash[13549]: audit 2021-01-28T04:02:15.586790+0000 mon.a (mon.0) 1325 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-29"}]: dispatch 2021-01-28T04:02:16.585 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:16 smithi100 bash[13549]: audit 2021-01-28T04:02:15.586904+0000 mon.c (mon.1) 214 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-17"}]: dispatch 2021-01-28T04:02:16.585 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:16 smithi100 bash[13549]: audit 2021-01-28T04:02:15.587718+0000 mon.a (mon.0) 1326 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-17"}]: dispatch 2021-01-28T04:02:17.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:17 smithi162 bash[9856]: cluster 2021-01-28T04:02:15.577679+0000 mgr.y (mgr.14138) 582 : cluster [DBG] pgmap v516: 292 pgs: 4 creating+peering, 32 unknown, 256 active+clean; 28 KiB data, 307 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 257 B/s wr, 1 op/s 2021-01-28T04:02:17.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:17 smithi162 bash[9856]: audit 2021-01-28T04:02:16.205398+0000 mon.b (mon.2) 178 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:17.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:17 smithi162 bash[9856]: cluster 2021-01-28T04:02:16.573534+0000 mon.a (mon.0) 1327 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:02:17.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:17 smithi162 bash[9856]: audit 2021-01-28T04:02:16.587369+0000 mon.a (mon.0) 1328 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-29"}]': finished 2021-01-28T04:02:17.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:17 smithi162 bash[9856]: audit 2021-01-28T04:02:16.587494+0000 mon.a (mon.0) 1329 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-17"}]': finished 2021-01-28T04:02:17.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:17 smithi162 bash[9856]: cluster 2021-01-28T04:02:16.588223+0000 mon.a (mon.0) 1330 : cluster [DBG] osdmap e178: 8 total, 8 up, 8 in 2021-01-28T04:02:17.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:17 smithi162 bash[9856]: audit 2021-01-28T04:02:16.618241+0000 mon.c (mon.1) 215 : audit [INF] from='client.? 172.21.15.100:0/1026916264' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-30"}]: dispatch 2021-01-28T04:02:17.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:17 smithi162 bash[9856]: audit 2021-01-28T04:02:16.619320+0000 mon.a (mon.0) 1331 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-30"}]: dispatch 2021-01-28T04:02:17.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:17 smithi162 bash[9856]: audit 2021-01-28T04:02:16.622263+0000 mon.c (mon.1) 216 : audit [INF] from='client.? 172.21.15.100:0/1026916264' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-30"}]: dispatch 2021-01-28T04:02:17.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:17 smithi162 bash[9856]: audit 2021-01-28T04:02:16.625063+0000 mon.a (mon.0) 1332 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-30"}]: dispatch 2021-01-28T04:02:17.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:17 smithi162 bash[9856]: audit 2021-01-28T04:02:16.626298+0000 mon.c (mon.1) 217 : audit [INF] from='client.? 172.21.15.100:0/1026916264' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:17.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:17 smithi162 bash[9856]: audit 2021-01-28T04:02:17.061965+0000 mon.a (mon.0) 1333 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:17.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:17 smithi100 bash[9834]: cluster 2021-01-28T04:02:15.577679+0000 mgr.y (mgr.14138) 582 : cluster [DBG] pgmap v516: 292 pgs: 4 creating+peering, 32 unknown, 256 active+clean; 28 KiB data, 307 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 257 B/s wr, 1 op/s 2021-01-28T04:02:17.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:17 smithi100 bash[9834]: audit 2021-01-28T04:02:16.205398+0000 mon.b (mon.2) 178 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:17.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:17 smithi100 bash[9834]: cluster 2021-01-28T04:02:16.573534+0000 mon.a (mon.0) 1327 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:02:17.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:17 smithi100 bash[9834]: audit 2021-01-28T04:02:16.587369+0000 mon.a (mon.0) 1328 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-29"}]': finished 2021-01-28T04:02:17.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:17 smithi100 bash[9834]: audit 2021-01-28T04:02:16.587494+0000 mon.a (mon.0) 1329 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-17"}]': finished 2021-01-28T04:02:17.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:17 smithi100 bash[9834]: cluster 2021-01-28T04:02:16.588223+0000 mon.a (mon.0) 1330 : cluster [DBG] osdmap e178: 8 total, 8 up, 8 in 2021-01-28T04:02:17.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:17 smithi100 bash[9834]: audit 2021-01-28T04:02:16.618241+0000 mon.c (mon.1) 215 : audit [INF] from='client.? 172.21.15.100:0/1026916264' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-30"}]: dispatch 2021-01-28T04:02:17.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:17 smithi100 bash[9834]: audit 2021-01-28T04:02:16.619320+0000 mon.a (mon.0) 1331 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-30"}]: dispatch 2021-01-28T04:02:17.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:17 smithi100 bash[9834]: audit 2021-01-28T04:02:16.622263+0000 mon.c (mon.1) 216 : audit [INF] from='client.? 172.21.15.100:0/1026916264' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-30"}]: dispatch 2021-01-28T04:02:17.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:17 smithi100 bash[9834]: audit 2021-01-28T04:02:16.625063+0000 mon.a (mon.0) 1332 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-30"}]: dispatch 2021-01-28T04:02:17.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:17 smithi100 bash[9834]: audit 2021-01-28T04:02:16.626298+0000 mon.c (mon.1) 217 : audit [INF] from='client.? 172.21.15.100:0/1026916264' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:17.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:17 smithi100 bash[9834]: audit 2021-01-28T04:02:17.061965+0000 mon.a (mon.0) 1333 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:17.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:17 smithi100 bash[13549]: cluster 2021-01-28T04:02:15.577679+0000 mgr.y (mgr.14138) 582 : cluster [DBG] pgmap v516: 292 pgs: 4 creating+peering, 32 unknown, 256 active+clean; 28 KiB data, 307 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 257 B/s wr, 1 op/s 2021-01-28T04:02:17.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:17 smithi100 bash[13549]: audit 2021-01-28T04:02:16.205398+0000 mon.b (mon.2) 178 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:17.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:17 smithi100 bash[13549]: cluster 2021-01-28T04:02:16.573534+0000 mon.a (mon.0) 1327 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:02:17.585 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:17 smithi100 bash[13549]: audit 2021-01-28T04:02:16.587369+0000 mon.a (mon.0) 1328 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-29"}]': finished 2021-01-28T04:02:17.585 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:17 smithi100 bash[13549]: audit 2021-01-28T04:02:16.587494+0000 mon.a (mon.0) 1329 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-17"}]': finished 2021-01-28T04:02:17.586 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:17 smithi100 bash[13549]: cluster 2021-01-28T04:02:16.588223+0000 mon.a (mon.0) 1330 : cluster [DBG] osdmap e178: 8 total, 8 up, 8 in 2021-01-28T04:02:17.586 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:17 smithi100 bash[13549]: audit 2021-01-28T04:02:16.618241+0000 mon.c (mon.1) 215 : audit [INF] from='client.? 172.21.15.100:0/1026916264' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-30"}]: dispatch 2021-01-28T04:02:17.586 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:17 smithi100 bash[13549]: audit 2021-01-28T04:02:16.619320+0000 mon.a (mon.0) 1331 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-30"}]: dispatch 2021-01-28T04:02:17.587 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:17 smithi100 bash[13549]: audit 2021-01-28T04:02:16.622263+0000 mon.c (mon.1) 216 : audit [INF] from='client.? 172.21.15.100:0/1026916264' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-30"}]: dispatch 2021-01-28T04:02:17.587 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:17 smithi100 bash[13549]: audit 2021-01-28T04:02:16.625063+0000 mon.a (mon.0) 1332 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-30"}]: dispatch 2021-01-28T04:02:17.587 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:17 smithi100 bash[13549]: audit 2021-01-28T04:02:16.626298+0000 mon.c (mon.1) 217 : audit [INF] from='client.? 172.21.15.100:0/1026916264' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:17.588 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:17 smithi100 bash[13549]: audit 2021-01-28T04:02:17.061965+0000 mon.a (mon.0) 1333 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:18.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:18 smithi162 bash[9856]: audit 2021-01-28T04:02:17.207448+0000 mon.b (mon.2) 179 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:18.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:18 smithi162 bash[9856]: audit 2021-01-28T04:02:17.602132+0000 mon.a (mon.0) 1334 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:02:18.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:18 smithi162 bash[9856]: cluster 2021-01-28T04:02:17.602400+0000 mon.a (mon.0) 1335 : cluster [DBG] osdmap e179: 8 total, 8 up, 8 in 2021-01-28T04:02:18.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:18 smithi162 bash[9856]: audit 2021-01-28T04:02:17.606350+0000 mon.c (mon.1) 218 : audit [INF] from='client.? 172.21.15.100:0/1026916264' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-30"}]: dispatch 2021-01-28T04:02:18.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:18 smithi162 bash[9856]: audit 2021-01-28T04:02:17.610241+0000 mon.a (mon.0) 1336 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-30"}]: dispatch 2021-01-28T04:02:18.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:18 smithi162 bash[9856]: audit 2021-01-28T04:02:17.611200+0000 mon.a (mon.0) 1337 : audit [INF] from='client.? 172.21.15.100:0/3403969416' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:18.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:18 smithi100 bash[9834]: audit 2021-01-28T04:02:17.207448+0000 mon.b (mon.2) 179 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:18.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:18 smithi100 bash[9834]: audit 2021-01-28T04:02:17.602132+0000 mon.a (mon.0) 1334 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:02:18.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:18 smithi100 bash[9834]: cluster 2021-01-28T04:02:17.602400+0000 mon.a (mon.0) 1335 : cluster [DBG] osdmap e179: 8 total, 8 up, 8 in 2021-01-28T04:02:18.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:18 smithi100 bash[9834]: audit 2021-01-28T04:02:17.606350+0000 mon.c (mon.1) 218 : audit [INF] from='client.? 172.21.15.100:0/1026916264' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-30"}]: dispatch 2021-01-28T04:02:18.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:18 smithi100 bash[9834]: audit 2021-01-28T04:02:17.610241+0000 mon.a (mon.0) 1336 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-30"}]: dispatch 2021-01-28T04:02:18.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:18 smithi100 bash[9834]: audit 2021-01-28T04:02:17.611200+0000 mon.a (mon.0) 1337 : audit [INF] from='client.? 172.21.15.100:0/3403969416' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:18.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:18 smithi100 bash[13549]: audit 2021-01-28T04:02:17.207448+0000 mon.b (mon.2) 179 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:18.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:18 smithi100 bash[13549]: audit 2021-01-28T04:02:17.602132+0000 mon.a (mon.0) 1334 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:02:18.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:18 smithi100 bash[13549]: cluster 2021-01-28T04:02:17.602400+0000 mon.a (mon.0) 1335 : cluster [DBG] osdmap e179: 8 total, 8 up, 8 in 2021-01-28T04:02:18.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:18 smithi100 bash[13549]: audit 2021-01-28T04:02:17.606350+0000 mon.c (mon.1) 218 : audit [INF] from='client.? 172.21.15.100:0/1026916264' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-30"}]: dispatch 2021-01-28T04:02:18.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:18 smithi100 bash[13549]: audit 2021-01-28T04:02:17.610241+0000 mon.a (mon.0) 1336 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-30"}]: dispatch 2021-01-28T04:02:18.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:18 smithi100 bash[13549]: audit 2021-01-28T04:02:17.611200+0000 mon.a (mon.0) 1337 : audit [INF] from='client.? 172.21.15.100:0/3403969416' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:19.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:19 smithi162 bash[9856]: cluster 2021-01-28T04:02:17.579167+0000 mgr.y (mgr.14138) 583 : cluster [DBG] pgmap v518: 260 pgs: 260 active+clean; 28 KiB data, 308 MiB used, 715 GiB / 715 GiB avail; 254 B/s rd, 508 B/s wr, 1 op/s 2021-01-28T04:02:19.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:19 smithi162 bash[9856]: audit 2021-01-28T04:02:18.209437+0000 mon.b (mon.2) 180 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:19.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:19 smithi162 bash[9856]: audit 2021-01-28T04:02:18.211071+0000 mon.b (mon.2) 181 : audit [INF] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi100-32195-1","var":"pg_num","val":"11"}]: dispatch 2021-01-28T04:02:19.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:19 smithi162 bash[9856]: audit 2021-01-28T04:02:18.211154+0000 mon.a (mon.0) 1338 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi100-32195-1","var":"pg_num","val":"11"}]: dispatch 2021-01-28T04:02:19.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:19 smithi162 bash[9856]: audit 2021-01-28T04:02:19.037331+0000 mon.a (mon.0) 1339 : audit [INF] from='client.? 172.21.15.100:0/3403969416' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-32","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:19.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:19 smithi162 bash[9856]: audit 2021-01-28T04:02:19.037895+0000 mon.a (mon.0) 1340 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi100-32195-1","var":"pg_num","val":"11"}]': finished 2021-01-28T04:02:19.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:19 smithi162 bash[9856]: cluster 2021-01-28T04:02:19.038397+0000 mon.a (mon.0) 1341 : cluster [DBG] osdmap e180: 8 total, 8 up, 8 in 2021-01-28T04:02:19.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:19 smithi162 bash[9856]: audit 2021-01-28T04:02:19.039130+0000 mon.c (mon.1) 219 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:19.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:19 smithi162 bash[9856]: audit 2021-01-28T04:02:19.040367+0000 mon.b (mon.2) 182 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:19.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:19 smithi162 bash[9856]: audit 2021-01-28T04:02:19.041515+0000 mon.b (mon.2) 183 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:19.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:19 smithi162 bash[9856]: audit 2021-01-28T04:02:19.042640+0000 mon.b (mon.2) 184 : audit [INF] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi100-32195-1","var":"pgp_num","val":"11"}]: dispatch 2021-01-28T04:02:19.766 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:19 smithi162 bash[9856]: audit 2021-01-28T04:02:19.047339+0000 mon.a (mon.0) 1342 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:19.766 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:19 smithi162 bash[9856]: audit 2021-01-28T04:02:19.048014+0000 mon.a (mon.0) 1343 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi100-32195-1","var":"pgp_num","val":"11"}]: dispatch 2021-01-28T04:02:19.809 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:19 smithi100 bash[9834]: cluster 2021-01-28T04:02:17.579167+0000 mgr.y (mgr.14138) 583 : cluster [DBG] pgmap v518: 260 pgs: 260 active+clean; 28 KiB data, 308 MiB used, 715 GiB / 715 GiB avail; 254 B/s rd, 508 B/s wr, 1 op/s 2021-01-28T04:02:19.810 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:19 smithi100 bash[9834]: audit 2021-01-28T04:02:18.209437+0000 mon.b (mon.2) 180 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:19.810 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:19 smithi100 bash[9834]: audit 2021-01-28T04:02:18.211071+0000 mon.b (mon.2) 181 : audit [INF] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi100-32195-1","var":"pg_num","val":"11"}]: dispatch 2021-01-28T04:02:19.810 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:19 smithi100 bash[9834]: audit 2021-01-28T04:02:18.211154+0000 mon.a (mon.0) 1338 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi100-32195-1","var":"pg_num","val":"11"}]: dispatch 2021-01-28T04:02:19.811 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:19 smithi100 bash[9834]: audit 2021-01-28T04:02:19.037331+0000 mon.a (mon.0) 1339 : audit [INF] from='client.? 172.21.15.100:0/3403969416' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-32","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:19.811 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:19 smithi100 bash[9834]: audit 2021-01-28T04:02:19.037895+0000 mon.a (mon.0) 1340 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi100-32195-1","var":"pg_num","val":"11"}]': finished 2021-01-28T04:02:19.812 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:19 smithi100 bash[9834]: cluster 2021-01-28T04:02:19.038397+0000 mon.a (mon.0) 1341 : cluster [DBG] osdmap e180: 8 total, 8 up, 8 in 2021-01-28T04:02:19.812 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:19 smithi100 bash[9834]: audit 2021-01-28T04:02:19.039130+0000 mon.c (mon.1) 219 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:19.812 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:19 smithi100 bash[9834]: audit 2021-01-28T04:02:19.040367+0000 mon.b (mon.2) 182 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:19.813 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:19 smithi100 bash[9834]: audit 2021-01-28T04:02:19.041515+0000 mon.b (mon.2) 183 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:19.813 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:19 smithi100 bash[9834]: audit 2021-01-28T04:02:19.042640+0000 mon.b (mon.2) 184 : audit [INF] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi100-32195-1","var":"pgp_num","val":"11"}]: dispatch 2021-01-28T04:02:19.813 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:19 smithi100 bash[9834]: audit 2021-01-28T04:02:19.047339+0000 mon.a (mon.0) 1342 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:19.814 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:19 smithi100 bash[9834]: audit 2021-01-28T04:02:19.048014+0000 mon.a (mon.0) 1343 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi100-32195-1","var":"pgp_num","val":"11"}]: dispatch 2021-01-28T04:02:19.814 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:19 smithi100 bash[13549]: cluster 2021-01-28T04:02:17.579167+0000 mgr.y (mgr.14138) 583 : cluster [DBG] pgmap v518: 260 pgs: 260 active+clean; 28 KiB data, 308 MiB used, 715 GiB / 715 GiB avail; 254 B/s rd, 508 B/s wr, 1 op/s 2021-01-28T04:02:19.814 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:19 smithi100 bash[13549]: audit 2021-01-28T04:02:18.209437+0000 mon.b (mon.2) 180 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:19.815 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:19 smithi100 bash[13549]: audit 2021-01-28T04:02:18.211071+0000 mon.b (mon.2) 181 : audit [INF] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi100-32195-1","var":"pg_num","val":"11"}]: dispatch 2021-01-28T04:02:19.815 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:19 smithi100 bash[13549]: audit 2021-01-28T04:02:18.211154+0000 mon.a (mon.0) 1338 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi100-32195-1","var":"pg_num","val":"11"}]: dispatch 2021-01-28T04:02:19.815 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:19 smithi100 bash[13549]: audit 2021-01-28T04:02:19.037331+0000 mon.a (mon.0) 1339 : audit [INF] from='client.? 172.21.15.100:0/3403969416' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-32","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:19.815 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:19 smithi100 bash[13549]: audit 2021-01-28T04:02:19.037895+0000 mon.a (mon.0) 1340 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi100-32195-1","var":"pg_num","val":"11"}]': finished 2021-01-28T04:02:19.816 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:19 smithi100 bash[13549]: cluster 2021-01-28T04:02:19.038397+0000 mon.a (mon.0) 1341 : cluster [DBG] osdmap e180: 8 total, 8 up, 8 in 2021-01-28T04:02:19.816 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:19 smithi100 bash[13549]: audit 2021-01-28T04:02:19.039130+0000 mon.c (mon.1) 219 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:19.816 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:19 smithi100 bash[13549]: audit 2021-01-28T04:02:19.040367+0000 mon.b (mon.2) 182 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:19.816 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:19 smithi100 bash[13549]: audit 2021-01-28T04:02:19.041515+0000 mon.b (mon.2) 183 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:19.817 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:19 smithi100 bash[13549]: audit 2021-01-28T04:02:19.042640+0000 mon.b (mon.2) 184 : audit [INF] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi100-32195-1","var":"pgp_num","val":"11"}]: dispatch 2021-01-28T04:02:19.817 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:19 smithi100 bash[13549]: audit 2021-01-28T04:02:19.047339+0000 mon.a (mon.0) 1342 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:19.817 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:19 smithi100 bash[13549]: audit 2021-01-28T04:02:19.048014+0000 mon.a (mon.0) 1343 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi100-32195-1","var":"pgp_num","val":"11"}]: dispatch 2021-01-28T04:02:20.078 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 04:02:19 smithi100 bash[10061]: debug 2021-01-28T04:02:19.805+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:02:20.263 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 04:02:19 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T04:02:21.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:20 smithi162 bash[9856]: cluster 2021-01-28T04:02:19.580623+0000 mgr.y (mgr.14138) 584 : cluster [DBG] pgmap v521: 292 pgs: 13 creating+peering, 47 unknown, 232 active+clean; 28 KiB data, 309 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-01-28T04:02:21.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:20 smithi162 bash[9856]: audit 2021-01-28T04:02:19.608983+0000 mon.a (mon.0) 1344 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-30"}]': finished 2021-01-28T04:02:21.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:20 smithi162 bash[9856]: audit 2021-01-28T04:02:19.609920+0000 mon.a (mon.0) 1345 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-19","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:21.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:20 smithi162 bash[9856]: audit 2021-01-28T04:02:19.612166+0000 mon.a (mon.0) 1346 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi100-32195-1","var":"pgp_num","val":"11"}]': finished 2021-01-28T04:02:21.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:20 smithi162 bash[9856]: cluster 2021-01-28T04:02:19.612293+0000 mon.a (mon.0) 1347 : cluster [DBG] osdmap e181: 8 total, 8 up, 8 in 2021-01-28T04:02:21.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:20 smithi162 bash[9856]: audit 2021-01-28T04:02:19.614602+0000 mon.b (mon.2) 185 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:21.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:20 smithi162 bash[9856]: audit 2021-01-28T04:02:19.615295+0000 mon.c (mon.1) 220 : audit [INF] from='client.? 172.21.15.100:0/759661877' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:21.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:20 smithi162 bash[9856]: audit 2021-01-28T04:02:19.622525+0000 mon.c (mon.1) 221 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-19", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:21.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:20 smithi162 bash[9856]: audit 2021-01-28T04:02:19.624928+0000 mon.a (mon.0) 1348 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:21.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:20 smithi162 bash[9856]: audit 2021-01-28T04:02:19.625218+0000 mon.a (mon.0) 1349 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-19", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:21.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:20 smithi162 bash[9856]: audit 2021-01-28T04:02:19.773692+0000 mon.b (mon.2) 186 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:21.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:20 smithi162 bash[9856]: audit 2021-01-28T04:02:19.774942+0000 mon.b (mon.2) 187 : audit [INF] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi100-32195-1","var":"pg_num","val":"11"}]: dispatch 2021-01-28T04:02:21.018 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:20 smithi162 bash[9856]: audit 2021-01-28T04:02:19.774955+0000 mon.a (mon.0) 1350 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi100-32195-1","var":"pg_num","val":"11"}]: dispatch 2021-01-28T04:02:21.018 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:20 smithi162 bash[9856]: audit 2021-01-28T04:02:19.807422+0000 mgr.y (mgr.14138) 585 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:02:21.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:20 smithi100 bash[9834]: cluster 2021-01-28T04:02:19.580623+0000 mgr.y (mgr.14138) 584 : cluster [DBG] pgmap v521: 292 pgs: 13 creating+peering, 47 unknown, 232 active+clean; 28 KiB data, 309 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-01-28T04:02:21.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:20 smithi100 bash[9834]: audit 2021-01-28T04:02:19.608983+0000 mon.a (mon.0) 1344 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-30"}]': finished 2021-01-28T04:02:21.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:20 smithi100 bash[9834]: audit 2021-01-28T04:02:19.609920+0000 mon.a (mon.0) 1345 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-19","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:21.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:20 smithi100 bash[9834]: audit 2021-01-28T04:02:19.612166+0000 mon.a (mon.0) 1346 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi100-32195-1","var":"pgp_num","val":"11"}]': finished 2021-01-28T04:02:21.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:20 smithi100 bash[9834]: cluster 2021-01-28T04:02:19.612293+0000 mon.a (mon.0) 1347 : cluster [DBG] osdmap e181: 8 total, 8 up, 8 in 2021-01-28T04:02:21.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:20 smithi100 bash[9834]: audit 2021-01-28T04:02:19.614602+0000 mon.b (mon.2) 185 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:21.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:20 smithi100 bash[9834]: audit 2021-01-28T04:02:19.615295+0000 mon.c (mon.1) 220 : audit [INF] from='client.? 172.21.15.100:0/759661877' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:21.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:20 smithi100 bash[9834]: audit 2021-01-28T04:02:19.622525+0000 mon.c (mon.1) 221 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-19", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:21.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:20 smithi100 bash[9834]: audit 2021-01-28T04:02:19.624928+0000 mon.a (mon.0) 1348 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:21.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:20 smithi100 bash[9834]: audit 2021-01-28T04:02:19.625218+0000 mon.a (mon.0) 1349 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-19", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:21.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:20 smithi100 bash[9834]: audit 2021-01-28T04:02:19.773692+0000 mon.b (mon.2) 186 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:21.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:20 smithi100 bash[9834]: audit 2021-01-28T04:02:19.774942+0000 mon.b (mon.2) 187 : audit [INF] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi100-32195-1","var":"pg_num","val":"11"}]: dispatch 2021-01-28T04:02:21.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:20 smithi100 bash[9834]: audit 2021-01-28T04:02:19.774955+0000 mon.a (mon.0) 1350 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi100-32195-1","var":"pg_num","val":"11"}]: dispatch 2021-01-28T04:02:21.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:20 smithi100 bash[9834]: audit 2021-01-28T04:02:19.807422+0000 mgr.y (mgr.14138) 585 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:02:21.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:20 smithi100 bash[13549]: cluster 2021-01-28T04:02:19.580623+0000 mgr.y (mgr.14138) 584 : cluster [DBG] pgmap v521: 292 pgs: 13 creating+peering, 47 unknown, 232 active+clean; 28 KiB data, 309 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-01-28T04:02:21.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:20 smithi100 bash[13549]: audit 2021-01-28T04:02:19.608983+0000 mon.a (mon.0) 1344 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-30"}]': finished 2021-01-28T04:02:21.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:20 smithi100 bash[13549]: audit 2021-01-28T04:02:19.609920+0000 mon.a (mon.0) 1345 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-19","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:21.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:20 smithi100 bash[13549]: audit 2021-01-28T04:02:19.612166+0000 mon.a (mon.0) 1346 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi100-32195-1","var":"pgp_num","val":"11"}]': finished 2021-01-28T04:02:21.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:20 smithi100 bash[13549]: cluster 2021-01-28T04:02:19.612293+0000 mon.a (mon.0) 1347 : cluster [DBG] osdmap e181: 8 total, 8 up, 8 in 2021-01-28T04:02:21.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:20 smithi100 bash[13549]: audit 2021-01-28T04:02:19.614602+0000 mon.b (mon.2) 185 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:21.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:20 smithi100 bash[13549]: audit 2021-01-28T04:02:19.615295+0000 mon.c (mon.1) 220 : audit [INF] from='client.? 172.21.15.100:0/759661877' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:21.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:20 smithi100 bash[13549]: audit 2021-01-28T04:02:19.622525+0000 mon.c (mon.1) 221 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-19", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:21.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:20 smithi100 bash[13549]: audit 2021-01-28T04:02:19.624928+0000 mon.a (mon.0) 1348 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:21.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:20 smithi100 bash[13549]: audit 2021-01-28T04:02:19.625218+0000 mon.a (mon.0) 1349 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-19", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:21.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:20 smithi100 bash[13549]: audit 2021-01-28T04:02:19.773692+0000 mon.b (mon.2) 186 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:21.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:20 smithi100 bash[13549]: audit 2021-01-28T04:02:19.774942+0000 mon.b (mon.2) 187 : audit [INF] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi100-32195-1","var":"pg_num","val":"11"}]: dispatch 2021-01-28T04:02:21.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:20 smithi100 bash[13549]: audit 2021-01-28T04:02:19.774955+0000 mon.a (mon.0) 1350 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi100-32195-1","var":"pg_num","val":"11"}]: dispatch 2021-01-28T04:02:21.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:20 smithi100 bash[13549]: audit 2021-01-28T04:02:19.807422+0000 mgr.y (mgr.14138) 585 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:02:22.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:21 smithi162 bash[9856]: audit 2021-01-28T04:02:20.617586+0000 mon.a (mon.0) 1351 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-33","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:22.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:21 smithi162 bash[9856]: audit 2021-01-28T04:02:20.617917+0000 mon.a (mon.0) 1352 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-19", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:02:22.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:21 smithi162 bash[9856]: audit 2021-01-28T04:02:20.618349+0000 mon.a (mon.0) 1353 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi100-32195-1","var":"pg_num","val":"11"}]': finished 2021-01-28T04:02:22.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:21 smithi162 bash[9856]: cluster 2021-01-28T04:02:20.618465+0000 mon.a (mon.0) 1354 : cluster [DBG] osdmap e182: 8 total, 8 up, 8 in 2021-01-28T04:02:22.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:21 smithi162 bash[9856]: audit 2021-01-28T04:02:20.620687+0000 mon.c (mon.1) 222 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-19"}]: dispatch 2021-01-28T04:02:22.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:21 smithi162 bash[9856]: audit 2021-01-28T04:02:20.621738+0000 mon.b (mon.2) 188 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:22.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:21 smithi162 bash[9856]: audit 2021-01-28T04:02:20.629153+0000 mon.a (mon.0) 1355 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-19"}]: dispatch 2021-01-28T04:02:22.078 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:21 smithi100 bash[13549]: audit 2021-01-28T04:02:20.617586+0000 mon.a (mon.0) 1351 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-33","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:22.078 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:21 smithi100 bash[13549]: audit 2021-01-28T04:02:20.617917+0000 mon.a (mon.0) 1352 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-19", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:02:22.079 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:21 smithi100 bash[13549]: audit 2021-01-28T04:02:20.618349+0000 mon.a (mon.0) 1353 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi100-32195-1","var":"pg_num","val":"11"}]': finished 2021-01-28T04:02:22.079 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:21 smithi100 bash[13549]: cluster 2021-01-28T04:02:20.618465+0000 mon.a (mon.0) 1354 : cluster [DBG] osdmap e182: 8 total, 8 up, 8 in 2021-01-28T04:02:22.079 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:21 smithi100 bash[13549]: audit 2021-01-28T04:02:20.620687+0000 mon.c (mon.1) 222 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-19"}]: dispatch 2021-01-28T04:02:22.079 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:21 smithi100 bash[13549]: audit 2021-01-28T04:02:20.621738+0000 mon.b (mon.2) 188 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:22.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:21 smithi100 bash[13549]: audit 2021-01-28T04:02:20.629153+0000 mon.a (mon.0) 1355 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-19"}]: dispatch 2021-01-28T04:02:22.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:21 smithi100 bash[9834]: audit 2021-01-28T04:02:20.617586+0000 mon.a (mon.0) 1351 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-33","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:22.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:21 smithi100 bash[9834]: audit 2021-01-28T04:02:20.617917+0000 mon.a (mon.0) 1352 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-19", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:02:22.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:21 smithi100 bash[9834]: audit 2021-01-28T04:02:20.618349+0000 mon.a (mon.0) 1353 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi100-32195-1","var":"pg_num","val":"11"}]': finished 2021-01-28T04:02:22.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:21 smithi100 bash[9834]: cluster 2021-01-28T04:02:20.618465+0000 mon.a (mon.0) 1354 : cluster [DBG] osdmap e182: 8 total, 8 up, 8 in 2021-01-28T04:02:22.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:21 smithi100 bash[9834]: audit 2021-01-28T04:02:20.620687+0000 mon.c (mon.1) 222 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-19"}]: dispatch 2021-01-28T04:02:22.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:21 smithi100 bash[9834]: audit 2021-01-28T04:02:20.621738+0000 mon.b (mon.2) 188 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:22.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:21 smithi100 bash[9834]: audit 2021-01-28T04:02:20.629153+0000 mon.a (mon.0) 1355 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-19"}]: dispatch 2021-01-28T04:02:23.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:22 smithi162 bash[9856]: cluster 2021-01-28T04:02:21.582001+0000 mgr.y (mgr.14138) 586 : cluster [DBG] pgmap v524: 332 pgs: 13 creating+peering, 72 unknown, 247 active+clean; 29 KiB data, 310 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2021-01-28T04:02:23.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:22 smithi162 bash[9856]: audit 2021-01-28T04:02:21.623036+0000 mon.b (mon.2) 189 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:23.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:22 smithi162 bash[9856]: audit 2021-01-28T04:02:21.626128+0000 mon.a (mon.0) 1356 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-19"}]': finished 2021-01-28T04:02:23.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:22 smithi162 bash[9856]: audit 2021-01-28T04:02:21.627473+0000 mon.c (mon.1) 223 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-19", "mode": "writeback"}]: dispatch 2021-01-28T04:02:23.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:22 smithi162 bash[9856]: cluster 2021-01-28T04:02:21.628171+0000 mon.a (mon.0) 1357 : cluster [DBG] osdmap e183: 8 total, 8 up, 8 in 2021-01-28T04:02:23.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:22 smithi162 bash[9856]: audit 2021-01-28T04:02:21.631008+0000 mon.c (mon.1) 224 : audit [INF] from='client.? 172.21.15.100:0/1026916264' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-30"}]: dispatch 2021-01-28T04:02:23.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:22 smithi162 bash[9856]: cluster 2021-01-28T04:02:21.632932+0000 mon.a (mon.0) 1358 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:02:23.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:22 smithi162 bash[9856]: audit 2021-01-28T04:02:21.638454+0000 mon.a (mon.0) 1359 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-19", "mode": "writeback"}]: dispatch 2021-01-28T04:02:23.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:22 smithi162 bash[9856]: audit 2021-01-28T04:02:21.640007+0000 mon.a (mon.0) 1360 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-30"}]: dispatch 2021-01-28T04:02:23.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:22 smithi162 bash[9856]: audit 2021-01-28T04:02:21.647097+0000 mon.a (mon.0) 1361 : audit [INF] from='client.? 172.21.15.100:0/2870624569' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:23.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:22 smithi162 bash[9856]: cluster 2021-01-28T04:02:22.612228+0000 mon.a (mon.0) 1362 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:02:23.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:22 smithi162 bash[9856]: audit 2021-01-28T04:02:22.619978+0000 mon.a (mon.0) 1363 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-19", "mode": "writeback"}]': finished 2021-01-28T04:02:23.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:22 smithi162 bash[9856]: audit 2021-01-28T04:02:22.620152+0000 mon.a (mon.0) 1364 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-30"}]': finished 2021-01-28T04:02:23.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:22 smithi162 bash[9856]: audit 2021-01-28T04:02:22.620300+0000 mon.a (mon.0) 1365 : audit [INF] from='client.? 172.21.15.100:0/2870624569' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-34","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:23.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:22 smithi162 bash[9856]: cluster 2021-01-28T04:02:22.620574+0000 mon.a (mon.0) 1366 : cluster [DBG] osdmap e184: 8 total, 8 up, 8 in 2021-01-28T04:02:23.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:22 smithi162 bash[9856]: audit 2021-01-28T04:02:22.622830+0000 mon.c (mon.1) 225 : audit [INF] from='client.? 172.21.15.100:0/1026916264' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-30"}]: dispatch 2021-01-28T04:02:23.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:22 smithi162 bash[9856]: audit 2021-01-28T04:02:22.624857+0000 mon.a (mon.0) 1367 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-30"}]: dispatch 2021-01-28T04:02:23.018 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:22 smithi162 bash[9856]: audit 2021-01-28T04:02:22.625028+0000 mon.b (mon.2) 190 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:23.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:22 smithi100 bash[9834]: cluster 2021-01-28T04:02:21.582001+0000 mgr.y (mgr.14138) 586 : cluster [DBG] pgmap v524: 332 pgs: 13 creating+peering, 72 unknown, 247 active+clean; 29 KiB data, 310 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2021-01-28T04:02:23.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:22 smithi100 bash[9834]: audit 2021-01-28T04:02:21.623036+0000 mon.b (mon.2) 189 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:23.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:22 smithi100 bash[9834]: audit 2021-01-28T04:02:21.626128+0000 mon.a (mon.0) 1356 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-19"}]': finished 2021-01-28T04:02:23.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:22 smithi100 bash[9834]: audit 2021-01-28T04:02:21.627473+0000 mon.c (mon.1) 223 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-19", "mode": "writeback"}]: dispatch 2021-01-28T04:02:23.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:22 smithi100 bash[9834]: cluster 2021-01-28T04:02:21.628171+0000 mon.a (mon.0) 1357 : cluster [DBG] osdmap e183: 8 total, 8 up, 8 in 2021-01-28T04:02:23.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:22 smithi100 bash[9834]: audit 2021-01-28T04:02:21.631008+0000 mon.c (mon.1) 224 : audit [INF] from='client.? 172.21.15.100:0/1026916264' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-30"}]: dispatch 2021-01-28T04:02:23.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:22 smithi100 bash[9834]: cluster 2021-01-28T04:02:21.632932+0000 mon.a (mon.0) 1358 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:02:23.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:22 smithi100 bash[9834]: audit 2021-01-28T04:02:21.638454+0000 mon.a (mon.0) 1359 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-19", "mode": "writeback"}]: dispatch 2021-01-28T04:02:23.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:22 smithi100 bash[9834]: audit 2021-01-28T04:02:21.640007+0000 mon.a (mon.0) 1360 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-30"}]: dispatch 2021-01-28T04:02:23.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:22 smithi100 bash[9834]: audit 2021-01-28T04:02:21.647097+0000 mon.a (mon.0) 1361 : audit [INF] from='client.? 172.21.15.100:0/2870624569' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:23.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:22 smithi100 bash[9834]: cluster 2021-01-28T04:02:22.612228+0000 mon.a (mon.0) 1362 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:02:23.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:22 smithi100 bash[9834]: audit 2021-01-28T04:02:22.619978+0000 mon.a (mon.0) 1363 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-19", "mode": "writeback"}]': finished 2021-01-28T04:02:23.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:22 smithi100 bash[9834]: audit 2021-01-28T04:02:22.620152+0000 mon.a (mon.0) 1364 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-30"}]': finished 2021-01-28T04:02:23.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:22 smithi100 bash[9834]: audit 2021-01-28T04:02:22.620300+0000 mon.a (mon.0) 1365 : audit [INF] from='client.? 172.21.15.100:0/2870624569' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-34","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:23.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:22 smithi100 bash[9834]: cluster 2021-01-28T04:02:22.620574+0000 mon.a (mon.0) 1366 : cluster [DBG] osdmap e184: 8 total, 8 up, 8 in 2021-01-28T04:02:23.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:22 smithi100 bash[9834]: audit 2021-01-28T04:02:22.622830+0000 mon.c (mon.1) 225 : audit [INF] from='client.? 172.21.15.100:0/1026916264' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-30"}]: dispatch 2021-01-28T04:02:23.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:22 smithi100 bash[9834]: audit 2021-01-28T04:02:22.624857+0000 mon.a (mon.0) 1367 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-30"}]: dispatch 2021-01-28T04:02:23.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:22 smithi100 bash[9834]: audit 2021-01-28T04:02:22.625028+0000 mon.b (mon.2) 190 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:23.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:22 smithi100 bash[13549]: cluster 2021-01-28T04:02:21.582001+0000 mgr.y (mgr.14138) 586 : cluster [DBG] pgmap v524: 332 pgs: 13 creating+peering, 72 unknown, 247 active+clean; 29 KiB data, 310 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2021-01-28T04:02:23.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:22 smithi100 bash[13549]: audit 2021-01-28T04:02:21.623036+0000 mon.b (mon.2) 189 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:23.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:22 smithi100 bash[13549]: audit 2021-01-28T04:02:21.626128+0000 mon.a (mon.0) 1356 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-19"}]': finished 2021-01-28T04:02:23.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:22 smithi100 bash[13549]: audit 2021-01-28T04:02:21.627473+0000 mon.c (mon.1) 223 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-19", "mode": "writeback"}]: dispatch 2021-01-28T04:02:23.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:22 smithi100 bash[13549]: cluster 2021-01-28T04:02:21.628171+0000 mon.a (mon.0) 1357 : cluster [DBG] osdmap e183: 8 total, 8 up, 8 in 2021-01-28T04:02:23.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:22 smithi100 bash[13549]: audit 2021-01-28T04:02:21.631008+0000 mon.c (mon.1) 224 : audit [INF] from='client.? 172.21.15.100:0/1026916264' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-30"}]: dispatch 2021-01-28T04:02:23.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:22 smithi100 bash[13549]: cluster 2021-01-28T04:02:21.632932+0000 mon.a (mon.0) 1358 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:02:23.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:22 smithi100 bash[13549]: audit 2021-01-28T04:02:21.638454+0000 mon.a (mon.0) 1359 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-19", "mode": "writeback"}]: dispatch 2021-01-28T04:02:23.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:22 smithi100 bash[13549]: audit 2021-01-28T04:02:21.640007+0000 mon.a (mon.0) 1360 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-30"}]: dispatch 2021-01-28T04:02:23.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:22 smithi100 bash[13549]: audit 2021-01-28T04:02:21.647097+0000 mon.a (mon.0) 1361 : audit [INF] from='client.? 172.21.15.100:0/2870624569' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:23.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:22 smithi100 bash[13549]: cluster 2021-01-28T04:02:22.612228+0000 mon.a (mon.0) 1362 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:02:23.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:22 smithi100 bash[13549]: audit 2021-01-28T04:02:22.619978+0000 mon.a (mon.0) 1363 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-19", "mode": "writeback"}]': finished 2021-01-28T04:02:23.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:22 smithi100 bash[13549]: audit 2021-01-28T04:02:22.620152+0000 mon.a (mon.0) 1364 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-30"}]': finished 2021-01-28T04:02:23.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:22 smithi100 bash[13549]: audit 2021-01-28T04:02:22.620300+0000 mon.a (mon.0) 1365 : audit [INF] from='client.? 172.21.15.100:0/2870624569' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-34","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:23.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:22 smithi100 bash[13549]: cluster 2021-01-28T04:02:22.620574+0000 mon.a (mon.0) 1366 : cluster [DBG] osdmap e184: 8 total, 8 up, 8 in 2021-01-28T04:02:23.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:22 smithi100 bash[13549]: audit 2021-01-28T04:02:22.622830+0000 mon.c (mon.1) 225 : audit [INF] from='client.? 172.21.15.100:0/1026916264' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-30"}]: dispatch 2021-01-28T04:02:23.087 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:22 smithi100 bash[13549]: audit 2021-01-28T04:02:22.624857+0000 mon.a (mon.0) 1367 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-30"}]: dispatch 2021-01-28T04:02:23.087 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:22 smithi100 bash[13549]: audit 2021-01-28T04:02:22.625028+0000 mon.b (mon.2) 190 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:24.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:23 smithi162 bash[9856]: audit 2021-01-28T04:02:22.686370+0000 mon.c (mon.1) 226 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:02:24.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:23 smithi162 bash[9856]: audit 2021-01-28T04:02:22.686893+0000 mon.a (mon.0) 1368 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:02:24.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:23 smithi162 bash[9856]: audit 2021-01-28T04:02:23.627119+0000 mon.a (mon.0) 1369 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-30"}]': finished 2021-01-28T04:02:24.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:23 smithi162 bash[9856]: audit 2021-01-28T04:02:23.627464+0000 mon.b (mon.2) 191 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:24.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:23 smithi162 bash[9856]: audit 2021-01-28T04:02:23.627638+0000 mon.a (mon.0) 1370 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:02:24.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:23 smithi162 bash[9856]: cluster 2021-01-28T04:02:23.628272+0000 mon.a (mon.0) 1371 : cluster [DBG] osdmap e185: 8 total, 8 up, 8 in 2021-01-28T04:02:24.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:23 smithi162 bash[9856]: audit 2021-01-28T04:02:23.629542+0000 mon.c (mon.1) 227 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-19"}]: dispatch 2021-01-28T04:02:24.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:23 smithi162 bash[9856]: audit 2021-01-28T04:02:23.630979+0000 mon.a (mon.0) 1372 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-19"}]: dispatch 2021-01-28T04:02:24.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:23 smithi100 bash[9834]: audit 2021-01-28T04:02:22.686370+0000 mon.c (mon.1) 226 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:02:24.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:23 smithi100 bash[9834]: audit 2021-01-28T04:02:22.686893+0000 mon.a (mon.0) 1368 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:02:24.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:23 smithi100 bash[9834]: audit 2021-01-28T04:02:23.627119+0000 mon.a (mon.0) 1369 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-30"}]': finished 2021-01-28T04:02:24.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:23 smithi100 bash[9834]: audit 2021-01-28T04:02:23.627464+0000 mon.b (mon.2) 191 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:24.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:23 smithi100 bash[9834]: audit 2021-01-28T04:02:23.627638+0000 mon.a (mon.0) 1370 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:02:24.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:23 smithi100 bash[9834]: cluster 2021-01-28T04:02:23.628272+0000 mon.a (mon.0) 1371 : cluster [DBG] osdmap e185: 8 total, 8 up, 8 in 2021-01-28T04:02:24.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:23 smithi100 bash[9834]: audit 2021-01-28T04:02:23.629542+0000 mon.c (mon.1) 227 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-19"}]: dispatch 2021-01-28T04:02:24.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:23 smithi100 bash[9834]: audit 2021-01-28T04:02:23.630979+0000 mon.a (mon.0) 1372 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-19"}]: dispatch 2021-01-28T04:02:24.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:23 smithi100 bash[13549]: audit 2021-01-28T04:02:22.686370+0000 mon.c (mon.1) 226 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:02:24.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:23 smithi100 bash[13549]: audit 2021-01-28T04:02:22.686893+0000 mon.a (mon.0) 1368 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:02:24.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:23 smithi100 bash[13549]: audit 2021-01-28T04:02:23.627119+0000 mon.a (mon.0) 1369 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-30"}]': finished 2021-01-28T04:02:24.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:23 smithi100 bash[13549]: audit 2021-01-28T04:02:23.627464+0000 mon.b (mon.2) 191 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:24.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:23 smithi100 bash[13549]: audit 2021-01-28T04:02:23.627638+0000 mon.a (mon.0) 1370 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:02:24.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:23 smithi100 bash[13549]: cluster 2021-01-28T04:02:23.628272+0000 mon.a (mon.0) 1371 : cluster [DBG] osdmap e185: 8 total, 8 up, 8 in 2021-01-28T04:02:24.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:23 smithi100 bash[13549]: audit 2021-01-28T04:02:23.629542+0000 mon.c (mon.1) 227 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-19"}]: dispatch 2021-01-28T04:02:24.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:23 smithi100 bash[13549]: audit 2021-01-28T04:02:23.630979+0000 mon.a (mon.0) 1372 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-19"}]: dispatch 2021-01-28T04:02:25.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:24 smithi162 bash[9856]: cluster 2021-01-28T04:02:23.583753+0000 mgr.y (mgr.14138) 587 : cluster [DBG] pgmap v527: 356 pgs: 20 creating+peering, 27 unknown, 309 active+clean; 28 KiB data, 316 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2021-01-28T04:02:25.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:24 smithi162 bash[9856]: audit 2021-01-28T04:02:23.655095+0000 mon.a (mon.0) 1373 : audit [INF] from='client.? 172.21.15.100:0/2746131882' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-31"}]: dispatch 2021-01-28T04:02:25.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:24 smithi162 bash[9856]: audit 2021-01-28T04:02:23.656138+0000 mon.a (mon.0) 1374 : audit [INF] from='client.? 172.21.15.100:0/2746131882' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-31"}]: dispatch 2021-01-28T04:02:25.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:24 smithi162 bash[9856]: audit 2021-01-28T04:02:23.656576+0000 mon.a (mon.0) 1375 : audit [INF] from='client.? 172.21.15.100:0/2746131882' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:25.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:24 smithi162 bash[9856]: cluster 2021-01-28T04:02:24.618350+0000 mon.a (mon.0) 1376 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:02:25.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:24 smithi162 bash[9856]: audit 2021-01-28T04:02:24.627713+0000 mon.a (mon.0) 1377 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-19"}]': finished 2021-01-28T04:02:25.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:24 smithi162 bash[9856]: audit 2021-01-28T04:02:24.627905+0000 mon.a (mon.0) 1378 : audit [INF] from='client.? 172.21.15.100:0/2746131882' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:02:25.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:24 smithi162 bash[9856]: cluster 2021-01-28T04:02:24.628009+0000 mon.a (mon.0) 1379 : cluster [DBG] osdmap e186: 8 total, 8 up, 8 in 2021-01-28T04:02:25.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:24 smithi162 bash[9856]: audit 2021-01-28T04:02:24.630379+0000 mon.b (mon.2) 192 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:25.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:24 smithi162 bash[9856]: audit 2021-01-28T04:02:24.631481+0000 mon.a (mon.0) 1380 : audit [INF] from='client.? 172.21.15.100:0/2746131882' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-31"}]: dispatch 2021-01-28T04:02:25.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:24 smithi100 bash[9834]: cluster 2021-01-28T04:02:23.583753+0000 mgr.y (mgr.14138) 587 : cluster [DBG] pgmap v527: 356 pgs: 20 creating+peering, 27 unknown, 309 active+clean; 28 KiB data, 316 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2021-01-28T04:02:25.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:24 smithi100 bash[9834]: audit 2021-01-28T04:02:23.655095+0000 mon.a (mon.0) 1373 : audit [INF] from='client.? 172.21.15.100:0/2746131882' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-31"}]: dispatch 2021-01-28T04:02:25.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:24 smithi100 bash[9834]: audit 2021-01-28T04:02:23.656138+0000 mon.a (mon.0) 1374 : audit [INF] from='client.? 172.21.15.100:0/2746131882' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-31"}]: dispatch 2021-01-28T04:02:25.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:24 smithi100 bash[9834]: audit 2021-01-28T04:02:23.656576+0000 mon.a (mon.0) 1375 : audit [INF] from='client.? 172.21.15.100:0/2746131882' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:25.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:24 smithi100 bash[9834]: cluster 2021-01-28T04:02:24.618350+0000 mon.a (mon.0) 1376 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:02:25.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:24 smithi100 bash[9834]: audit 2021-01-28T04:02:24.627713+0000 mon.a (mon.0) 1377 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-19"}]': finished 2021-01-28T04:02:25.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:24 smithi100 bash[9834]: audit 2021-01-28T04:02:24.627905+0000 mon.a (mon.0) 1378 : audit [INF] from='client.? 172.21.15.100:0/2746131882' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:02:25.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:24 smithi100 bash[9834]: cluster 2021-01-28T04:02:24.628009+0000 mon.a (mon.0) 1379 : cluster [DBG] osdmap e186: 8 total, 8 up, 8 in 2021-01-28T04:02:25.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:24 smithi100 bash[9834]: audit 2021-01-28T04:02:24.630379+0000 mon.b (mon.2) 192 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:25.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:24 smithi100 bash[9834]: audit 2021-01-28T04:02:24.631481+0000 mon.a (mon.0) 1380 : audit [INF] from='client.? 172.21.15.100:0/2746131882' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-31"}]: dispatch 2021-01-28T04:02:25.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:24 smithi100 bash[13549]: cluster 2021-01-28T04:02:23.583753+0000 mgr.y (mgr.14138) 587 : cluster [DBG] pgmap v527: 356 pgs: 20 creating+peering, 27 unknown, 309 active+clean; 28 KiB data, 316 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2021-01-28T04:02:25.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:24 smithi100 bash[13549]: audit 2021-01-28T04:02:23.655095+0000 mon.a (mon.0) 1373 : audit [INF] from='client.? 172.21.15.100:0/2746131882' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-31"}]: dispatch 2021-01-28T04:02:25.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:24 smithi100 bash[13549]: audit 2021-01-28T04:02:23.656138+0000 mon.a (mon.0) 1374 : audit [INF] from='client.? 172.21.15.100:0/2746131882' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-31"}]: dispatch 2021-01-28T04:02:25.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:24 smithi100 bash[13549]: audit 2021-01-28T04:02:23.656576+0000 mon.a (mon.0) 1375 : audit [INF] from='client.? 172.21.15.100:0/2746131882' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:25.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:24 smithi100 bash[13549]: cluster 2021-01-28T04:02:24.618350+0000 mon.a (mon.0) 1376 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:02:25.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:24 smithi100 bash[13549]: audit 2021-01-28T04:02:24.627713+0000 mon.a (mon.0) 1377 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-19"}]': finished 2021-01-28T04:02:25.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:24 smithi100 bash[13549]: audit 2021-01-28T04:02:24.627905+0000 mon.a (mon.0) 1378 : audit [INF] from='client.? 172.21.15.100:0/2746131882' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:02:25.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:24 smithi100 bash[13549]: cluster 2021-01-28T04:02:24.628009+0000 mon.a (mon.0) 1379 : cluster [DBG] osdmap e186: 8 total, 8 up, 8 in 2021-01-28T04:02:25.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:24 smithi100 bash[13549]: audit 2021-01-28T04:02:24.630379+0000 mon.b (mon.2) 192 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:25.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:24 smithi100 bash[13549]: audit 2021-01-28T04:02:24.631481+0000 mon.a (mon.0) 1380 : audit [INF] from='client.? 172.21.15.100:0/2746131882' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-31"}]: dispatch 2021-01-28T04:02:27.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:26 smithi162 bash[9856]: audit 2021-01-28T04:02:25.587182+0000 mon.a (mon.0) 1381 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi100-32195-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2021-01-28T04:02:27.328 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:26 smithi100 bash[13549]: audit 2021-01-28T04:02:25.587182+0000 mon.a (mon.0) 1381 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi100-32195-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2021-01-28T04:02:27.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:26 smithi100 bash[9834]: audit 2021-01-28T04:02:25.587182+0000 mon.a (mon.0) 1381 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi100-32195-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2021-01-28T04:02:28.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:27 smithi162 bash[9856]: cluster 2021-01-28T04:02:25.584693+0000 mgr.y (mgr.14138) 588 : cluster [DBG] pgmap v530: 292 pgs: 292 active+clean; 28 KiB data, 316 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2021-01-28T04:02:28.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:27 smithi162 bash[9856]: audit 2021-01-28T04:02:25.634643+0000 mon.b (mon.2) 193 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:28.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:27 smithi162 bash[9856]: audit 2021-01-28T04:02:26.061817+0000 mon.a (mon.0) 1382 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "test-rados-api-smithi100-32195-1", "var": "pgp_num_actual", "val": "31"}]': finished 2021-01-28T04:02:28.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:27 smithi162 bash[9856]: cluster 2021-01-28T04:02:26.062062+0000 mon.a (mon.0) 1383 : cluster [DBG] osdmap e187: 8 total, 8 up, 8 in 2021-01-28T04:02:28.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:27 smithi162 bash[9856]: audit 2021-01-28T04:02:26.636217+0000 mon.b (mon.2) 194 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:28.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:27 smithi162 bash[9856]: audit 2021-01-28T04:02:26.637641+0000 mon.b (mon.2) 195 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:28.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:27 smithi162 bash[9856]: audit 2021-01-28T04:02:26.639049+0000 mon.b (mon.2) 196 : audit [INF] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi100-32195-1","var":"pgp_num","val":"11"}]: dispatch 2021-01-28T04:02:28.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:27 smithi162 bash[9856]: audit 2021-01-28T04:02:26.940070+0000 mon.a (mon.0) 1384 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi100-32195-1","var":"pgp_num","val":"11"}]: dispatch 2021-01-28T04:02:28.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:27 smithi162 bash[9856]: audit 2021-01-28T04:02:26.945820+0000 mon.a (mon.0) 1385 : audit [INF] from='client.? 172.21.15.100:0/2746131882' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-31"}]': finished 2021-01-28T04:02:28.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:27 smithi162 bash[9856]: cluster 2021-01-28T04:02:26.946236+0000 mon.a (mon.0) 1386 : cluster [DBG] osdmap e188: 8 total, 8 up, 8 in 2021-01-28T04:02:28.266 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:27 smithi162 bash[9856]: audit 2021-01-28T04:02:26.952232+0000 mon.c (mon.1) 228 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:28.266 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:27 smithi162 bash[9856]: audit 2021-01-28T04:02:26.952568+0000 mon.c (mon.1) 229 : audit [INF] from='client.? 172.21.15.100:0/2896849671' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:28.266 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:27 smithi162 bash[9856]: audit 2021-01-28T04:02:26.952774+0000 mon.a (mon.0) 1387 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:28.266 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:27 smithi162 bash[9856]: audit 2021-01-28T04:02:26.953422+0000 mon.a (mon.0) 1388 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:28.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:27 smithi100 bash[9834]: cluster 2021-01-28T04:02:25.584693+0000 mgr.y (mgr.14138) 588 : cluster [DBG] pgmap v530: 292 pgs: 292 active+clean; 28 KiB data, 316 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2021-01-28T04:02:28.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:27 smithi100 bash[9834]: audit 2021-01-28T04:02:25.634643+0000 mon.b (mon.2) 193 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:28.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:27 smithi100 bash[9834]: audit 2021-01-28T04:02:26.061817+0000 mon.a (mon.0) 1382 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "test-rados-api-smithi100-32195-1", "var": "pgp_num_actual", "val": "31"}]': finished 2021-01-28T04:02:28.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:27 smithi100 bash[9834]: cluster 2021-01-28T04:02:26.062062+0000 mon.a (mon.0) 1383 : cluster [DBG] osdmap e187: 8 total, 8 up, 8 in 2021-01-28T04:02:28.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:27 smithi100 bash[9834]: audit 2021-01-28T04:02:26.636217+0000 mon.b (mon.2) 194 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:28.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:27 smithi100 bash[9834]: audit 2021-01-28T04:02:26.637641+0000 mon.b (mon.2) 195 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:28.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:27 smithi100 bash[9834]: audit 2021-01-28T04:02:26.639049+0000 mon.b (mon.2) 196 : audit [INF] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi100-32195-1","var":"pgp_num","val":"11"}]: dispatch 2021-01-28T04:02:28.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:27 smithi100 bash[9834]: audit 2021-01-28T04:02:26.940070+0000 mon.a (mon.0) 1384 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi100-32195-1","var":"pgp_num","val":"11"}]: dispatch 2021-01-28T04:02:28.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:27 smithi100 bash[9834]: audit 2021-01-28T04:02:26.945820+0000 mon.a (mon.0) 1385 : audit [INF] from='client.? 172.21.15.100:0/2746131882' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-31"}]': finished 2021-01-28T04:02:28.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:27 smithi100 bash[9834]: cluster 2021-01-28T04:02:26.946236+0000 mon.a (mon.0) 1386 : cluster [DBG] osdmap e188: 8 total, 8 up, 8 in 2021-01-28T04:02:28.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:27 smithi100 bash[9834]: audit 2021-01-28T04:02:26.952232+0000 mon.c (mon.1) 228 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:28.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:27 smithi100 bash[9834]: audit 2021-01-28T04:02:26.952568+0000 mon.c (mon.1) 229 : audit [INF] from='client.? 172.21.15.100:0/2896849671' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:28.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:27 smithi100 bash[9834]: audit 2021-01-28T04:02:26.952774+0000 mon.a (mon.0) 1387 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:28.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:27 smithi100 bash[9834]: audit 2021-01-28T04:02:26.953422+0000 mon.a (mon.0) 1388 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:28.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:27 smithi100 bash[13549]: cluster 2021-01-28T04:02:25.584693+0000 mgr.y (mgr.14138) 588 : cluster [DBG] pgmap v530: 292 pgs: 292 active+clean; 28 KiB data, 316 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2021-01-28T04:02:28.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:27 smithi100 bash[13549]: audit 2021-01-28T04:02:25.634643+0000 mon.b (mon.2) 193 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:28.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:27 smithi100 bash[13549]: audit 2021-01-28T04:02:26.061817+0000 mon.a (mon.0) 1382 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "test-rados-api-smithi100-32195-1", "var": "pgp_num_actual", "val": "31"}]': finished 2021-01-28T04:02:28.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:27 smithi100 bash[13549]: cluster 2021-01-28T04:02:26.062062+0000 mon.a (mon.0) 1383 : cluster [DBG] osdmap e187: 8 total, 8 up, 8 in 2021-01-28T04:02:28.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:27 smithi100 bash[13549]: audit 2021-01-28T04:02:26.636217+0000 mon.b (mon.2) 194 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:28.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:27 smithi100 bash[13549]: audit 2021-01-28T04:02:26.637641+0000 mon.b (mon.2) 195 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:28.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:27 smithi100 bash[13549]: audit 2021-01-28T04:02:26.639049+0000 mon.b (mon.2) 196 : audit [INF] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi100-32195-1","var":"pgp_num","val":"11"}]: dispatch 2021-01-28T04:02:28.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:27 smithi100 bash[13549]: audit 2021-01-28T04:02:26.940070+0000 mon.a (mon.0) 1384 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"test-rados-api-smithi100-32195-1","var":"pgp_num","val":"11"}]: dispatch 2021-01-28T04:02:28.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:27 smithi100 bash[13549]: audit 2021-01-28T04:02:26.945820+0000 mon.a (mon.0) 1385 : audit [INF] from='client.? 172.21.15.100:0/2746131882' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-31"}]': finished 2021-01-28T04:02:28.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:27 smithi100 bash[13549]: cluster 2021-01-28T04:02:26.946236+0000 mon.a (mon.0) 1386 : cluster [DBG] osdmap e188: 8 total, 8 up, 8 in 2021-01-28T04:02:28.334 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:27 smithi100 bash[13549]: audit 2021-01-28T04:02:26.952232+0000 mon.c (mon.1) 228 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:28.334 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:27 smithi100 bash[13549]: audit 2021-01-28T04:02:26.952568+0000 mon.c (mon.1) 229 : audit [INF] from='client.? 172.21.15.100:0/2896849671' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:28.334 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:27 smithi100 bash[13549]: audit 2021-01-28T04:02:26.952774+0000 mon.a (mon.0) 1387 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:28.334 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:27 smithi100 bash[13549]: audit 2021-01-28T04:02:26.953422+0000 mon.a (mon.0) 1388 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:29.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:28 smithi162 bash[9856]: cluster 2021-01-28T04:02:27.586272+0000 mgr.y (mgr.14138) 589 : cluster [DBG] pgmap v533: 300 pgs: 31 creating+peering, 41 unknown, 1 peering, 227 active+clean; 28 KiB data, 317 MiB used, 715 GiB / 715 GiB avail; 767 B/s wr, 1 op/s 2021-01-28T04:02:29.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:28 smithi162 bash[9856]: audit 2021-01-28T04:02:27.953223+0000 mon.a (mon.0) 1389 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi100-32195-1","var":"pgp_num","val":"11"}]': finished 2021-01-28T04:02:29.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:28 smithi162 bash[9856]: audit 2021-01-28T04:02:27.953326+0000 mon.a (mon.0) 1390 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-21","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:29.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:28 smithi162 bash[9856]: audit 2021-01-28T04:02:27.953394+0000 mon.a (mon.0) 1391 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-35","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:29.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:28 smithi162 bash[9856]: cluster 2021-01-28T04:02:27.953603+0000 mon.a (mon.0) 1392 : cluster [DBG] osdmap e189: 8 total, 8 up, 8 in 2021-01-28T04:02:29.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:28 smithi162 bash[9856]: audit 2021-01-28T04:02:27.960061+0000 mon.b (mon.2) 197 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:29.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:28 smithi162 bash[9856]: audit 2021-01-28T04:02:27.975081+0000 mon.c (mon.1) 230 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-21", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:29.266 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:28 smithi162 bash[9856]: audit 2021-01-28T04:02:27.975866+0000 mon.a (mon.0) 1393 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-21", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:29.266 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:28 smithi162 bash[9856]: cluster 2021-01-28T04:02:28.550637+0000 mon.a (mon.0) 1394 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:02:29.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:28 smithi100 bash[9834]: cluster 2021-01-28T04:02:27.586272+0000 mgr.y (mgr.14138) 589 : cluster [DBG] pgmap v533: 300 pgs: 31 creating+peering, 41 unknown, 1 peering, 227 active+clean; 28 KiB data, 317 MiB used, 715 GiB / 715 GiB avail; 767 B/s wr, 1 op/s 2021-01-28T04:02:29.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:28 smithi100 bash[9834]: audit 2021-01-28T04:02:27.953223+0000 mon.a (mon.0) 1389 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi100-32195-1","var":"pgp_num","val":"11"}]': finished 2021-01-28T04:02:29.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:28 smithi100 bash[9834]: audit 2021-01-28T04:02:27.953326+0000 mon.a (mon.0) 1390 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-21","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:29.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:28 smithi100 bash[9834]: audit 2021-01-28T04:02:27.953394+0000 mon.a (mon.0) 1391 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-35","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:29.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:28 smithi100 bash[9834]: cluster 2021-01-28T04:02:27.953603+0000 mon.a (mon.0) 1392 : cluster [DBG] osdmap e189: 8 total, 8 up, 8 in 2021-01-28T04:02:29.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:28 smithi100 bash[9834]: audit 2021-01-28T04:02:27.960061+0000 mon.b (mon.2) 197 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:29.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:28 smithi100 bash[9834]: audit 2021-01-28T04:02:27.975081+0000 mon.c (mon.1) 230 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-21", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:29.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:28 smithi100 bash[9834]: audit 2021-01-28T04:02:27.975866+0000 mon.a (mon.0) 1393 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-21", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:29.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:28 smithi100 bash[9834]: cluster 2021-01-28T04:02:28.550637+0000 mon.a (mon.0) 1394 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:02:29.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:28 smithi100 bash[13549]: cluster 2021-01-28T04:02:27.586272+0000 mgr.y (mgr.14138) 589 : cluster [DBG] pgmap v533: 300 pgs: 31 creating+peering, 41 unknown, 1 peering, 227 active+clean; 28 KiB data, 317 MiB used, 715 GiB / 715 GiB avail; 767 B/s wr, 1 op/s 2021-01-28T04:02:29.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:28 smithi100 bash[13549]: audit 2021-01-28T04:02:27.953223+0000 mon.a (mon.0) 1389 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"test-rados-api-smithi100-32195-1","var":"pgp_num","val":"11"}]': finished 2021-01-28T04:02:29.334 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:28 smithi100 bash[13549]: audit 2021-01-28T04:02:27.953326+0000 mon.a (mon.0) 1390 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-21","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:29.334 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:28 smithi100 bash[13549]: audit 2021-01-28T04:02:27.953394+0000 mon.a (mon.0) 1391 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-35","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:29.334 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:28 smithi100 bash[13549]: cluster 2021-01-28T04:02:27.953603+0000 mon.a (mon.0) 1392 : cluster [DBG] osdmap e189: 8 total, 8 up, 8 in 2021-01-28T04:02:29.335 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:28 smithi100 bash[13549]: audit 2021-01-28T04:02:27.960061+0000 mon.b (mon.2) 197 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:29.335 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:28 smithi100 bash[13549]: audit 2021-01-28T04:02:27.975081+0000 mon.c (mon.1) 230 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-21", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:29.336 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:28 smithi100 bash[13549]: audit 2021-01-28T04:02:27.975866+0000 mon.a (mon.0) 1393 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-21", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:29.336 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:28 smithi100 bash[13549]: cluster 2021-01-28T04:02:28.550637+0000 mon.a (mon.0) 1394 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:02:30.078 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 04:02:29 smithi100 bash[10061]: debug 2021-01-28T04:02:29.816+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:02:30.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:29 smithi100 bash[9834]: audit 2021-01-28T04:02:28.961844+0000 mon.a (mon.0) 1395 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-21", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:02:30.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:29 smithi100 bash[9834]: audit 2021-01-28T04:02:28.962220+0000 mon.b (mon.2) 198 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:30.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:29 smithi100 bash[9834]: cluster 2021-01-28T04:02:28.962367+0000 mon.a (mon.0) 1396 : cluster [DBG] osdmap e190: 8 total, 8 up, 8 in 2021-01-28T04:02:30.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:29 smithi100 bash[9834]: audit 2021-01-28T04:02:28.964240+0000 mon.c (mon.1) 231 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-21"}]: dispatch 2021-01-28T04:02:30.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:29 smithi100 bash[9834]: audit 2021-01-28T04:02:28.969621+0000 mon.a (mon.0) 1397 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-21"}]: dispatch 2021-01-28T04:02:30.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:29 smithi100 bash[9834]: audit 2021-01-28T04:02:28.975142+0000 mon.a (mon.0) 1398 : audit [INF] from='client.? 172.21.15.100:0/2746131882' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-31"}]: dispatch 2021-01-28T04:02:30.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:29 smithi100 bash[9834]: audit 2021-01-28T04:02:28.975523+0000 mon.a (mon.0) 1399 : audit [INF] from='client.? 172.21.15.100:0/3356948815' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:30.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:29 smithi100 bash[9834]: audit 2021-01-28T04:02:29.964008+0000 mon.a (mon.0) 1400 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-21"}]': finished 2021-01-28T04:02:30.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:29 smithi100 bash[9834]: audit 2021-01-28T04:02:29.964309+0000 mon.a (mon.0) 1401 : audit [INF] from='client.? 172.21.15.100:0/2746131882' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-31"}]': finished 2021-01-28T04:02:30.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:29 smithi100 bash[9834]: audit 2021-01-28T04:02:29.964446+0000 mon.a (mon.0) 1402 : audit [INF] from='client.? 172.21.15.100:0/3356948815' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-36","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:30.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:29 smithi100 bash[9834]: cluster 2021-01-28T04:02:29.964713+0000 mon.a (mon.0) 1403 : cluster [DBG] osdmap e191: 8 total, 8 up, 8 in 2021-01-28T04:02:30.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:29 smithi100 bash[9834]: audit 2021-01-28T04:02:29.965066+0000 mon.b (mon.2) 199 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:30.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:29 smithi100 bash[9834]: audit 2021-01-28T04:02:29.967278+0000 mon.c (mon.1) 232 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-21", "mode": "writeback"}]: dispatch 2021-01-28T04:02:30.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:29 smithi100 bash[9834]: audit 2021-01-28T04:02:29.968411+0000 mon.a (mon.0) 1404 : audit [INF] from='client.? 172.21.15.100:0/2746131882' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-31"}]: dispatch 2021-01-28T04:02:30.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:29 smithi100 bash[9834]: audit 2021-01-28T04:02:29.968770+0000 mon.a (mon.0) 1405 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-21", "mode": "writeback"}]: dispatch 2021-01-28T04:02:30.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:29 smithi100 bash[13549]: audit 2021-01-28T04:02:28.961844+0000 mon.a (mon.0) 1395 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-21", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:02:30.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:29 smithi100 bash[13549]: audit 2021-01-28T04:02:28.962220+0000 mon.b (mon.2) 198 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:30.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:29 smithi100 bash[13549]: cluster 2021-01-28T04:02:28.962367+0000 mon.a (mon.0) 1396 : cluster [DBG] osdmap e190: 8 total, 8 up, 8 in 2021-01-28T04:02:30.087 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:29 smithi100 bash[13549]: audit 2021-01-28T04:02:28.964240+0000 mon.c (mon.1) 231 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-21"}]: dispatch 2021-01-28T04:02:30.087 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:29 smithi100 bash[13549]: audit 2021-01-28T04:02:28.969621+0000 mon.a (mon.0) 1397 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-21"}]: dispatch 2021-01-28T04:02:30.088 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:29 smithi100 bash[13549]: audit 2021-01-28T04:02:28.975142+0000 mon.a (mon.0) 1398 : audit [INF] from='client.? 172.21.15.100:0/2746131882' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-31"}]: dispatch 2021-01-28T04:02:30.088 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:29 smithi100 bash[13549]: audit 2021-01-28T04:02:28.975523+0000 mon.a (mon.0) 1399 : audit [INF] from='client.? 172.21.15.100:0/3356948815' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:30.089 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:29 smithi100 bash[13549]: audit 2021-01-28T04:02:29.964008+0000 mon.a (mon.0) 1400 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-21"}]': finished 2021-01-28T04:02:30.089 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:29 smithi100 bash[13549]: audit 2021-01-28T04:02:29.964309+0000 mon.a (mon.0) 1401 : audit [INF] from='client.? 172.21.15.100:0/2746131882' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-31"}]': finished 2021-01-28T04:02:30.090 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:29 smithi100 bash[13549]: audit 2021-01-28T04:02:29.964446+0000 mon.a (mon.0) 1402 : audit [INF] from='client.? 172.21.15.100:0/3356948815' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-36","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:30.090 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:29 smithi100 bash[13549]: cluster 2021-01-28T04:02:29.964713+0000 mon.a (mon.0) 1403 : cluster [DBG] osdmap e191: 8 total, 8 up, 8 in 2021-01-28T04:02:30.090 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:29 smithi100 bash[13549]: audit 2021-01-28T04:02:29.965066+0000 mon.b (mon.2) 199 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:30.091 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:29 smithi100 bash[13549]: audit 2021-01-28T04:02:29.967278+0000 mon.c (mon.1) 232 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-21", "mode": "writeback"}]: dispatch 2021-01-28T04:02:30.091 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:29 smithi100 bash[13549]: audit 2021-01-28T04:02:29.968411+0000 mon.a (mon.0) 1404 : audit [INF] from='client.? 172.21.15.100:0/2746131882' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-31"}]: dispatch 2021-01-28T04:02:30.091 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:29 smithi100 bash[13549]: audit 2021-01-28T04:02:29.968770+0000 mon.a (mon.0) 1405 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-21", "mode": "writeback"}]: dispatch 2021-01-28T04:02:30.263 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 04:02:29 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T04:02:30.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:29 smithi162 bash[9856]: audit 2021-01-28T04:02:28.961844+0000 mon.a (mon.0) 1395 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-21", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:02:30.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:29 smithi162 bash[9856]: audit 2021-01-28T04:02:28.962220+0000 mon.b (mon.2) 198 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:30.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:29 smithi162 bash[9856]: cluster 2021-01-28T04:02:28.962367+0000 mon.a (mon.0) 1396 : cluster [DBG] osdmap e190: 8 total, 8 up, 8 in 2021-01-28T04:02:30.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:29 smithi162 bash[9856]: audit 2021-01-28T04:02:28.964240+0000 mon.c (mon.1) 231 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-21"}]: dispatch 2021-01-28T04:02:30.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:29 smithi162 bash[9856]: audit 2021-01-28T04:02:28.969621+0000 mon.a (mon.0) 1397 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-21"}]: dispatch 2021-01-28T04:02:30.266 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:29 smithi162 bash[9856]: audit 2021-01-28T04:02:28.975142+0000 mon.a (mon.0) 1398 : audit [INF] from='client.? 172.21.15.100:0/2746131882' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-31"}]: dispatch 2021-01-28T04:02:30.266 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:29 smithi162 bash[9856]: audit 2021-01-28T04:02:28.975523+0000 mon.a (mon.0) 1399 : audit [INF] from='client.? 172.21.15.100:0/3356948815' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:30.267 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:29 smithi162 bash[9856]: audit 2021-01-28T04:02:29.964008+0000 mon.a (mon.0) 1400 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-21"}]': finished 2021-01-28T04:02:30.267 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:29 smithi162 bash[9856]: audit 2021-01-28T04:02:29.964309+0000 mon.a (mon.0) 1401 : audit [INF] from='client.? 172.21.15.100:0/2746131882' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-31"}]': finished 2021-01-28T04:02:30.268 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:29 smithi162 bash[9856]: audit 2021-01-28T04:02:29.964446+0000 mon.a (mon.0) 1402 : audit [INF] from='client.? 172.21.15.100:0/3356948815' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-36","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:30.268 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:29 smithi162 bash[9856]: cluster 2021-01-28T04:02:29.964713+0000 mon.a (mon.0) 1403 : cluster [DBG] osdmap e191: 8 total, 8 up, 8 in 2021-01-28T04:02:30.269 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:29 smithi162 bash[9856]: audit 2021-01-28T04:02:29.965066+0000 mon.b (mon.2) 199 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:30.269 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:29 smithi162 bash[9856]: audit 2021-01-28T04:02:29.967278+0000 mon.c (mon.1) 232 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-21", "mode": "writeback"}]: dispatch 2021-01-28T04:02:30.270 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:29 smithi162 bash[9856]: audit 2021-01-28T04:02:29.968411+0000 mon.a (mon.0) 1404 : audit [INF] from='client.? 172.21.15.100:0/2746131882' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-31"}]: dispatch 2021-01-28T04:02:30.270 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:29 smithi162 bash[9856]: audit 2021-01-28T04:02:29.968770+0000 mon.a (mon.0) 1405 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-21", "mode": "writeback"}]: dispatch 2021-01-28T04:02:31.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:30 smithi162 bash[9856]: cluster 2021-01-28T04:02:29.587577+0000 mgr.y (mgr.14138) 590 : cluster [DBG] pgmap v536: 324 pgs: 35 creating+peering, 42 unknown, 1 peering, 246 active+clean; 28 KiB data, 319 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-28T04:02:31.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:30 smithi162 bash[9856]: audit 2021-01-28T04:02:29.818114+0000 mgr.y (mgr.14138) 591 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:02:31.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:30 smithi162 bash[9856]: cluster 2021-01-28T04:02:30.959274+0000 mon.a (mon.0) 1406 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:02:31.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:30 smithi162 bash[9856]: audit 2021-01-28T04:02:30.972138+0000 mon.a (mon.0) 1407 : audit [INF] from='client.? 172.21.15.100:0/2746131882' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-31"}]': finished 2021-01-28T04:02:31.266 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:30 smithi162 bash[9856]: audit 2021-01-28T04:02:30.972370+0000 mon.a (mon.0) 1408 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-21", "mode": "writeback"}]': finished 2021-01-28T04:02:31.266 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:30 smithi162 bash[9856]: cluster 2021-01-28T04:02:30.972549+0000 mon.a (mon.0) 1409 : cluster [DBG] osdmap e192: 8 total, 8 up, 8 in 2021-01-28T04:02:31.266 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:30 smithi162 bash[9856]: audit 2021-01-28T04:02:30.981932+0000 mon.c (mon.1) 233 : audit [INF] from='client.? 172.21.15.100:0/3050649858' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:31.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:30 smithi100 bash[9834]: cluster 2021-01-28T04:02:29.587577+0000 mgr.y (mgr.14138) 590 : cluster [DBG] pgmap v536: 324 pgs: 35 creating+peering, 42 unknown, 1 peering, 246 active+clean; 28 KiB data, 319 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-28T04:02:31.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:30 smithi100 bash[9834]: audit 2021-01-28T04:02:29.818114+0000 mgr.y (mgr.14138) 591 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:02:31.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:30 smithi100 bash[9834]: cluster 2021-01-28T04:02:30.959274+0000 mon.a (mon.0) 1406 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:02:31.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:30 smithi100 bash[9834]: audit 2021-01-28T04:02:30.972138+0000 mon.a (mon.0) 1407 : audit [INF] from='client.? 172.21.15.100:0/2746131882' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-31"}]': finished 2021-01-28T04:02:31.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:30 smithi100 bash[9834]: audit 2021-01-28T04:02:30.972370+0000 mon.a (mon.0) 1408 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-21", "mode": "writeback"}]': finished 2021-01-28T04:02:31.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:30 smithi100 bash[9834]: cluster 2021-01-28T04:02:30.972549+0000 mon.a (mon.0) 1409 : cluster [DBG] osdmap e192: 8 total, 8 up, 8 in 2021-01-28T04:02:31.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:30 smithi100 bash[9834]: audit 2021-01-28T04:02:30.981932+0000 mon.c (mon.1) 233 : audit [INF] from='client.? 172.21.15.100:0/3050649858' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:31.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:30 smithi100 bash[13549]: cluster 2021-01-28T04:02:29.587577+0000 mgr.y (mgr.14138) 590 : cluster [DBG] pgmap v536: 324 pgs: 35 creating+peering, 42 unknown, 1 peering, 246 active+clean; 28 KiB data, 319 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-28T04:02:31.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:30 smithi100 bash[13549]: audit 2021-01-28T04:02:29.818114+0000 mgr.y (mgr.14138) 591 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:02:31.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:30 smithi100 bash[13549]: cluster 2021-01-28T04:02:30.959274+0000 mon.a (mon.0) 1406 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:02:31.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:30 smithi100 bash[13549]: audit 2021-01-28T04:02:30.972138+0000 mon.a (mon.0) 1407 : audit [INF] from='client.? 172.21.15.100:0/2746131882' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-31"}]': finished 2021-01-28T04:02:31.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:30 smithi100 bash[13549]: audit 2021-01-28T04:02:30.972370+0000 mon.a (mon.0) 1408 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-21", "mode": "writeback"}]': finished 2021-01-28T04:02:31.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:30 smithi100 bash[13549]: cluster 2021-01-28T04:02:30.972549+0000 mon.a (mon.0) 1409 : cluster [DBG] osdmap e192: 8 total, 8 up, 8 in 2021-01-28T04:02:31.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:30 smithi100 bash[13549]: audit 2021-01-28T04:02:30.981932+0000 mon.c (mon.1) 233 : audit [INF] from='client.? 172.21.15.100:0/3050649858' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:32.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:32 smithi162 bash[9856]: audit 2021-01-28T04:02:30.971412+0000 mon.b (mon.2) 200 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:32.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:32 smithi162 bash[9856]: audit 2021-01-28T04:02:30.982704+0000 mon.a (mon.0) 1410 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:32.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:32 smithi162 bash[9856]: audit 2021-01-28T04:02:31.003585+0000 mon.a (mon.0) 1411 : audit [INF] from='client.? 172.21.15.100:0/2465224533' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-32"}]: dispatch 2021-01-28T04:02:32.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:32 smithi162 bash[9856]: audit 2021-01-28T04:02:31.004598+0000 mon.a (mon.0) 1412 : audit [INF] from='client.? 172.21.15.100:0/2465224533' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-32"}]: dispatch 2021-01-28T04:02:32.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:32 smithi162 bash[9856]: audit 2021-01-28T04:02:31.005123+0000 mon.a (mon.0) 1413 : audit [INF] from='client.? 172.21.15.100:0/2465224533' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:32.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:32 smithi162 bash[9856]: audit 2021-01-28T04:02:31.084752+0000 mon.c (mon.1) 234 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:02:32.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:32 smithi162 bash[9856]: audit 2021-01-28T04:02:31.085350+0000 mon.a (mon.0) 1414 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:02:32.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:32 smithi162 bash[9856]: audit 2021-01-28T04:02:31.591401+0000 mon.a (mon.0) 1415 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi100-32195-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2021-01-28T04:02:32.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:32 smithi162 bash[9856]: audit 2021-01-28T04:02:31.972436+0000 mon.a (mon.0) 1416 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-37","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:32.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:32 smithi162 bash[9856]: audit 2021-01-28T04:02:31.973535+0000 mon.b (mon.2) 201 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:32.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:32 smithi162 bash[9856]: audit 2021-01-28T04:02:31.973849+0000 mon.a (mon.0) 1417 : audit [INF] from='client.? 172.21.15.100:0/2465224533' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:02:32.266 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:32 smithi162 bash[9856]: audit 2021-01-28T04:02:31.974585+0000 mon.a (mon.0) 1418 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:02:32.266 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:32 smithi162 bash[9856]: audit 2021-01-28T04:02:31.974975+0000 mon.a (mon.0) 1419 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "test-rados-api-smithi100-32195-1", "var": "pg_num_actual", "val": "31"}]': finished 2021-01-28T04:02:32.266 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:32 smithi162 bash[9856]: cluster 2021-01-28T04:02:31.975139+0000 mon.a (mon.0) 1420 : cluster [DBG] osdmap e193: 8 total, 8 up, 8 in 2021-01-28T04:02:32.266 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:32 smithi162 bash[9856]: audit 2021-01-28T04:02:31.978856+0000 mon.c (mon.1) 235 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-21"}]: dispatch 2021-01-28T04:02:32.267 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:32 smithi162 bash[9856]: audit 2021-01-28T04:02:31.979623+0000 mon.a (mon.0) 1421 : audit [INF] from='client.? 172.21.15.100:0/2465224533' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-32"}]: dispatch 2021-01-28T04:02:32.267 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:32 smithi162 bash[9856]: audit 2021-01-28T04:02:31.980333+0000 mon.a (mon.0) 1422 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-21"}]: dispatch 2021-01-28T04:02:32.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:31 smithi100 bash[9834]: audit 2021-01-28T04:02:30.971412+0000 mon.b (mon.2) 200 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:32.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:31 smithi100 bash[9834]: audit 2021-01-28T04:02:30.982704+0000 mon.a (mon.0) 1410 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:32.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:31 smithi100 bash[9834]: audit 2021-01-28T04:02:31.003585+0000 mon.a (mon.0) 1411 : audit [INF] from='client.? 172.21.15.100:0/2465224533' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-32"}]: dispatch 2021-01-28T04:02:32.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:31 smithi100 bash[9834]: audit 2021-01-28T04:02:31.004598+0000 mon.a (mon.0) 1412 : audit [INF] from='client.? 172.21.15.100:0/2465224533' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-32"}]: dispatch 2021-01-28T04:02:32.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:31 smithi100 bash[9834]: audit 2021-01-28T04:02:31.005123+0000 mon.a (mon.0) 1413 : audit [INF] from='client.? 172.21.15.100:0/2465224533' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:32.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:31 smithi100 bash[9834]: audit 2021-01-28T04:02:31.084752+0000 mon.c (mon.1) 234 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:02:32.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:31 smithi100 bash[9834]: audit 2021-01-28T04:02:31.085350+0000 mon.a (mon.0) 1414 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:02:32.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:31 smithi100 bash[9834]: audit 2021-01-28T04:02:31.591401+0000 mon.a (mon.0) 1415 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi100-32195-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2021-01-28T04:02:32.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:31 smithi100 bash[9834]: audit 2021-01-28T04:02:31.972436+0000 mon.a (mon.0) 1416 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-37","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:32.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:31 smithi100 bash[9834]: audit 2021-01-28T04:02:31.973535+0000 mon.b (mon.2) 201 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:32.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:32 smithi100 bash[9834]: audit 2021-01-28T04:02:31.973849+0000 mon.a (mon.0) 1417 : audit [INF] from='client.? 172.21.15.100:0/2465224533' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:02:32.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:32 smithi100 bash[9834]: audit 2021-01-28T04:02:31.974585+0000 mon.a (mon.0) 1418 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:02:32.333 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:32 smithi100 bash[9834]: audit 2021-01-28T04:02:31.974975+0000 mon.a (mon.0) 1419 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "test-rados-api-smithi100-32195-1", "var": "pg_num_actual", "val": "31"}]': finished 2021-01-28T04:02:32.333 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:32 smithi100 bash[9834]: cluster 2021-01-28T04:02:31.975139+0000 mon.a (mon.0) 1420 : cluster [DBG] osdmap e193: 8 total, 8 up, 8 in 2021-01-28T04:02:32.333 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:32 smithi100 bash[9834]: audit 2021-01-28T04:02:31.978856+0000 mon.c (mon.1) 235 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-21"}]: dispatch 2021-01-28T04:02:32.333 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:32 smithi100 bash[9834]: audit 2021-01-28T04:02:31.979623+0000 mon.a (mon.0) 1421 : audit [INF] from='client.? 172.21.15.100:0/2465224533' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-32"}]: dispatch 2021-01-28T04:02:32.334 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:32 smithi100 bash[9834]: audit 2021-01-28T04:02:31.980333+0000 mon.a (mon.0) 1422 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-21"}]: dispatch 2021-01-28T04:02:32.334 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:31 smithi100 bash[13549]: audit 2021-01-28T04:02:30.971412+0000 mon.b (mon.2) 200 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:32.334 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:31 smithi100 bash[13549]: audit 2021-01-28T04:02:30.982704+0000 mon.a (mon.0) 1410 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:32.334 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:31 smithi100 bash[13549]: audit 2021-01-28T04:02:31.003585+0000 mon.a (mon.0) 1411 : audit [INF] from='client.? 172.21.15.100:0/2465224533' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-32"}]: dispatch 2021-01-28T04:02:32.335 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:31 smithi100 bash[13549]: audit 2021-01-28T04:02:31.004598+0000 mon.a (mon.0) 1412 : audit [INF] from='client.? 172.21.15.100:0/2465224533' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-32"}]: dispatch 2021-01-28T04:02:32.335 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:31 smithi100 bash[13549]: audit 2021-01-28T04:02:31.005123+0000 mon.a (mon.0) 1413 : audit [INF] from='client.? 172.21.15.100:0/2465224533' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:32.335 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:31 smithi100 bash[13549]: audit 2021-01-28T04:02:31.084752+0000 mon.c (mon.1) 234 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:02:32.336 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:31 smithi100 bash[13549]: audit 2021-01-28T04:02:31.085350+0000 mon.a (mon.0) 1414 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:02:32.336 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:31 smithi100 bash[13549]: audit 2021-01-28T04:02:31.591401+0000 mon.a (mon.0) 1415 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi100-32195-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2021-01-28T04:02:32.336 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:31 smithi100 bash[13549]: audit 2021-01-28T04:02:31.972436+0000 mon.a (mon.0) 1416 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-37","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:32.336 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:31 smithi100 bash[13549]: audit 2021-01-28T04:02:31.973535+0000 mon.b (mon.2) 201 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:32.337 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:31 smithi100 bash[13549]: audit 2021-01-28T04:02:31.973849+0000 mon.a (mon.0) 1417 : audit [INF] from='client.? 172.21.15.100:0/2465224533' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:02:32.337 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:31 smithi100 bash[13549]: audit 2021-01-28T04:02:31.974585+0000 mon.a (mon.0) 1418 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:02:32.337 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:31 smithi100 bash[13549]: audit 2021-01-28T04:02:31.974975+0000 mon.a (mon.0) 1419 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "test-rados-api-smithi100-32195-1", "var": "pg_num_actual", "val": "31"}]': finished 2021-01-28T04:02:32.337 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:31 smithi100 bash[13549]: cluster 2021-01-28T04:02:31.975139+0000 mon.a (mon.0) 1420 : cluster [DBG] osdmap e193: 8 total, 8 up, 8 in 2021-01-28T04:02:32.337 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:32 smithi100 bash[13549]: audit 2021-01-28T04:02:31.978856+0000 mon.c (mon.1) 235 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-21"}]: dispatch 2021-01-28T04:02:32.338 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:32 smithi100 bash[13549]: audit 2021-01-28T04:02:31.979623+0000 mon.a (mon.0) 1421 : audit [INF] from='client.? 172.21.15.100:0/2465224533' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-32"}]: dispatch 2021-01-28T04:02:32.338 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:32 smithi100 bash[13549]: audit 2021-01-28T04:02:31.980333+0000 mon.a (mon.0) 1422 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-21"}]: dispatch 2021-01-28T04:02:33.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:33 smithi162 bash[9856]: cluster 2021-01-28T04:02:31.588540+0000 mgr.y (mgr.14138) 592 : cluster [DBG] pgmap v539: 356 pgs: 35 creating+peering, 53 unknown, 268 active+clean; 28 KiB data, 319 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s; 31 B/s, 0 objects/s recovering 2021-01-28T04:02:33.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:33 smithi162 bash[9856]: cluster 2021-01-28T04:02:32.967821+0000 mon.a (mon.0) 1423 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:02:33.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:33 smithi162 bash[9856]: audit 2021-01-28T04:02:33.400950+0000 mon.a (mon.0) 1424 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-21"}]': finished 2021-01-28T04:02:33.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:33 smithi100 bash[13549]: cluster 2021-01-28T04:02:31.588540+0000 mgr.y (mgr.14138) 592 : cluster [DBG] pgmap v539: 356 pgs: 35 creating+peering, 53 unknown, 268 active+clean; 28 KiB data, 319 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s; 31 B/s, 0 objects/s recovering 2021-01-28T04:02:33.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:33 smithi100 bash[13549]: cluster 2021-01-28T04:02:32.967821+0000 mon.a (mon.0) 1423 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:02:33.829 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:33 smithi100 bash[13549]: audit 2021-01-28T04:02:33.400950+0000 mon.a (mon.0) 1424 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-21"}]': finished 2021-01-28T04:02:33.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:33 smithi100 bash[9834]: cluster 2021-01-28T04:02:31.588540+0000 mgr.y (mgr.14138) 592 : cluster [DBG] pgmap v539: 356 pgs: 35 creating+peering, 53 unknown, 268 active+clean; 28 KiB data, 319 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s; 31 B/s, 0 objects/s recovering 2021-01-28T04:02:33.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:33 smithi100 bash[9834]: cluster 2021-01-28T04:02:32.967821+0000 mon.a (mon.0) 1423 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:02:33.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:33 smithi100 bash[9834]: audit 2021-01-28T04:02:33.400950+0000 mon.a (mon.0) 1424 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-21"}]': finished 2021-01-28T04:02:34.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:34 smithi162 bash[9856]: audit 2021-01-28T04:02:32.980588+0000 mon.b (mon.2) 202 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:34.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:34 smithi162 bash[9856]: cluster 2021-01-28T04:02:33.401267+0000 mon.a (mon.0) 1425 : cluster [DBG] osdmap e194: 8 total, 8 up, 8 in 2021-01-28T04:02:34.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:34 smithi162 bash[9856]: audit 2021-01-28T04:02:33.410919+0000 mon.a (mon.0) 1426 : audit [INF] from='client.? 172.21.15.100:0/780598279' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:34.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:34 smithi162 bash[9856]: audit 2021-01-28T04:02:33.982334+0000 mon.b (mon.2) 203 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:34.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:34 smithi162 bash[9856]: audit 2021-01-28T04:02:33.983964+0000 mon.a (mon.0) 1427 : audit [INF] from='client.? 172.21.15.100:0/2465224533' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-32"}]': finished 2021-01-28T04:02:34.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:34 smithi162 bash[9856]: audit 2021-01-28T04:02:33.984494+0000 mon.a (mon.0) 1428 : audit [INF] from='client.? 172.21.15.100:0/780598279' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-38","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:34.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:34 smithi162 bash[9856]: cluster 2021-01-28T04:02:33.984904+0000 mon.a (mon.0) 1429 : cluster [DBG] osdmap e195: 8 total, 8 up, 8 in 2021-01-28T04:02:34.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:34 smithi100 bash[9834]: audit 2021-01-28T04:02:32.980588+0000 mon.b (mon.2) 202 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:34.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:34 smithi100 bash[9834]: cluster 2021-01-28T04:02:33.401267+0000 mon.a (mon.0) 1425 : cluster [DBG] osdmap e194: 8 total, 8 up, 8 in 2021-01-28T04:02:34.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:34 smithi100 bash[9834]: audit 2021-01-28T04:02:33.410919+0000 mon.a (mon.0) 1426 : audit [INF] from='client.? 172.21.15.100:0/780598279' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:34.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:34 smithi100 bash[9834]: audit 2021-01-28T04:02:33.982334+0000 mon.b (mon.2) 203 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:34.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:34 smithi100 bash[9834]: audit 2021-01-28T04:02:33.983964+0000 mon.a (mon.0) 1427 : audit [INF] from='client.? 172.21.15.100:0/2465224533' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-32"}]': finished 2021-01-28T04:02:34.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:34 smithi100 bash[9834]: audit 2021-01-28T04:02:33.984494+0000 mon.a (mon.0) 1428 : audit [INF] from='client.? 172.21.15.100:0/780598279' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-38","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:34.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:34 smithi100 bash[9834]: cluster 2021-01-28T04:02:33.984904+0000 mon.a (mon.0) 1429 : cluster [DBG] osdmap e195: 8 total, 8 up, 8 in 2021-01-28T04:02:34.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:34 smithi100 bash[13549]: audit 2021-01-28T04:02:32.980588+0000 mon.b (mon.2) 202 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:34.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:34 smithi100 bash[13549]: cluster 2021-01-28T04:02:33.401267+0000 mon.a (mon.0) 1425 : cluster [DBG] osdmap e194: 8 total, 8 up, 8 in 2021-01-28T04:02:34.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:34 smithi100 bash[13549]: audit 2021-01-28T04:02:33.410919+0000 mon.a (mon.0) 1426 : audit [INF] from='client.? 172.21.15.100:0/780598279' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:34.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:34 smithi100 bash[13549]: audit 2021-01-28T04:02:33.982334+0000 mon.b (mon.2) 203 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:34.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:34 smithi100 bash[13549]: audit 2021-01-28T04:02:33.983964+0000 mon.a (mon.0) 1427 : audit [INF] from='client.? 172.21.15.100:0/2465224533' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-32"}]': finished 2021-01-28T04:02:34.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:34 smithi100 bash[13549]: audit 2021-01-28T04:02:33.984494+0000 mon.a (mon.0) 1428 : audit [INF] from='client.? 172.21.15.100:0/780598279' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-38","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:34.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:34 smithi100 bash[13549]: cluster 2021-01-28T04:02:33.984904+0000 mon.a (mon.0) 1429 : cluster [DBG] osdmap e195: 8 total, 8 up, 8 in 2021-01-28T04:02:35.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:35 smithi162 bash[9856]: cluster 2021-01-28T04:02:33.589873+0000 mgr.y (mgr.14138) 593 : cluster [DBG] pgmap v542: 388 pgs: 9 creating+peering, 37 unknown, 342 active+clean; 29 KiB data, 325 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 4 op/s; 31 B/s, 0 objects/s recovering 2021-01-28T04:02:35.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:35 smithi162 bash[9856]: audit 2021-01-28T04:02:34.987601+0000 mon.b (mon.2) 204 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:35.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:35 smithi162 bash[9856]: cluster 2021-01-28T04:02:34.988132+0000 mon.a (mon.0) 1430 : cluster [DBG] osdmap e196: 8 total, 8 up, 8 in 2021-01-28T04:02:35.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:35 smithi162 bash[9856]: audit 2021-01-28T04:02:34.993196+0000 mon.c (mon.1) 236 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:35.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:35 smithi162 bash[9856]: audit 2021-01-28T04:02:34.994850+0000 mon.a (mon.0) 1431 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:35.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:35 smithi162 bash[9856]: audit 2021-01-28T04:02:35.000933+0000 mon.b (mon.2) 205 : audit [INF] from='client.? 172.21.15.100:0/3928511651' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:35.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:35 smithi162 bash[9856]: audit 2021-01-28T04:02:35.001986+0000 mon.a (mon.0) 1432 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:35.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:35 smithi100 bash[9834]: cluster 2021-01-28T04:02:33.589873+0000 mgr.y (mgr.14138) 593 : cluster [DBG] pgmap v542: 388 pgs: 9 creating+peering, 37 unknown, 342 active+clean; 29 KiB data, 325 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 4 op/s; 31 B/s, 0 objects/s recovering 2021-01-28T04:02:35.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:35 smithi100 bash[9834]: audit 2021-01-28T04:02:34.987601+0000 mon.b (mon.2) 204 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:35.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:35 smithi100 bash[9834]: cluster 2021-01-28T04:02:34.988132+0000 mon.a (mon.0) 1430 : cluster [DBG] osdmap e196: 8 total, 8 up, 8 in 2021-01-28T04:02:35.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:35 smithi100 bash[9834]: audit 2021-01-28T04:02:34.993196+0000 mon.c (mon.1) 236 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:35.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:35 smithi100 bash[9834]: audit 2021-01-28T04:02:34.994850+0000 mon.a (mon.0) 1431 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:35.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:35 smithi100 bash[9834]: audit 2021-01-28T04:02:35.000933+0000 mon.b (mon.2) 205 : audit [INF] from='client.? 172.21.15.100:0/3928511651' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:35.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:35 smithi100 bash[9834]: audit 2021-01-28T04:02:35.001986+0000 mon.a (mon.0) 1432 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:35.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:35 smithi100 bash[13549]: cluster 2021-01-28T04:02:33.589873+0000 mgr.y (mgr.14138) 593 : cluster [DBG] pgmap v542: 388 pgs: 9 creating+peering, 37 unknown, 342 active+clean; 29 KiB data, 325 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 4 op/s; 31 B/s, 0 objects/s recovering 2021-01-28T04:02:35.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:35 smithi100 bash[13549]: audit 2021-01-28T04:02:34.987601+0000 mon.b (mon.2) 204 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:35.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:35 smithi100 bash[13549]: cluster 2021-01-28T04:02:34.988132+0000 mon.a (mon.0) 1430 : cluster [DBG] osdmap e196: 8 total, 8 up, 8 in 2021-01-28T04:02:35.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:35 smithi100 bash[13549]: audit 2021-01-28T04:02:34.993196+0000 mon.c (mon.1) 236 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:35.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:35 smithi100 bash[13549]: audit 2021-01-28T04:02:34.994850+0000 mon.a (mon.0) 1431 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:35.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:35 smithi100 bash[13549]: audit 2021-01-28T04:02:35.000933+0000 mon.b (mon.2) 205 : audit [INF] from='client.? 172.21.15.100:0/3928511651' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:35.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:35 smithi100 bash[13549]: audit 2021-01-28T04:02:35.001986+0000 mon.a (mon.0) 1432 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:37.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:37 smithi162 bash[9856]: cluster 2021-01-28T04:02:35.591029+0000 mgr.y (mgr.14138) 594 : cluster [DBG] pgmap v545: 427 pgs: 9 creating+peering, 95 unknown, 323 active+clean; 29 KiB data, 326 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:02:37.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:37 smithi162 bash[9856]: audit 2021-01-28T04:02:35.988568+0000 mon.a (mon.0) 1433 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-23","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:37.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:37 smithi162 bash[9856]: audit 2021-01-28T04:02:35.989085+0000 mon.a (mon.0) 1434 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-39","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:37.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:37 smithi162 bash[9856]: cluster 2021-01-28T04:02:35.989347+0000 mon.a (mon.0) 1435 : cluster [DBG] osdmap e197: 8 total, 8 up, 8 in 2021-01-28T04:02:37.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:37 smithi162 bash[9856]: audit 2021-01-28T04:02:35.991180+0000 mon.b (mon.2) 206 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:37.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:37 smithi162 bash[9856]: audit 2021-01-28T04:02:35.992298+0000 mon.a (mon.0) 1436 : audit [INF] from='client.? 172.21.15.100:0/2465224533' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-32"}]: dispatch 2021-01-28T04:02:37.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:37 smithi162 bash[9856]: audit 2021-01-28T04:02:36.100424+0000 mon.a (mon.0) 1437 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:02:37.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:37 smithi162 bash[9856]: audit 2021-01-28T04:02:36.101196+0000 mon.a (mon.0) 1438 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:02:37.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:37 smithi100 bash[9834]: cluster 2021-01-28T04:02:35.591029+0000 mgr.y (mgr.14138) 594 : cluster [DBG] pgmap v545: 427 pgs: 9 creating+peering, 95 unknown, 323 active+clean; 29 KiB data, 326 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:02:37.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:37 smithi100 bash[9834]: audit 2021-01-28T04:02:35.988568+0000 mon.a (mon.0) 1433 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-23","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:37.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:37 smithi100 bash[9834]: audit 2021-01-28T04:02:35.989085+0000 mon.a (mon.0) 1434 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-39","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:37.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:37 smithi100 bash[9834]: cluster 2021-01-28T04:02:35.989347+0000 mon.a (mon.0) 1435 : cluster [DBG] osdmap e197: 8 total, 8 up, 8 in 2021-01-28T04:02:37.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:37 smithi100 bash[9834]: audit 2021-01-28T04:02:35.991180+0000 mon.b (mon.2) 206 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:37.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:37 smithi100 bash[9834]: audit 2021-01-28T04:02:35.992298+0000 mon.a (mon.0) 1436 : audit [INF] from='client.? 172.21.15.100:0/2465224533' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-32"}]: dispatch 2021-01-28T04:02:37.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:37 smithi100 bash[9834]: audit 2021-01-28T04:02:36.100424+0000 mon.a (mon.0) 1437 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:02:37.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:37 smithi100 bash[9834]: audit 2021-01-28T04:02:36.101196+0000 mon.a (mon.0) 1438 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:02:37.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:37 smithi100 bash[13549]: cluster 2021-01-28T04:02:35.591029+0000 mgr.y (mgr.14138) 594 : cluster [DBG] pgmap v545: 427 pgs: 9 creating+peering, 95 unknown, 323 active+clean; 29 KiB data, 326 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:02:37.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:37 smithi100 bash[13549]: audit 2021-01-28T04:02:35.988568+0000 mon.a (mon.0) 1433 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-23","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:37.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:37 smithi100 bash[13549]: audit 2021-01-28T04:02:35.989085+0000 mon.a (mon.0) 1434 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-39","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:37.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:37 smithi100 bash[13549]: cluster 2021-01-28T04:02:35.989347+0000 mon.a (mon.0) 1435 : cluster [DBG] osdmap e197: 8 total, 8 up, 8 in 2021-01-28T04:02:37.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:37 smithi100 bash[13549]: audit 2021-01-28T04:02:35.991180+0000 mon.b (mon.2) 206 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:37.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:37 smithi100 bash[13549]: audit 2021-01-28T04:02:35.992298+0000 mon.a (mon.0) 1436 : audit [INF] from='client.? 172.21.15.100:0/2465224533' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-32"}]: dispatch 2021-01-28T04:02:37.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:37 smithi100 bash[13549]: audit 2021-01-28T04:02:36.100424+0000 mon.a (mon.0) 1437 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:02:37.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:37 smithi100 bash[13549]: audit 2021-01-28T04:02:36.101196+0000 mon.a (mon.0) 1438 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:02:38.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:38 smithi100 bash[9834]: audit 2021-01-28T04:02:36.992056+0000 mon.a (mon.0) 1439 : audit [INF] from='client.? 172.21.15.100:0/2465224533' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-32"}]': finished 2021-01-28T04:02:38.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:38 smithi100 bash[9834]: cluster 2021-01-28T04:02:36.992312+0000 mon.a (mon.0) 1440 : cluster [DBG] osdmap e198: 8 total, 8 up, 8 in 2021-01-28T04:02:38.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:38 smithi100 bash[9834]: audit 2021-01-28T04:02:36.993079+0000 mon.b (mon.2) 207 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:38.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:38 smithi100 bash[9834]: audit 2021-01-28T04:02:36.999688+0000 mon.a (mon.0) 1441 : audit [INF] from='client.? 172.21.15.100:0/2465224533' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-32"}]: dispatch 2021-01-28T04:02:38.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:38 smithi100 bash[9834]: audit 2021-01-28T04:02:37.042006+0000 mon.c (mon.1) 237 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-23", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:38.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:38 smithi100 bash[9834]: audit 2021-01-28T04:02:37.044004+0000 mon.a (mon.0) 1442 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-23", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:38.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:38 smithi100 bash[9834]: audit 2021-01-28T04:02:37.995267+0000 mon.a (mon.0) 1443 : audit [INF] from='client.? 172.21.15.100:0/2465224533' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-32"}]': finished 2021-01-28T04:02:38.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:38 smithi100 bash[9834]: audit 2021-01-28T04:02:37.995477+0000 mon.a (mon.0) 1444 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-23", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:02:38.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:38 smithi100 bash[9834]: cluster 2021-01-28T04:02:37.995614+0000 mon.a (mon.0) 1445 : cluster [DBG] osdmap e199: 8 total, 8 up, 8 in 2021-01-28T04:02:38.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:38 smithi100 bash[9834]: audit 2021-01-28T04:02:37.997232+0000 mon.b (mon.2) 208 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:38.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:38 smithi100 bash[9834]: audit 2021-01-28T04:02:37.997568+0000 mon.c (mon.1) 238 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-23"}]: dispatch 2021-01-28T04:02:38.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:38 smithi100 bash[9834]: audit 2021-01-28T04:02:38.000118+0000 mon.a (mon.0) 1446 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-23"}]: dispatch 2021-01-28T04:02:38.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:38 smithi100 bash[13549]: audit 2021-01-28T04:02:36.992056+0000 mon.a (mon.0) 1439 : audit [INF] from='client.? 172.21.15.100:0/2465224533' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-32"}]': finished 2021-01-28T04:02:38.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:38 smithi100 bash[13549]: cluster 2021-01-28T04:02:36.992312+0000 mon.a (mon.0) 1440 : cluster [DBG] osdmap e198: 8 total, 8 up, 8 in 2021-01-28T04:02:38.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:38 smithi100 bash[13549]: audit 2021-01-28T04:02:36.993079+0000 mon.b (mon.2) 207 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:38.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:38 smithi100 bash[13549]: audit 2021-01-28T04:02:36.999688+0000 mon.a (mon.0) 1441 : audit [INF] from='client.? 172.21.15.100:0/2465224533' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-32"}]: dispatch 2021-01-28T04:02:38.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:38 smithi100 bash[13549]: audit 2021-01-28T04:02:37.042006+0000 mon.c (mon.1) 237 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-23", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:38.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:38 smithi100 bash[13549]: audit 2021-01-28T04:02:37.044004+0000 mon.a (mon.0) 1442 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-23", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:38.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:38 smithi100 bash[13549]: audit 2021-01-28T04:02:37.995267+0000 mon.a (mon.0) 1443 : audit [INF] from='client.? 172.21.15.100:0/2465224533' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-32"}]': finished 2021-01-28T04:02:38.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:38 smithi100 bash[13549]: audit 2021-01-28T04:02:37.995477+0000 mon.a (mon.0) 1444 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-23", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:02:38.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:38 smithi100 bash[13549]: cluster 2021-01-28T04:02:37.995614+0000 mon.a (mon.0) 1445 : cluster [DBG] osdmap e199: 8 total, 8 up, 8 in 2021-01-28T04:02:38.334 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:38 smithi100 bash[13549]: audit 2021-01-28T04:02:37.997232+0000 mon.b (mon.2) 208 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:38.334 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:38 smithi100 bash[13549]: audit 2021-01-28T04:02:37.997568+0000 mon.c (mon.1) 238 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-23"}]: dispatch 2021-01-28T04:02:38.334 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:38 smithi100 bash[13549]: audit 2021-01-28T04:02:38.000118+0000 mon.a (mon.0) 1446 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-23"}]: dispatch 2021-01-28T04:02:38.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:38 smithi162 bash[9856]: audit 2021-01-28T04:02:36.992056+0000 mon.a (mon.0) 1439 : audit [INF] from='client.? 172.21.15.100:0/2465224533' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-32"}]': finished 2021-01-28T04:02:38.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:38 smithi162 bash[9856]: cluster 2021-01-28T04:02:36.992312+0000 mon.a (mon.0) 1440 : cluster [DBG] osdmap e198: 8 total, 8 up, 8 in 2021-01-28T04:02:38.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:38 smithi162 bash[9856]: audit 2021-01-28T04:02:36.993079+0000 mon.b (mon.2) 207 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:38.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:38 smithi162 bash[9856]: audit 2021-01-28T04:02:36.999688+0000 mon.a (mon.0) 1441 : audit [INF] from='client.? 172.21.15.100:0/2465224533' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-32"}]: dispatch 2021-01-28T04:02:38.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:38 smithi162 bash[9856]: audit 2021-01-28T04:02:37.042006+0000 mon.c (mon.1) 237 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-23", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:38.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:38 smithi162 bash[9856]: audit 2021-01-28T04:02:37.044004+0000 mon.a (mon.0) 1442 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-23", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:38.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:38 smithi162 bash[9856]: audit 2021-01-28T04:02:37.995267+0000 mon.a (mon.0) 1443 : audit [INF] from='client.? 172.21.15.100:0/2465224533' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-32"}]': finished 2021-01-28T04:02:38.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:38 smithi162 bash[9856]: audit 2021-01-28T04:02:37.995477+0000 mon.a (mon.0) 1444 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-23", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:02:38.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:38 smithi162 bash[9856]: cluster 2021-01-28T04:02:37.995614+0000 mon.a (mon.0) 1445 : cluster [DBG] osdmap e199: 8 total, 8 up, 8 in 2021-01-28T04:02:38.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:38 smithi162 bash[9856]: audit 2021-01-28T04:02:37.997232+0000 mon.b (mon.2) 208 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:38.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:38 smithi162 bash[9856]: audit 2021-01-28T04:02:37.997568+0000 mon.c (mon.1) 238 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-23"}]: dispatch 2021-01-28T04:02:38.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:38 smithi162 bash[9856]: audit 2021-01-28T04:02:38.000118+0000 mon.a (mon.0) 1446 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-23"}]: dispatch 2021-01-28T04:02:39.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:39 smithi100 bash[9834]: cluster 2021-01-28T04:02:37.592942+0000 mgr.y (mgr.14138) 595 : cluster [DBG] pgmap v548: 387 pgs: 14 creating+peering, 17 unknown, 356 active+clean; 29 KiB data, 327 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:02:39.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:39 smithi100 bash[9834]: audit 2021-01-28T04:02:38.022944+0000 mon.a (mon.0) 1447 : audit [INF] from='client.? 172.21.15.100:0/3387309113' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-33"}]: dispatch 2021-01-28T04:02:39.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:39 smithi100 bash[9834]: audit 2021-01-28T04:02:38.023820+0000 mon.a (mon.0) 1448 : audit [INF] from='client.? 172.21.15.100:0/3387309113' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-33"}]: dispatch 2021-01-28T04:02:39.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:39 smithi100 bash[9834]: audit 2021-01-28T04:02:38.024320+0000 mon.a (mon.0) 1449 : audit [INF] from='client.? 172.21.15.100:0/3387309113' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:39.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:39 smithi100 bash[9834]: audit 2021-01-28T04:02:38.999439+0000 mon.a (mon.0) 1450 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-23"}]': finished 2021-01-28T04:02:39.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:39 smithi100 bash[9834]: audit 2021-01-28T04:02:38.999588+0000 mon.a (mon.0) 1451 : audit [INF] from='client.? 172.21.15.100:0/3387309113' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:02:39.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:39 smithi100 bash[9834]: cluster 2021-01-28T04:02:38.999674+0000 mon.a (mon.0) 1452 : cluster [DBG] osdmap e200: 8 total, 8 up, 8 in 2021-01-28T04:02:39.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:39 smithi100 bash[9834]: audit 2021-01-28T04:02:39.001096+0000 mon.b (mon.2) 209 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:39.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:39 smithi100 bash[9834]: audit 2021-01-28T04:02:39.002170+0000 mon.c (mon.1) 239 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-23", "mode": "writeback"}]: dispatch 2021-01-28T04:02:39.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:39 smithi100 bash[9834]: audit 2021-01-28T04:02:39.002255+0000 mon.a (mon.0) 1453 : audit [INF] from='client.? 172.21.15.100:0/3387309113' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-33"}]: dispatch 2021-01-28T04:02:39.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:39 smithi100 bash[9834]: audit 2021-01-28T04:02:39.003338+0000 mon.a (mon.0) 1454 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-23", "mode": "writeback"}]: dispatch 2021-01-28T04:02:39.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:39 smithi100 bash[13549]: cluster 2021-01-28T04:02:37.592942+0000 mgr.y (mgr.14138) 595 : cluster [DBG] pgmap v548: 387 pgs: 14 creating+peering, 17 unknown, 356 active+clean; 29 KiB data, 327 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:02:39.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:39 smithi100 bash[13549]: audit 2021-01-28T04:02:38.022944+0000 mon.a (mon.0) 1447 : audit [INF] from='client.? 172.21.15.100:0/3387309113' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-33"}]: dispatch 2021-01-28T04:02:39.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:39 smithi100 bash[13549]: audit 2021-01-28T04:02:38.023820+0000 mon.a (mon.0) 1448 : audit [INF] from='client.? 172.21.15.100:0/3387309113' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-33"}]: dispatch 2021-01-28T04:02:39.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:39 smithi100 bash[13549]: audit 2021-01-28T04:02:38.024320+0000 mon.a (mon.0) 1449 : audit [INF] from='client.? 172.21.15.100:0/3387309113' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:39.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:39 smithi100 bash[13549]: audit 2021-01-28T04:02:38.999439+0000 mon.a (mon.0) 1450 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-23"}]': finished 2021-01-28T04:02:39.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:39 smithi100 bash[13549]: audit 2021-01-28T04:02:38.999588+0000 mon.a (mon.0) 1451 : audit [INF] from='client.? 172.21.15.100:0/3387309113' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:02:39.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:39 smithi100 bash[13549]: cluster 2021-01-28T04:02:38.999674+0000 mon.a (mon.0) 1452 : cluster [DBG] osdmap e200: 8 total, 8 up, 8 in 2021-01-28T04:02:39.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:39 smithi100 bash[13549]: audit 2021-01-28T04:02:39.001096+0000 mon.b (mon.2) 209 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:39.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:39 smithi100 bash[13549]: audit 2021-01-28T04:02:39.002170+0000 mon.c (mon.1) 239 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-23", "mode": "writeback"}]: dispatch 2021-01-28T04:02:39.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:39 smithi100 bash[13549]: audit 2021-01-28T04:02:39.002255+0000 mon.a (mon.0) 1453 : audit [INF] from='client.? 172.21.15.100:0/3387309113' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-33"}]: dispatch 2021-01-28T04:02:39.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:39 smithi100 bash[13549]: audit 2021-01-28T04:02:39.003338+0000 mon.a (mon.0) 1454 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-23", "mode": "writeback"}]: dispatch 2021-01-28T04:02:39.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:39 smithi162 bash[9856]: cluster 2021-01-28T04:02:37.592942+0000 mgr.y (mgr.14138) 595 : cluster [DBG] pgmap v548: 387 pgs: 14 creating+peering, 17 unknown, 356 active+clean; 29 KiB data, 327 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:02:39.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:39 smithi162 bash[9856]: audit 2021-01-28T04:02:38.022944+0000 mon.a (mon.0) 1447 : audit [INF] from='client.? 172.21.15.100:0/3387309113' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-33"}]: dispatch 2021-01-28T04:02:39.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:39 smithi162 bash[9856]: audit 2021-01-28T04:02:38.023820+0000 mon.a (mon.0) 1448 : audit [INF] from='client.? 172.21.15.100:0/3387309113' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-33"}]: dispatch 2021-01-28T04:02:39.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:39 smithi162 bash[9856]: audit 2021-01-28T04:02:38.024320+0000 mon.a (mon.0) 1449 : audit [INF] from='client.? 172.21.15.100:0/3387309113' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:39.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:39 smithi162 bash[9856]: audit 2021-01-28T04:02:38.999439+0000 mon.a (mon.0) 1450 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-23"}]': finished 2021-01-28T04:02:39.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:39 smithi162 bash[9856]: audit 2021-01-28T04:02:38.999588+0000 mon.a (mon.0) 1451 : audit [INF] from='client.? 172.21.15.100:0/3387309113' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:02:39.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:39 smithi162 bash[9856]: cluster 2021-01-28T04:02:38.999674+0000 mon.a (mon.0) 1452 : cluster [DBG] osdmap e200: 8 total, 8 up, 8 in 2021-01-28T04:02:39.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:39 smithi162 bash[9856]: audit 2021-01-28T04:02:39.001096+0000 mon.b (mon.2) 209 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:39.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:39 smithi162 bash[9856]: audit 2021-01-28T04:02:39.002170+0000 mon.c (mon.1) 239 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-23", "mode": "writeback"}]: dispatch 2021-01-28T04:02:39.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:39 smithi162 bash[9856]: audit 2021-01-28T04:02:39.002255+0000 mon.a (mon.0) 1453 : audit [INF] from='client.? 172.21.15.100:0/3387309113' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-33"}]: dispatch 2021-01-28T04:02:39.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:39 smithi162 bash[9856]: audit 2021-01-28T04:02:39.003338+0000 mon.a (mon.0) 1454 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-23", "mode": "writeback"}]: dispatch 2021-01-28T04:02:40.263 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 04:02:39 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T04:02:40.328 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 04:02:39 smithi100 bash[10061]: debug 2021-01-28T04:02:39.824+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:02:40.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:40 smithi162 bash[9856]: cluster 2021-01-28T04:02:39.994652+0000 mon.a (mon.0) 1455 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:02:40.827 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:40 smithi100 bash[9834]: cluster 2021-01-28T04:02:39.994652+0000 mon.a (mon.0) 1455 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:02:40.828 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:40 smithi100 bash[13549]: cluster 2021-01-28T04:02:39.994652+0000 mon.a (mon.0) 1455 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:02:41.328 INFO:journalctl@ceph.osd.0.smithi100.stdout:Jan 28 04:02:41 smithi100 bash[16657]: debug 2021-01-28T04:02:41.020+0000 7f5fbdd39700 -1 osd.0 pg_epoch: 202 pg[65.17( v 198'72 (0'0,198'72] local-lis/les=87/88 n=7 ec=87/87 lis/c=87/87 les/c/f=88/88/0 sis=87) [0,5,4] r=0 lpr=87 crt=198'72 lcod 197'70 mlcod 197'70 active+clean+snaptrim trimq=[e~1]] removing snap head 2021-01-28T04:02:41.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:41 smithi162 bash[9856]: cluster 2021-01-28T04:02:39.594285+0000 mgr.y (mgr.14138) 596 : cluster [DBG] pgmap v551: 323 pgs: 7 creating+peering, 316 active+clean; 29 KiB data, 329 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 4 op/s; 31 B/s, 0 objects/s recovering 2021-01-28T04:02:41.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:41 smithi162 bash[9856]: audit 2021-01-28T04:02:39.829566+0000 mgr.y (mgr.14138) 597 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:02:41.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:41 smithi162 bash[9856]: audit 2021-01-28T04:02:40.006297+0000 mon.b (mon.2) 210 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:41.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:41 smithi162 bash[9856]: audit 2021-01-28T04:02:40.425914+0000 mon.a (mon.0) 1456 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-23", "mode": "writeback"}]': finished 2021-01-28T04:02:41.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:41 smithi162 bash[9856]: cluster 2021-01-28T04:02:40.426263+0000 mon.a (mon.0) 1457 : cluster [DBG] osdmap e201: 8 total, 8 up, 8 in 2021-01-28T04:02:41.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:41 smithi162 bash[9856]: audit 2021-01-28T04:02:41.004516+0000 mon.a (mon.0) 1458 : audit [INF] from='client.? 172.21.15.100:0/3387309113' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-33"}]': finished 2021-01-28T04:02:41.766 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:41 smithi162 bash[9856]: cluster 2021-01-28T04:02:41.004764+0000 mon.a (mon.0) 1459 : cluster [DBG] osdmap e202: 8 total, 8 up, 8 in 2021-01-28T04:02:41.766 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:41 smithi162 bash[9856]: audit 2021-01-28T04:02:41.011029+0000 mon.b (mon.2) 211 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:41.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:41 smithi100 bash[9834]: cluster 2021-01-28T04:02:39.594285+0000 mgr.y (mgr.14138) 596 : cluster [DBG] pgmap v551: 323 pgs: 7 creating+peering, 316 active+clean; 29 KiB data, 329 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 4 op/s; 31 B/s, 0 objects/s recovering 2021-01-28T04:02:41.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:41 smithi100 bash[9834]: audit 2021-01-28T04:02:39.829566+0000 mgr.y (mgr.14138) 597 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:02:41.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:41 smithi100 bash[9834]: audit 2021-01-28T04:02:40.006297+0000 mon.b (mon.2) 210 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:41.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:41 smithi100 bash[9834]: audit 2021-01-28T04:02:40.425914+0000 mon.a (mon.0) 1456 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-23", "mode": "writeback"}]': finished 2021-01-28T04:02:41.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:41 smithi100 bash[9834]: cluster 2021-01-28T04:02:40.426263+0000 mon.a (mon.0) 1457 : cluster [DBG] osdmap e201: 8 total, 8 up, 8 in 2021-01-28T04:02:41.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:41 smithi100 bash[9834]: audit 2021-01-28T04:02:41.004516+0000 mon.a (mon.0) 1458 : audit [INF] from='client.? 172.21.15.100:0/3387309113' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-33"}]': finished 2021-01-28T04:02:41.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:41 smithi100 bash[9834]: cluster 2021-01-28T04:02:41.004764+0000 mon.a (mon.0) 1459 : cluster [DBG] osdmap e202: 8 total, 8 up, 8 in 2021-01-28T04:02:41.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:41 smithi100 bash[9834]: audit 2021-01-28T04:02:41.011029+0000 mon.b (mon.2) 211 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:41.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:41 smithi100 bash[13549]: cluster 2021-01-28T04:02:39.594285+0000 mgr.y (mgr.14138) 596 : cluster [DBG] pgmap v551: 323 pgs: 7 creating+peering, 316 active+clean; 29 KiB data, 329 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.2 KiB/s wr, 4 op/s; 31 B/s, 0 objects/s recovering 2021-01-28T04:02:41.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:41 smithi100 bash[13549]: audit 2021-01-28T04:02:39.829566+0000 mgr.y (mgr.14138) 597 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:02:41.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:41 smithi100 bash[13549]: audit 2021-01-28T04:02:40.006297+0000 mon.b (mon.2) 210 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:41.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:41 smithi100 bash[13549]: audit 2021-01-28T04:02:40.425914+0000 mon.a (mon.0) 1456 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-23", "mode": "writeback"}]': finished 2021-01-28T04:02:41.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:41 smithi100 bash[13549]: cluster 2021-01-28T04:02:40.426263+0000 mon.a (mon.0) 1457 : cluster [DBG] osdmap e201: 8 total, 8 up, 8 in 2021-01-28T04:02:41.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:41 smithi100 bash[13549]: audit 2021-01-28T04:02:41.004516+0000 mon.a (mon.0) 1458 : audit [INF] from='client.? 172.21.15.100:0/3387309113' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-33"}]': finished 2021-01-28T04:02:41.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:41 smithi100 bash[13549]: cluster 2021-01-28T04:02:41.004764+0000 mon.a (mon.0) 1459 : cluster [DBG] osdmap e202: 8 total, 8 up, 8 in 2021-01-28T04:02:41.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:41 smithi100 bash[13549]: audit 2021-01-28T04:02:41.011029+0000 mon.b (mon.2) 211 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:42.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:42 smithi162 bash[9856]: audit 2021-01-28T04:02:41.061424+0000 mon.c (mon.1) 240 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:02:42.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:42 smithi162 bash[9856]: audit 2021-01-28T04:02:41.455633+0000 mon.a (mon.0) 1460 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:02:42.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:42 smithi162 bash[9856]: audit 2021-01-28T04:02:42.013216+0000 mon.a (mon.0) 1461 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:02:42.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:42 smithi162 bash[9856]: cluster 2021-01-28T04:02:42.013507+0000 mon.a (mon.0) 1462 : cluster [DBG] osdmap e203: 8 total, 8 up, 8 in 2021-01-28T04:02:42.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:42 smithi162 bash[9856]: audit 2021-01-28T04:02:42.014257+0000 mon.b (mon.2) 212 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:42.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:42 smithi162 bash[9856]: audit 2021-01-28T04:02:42.015954+0000 mon.c (mon.1) 241 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-23"}]: dispatch 2021-01-28T04:02:42.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:42 smithi162 bash[9856]: audit 2021-01-28T04:02:42.018837+0000 mon.a (mon.0) 1463 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-23"}]: dispatch 2021-01-28T04:02:42.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:42 smithi162 bash[9856]: audit 2021-01-28T04:02:42.019838+0000 mon.a (mon.0) 1464 : audit [INF] from='client.? 172.21.15.100:0/1989654947' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:42.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:42 smithi100 bash[9834]: audit 2021-01-28T04:02:41.061424+0000 mon.c (mon.1) 240 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:02:42.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:42 smithi100 bash[9834]: audit 2021-01-28T04:02:41.455633+0000 mon.a (mon.0) 1460 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:02:42.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:42 smithi100 bash[9834]: audit 2021-01-28T04:02:42.013216+0000 mon.a (mon.0) 1461 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:02:42.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:42 smithi100 bash[9834]: cluster 2021-01-28T04:02:42.013507+0000 mon.a (mon.0) 1462 : cluster [DBG] osdmap e203: 8 total, 8 up, 8 in 2021-01-28T04:02:42.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:42 smithi100 bash[9834]: audit 2021-01-28T04:02:42.014257+0000 mon.b (mon.2) 212 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:42.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:42 smithi100 bash[9834]: audit 2021-01-28T04:02:42.015954+0000 mon.c (mon.1) 241 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-23"}]: dispatch 2021-01-28T04:02:42.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:42 smithi100 bash[9834]: audit 2021-01-28T04:02:42.018837+0000 mon.a (mon.0) 1463 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-23"}]: dispatch 2021-01-28T04:02:42.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:42 smithi100 bash[9834]: audit 2021-01-28T04:02:42.019838+0000 mon.a (mon.0) 1464 : audit [INF] from='client.? 172.21.15.100:0/1989654947' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:42.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:42 smithi100 bash[13549]: audit 2021-01-28T04:02:41.061424+0000 mon.c (mon.1) 240 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:02:42.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:42 smithi100 bash[13549]: audit 2021-01-28T04:02:41.455633+0000 mon.a (mon.0) 1460 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:02:42.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:42 smithi100 bash[13549]: audit 2021-01-28T04:02:42.013216+0000 mon.a (mon.0) 1461 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:02:42.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:42 smithi100 bash[13549]: cluster 2021-01-28T04:02:42.013507+0000 mon.a (mon.0) 1462 : cluster [DBG] osdmap e203: 8 total, 8 up, 8 in 2021-01-28T04:02:42.834 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:42 smithi100 bash[13549]: audit 2021-01-28T04:02:42.014257+0000 mon.b (mon.2) 212 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:42.835 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:42 smithi100 bash[13549]: audit 2021-01-28T04:02:42.015954+0000 mon.c (mon.1) 241 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-23"}]: dispatch 2021-01-28T04:02:42.835 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:42 smithi100 bash[13549]: audit 2021-01-28T04:02:42.018837+0000 mon.a (mon.0) 1463 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-23"}]: dispatch 2021-01-28T04:02:42.835 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:42 smithi100 bash[13549]: audit 2021-01-28T04:02:42.019838+0000 mon.a (mon.0) 1464 : audit [INF] from='client.? 172.21.15.100:0/1989654947' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:43.771 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:43 smithi162 bash[9856]: cluster 2021-01-28T04:02:41.595198+0000 mgr.y (mgr.14138) 598 : cluster [DBG] pgmap v554: 267 pgs: 8 unknown, 259 active+clean; 28 KiB data, 329 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-01-28T04:02:43.772 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:43 smithi162 bash[9856]: cluster 2021-01-28T04:02:43.004059+0000 mon.a (mon.0) 1465 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:02:43.772 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:43 smithi162 bash[9856]: audit 2021-01-28T04:02:43.015997+0000 mon.a (mon.0) 1466 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-23"}]': finished 2021-01-28T04:02:43.773 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:43 smithi162 bash[9856]: audit 2021-01-28T04:02:43.016083+0000 mon.b (mon.2) 213 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:43.773 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:43 smithi162 bash[9856]: audit 2021-01-28T04:02:43.016207+0000 mon.a (mon.0) 1467 : audit [INF] from='client.? 172.21.15.100:0/1989654947' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-40","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:43.774 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:43 smithi162 bash[9856]: cluster 2021-01-28T04:02:43.016464+0000 mon.a (mon.0) 1468 : cluster [DBG] osdmap e204: 8 total, 8 up, 8 in 2021-01-28T04:02:43.774 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:43 smithi162 bash[9856]: audit 2021-01-28T04:02:43.030591+0000 mon.a (mon.0) 1469 : audit [INF] from='client.? 172.21.15.100:0/3387309113' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-33"}]: dispatch 2021-01-28T04:02:43.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:43 smithi100 bash[9834]: cluster 2021-01-28T04:02:41.595198+0000 mgr.y (mgr.14138) 598 : cluster [DBG] pgmap v554: 267 pgs: 8 unknown, 259 active+clean; 28 KiB data, 329 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-01-28T04:02:43.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:43 smithi100 bash[9834]: cluster 2021-01-28T04:02:43.004059+0000 mon.a (mon.0) 1465 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:02:43.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:43 smithi100 bash[9834]: audit 2021-01-28T04:02:43.015997+0000 mon.a (mon.0) 1466 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-23"}]': finished 2021-01-28T04:02:43.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:43 smithi100 bash[9834]: audit 2021-01-28T04:02:43.016083+0000 mon.b (mon.2) 213 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:43.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:43 smithi100 bash[9834]: audit 2021-01-28T04:02:43.016207+0000 mon.a (mon.0) 1467 : audit [INF] from='client.? 172.21.15.100:0/1989654947' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-40","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:43.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:43 smithi100 bash[9834]: cluster 2021-01-28T04:02:43.016464+0000 mon.a (mon.0) 1468 : cluster [DBG] osdmap e204: 8 total, 8 up, 8 in 2021-01-28T04:02:43.832 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:43 smithi100 bash[9834]: audit 2021-01-28T04:02:43.030591+0000 mon.a (mon.0) 1469 : audit [INF] from='client.? 172.21.15.100:0/3387309113' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-33"}]: dispatch 2021-01-28T04:02:43.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:43 smithi100 bash[13549]: cluster 2021-01-28T04:02:41.595198+0000 mgr.y (mgr.14138) 598 : cluster [DBG] pgmap v554: 267 pgs: 8 unknown, 259 active+clean; 28 KiB data, 329 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-01-28T04:02:43.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:43 smithi100 bash[13549]: cluster 2021-01-28T04:02:43.004059+0000 mon.a (mon.0) 1465 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:02:43.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:43 smithi100 bash[13549]: audit 2021-01-28T04:02:43.015997+0000 mon.a (mon.0) 1466 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-23"}]': finished 2021-01-28T04:02:43.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:43 smithi100 bash[13549]: audit 2021-01-28T04:02:43.016083+0000 mon.b (mon.2) 213 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:43.834 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:43 smithi100 bash[13549]: audit 2021-01-28T04:02:43.016207+0000 mon.a (mon.0) 1467 : audit [INF] from='client.? 172.21.15.100:0/1989654947' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-40","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:43.834 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:43 smithi100 bash[13549]: cluster 2021-01-28T04:02:43.016464+0000 mon.a (mon.0) 1468 : cluster [DBG] osdmap e204: 8 total, 8 up, 8 in 2021-01-28T04:02:43.835 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:43 smithi100 bash[13549]: audit 2021-01-28T04:02:43.030591+0000 mon.a (mon.0) 1469 : audit [INF] from='client.? 172.21.15.100:0/3387309113' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-33"}]: dispatch 2021-01-28T04:02:45.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:45 smithi100 bash[9834]: cluster 2021-01-28T04:02:43.596232+0000 mgr.y (mgr.14138) 599 : cluster [DBG] pgmap v557: 291 pgs: 18 creating+peering, 11 unknown, 262 active+clean; 28 KiB data, 322 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 0 B/s wr, 3 op/s 2021-01-28T04:02:45.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:45 smithi100 bash[9834]: audit 2021-01-28T04:02:44.017373+0000 mon.a (mon.0) 1470 : audit [INF] from='client.? 172.21.15.100:0/3387309113' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-33"}]': finished 2021-01-28T04:02:45.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:45 smithi100 bash[9834]: cluster 2021-01-28T04:02:44.017937+0000 mon.a (mon.0) 1471 : cluster [DBG] osdmap e205: 8 total, 8 up, 8 in 2021-01-28T04:02:45.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:45 smithi100 bash[9834]: audit 2021-01-28T04:02:44.020321+0000 mon.a (mon.0) 1472 : audit [INF] from='client.? 172.21.15.100:0/3387309113' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-33"}]: dispatch 2021-01-28T04:02:45.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:45 smithi100 bash[9834]: audit 2021-01-28T04:02:44.022399+0000 mon.b (mon.2) 214 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:45.329 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:45 smithi100 bash[13549]: cluster 2021-01-28T04:02:43.596232+0000 mgr.y (mgr.14138) 599 : cluster [DBG] pgmap v557: 291 pgs: 18 creating+peering, 11 unknown, 262 active+clean; 28 KiB data, 322 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 0 B/s wr, 3 op/s 2021-01-28T04:02:45.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:45 smithi100 bash[13549]: audit 2021-01-28T04:02:44.017373+0000 mon.a (mon.0) 1470 : audit [INF] from='client.? 172.21.15.100:0/3387309113' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-33"}]': finished 2021-01-28T04:02:45.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:45 smithi100 bash[13549]: cluster 2021-01-28T04:02:44.017937+0000 mon.a (mon.0) 1471 : cluster [DBG] osdmap e205: 8 total, 8 up, 8 in 2021-01-28T04:02:45.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:45 smithi100 bash[13549]: audit 2021-01-28T04:02:44.020321+0000 mon.a (mon.0) 1472 : audit [INF] from='client.? 172.21.15.100:0/3387309113' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-33"}]: dispatch 2021-01-28T04:02:45.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:45 smithi100 bash[13549]: audit 2021-01-28T04:02:44.022399+0000 mon.b (mon.2) 214 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:45.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:45 smithi162 bash[9856]: cluster 2021-01-28T04:02:43.596232+0000 mgr.y (mgr.14138) 599 : cluster [DBG] pgmap v557: 291 pgs: 18 creating+peering, 11 unknown, 262 active+clean; 28 KiB data, 322 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 0 B/s wr, 3 op/s 2021-01-28T04:02:45.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:45 smithi162 bash[9856]: audit 2021-01-28T04:02:44.017373+0000 mon.a (mon.0) 1470 : audit [INF] from='client.? 172.21.15.100:0/3387309113' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-33"}]': finished 2021-01-28T04:02:45.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:45 smithi162 bash[9856]: cluster 2021-01-28T04:02:44.017937+0000 mon.a (mon.0) 1471 : cluster [DBG] osdmap e205: 8 total, 8 up, 8 in 2021-01-28T04:02:45.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:45 smithi162 bash[9856]: audit 2021-01-28T04:02:44.020321+0000 mon.a (mon.0) 1472 : audit [INF] from='client.? 172.21.15.100:0/3387309113' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-33"}]: dispatch 2021-01-28T04:02:45.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:45 smithi162 bash[9856]: audit 2021-01-28T04:02:44.022399+0000 mon.b (mon.2) 214 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:46.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:46 smithi100 bash[9834]: audit 2021-01-28T04:02:45.023896+0000 mon.b (mon.2) 215 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:46.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:46 smithi100 bash[9834]: audit 2021-01-28T04:02:45.027551+0000 mon.a (mon.0) 1473 : audit [INF] from='client.? 172.21.15.100:0/3387309113' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-33"}]': finished 2021-01-28T04:02:46.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:46 smithi100 bash[9834]: cluster 2021-01-28T04:02:45.030374+0000 mon.a (mon.0) 1474 : cluster [DBG] osdmap e206: 8 total, 8 up, 8 in 2021-01-28T04:02:46.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:46 smithi100 bash[9834]: audit 2021-01-28T04:02:45.032522+0000 mon.c (mon.1) 242 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:46.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:46 smithi100 bash[9834]: audit 2021-01-28T04:02:45.032801+0000 mon.c (mon.1) 243 : audit [INF] from='client.? 172.21.15.100:0/3931744829' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:46.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:46 smithi100 bash[9834]: audit 2021-01-28T04:02:45.034461+0000 mon.a (mon.0) 1475 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:46.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:46 smithi100 bash[9834]: audit 2021-01-28T04:02:45.035342+0000 mon.a (mon.0) 1476 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:46.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:46 smithi100 bash[9834]: audit 2021-01-28T04:02:45.058920+0000 mon.a (mon.0) 1477 : audit [INF] from='client.? 172.21.15.100:0/3162238307' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-34"}]: dispatch 2021-01-28T04:02:46.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:46 smithi100 bash[9834]: audit 2021-01-28T04:02:45.059869+0000 mon.a (mon.0) 1478 : audit [INF] from='client.? 172.21.15.100:0/3162238307' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-34"}]: dispatch 2021-01-28T04:02:46.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:46 smithi100 bash[9834]: audit 2021-01-28T04:02:45.060236+0000 mon.a (mon.0) 1479 : audit [INF] from='client.? 172.21.15.100:0/3162238307' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:46.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:46 smithi100 bash[13549]: audit 2021-01-28T04:02:45.023896+0000 mon.b (mon.2) 215 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:46.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:46 smithi100 bash[13549]: audit 2021-01-28T04:02:45.027551+0000 mon.a (mon.0) 1473 : audit [INF] from='client.? 172.21.15.100:0/3387309113' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-33"}]': finished 2021-01-28T04:02:46.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:46 smithi100 bash[13549]: cluster 2021-01-28T04:02:45.030374+0000 mon.a (mon.0) 1474 : cluster [DBG] osdmap e206: 8 total, 8 up, 8 in 2021-01-28T04:02:46.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:46 smithi100 bash[13549]: audit 2021-01-28T04:02:45.032522+0000 mon.c (mon.1) 242 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:46.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:46 smithi100 bash[13549]: audit 2021-01-28T04:02:45.032801+0000 mon.c (mon.1) 243 : audit [INF] from='client.? 172.21.15.100:0/3931744829' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:46.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:46 smithi100 bash[13549]: audit 2021-01-28T04:02:45.034461+0000 mon.a (mon.0) 1475 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:46.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:46 smithi100 bash[13549]: audit 2021-01-28T04:02:45.035342+0000 mon.a (mon.0) 1476 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:46.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:46 smithi100 bash[13549]: audit 2021-01-28T04:02:45.058920+0000 mon.a (mon.0) 1477 : audit [INF] from='client.? 172.21.15.100:0/3162238307' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-34"}]: dispatch 2021-01-28T04:02:46.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:46 smithi100 bash[13549]: audit 2021-01-28T04:02:45.059869+0000 mon.a (mon.0) 1478 : audit [INF] from='client.? 172.21.15.100:0/3162238307' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-34"}]: dispatch 2021-01-28T04:02:46.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:46 smithi100 bash[13549]: audit 2021-01-28T04:02:45.060236+0000 mon.a (mon.0) 1479 : audit [INF] from='client.? 172.21.15.100:0/3162238307' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:46.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:46 smithi162 bash[9856]: audit 2021-01-28T04:02:45.023896+0000 mon.b (mon.2) 215 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:46.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:46 smithi162 bash[9856]: audit 2021-01-28T04:02:45.027551+0000 mon.a (mon.0) 1473 : audit [INF] from='client.? 172.21.15.100:0/3387309113' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-33"}]': finished 2021-01-28T04:02:46.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:46 smithi162 bash[9856]: cluster 2021-01-28T04:02:45.030374+0000 mon.a (mon.0) 1474 : cluster [DBG] osdmap e206: 8 total, 8 up, 8 in 2021-01-28T04:02:46.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:46 smithi162 bash[9856]: audit 2021-01-28T04:02:45.032522+0000 mon.c (mon.1) 242 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:46.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:46 smithi162 bash[9856]: audit 2021-01-28T04:02:45.032801+0000 mon.c (mon.1) 243 : audit [INF] from='client.? 172.21.15.100:0/3931744829' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:46.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:46 smithi162 bash[9856]: audit 2021-01-28T04:02:45.034461+0000 mon.a (mon.0) 1475 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:46.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:46 smithi162 bash[9856]: audit 2021-01-28T04:02:45.035342+0000 mon.a (mon.0) 1476 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:46.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:46 smithi162 bash[9856]: audit 2021-01-28T04:02:45.058920+0000 mon.a (mon.0) 1477 : audit [INF] from='client.? 172.21.15.100:0/3162238307' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-34"}]: dispatch 2021-01-28T04:02:46.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:46 smithi162 bash[9856]: audit 2021-01-28T04:02:45.059869+0000 mon.a (mon.0) 1478 : audit [INF] from='client.? 172.21.15.100:0/3162238307' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-34"}]: dispatch 2021-01-28T04:02:46.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:46 smithi162 bash[9856]: audit 2021-01-28T04:02:45.060236+0000 mon.a (mon.0) 1479 : audit [INF] from='client.? 172.21.15.100:0/3162238307' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:47.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:47 smithi162 bash[9856]: cluster 2021-01-28T04:02:45.597368+0000 mgr.y (mgr.14138) 600 : cluster [DBG] pgmap v560: 291 pgs: 64 unknown, 227 active+clean; 28 KiB data, 323 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2021-01-28T04:02:47.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:47 smithi162 bash[9856]: audit 2021-01-28T04:02:46.025481+0000 mon.b (mon.2) 216 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:47.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:47 smithi162 bash[9856]: audit 2021-01-28T04:02:46.037441+0000 mon.a (mon.0) 1480 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-25","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:47.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:47 smithi162 bash[9856]: audit 2021-01-28T04:02:46.037580+0000 mon.a (mon.0) 1481 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-41","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:47.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:47 smithi162 bash[9856]: audit 2021-01-28T04:02:46.037883+0000 mon.a (mon.0) 1482 : audit [INF] from='client.? 172.21.15.100:0/3162238307' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:02:47.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:47 smithi162 bash[9856]: cluster 2021-01-28T04:02:46.037979+0000 mon.a (mon.0) 1483 : cluster [DBG] osdmap e207: 8 total, 8 up, 8 in 2021-01-28T04:02:47.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:47 smithi162 bash[9856]: audit 2021-01-28T04:02:46.039986+0000 mon.a (mon.0) 1484 : audit [INF] from='client.? 172.21.15.100:0/3162238307' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-34"}]: dispatch 2021-01-28T04:02:47.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:47 smithi162 bash[9856]: audit 2021-01-28T04:02:47.027470+0000 mon.b (mon.2) 217 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:47.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:47 smithi100 bash[9834]: cluster 2021-01-28T04:02:45.597368+0000 mgr.y (mgr.14138) 600 : cluster [DBG] pgmap v560: 291 pgs: 64 unknown, 227 active+clean; 28 KiB data, 323 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2021-01-28T04:02:47.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:47 smithi100 bash[9834]: audit 2021-01-28T04:02:46.025481+0000 mon.b (mon.2) 216 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:47.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:47 smithi100 bash[9834]: audit 2021-01-28T04:02:46.037441+0000 mon.a (mon.0) 1480 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-25","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:47.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:47 smithi100 bash[9834]: audit 2021-01-28T04:02:46.037580+0000 mon.a (mon.0) 1481 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-41","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:47.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:47 smithi100 bash[9834]: audit 2021-01-28T04:02:46.037883+0000 mon.a (mon.0) 1482 : audit [INF] from='client.? 172.21.15.100:0/3162238307' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:02:47.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:47 smithi100 bash[9834]: cluster 2021-01-28T04:02:46.037979+0000 mon.a (mon.0) 1483 : cluster [DBG] osdmap e207: 8 total, 8 up, 8 in 2021-01-28T04:02:47.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:47 smithi100 bash[9834]: audit 2021-01-28T04:02:46.039986+0000 mon.a (mon.0) 1484 : audit [INF] from='client.? 172.21.15.100:0/3162238307' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-34"}]: dispatch 2021-01-28T04:02:47.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:47 smithi100 bash[9834]: audit 2021-01-28T04:02:47.027470+0000 mon.b (mon.2) 217 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:47.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:47 smithi100 bash[13549]: cluster 2021-01-28T04:02:45.597368+0000 mgr.y (mgr.14138) 600 : cluster [DBG] pgmap v560: 291 pgs: 64 unknown, 227 active+clean; 28 KiB data, 323 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2021-01-28T04:02:47.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:47 smithi100 bash[13549]: audit 2021-01-28T04:02:46.025481+0000 mon.b (mon.2) 216 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:47.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:47 smithi100 bash[13549]: audit 2021-01-28T04:02:46.037441+0000 mon.a (mon.0) 1480 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-25","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:47.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:47 smithi100 bash[13549]: audit 2021-01-28T04:02:46.037580+0000 mon.a (mon.0) 1481 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-41","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:47.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:47 smithi100 bash[13549]: audit 2021-01-28T04:02:46.037883+0000 mon.a (mon.0) 1482 : audit [INF] from='client.? 172.21.15.100:0/3162238307' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:02:47.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:47 smithi100 bash[13549]: cluster 2021-01-28T04:02:46.037979+0000 mon.a (mon.0) 1483 : cluster [DBG] osdmap e207: 8 total, 8 up, 8 in 2021-01-28T04:02:47.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:47 smithi100 bash[13549]: audit 2021-01-28T04:02:46.039986+0000 mon.a (mon.0) 1484 : audit [INF] from='client.? 172.21.15.100:0/3162238307' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-34"}]: dispatch 2021-01-28T04:02:47.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:47 smithi100 bash[13549]: audit 2021-01-28T04:02:47.027470+0000 mon.b (mon.2) 217 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:48.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:48 smithi162 bash[9856]: cluster 2021-01-28T04:02:47.458515+0000 mon.a (mon.0) 1485 : cluster [DBG] osdmap e208: 8 total, 8 up, 8 in 2021-01-28T04:02:48.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:48 smithi162 bash[9856]: audit 2021-01-28T04:02:47.468290+0000 mon.c (mon.1) 244 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-25", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:48.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:48 smithi162 bash[9856]: audit 2021-01-28T04:02:47.469793+0000 mon.a (mon.0) 1486 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-25", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:48.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:48 smithi162 bash[9856]: audit 2021-01-28T04:02:47.476233+0000 mon.a (mon.0) 1487 : audit [INF] from='client.? 172.21.15.100:0/2574759195' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-42"}]: dispatch 2021-01-28T04:02:48.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:48 smithi162 bash[9856]: audit 2021-01-28T04:02:47.477462+0000 mon.a (mon.0) 1488 : audit [INF] from='client.? 172.21.15.100:0/2574759195' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-42"}]: dispatch 2021-01-28T04:02:48.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:48 smithi162 bash[9856]: audit 2021-01-28T04:02:47.477780+0000 mon.a (mon.0) 1489 : audit [INF] from='client.? 172.21.15.100:0/2574759195' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:48.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:48 smithi162 bash[9856]: audit 2021-01-28T04:02:48.029365+0000 mon.b (mon.2) 218 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:48.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:48 smithi162 bash[9856]: audit 2021-01-28T04:02:48.040800+0000 mon.a (mon.0) 1490 : audit [INF] from='client.? 172.21.15.100:0/3162238307' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-34"}]': finished 2021-01-28T04:02:48.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:48 smithi162 bash[9856]: audit 2021-01-28T04:02:48.041928+0000 mon.a (mon.0) 1491 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-25", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:02:48.766 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:48 smithi162 bash[9856]: audit 2021-01-28T04:02:48.042748+0000 mon.a (mon.0) 1492 : audit [INF] from='client.? 172.21.15.100:0/2574759195' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:02:48.766 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:48 smithi162 bash[9856]: audit 2021-01-28T04:02:48.043040+0000 mon.c (mon.1) 245 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-25"}]: dispatch 2021-01-28T04:02:48.766 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:48 smithi162 bash[9856]: cluster 2021-01-28T04:02:48.043248+0000 mon.a (mon.0) 1493 : cluster [DBG] osdmap e209: 8 total, 8 up, 8 in 2021-01-28T04:02:48.766 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:48 smithi162 bash[9856]: audit 2021-01-28T04:02:48.048923+0000 mon.a (mon.0) 1494 : audit [INF] from='client.? 172.21.15.100:0/2574759195' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-42"}]: dispatch 2021-01-28T04:02:48.767 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:48 smithi162 bash[9856]: audit 2021-01-28T04:02:48.049689+0000 mon.a (mon.0) 1495 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-25"}]: dispatch 2021-01-28T04:02:48.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:48 smithi100 bash[9834]: cluster 2021-01-28T04:02:47.458515+0000 mon.a (mon.0) 1485 : cluster [DBG] osdmap e208: 8 total, 8 up, 8 in 2021-01-28T04:02:48.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:48 smithi100 bash[9834]: audit 2021-01-28T04:02:47.468290+0000 mon.c (mon.1) 244 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-25", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:48.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:48 smithi100 bash[9834]: audit 2021-01-28T04:02:47.469793+0000 mon.a (mon.0) 1486 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-25", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:48.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:48 smithi100 bash[9834]: audit 2021-01-28T04:02:47.476233+0000 mon.a (mon.0) 1487 : audit [INF] from='client.? 172.21.15.100:0/2574759195' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-42"}]: dispatch 2021-01-28T04:02:48.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:48 smithi100 bash[9834]: audit 2021-01-28T04:02:47.477462+0000 mon.a (mon.0) 1488 : audit [INF] from='client.? 172.21.15.100:0/2574759195' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-42"}]: dispatch 2021-01-28T04:02:48.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:48 smithi100 bash[9834]: audit 2021-01-28T04:02:47.477780+0000 mon.a (mon.0) 1489 : audit [INF] from='client.? 172.21.15.100:0/2574759195' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:48.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:48 smithi100 bash[9834]: audit 2021-01-28T04:02:48.029365+0000 mon.b (mon.2) 218 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:48.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:48 smithi100 bash[9834]: audit 2021-01-28T04:02:48.040800+0000 mon.a (mon.0) 1490 : audit [INF] from='client.? 172.21.15.100:0/3162238307' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-34"}]': finished 2021-01-28T04:02:48.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:48 smithi100 bash[9834]: audit 2021-01-28T04:02:48.041928+0000 mon.a (mon.0) 1491 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-25", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:02:48.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:48 smithi100 bash[9834]: audit 2021-01-28T04:02:48.042748+0000 mon.a (mon.0) 1492 : audit [INF] from='client.? 172.21.15.100:0/2574759195' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:02:48.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:48 smithi100 bash[9834]: audit 2021-01-28T04:02:48.043040+0000 mon.c (mon.1) 245 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-25"}]: dispatch 2021-01-28T04:02:48.832 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:48 smithi100 bash[9834]: cluster 2021-01-28T04:02:48.043248+0000 mon.a (mon.0) 1493 : cluster [DBG] osdmap e209: 8 total, 8 up, 8 in 2021-01-28T04:02:48.832 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:48 smithi100 bash[9834]: audit 2021-01-28T04:02:48.048923+0000 mon.a (mon.0) 1494 : audit [INF] from='client.? 172.21.15.100:0/2574759195' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-42"}]: dispatch 2021-01-28T04:02:48.832 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:48 smithi100 bash[9834]: audit 2021-01-28T04:02:48.049689+0000 mon.a (mon.0) 1495 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-25"}]: dispatch 2021-01-28T04:02:48.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:48 smithi100 bash[13549]: cluster 2021-01-28T04:02:47.458515+0000 mon.a (mon.0) 1485 : cluster [DBG] osdmap e208: 8 total, 8 up, 8 in 2021-01-28T04:02:48.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:48 smithi100 bash[13549]: audit 2021-01-28T04:02:47.468290+0000 mon.c (mon.1) 244 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-25", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:48.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:48 smithi100 bash[13549]: audit 2021-01-28T04:02:47.469793+0000 mon.a (mon.0) 1486 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-25", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:48.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:48 smithi100 bash[13549]: audit 2021-01-28T04:02:47.476233+0000 mon.a (mon.0) 1487 : audit [INF] from='client.? 172.21.15.100:0/2574759195' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-42"}]: dispatch 2021-01-28T04:02:48.834 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:48 smithi100 bash[13549]: audit 2021-01-28T04:02:47.477462+0000 mon.a (mon.0) 1488 : audit [INF] from='client.? 172.21.15.100:0/2574759195' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-42"}]: dispatch 2021-01-28T04:02:48.834 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:48 smithi100 bash[13549]: audit 2021-01-28T04:02:47.477780+0000 mon.a (mon.0) 1489 : audit [INF] from='client.? 172.21.15.100:0/2574759195' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:48.834 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:48 smithi100 bash[13549]: audit 2021-01-28T04:02:48.029365+0000 mon.b (mon.2) 218 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:48.835 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:48 smithi100 bash[13549]: audit 2021-01-28T04:02:48.040800+0000 mon.a (mon.0) 1490 : audit [INF] from='client.? 172.21.15.100:0/3162238307' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-34"}]': finished 2021-01-28T04:02:48.835 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:48 smithi100 bash[13549]: audit 2021-01-28T04:02:48.041928+0000 mon.a (mon.0) 1491 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-25", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:02:48.835 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:48 smithi100 bash[13549]: audit 2021-01-28T04:02:48.042748+0000 mon.a (mon.0) 1492 : audit [INF] from='client.? 172.21.15.100:0/2574759195' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:02:48.835 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:48 smithi100 bash[13549]: audit 2021-01-28T04:02:48.043040+0000 mon.c (mon.1) 245 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-25"}]: dispatch 2021-01-28T04:02:48.836 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:48 smithi100 bash[13549]: cluster 2021-01-28T04:02:48.043248+0000 mon.a (mon.0) 1493 : cluster [DBG] osdmap e209: 8 total, 8 up, 8 in 2021-01-28T04:02:48.836 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:48 smithi100 bash[13549]: audit 2021-01-28T04:02:48.048923+0000 mon.a (mon.0) 1494 : audit [INF] from='client.? 172.21.15.100:0/2574759195' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-42"}]: dispatch 2021-01-28T04:02:48.836 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:48 smithi100 bash[13549]: audit 2021-01-28T04:02:48.049689+0000 mon.a (mon.0) 1495 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-25"}]: dispatch 2021-01-28T04:02:49.843 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:49 smithi100 bash[9834]: cluster 2021-01-28T04:02:47.598632+0000 mgr.y (mgr.14138) 601 : cluster [DBG] pgmap v563: 259 pgs: 5 creating+peering, 16 unknown, 238 active+clean; 28 KiB data, 329 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:02:49.843 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:49 smithi100 bash[9834]: audit 2021-01-28T04:02:48.998977+0000 mon.a (mon.0) 1496 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-25"}]': finished 2021-01-28T04:02:49.844 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:49 smithi100 bash[9834]: cluster 2021-01-28T04:02:48.999153+0000 mon.a (mon.0) 1497 : cluster [DBG] osdmap e210: 8 total, 8 up, 8 in 2021-01-28T04:02:49.844 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:49 smithi100 bash[9834]: audit 2021-01-28T04:02:49.000205+0000 mon.c (mon.1) 246 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-25", "mode": "writeback"}]: dispatch 2021-01-28T04:02:49.844 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:49 smithi100 bash[9834]: audit 2021-01-28T04:02:49.005269+0000 mon.a (mon.0) 1498 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-25", "mode": "writeback"}]: dispatch 2021-01-28T04:02:49.845 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:49 smithi100 bash[9834]: audit 2021-01-28T04:02:49.031156+0000 mon.b (mon.2) 219 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:49.845 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:49 smithi100 bash[13549]: cluster 2021-01-28T04:02:47.598632+0000 mgr.y (mgr.14138) 601 : cluster [DBG] pgmap v563: 259 pgs: 5 creating+peering, 16 unknown, 238 active+clean; 28 KiB data, 329 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:02:49.845 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:49 smithi100 bash[13549]: audit 2021-01-28T04:02:48.998977+0000 mon.a (mon.0) 1496 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-25"}]': finished 2021-01-28T04:02:49.845 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:49 smithi100 bash[13549]: cluster 2021-01-28T04:02:48.999153+0000 mon.a (mon.0) 1497 : cluster [DBG] osdmap e210: 8 total, 8 up, 8 in 2021-01-28T04:02:49.846 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:49 smithi100 bash[13549]: audit 2021-01-28T04:02:49.000205+0000 mon.c (mon.1) 246 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-25", "mode": "writeback"}]: dispatch 2021-01-28T04:02:49.846 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:49 smithi100 bash[13549]: audit 2021-01-28T04:02:49.005269+0000 mon.a (mon.0) 1498 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-25", "mode": "writeback"}]: dispatch 2021-01-28T04:02:49.846 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:49 smithi100 bash[13549]: audit 2021-01-28T04:02:49.031156+0000 mon.b (mon.2) 219 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:49.847 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:49 smithi162 bash[9856]: cluster 2021-01-28T04:02:47.598632+0000 mgr.y (mgr.14138) 601 : cluster [DBG] pgmap v563: 259 pgs: 5 creating+peering, 16 unknown, 238 active+clean; 28 KiB data, 329 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:02:49.847 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:49 smithi162 bash[9856]: audit 2021-01-28T04:02:48.998977+0000 mon.a (mon.0) 1496 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-25"}]': finished 2021-01-28T04:02:49.847 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:49 smithi162 bash[9856]: cluster 2021-01-28T04:02:48.999153+0000 mon.a (mon.0) 1497 : cluster [DBG] osdmap e210: 8 total, 8 up, 8 in 2021-01-28T04:02:49.847 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:49 smithi162 bash[9856]: audit 2021-01-28T04:02:49.000205+0000 mon.c (mon.1) 246 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-25", "mode": "writeback"}]: dispatch 2021-01-28T04:02:49.848 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:49 smithi162 bash[9856]: audit 2021-01-28T04:02:49.005269+0000 mon.a (mon.0) 1498 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-25", "mode": "writeback"}]: dispatch 2021-01-28T04:02:49.848 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:49 smithi162 bash[9856]: audit 2021-01-28T04:02:49.031156+0000 mon.b (mon.2) 219 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:50.263 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 04:02:49 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T04:02:50.352 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 04:02:49 smithi100 bash[10061]: debug 2021-01-28T04:02:49.836+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:02:51.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:50 smithi162 bash[9856]: cluster 2021-01-28T04:02:49.561774+0000 mon.a (mon.0) 1499 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:02:51.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:50 smithi162 bash[9856]: audit 2021-01-28T04:02:49.572681+0000 mon.a (mon.0) 1500 : audit [INF] from='client.? 172.21.15.100:0/2574759195' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-42"}]': finished 2021-01-28T04:02:51.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:50 smithi162 bash[9856]: audit 2021-01-28T04:02:49.572942+0000 mon.a (mon.0) 1501 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-25", "mode": "writeback"}]': finished 2021-01-28T04:02:51.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:50 smithi162 bash[9856]: cluster 2021-01-28T04:02:49.573250+0000 mon.a (mon.0) 1502 : cluster [DBG] osdmap e211: 8 total, 8 up, 8 in 2021-01-28T04:02:51.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:50 smithi162 bash[9856]: audit 2021-01-28T04:02:49.576627+0000 mon.a (mon.0) 1503 : audit [INF] from='client.? 172.21.15.100:0/3162238307' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-34"}]: dispatch 2021-01-28T04:02:51.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:50 smithi162 bash[9856]: cluster 2021-01-28T04:02:49.599170+0000 mgr.y (mgr.14138) 602 : cluster [DBG] pgmap v567: 267 pgs: 5 creating+peering, 8 unknown, 254 active+clean; 28 KiB data, 338 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2021-01-28T04:02:51.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:50 smithi162 bash[9856]: audit 2021-01-28T04:02:49.622899+0000 mon.c (mon.1) 247 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:02:51.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:50 smithi162 bash[9856]: audit 2021-01-28T04:02:49.623639+0000 mon.a (mon.0) 1504 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:02:51.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:50 smithi162 bash[9856]: audit 2021-01-28T04:02:49.841074+0000 mgr.y (mgr.14138) 603 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:02:51.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:50 smithi162 bash[9856]: audit 2021-01-28T04:02:50.032750+0000 mon.b (mon.2) 220 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:51.018 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:50 smithi162 bash[9856]: audit 2021-01-28T04:02:50.574197+0000 mon.a (mon.0) 1505 : audit [INF] from='client.? 172.21.15.100:0/3162238307' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-34"}]': finished 2021-01-28T04:02:51.018 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:50 smithi162 bash[9856]: audit 2021-01-28T04:02:50.575380+0000 mon.a (mon.0) 1506 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:02:51.019 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:50 smithi162 bash[9856]: cluster 2021-01-28T04:02:50.575569+0000 mon.a (mon.0) 1507 : cluster [DBG] osdmap e212: 8 total, 8 up, 8 in 2021-01-28T04:02:51.020 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:50 smithi162 bash[9856]: audit 2021-01-28T04:02:50.576649+0000 mon.a (mon.0) 1508 : audit [INF] from='client.? 172.21.15.100:0/3162238307' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-34"}]: dispatch 2021-01-28T04:02:51.020 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:50 smithi162 bash[9856]: audit 2021-01-28T04:02:50.576954+0000 mon.c (mon.1) 248 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-25"}]: dispatch 2021-01-28T04:02:51.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:50 smithi100 bash[9834]: cluster 2021-01-28T04:02:49.561774+0000 mon.a (mon.0) 1499 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:02:51.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:50 smithi100 bash[9834]: audit 2021-01-28T04:02:49.572681+0000 mon.a (mon.0) 1500 : audit [INF] from='client.? 172.21.15.100:0/2574759195' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-42"}]': finished 2021-01-28T04:02:51.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:50 smithi100 bash[9834]: audit 2021-01-28T04:02:49.572942+0000 mon.a (mon.0) 1501 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-25", "mode": "writeback"}]': finished 2021-01-28T04:02:51.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:50 smithi100 bash[9834]: cluster 2021-01-28T04:02:49.573250+0000 mon.a (mon.0) 1502 : cluster [DBG] osdmap e211: 8 total, 8 up, 8 in 2021-01-28T04:02:51.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:50 smithi100 bash[9834]: audit 2021-01-28T04:02:49.576627+0000 mon.a (mon.0) 1503 : audit [INF] from='client.? 172.21.15.100:0/3162238307' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-34"}]: dispatch 2021-01-28T04:02:51.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:50 smithi100 bash[9834]: cluster 2021-01-28T04:02:49.599170+0000 mgr.y (mgr.14138) 602 : cluster [DBG] pgmap v567: 267 pgs: 5 creating+peering, 8 unknown, 254 active+clean; 28 KiB data, 338 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2021-01-28T04:02:51.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:50 smithi100 bash[9834]: audit 2021-01-28T04:02:49.622899+0000 mon.c (mon.1) 247 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:02:51.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:50 smithi100 bash[9834]: audit 2021-01-28T04:02:49.623639+0000 mon.a (mon.0) 1504 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:02:51.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:50 smithi100 bash[9834]: audit 2021-01-28T04:02:49.841074+0000 mgr.y (mgr.14138) 603 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:02:51.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:50 smithi100 bash[9834]: audit 2021-01-28T04:02:50.032750+0000 mon.b (mon.2) 220 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:51.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:50 smithi100 bash[9834]: audit 2021-01-28T04:02:50.574197+0000 mon.a (mon.0) 1505 : audit [INF] from='client.? 172.21.15.100:0/3162238307' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-34"}]': finished 2021-01-28T04:02:51.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:50 smithi100 bash[9834]: audit 2021-01-28T04:02:50.575380+0000 mon.a (mon.0) 1506 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:02:51.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:50 smithi100 bash[9834]: cluster 2021-01-28T04:02:50.575569+0000 mon.a (mon.0) 1507 : cluster [DBG] osdmap e212: 8 total, 8 up, 8 in 2021-01-28T04:02:51.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:50 smithi100 bash[9834]: audit 2021-01-28T04:02:50.576649+0000 mon.a (mon.0) 1508 : audit [INF] from='client.? 172.21.15.100:0/3162238307' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-34"}]: dispatch 2021-01-28T04:02:51.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:50 smithi100 bash[9834]: audit 2021-01-28T04:02:50.576954+0000 mon.c (mon.1) 248 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-25"}]: dispatch 2021-01-28T04:02:51.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:50 smithi100 bash[13549]: cluster 2021-01-28T04:02:49.561774+0000 mon.a (mon.0) 1499 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:02:51.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:50 smithi100 bash[13549]: audit 2021-01-28T04:02:49.572681+0000 mon.a (mon.0) 1500 : audit [INF] from='client.? 172.21.15.100:0/2574759195' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-42"}]': finished 2021-01-28T04:02:51.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:50 smithi100 bash[13549]: audit 2021-01-28T04:02:49.572942+0000 mon.a (mon.0) 1501 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-25", "mode": "writeback"}]': finished 2021-01-28T04:02:51.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:50 smithi100 bash[13549]: cluster 2021-01-28T04:02:49.573250+0000 mon.a (mon.0) 1502 : cluster [DBG] osdmap e211: 8 total, 8 up, 8 in 2021-01-28T04:02:51.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:50 smithi100 bash[13549]: audit 2021-01-28T04:02:49.576627+0000 mon.a (mon.0) 1503 : audit [INF] from='client.? 172.21.15.100:0/3162238307' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-34"}]: dispatch 2021-01-28T04:02:51.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:50 smithi100 bash[13549]: cluster 2021-01-28T04:02:49.599170+0000 mgr.y (mgr.14138) 602 : cluster [DBG] pgmap v567: 267 pgs: 5 creating+peering, 8 unknown, 254 active+clean; 28 KiB data, 338 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2021-01-28T04:02:51.087 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:50 smithi100 bash[13549]: audit 2021-01-28T04:02:49.622899+0000 mon.c (mon.1) 247 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:02:51.087 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:50 smithi100 bash[13549]: audit 2021-01-28T04:02:49.623639+0000 mon.a (mon.0) 1504 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:02:51.088 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:50 smithi100 bash[13549]: audit 2021-01-28T04:02:49.841074+0000 mgr.y (mgr.14138) 603 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:02:51.088 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:50 smithi100 bash[13549]: audit 2021-01-28T04:02:50.032750+0000 mon.b (mon.2) 220 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:51.088 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:50 smithi100 bash[13549]: audit 2021-01-28T04:02:50.574197+0000 mon.a (mon.0) 1505 : audit [INF] from='client.? 172.21.15.100:0/3162238307' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-34"}]': finished 2021-01-28T04:02:51.088 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:50 smithi100 bash[13549]: audit 2021-01-28T04:02:50.575380+0000 mon.a (mon.0) 1506 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:02:51.088 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:50 smithi100 bash[13549]: cluster 2021-01-28T04:02:50.575569+0000 mon.a (mon.0) 1507 : cluster [DBG] osdmap e212: 8 total, 8 up, 8 in 2021-01-28T04:02:51.089 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:50 smithi100 bash[13549]: audit 2021-01-28T04:02:50.576649+0000 mon.a (mon.0) 1508 : audit [INF] from='client.? 172.21.15.100:0/3162238307' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-34"}]: dispatch 2021-01-28T04:02:51.089 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:50 smithi100 bash[13549]: audit 2021-01-28T04:02:50.576954+0000 mon.c (mon.1) 248 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-25"}]: dispatch 2021-01-28T04:02:52.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:51 smithi162 bash[9856]: audit 2021-01-28T04:02:50.577723+0000 mon.a (mon.0) 1509 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-25"}]: dispatch 2021-01-28T04:02:52.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:51 smithi162 bash[9856]: audit 2021-01-28T04:02:51.034703+0000 mon.b (mon.2) 221 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:52.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:51 smithi162 bash[9856]: cluster 2021-01-28T04:02:51.568695+0000 mon.a (mon.0) 1510 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:02:52.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:51 smithi162 bash[9856]: audit 2021-01-28T04:02:51.579075+0000 mon.a (mon.0) 1511 : audit [INF] from='client.? 172.21.15.100:0/3162238307' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-34"}]': finished 2021-01-28T04:02:52.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:51 smithi162 bash[9856]: audit 2021-01-28T04:02:51.579549+0000 mon.a (mon.0) 1512 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-25"}]': finished 2021-01-28T04:02:52.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:51 smithi162 bash[9856]: cluster 2021-01-28T04:02:51.579747+0000 mon.a (mon.0) 1513 : cluster [DBG] osdmap e213: 8 total, 8 up, 8 in 2021-01-28T04:02:52.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:51 smithi162 bash[9856]: audit 2021-01-28T04:02:51.582391+0000 mon.a (mon.0) 1514 : audit [INF] from='client.? 172.21.15.100:0/2574759195' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-42"}]: dispatch 2021-01-28T04:02:52.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:51 smithi100 bash[9834]: audit 2021-01-28T04:02:50.577723+0000 mon.a (mon.0) 1509 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-25"}]: dispatch 2021-01-28T04:02:52.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:51 smithi100 bash[9834]: audit 2021-01-28T04:02:51.034703+0000 mon.b (mon.2) 221 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:52.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:51 smithi100 bash[9834]: cluster 2021-01-28T04:02:51.568695+0000 mon.a (mon.0) 1510 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:02:52.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:51 smithi100 bash[9834]: audit 2021-01-28T04:02:51.579075+0000 mon.a (mon.0) 1511 : audit [INF] from='client.? 172.21.15.100:0/3162238307' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-34"}]': finished 2021-01-28T04:02:52.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:51 smithi100 bash[9834]: audit 2021-01-28T04:02:51.579549+0000 mon.a (mon.0) 1512 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-25"}]': finished 2021-01-28T04:02:52.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:51 smithi100 bash[9834]: cluster 2021-01-28T04:02:51.579747+0000 mon.a (mon.0) 1513 : cluster [DBG] osdmap e213: 8 total, 8 up, 8 in 2021-01-28T04:02:52.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:51 smithi100 bash[9834]: audit 2021-01-28T04:02:51.582391+0000 mon.a (mon.0) 1514 : audit [INF] from='client.? 172.21.15.100:0/2574759195' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-42"}]: dispatch 2021-01-28T04:02:52.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:51 smithi100 bash[13549]: audit 2021-01-28T04:02:50.577723+0000 mon.a (mon.0) 1509 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-25"}]: dispatch 2021-01-28T04:02:52.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:51 smithi100 bash[13549]: audit 2021-01-28T04:02:51.034703+0000 mon.b (mon.2) 221 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:52.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:51 smithi100 bash[13549]: cluster 2021-01-28T04:02:51.568695+0000 mon.a (mon.0) 1510 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:02:52.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:51 smithi100 bash[13549]: audit 2021-01-28T04:02:51.579075+0000 mon.a (mon.0) 1511 : audit [INF] from='client.? 172.21.15.100:0/3162238307' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-34"}]': finished 2021-01-28T04:02:52.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:51 smithi100 bash[13549]: audit 2021-01-28T04:02:51.579549+0000 mon.a (mon.0) 1512 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-25"}]': finished 2021-01-28T04:02:52.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:51 smithi100 bash[13549]: cluster 2021-01-28T04:02:51.579747+0000 mon.a (mon.0) 1513 : cluster [DBG] osdmap e213: 8 total, 8 up, 8 in 2021-01-28T04:02:52.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:51 smithi100 bash[13549]: audit 2021-01-28T04:02:51.582391+0000 mon.a (mon.0) 1514 : audit [INF] from='client.? 172.21.15.100:0/2574759195' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-42"}]: dispatch 2021-01-28T04:02:53.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:53 smithi100 bash[9834]: cluster 2021-01-28T04:02:51.599659+0000 mgr.y (mgr.14138) 604 : cluster [DBG] pgmap v570: 259 pgs: 259 active+clean; 28 KiB data, 338 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 574 B/s wr, 0 op/s 2021-01-28T04:02:53.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:53 smithi100 bash[9834]: audit 2021-01-28T04:02:51.600949+0000 mon.a (mon.0) 1515 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi100-32195-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2021-01-28T04:02:53.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:53 smithi100 bash[9834]: audit 2021-01-28T04:02:51.606192+0000 mon.c (mon.1) 249 : audit [INF] from='client.? 172.21.15.100:0/841491844' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-35"}]: dispatch 2021-01-28T04:02:53.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:53 smithi100 bash[9834]: audit 2021-01-28T04:02:51.607341+0000 mon.a (mon.0) 1516 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-35"}]: dispatch 2021-01-28T04:02:53.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:53 smithi100 bash[9834]: audit 2021-01-28T04:02:51.608108+0000 mon.c (mon.1) 250 : audit [INF] from='client.? 172.21.15.100:0/841491844' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-35"}]: dispatch 2021-01-28T04:02:53.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:53 smithi100 bash[9834]: audit 2021-01-28T04:02:51.608449+0000 mon.a (mon.0) 1517 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-35"}]: dispatch 2021-01-28T04:02:53.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:53 smithi100 bash[9834]: audit 2021-01-28T04:02:51.609012+0000 mon.c (mon.1) 251 : audit [INF] from='client.? 172.21.15.100:0/841491844' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:53.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:53 smithi100 bash[9834]: audit 2021-01-28T04:02:51.609330+0000 mon.a (mon.0) 1518 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:53.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:53 smithi100 bash[9834]: audit 2021-01-28T04:02:52.036685+0000 mon.b (mon.2) 222 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:53.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:53 smithi100 bash[9834]: audit 2021-01-28T04:02:52.580026+0000 mon.a (mon.0) 1519 : audit [INF] from='client.? 172.21.15.100:0/2574759195' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-42"}]': finished 2021-01-28T04:02:53.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:53 smithi100 bash[9834]: audit 2021-01-28T04:02:52.580216+0000 mon.a (mon.0) 1520 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "test-rados-api-smithi100-32195-1", "var": "pgp_num_actual", "val": "30"}]': finished 2021-01-28T04:02:53.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:53 smithi100 bash[9834]: audit 2021-01-28T04:02:52.580482+0000 mon.a (mon.0) 1521 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:02:53.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:53 smithi100 bash[9834]: cluster 2021-01-28T04:02:52.580738+0000 mon.a (mon.0) 1522 : cluster [DBG] osdmap e214: 8 total, 8 up, 8 in 2021-01-28T04:02:53.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:53 smithi100 bash[9834]: audit 2021-01-28T04:02:52.584313+0000 mon.c (mon.1) 252 : audit [INF] from='client.? 172.21.15.100:0/841491844' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-35"}]: dispatch 2021-01-28T04:02:53.333 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:53 smithi100 bash[9834]: audit 2021-01-28T04:02:52.585424+0000 mon.a (mon.0) 1523 : audit [INF] from='client.? 172.21.15.100:0/2574759195' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-42"}]: dispatch 2021-01-28T04:02:53.333 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:53 smithi100 bash[9834]: audit 2021-01-28T04:02:52.585952+0000 mon.a (mon.0) 1524 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-35"}]: dispatch 2021-01-28T04:02:53.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:53 smithi100 bash[13549]: cluster 2021-01-28T04:02:51.599659+0000 mgr.y (mgr.14138) 604 : cluster [DBG] pgmap v570: 259 pgs: 259 active+clean; 28 KiB data, 338 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 574 B/s wr, 0 op/s 2021-01-28T04:02:53.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:53 smithi100 bash[13549]: audit 2021-01-28T04:02:51.600949+0000 mon.a (mon.0) 1515 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi100-32195-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2021-01-28T04:02:53.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:53 smithi100 bash[13549]: audit 2021-01-28T04:02:51.606192+0000 mon.c (mon.1) 249 : audit [INF] from='client.? 172.21.15.100:0/841491844' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-35"}]: dispatch 2021-01-28T04:02:53.334 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:53 smithi100 bash[13549]: audit 2021-01-28T04:02:51.607341+0000 mon.a (mon.0) 1516 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-35"}]: dispatch 2021-01-28T04:02:53.335 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:53 smithi100 bash[13549]: audit 2021-01-28T04:02:51.608108+0000 mon.c (mon.1) 250 : audit [INF] from='client.? 172.21.15.100:0/841491844' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-35"}]: dispatch 2021-01-28T04:02:53.335 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:53 smithi100 bash[13549]: audit 2021-01-28T04:02:51.608449+0000 mon.a (mon.0) 1517 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-35"}]: dispatch 2021-01-28T04:02:53.335 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:53 smithi100 bash[13549]: audit 2021-01-28T04:02:51.609012+0000 mon.c (mon.1) 251 : audit [INF] from='client.? 172.21.15.100:0/841491844' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:53.336 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:53 smithi100 bash[13549]: audit 2021-01-28T04:02:51.609330+0000 mon.a (mon.0) 1518 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:53.336 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:53 smithi100 bash[13549]: audit 2021-01-28T04:02:52.036685+0000 mon.b (mon.2) 222 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:53.336 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:53 smithi100 bash[13549]: audit 2021-01-28T04:02:52.580026+0000 mon.a (mon.0) 1519 : audit [INF] from='client.? 172.21.15.100:0/2574759195' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-42"}]': finished 2021-01-28T04:02:53.336 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:53 smithi100 bash[13549]: audit 2021-01-28T04:02:52.580216+0000 mon.a (mon.0) 1520 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "test-rados-api-smithi100-32195-1", "var": "pgp_num_actual", "val": "30"}]': finished 2021-01-28T04:02:53.336 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:53 smithi100 bash[13549]: audit 2021-01-28T04:02:52.580482+0000 mon.a (mon.0) 1521 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:02:53.337 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:53 smithi100 bash[13549]: cluster 2021-01-28T04:02:52.580738+0000 mon.a (mon.0) 1522 : cluster [DBG] osdmap e214: 8 total, 8 up, 8 in 2021-01-28T04:02:53.337 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:53 smithi100 bash[13549]: audit 2021-01-28T04:02:52.584313+0000 mon.c (mon.1) 252 : audit [INF] from='client.? 172.21.15.100:0/841491844' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-35"}]: dispatch 2021-01-28T04:02:53.337 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:53 smithi100 bash[13549]: audit 2021-01-28T04:02:52.585424+0000 mon.a (mon.0) 1523 : audit [INF] from='client.? 172.21.15.100:0/2574759195' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-42"}]: dispatch 2021-01-28T04:02:53.337 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:53 smithi100 bash[13549]: audit 2021-01-28T04:02:52.585952+0000 mon.a (mon.0) 1524 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-35"}]: dispatch 2021-01-28T04:02:53.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:53 smithi162 bash[9856]: cluster 2021-01-28T04:02:51.599659+0000 mgr.y (mgr.14138) 604 : cluster [DBG] pgmap v570: 259 pgs: 259 active+clean; 28 KiB data, 338 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 574 B/s wr, 0 op/s 2021-01-28T04:02:53.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:53 smithi162 bash[9856]: audit 2021-01-28T04:02:51.600949+0000 mon.a (mon.0) 1515 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "test-rados-api-smithi100-32195-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2021-01-28T04:02:53.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:53 smithi162 bash[9856]: audit 2021-01-28T04:02:51.606192+0000 mon.c (mon.1) 249 : audit [INF] from='client.? 172.21.15.100:0/841491844' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-35"}]: dispatch 2021-01-28T04:02:53.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:53 smithi162 bash[9856]: audit 2021-01-28T04:02:51.607341+0000 mon.a (mon.0) 1516 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-35"}]: dispatch 2021-01-28T04:02:53.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:53 smithi162 bash[9856]: audit 2021-01-28T04:02:51.608108+0000 mon.c (mon.1) 250 : audit [INF] from='client.? 172.21.15.100:0/841491844' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-35"}]: dispatch 2021-01-28T04:02:53.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:53 smithi162 bash[9856]: audit 2021-01-28T04:02:51.608449+0000 mon.a (mon.0) 1517 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-35"}]: dispatch 2021-01-28T04:02:53.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:53 smithi162 bash[9856]: audit 2021-01-28T04:02:51.609012+0000 mon.c (mon.1) 251 : audit [INF] from='client.? 172.21.15.100:0/841491844' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:53.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:53 smithi162 bash[9856]: audit 2021-01-28T04:02:51.609330+0000 mon.a (mon.0) 1518 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:53.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:53 smithi162 bash[9856]: audit 2021-01-28T04:02:52.036685+0000 mon.b (mon.2) 222 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:53.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:53 smithi162 bash[9856]: audit 2021-01-28T04:02:52.580026+0000 mon.a (mon.0) 1519 : audit [INF] from='client.? 172.21.15.100:0/2574759195' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-42"}]': finished 2021-01-28T04:02:53.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:53 smithi162 bash[9856]: audit 2021-01-28T04:02:52.580216+0000 mon.a (mon.0) 1520 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "test-rados-api-smithi100-32195-1", "var": "pgp_num_actual", "val": "30"}]': finished 2021-01-28T04:02:53.518 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:53 smithi162 bash[9856]: audit 2021-01-28T04:02:52.580482+0000 mon.a (mon.0) 1521 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:02:53.518 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:53 smithi162 bash[9856]: cluster 2021-01-28T04:02:52.580738+0000 mon.a (mon.0) 1522 : cluster [DBG] osdmap e214: 8 total, 8 up, 8 in 2021-01-28T04:02:53.518 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:53 smithi162 bash[9856]: audit 2021-01-28T04:02:52.584313+0000 mon.c (mon.1) 252 : audit [INF] from='client.? 172.21.15.100:0/841491844' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-35"}]: dispatch 2021-01-28T04:02:53.519 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:53 smithi162 bash[9856]: audit 2021-01-28T04:02:52.585424+0000 mon.a (mon.0) 1523 : audit [INF] from='client.? 172.21.15.100:0/2574759195' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-42"}]: dispatch 2021-01-28T04:02:53.519 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:53 smithi162 bash[9856]: audit 2021-01-28T04:02:52.585952+0000 mon.a (mon.0) 1524 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-35"}]: dispatch 2021-01-28T04:02:54.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:54 smithi100 bash[9834]: audit 2021-01-28T04:02:53.038215+0000 mon.b (mon.2) 223 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:54.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:54 smithi100 bash[9834]: audit 2021-01-28T04:02:53.580499+0000 mon.a (mon.0) 1525 : audit [INF] from='client.? 172.21.15.100:0/2574759195' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-42"}]': finished 2021-01-28T04:02:54.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:54 smithi100 bash[9834]: cluster 2021-01-28T04:02:53.991126+0000 mon.a (mon.0) 1526 : cluster [DBG] osdmap e215: 8 total, 8 up, 8 in 2021-01-28T04:02:54.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:54 smithi100 bash[9834]: audit 2021-01-28T04:02:53.992875+0000 mon.c (mon.1) 253 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:54.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:54 smithi100 bash[9834]: audit 2021-01-28T04:02:53.998907+0000 mon.a (mon.0) 1527 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:54.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:54 smithi100 bash[9834]: audit 2021-01-28T04:02:54.014021+0000 mon.a (mon.0) 1528 : audit [INF] from='client.? 172.21.15.100:0/1597036295' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-43"}]: dispatch 2021-01-28T04:02:54.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:54 smithi100 bash[9834]: audit 2021-01-28T04:02:54.015409+0000 mon.a (mon.0) 1529 : audit [INF] from='client.? 172.21.15.100:0/1597036295' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-43"}]: dispatch 2021-01-28T04:02:54.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:54 smithi100 bash[9834]: audit 2021-01-28T04:02:54.015820+0000 mon.a (mon.0) 1530 : audit [INF] from='client.? 172.21.15.100:0/1597036295' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-43", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:54.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:54 smithi100 bash[13549]: audit 2021-01-28T04:02:53.038215+0000 mon.b (mon.2) 223 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:54.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:54 smithi100 bash[13549]: audit 2021-01-28T04:02:53.580499+0000 mon.a (mon.0) 1525 : audit [INF] from='client.? 172.21.15.100:0/2574759195' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-42"}]': finished 2021-01-28T04:02:54.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:54 smithi100 bash[13549]: cluster 2021-01-28T04:02:53.991126+0000 mon.a (mon.0) 1526 : cluster [DBG] osdmap e215: 8 total, 8 up, 8 in 2021-01-28T04:02:54.334 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:54 smithi100 bash[13549]: audit 2021-01-28T04:02:53.992875+0000 mon.c (mon.1) 253 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:54.334 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:54 smithi100 bash[13549]: audit 2021-01-28T04:02:53.998907+0000 mon.a (mon.0) 1527 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:54.335 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:54 smithi100 bash[13549]: audit 2021-01-28T04:02:54.014021+0000 mon.a (mon.0) 1528 : audit [INF] from='client.? 172.21.15.100:0/1597036295' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-43"}]: dispatch 2021-01-28T04:02:54.335 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:54 smithi100 bash[13549]: audit 2021-01-28T04:02:54.015409+0000 mon.a (mon.0) 1529 : audit [INF] from='client.? 172.21.15.100:0/1597036295' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-43"}]: dispatch 2021-01-28T04:02:54.335 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:54 smithi100 bash[13549]: audit 2021-01-28T04:02:54.015820+0000 mon.a (mon.0) 1530 : audit [INF] from='client.? 172.21.15.100:0/1597036295' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-43", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:54.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:54 smithi162 bash[9856]: audit 2021-01-28T04:02:53.038215+0000 mon.b (mon.2) 223 : audit [DBG] from='client.? 172.21.15.100:0/1102264942' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2021-01-28T04:02:54.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:54 smithi162 bash[9856]: audit 2021-01-28T04:02:53.580499+0000 mon.a (mon.0) 1525 : audit [INF] from='client.? 172.21.15.100:0/2574759195' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-42"}]': finished 2021-01-28T04:02:54.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:54 smithi162 bash[9856]: cluster 2021-01-28T04:02:53.991126+0000 mon.a (mon.0) 1526 : cluster [DBG] osdmap e215: 8 total, 8 up, 8 in 2021-01-28T04:02:54.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:54 smithi162 bash[9856]: audit 2021-01-28T04:02:53.992875+0000 mon.c (mon.1) 253 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:54.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:54 smithi162 bash[9856]: audit 2021-01-28T04:02:53.998907+0000 mon.a (mon.0) 1527 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:02:54.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:54 smithi162 bash[9856]: audit 2021-01-28T04:02:54.014021+0000 mon.a (mon.0) 1528 : audit [INF] from='client.? 172.21.15.100:0/1597036295' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-43"}]: dispatch 2021-01-28T04:02:54.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:54 smithi162 bash[9856]: audit 2021-01-28T04:02:54.015409+0000 mon.a (mon.0) 1529 : audit [INF] from='client.? 172.21.15.100:0/1597036295' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-43"}]: dispatch 2021-01-28T04:02:54.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:54 smithi162 bash[9856]: audit 2021-01-28T04:02:54.015820+0000 mon.a (mon.0) 1530 : audit [INF] from='client.? 172.21.15.100:0/1597036295' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-43", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:55.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:55 smithi100 bash[9834]: cluster 2021-01-28T04:02:53.600325+0000 mgr.y (mgr.14138) 605 : cluster [DBG] pgmap v573: 259 pgs: 32 unknown, 227 active+clean; 28 KiB data, 323 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-01-28T04:02:55.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:55 smithi100 bash[9834]: audit 2021-01-28T04:02:54.592717+0000 mon.a (mon.0) 1531 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-35"}]': finished 2021-01-28T04:02:55.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:55 smithi100 bash[9834]: audit 2021-01-28T04:02:54.593027+0000 mon.a (mon.0) 1532 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-27","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:55.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:55 smithi100 bash[9834]: audit 2021-01-28T04:02:54.593161+0000 mon.a (mon.0) 1533 : audit [INF] from='client.? 172.21.15.100:0/1597036295' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-43", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:02:55.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:55 smithi100 bash[9834]: cluster 2021-01-28T04:02:54.593220+0000 mon.a (mon.0) 1534 : cluster [DBG] osdmap e216: 8 total, 8 up, 8 in 2021-01-28T04:02:55.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:55 smithi100 bash[9834]: audit 2021-01-28T04:02:54.604896+0000 mon.a (mon.0) 1535 : audit [INF] from='client.? 172.21.15.100:0/1597036295' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-43", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-43"}]: dispatch 2021-01-28T04:02:55.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:55 smithi100 bash[9834]: audit 2021-01-28T04:02:54.640069+0000 mon.a (mon.0) 1536 : audit [INF] from='client.? 172.21.15.100:0/2331822136' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32195-2"}]: dispatch 2021-01-28T04:02:55.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:55 smithi100 bash[9834]: audit 2021-01-28T04:02:54.643037+0000 mon.a (mon.0) 1537 : audit [INF] from='client.? 172.21.15.100:0/2331822136' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32195-2"}]: dispatch 2021-01-28T04:02:55.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:55 smithi100 bash[9834]: audit 2021-01-28T04:02:54.643668+0000 mon.a (mon.0) 1538 : audit [INF] from='client.? 172.21.15.100:0/2331822136' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32195-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:55.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:55 smithi100 bash[13549]: cluster 2021-01-28T04:02:53.600325+0000 mgr.y (mgr.14138) 605 : cluster [DBG] pgmap v573: 259 pgs: 32 unknown, 227 active+clean; 28 KiB data, 323 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-01-28T04:02:55.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:55 smithi100 bash[13549]: audit 2021-01-28T04:02:54.592717+0000 mon.a (mon.0) 1531 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-35"}]': finished 2021-01-28T04:02:55.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:55 smithi100 bash[13549]: audit 2021-01-28T04:02:54.593027+0000 mon.a (mon.0) 1532 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-27","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:55.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:55 smithi100 bash[13549]: audit 2021-01-28T04:02:54.593161+0000 mon.a (mon.0) 1533 : audit [INF] from='client.? 172.21.15.100:0/1597036295' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-43", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:02:55.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:55 smithi100 bash[13549]: cluster 2021-01-28T04:02:54.593220+0000 mon.a (mon.0) 1534 : cluster [DBG] osdmap e216: 8 total, 8 up, 8 in 2021-01-28T04:02:55.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:55 smithi100 bash[13549]: audit 2021-01-28T04:02:54.604896+0000 mon.a (mon.0) 1535 : audit [INF] from='client.? 172.21.15.100:0/1597036295' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-43", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-43"}]: dispatch 2021-01-28T04:02:55.332 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:55 smithi100 bash[13549]: audit 2021-01-28T04:02:54.640069+0000 mon.a (mon.0) 1536 : audit [INF] from='client.? 172.21.15.100:0/2331822136' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32195-2"}]: dispatch 2021-01-28T04:02:55.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:55 smithi100 bash[13549]: audit 2021-01-28T04:02:54.643037+0000 mon.a (mon.0) 1537 : audit [INF] from='client.? 172.21.15.100:0/2331822136' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32195-2"}]: dispatch 2021-01-28T04:02:55.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:55 smithi100 bash[13549]: audit 2021-01-28T04:02:54.643668+0000 mon.a (mon.0) 1538 : audit [INF] from='client.? 172.21.15.100:0/2331822136' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32195-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:55.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:55 smithi162 bash[9856]: cluster 2021-01-28T04:02:53.600325+0000 mgr.y (mgr.14138) 605 : cluster [DBG] pgmap v573: 259 pgs: 32 unknown, 227 active+clean; 28 KiB data, 323 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2021-01-28T04:02:55.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:55 smithi162 bash[9856]: audit 2021-01-28T04:02:54.592717+0000 mon.a (mon.0) 1531 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-35"}]': finished 2021-01-28T04:02:55.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:55 smithi162 bash[9856]: audit 2021-01-28T04:02:54.593027+0000 mon.a (mon.0) 1532 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-27","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:02:55.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:55 smithi162 bash[9856]: audit 2021-01-28T04:02:54.593161+0000 mon.a (mon.0) 1533 : audit [INF] from='client.? 172.21.15.100:0/1597036295' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-43", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:02:55.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:55 smithi162 bash[9856]: cluster 2021-01-28T04:02:54.593220+0000 mon.a (mon.0) 1534 : cluster [DBG] osdmap e216: 8 total, 8 up, 8 in 2021-01-28T04:02:55.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:55 smithi162 bash[9856]: audit 2021-01-28T04:02:54.604896+0000 mon.a (mon.0) 1535 : audit [INF] from='client.? 172.21.15.100:0/1597036295' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-43", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-43"}]: dispatch 2021-01-28T04:02:55.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:55 smithi162 bash[9856]: audit 2021-01-28T04:02:54.640069+0000 mon.a (mon.0) 1536 : audit [INF] from='client.? 172.21.15.100:0/2331822136' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32195-2"}]: dispatch 2021-01-28T04:02:55.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:55 smithi162 bash[9856]: audit 2021-01-28T04:02:54.643037+0000 mon.a (mon.0) 1537 : audit [INF] from='client.? 172.21.15.100:0/2331822136' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32195-2"}]: dispatch 2021-01-28T04:02:55.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:55 smithi162 bash[9856]: audit 2021-01-28T04:02:54.643668+0000 mon.a (mon.0) 1538 : audit [INF] from='client.? 172.21.15.100:0/2331822136' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32195-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:02:57.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:56 smithi162 bash[9856]: cluster 2021-01-28T04:02:55.601856+0000 mgr.y (mgr.14138) 606 : cluster [DBG] pgmap v576: 236 pgs: 4 creating+peering, 36 unknown, 196 active+clean; 26 KiB data, 324 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:02:57.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:56 smithi162 bash[9856]: audit 2021-01-28T04:02:56.018472+0000 mon.a (mon.0) 1539 : audit [INF] from='client.? 172.21.15.100:0/2331822136' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32195-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:02:57.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:56 smithi162 bash[9856]: cluster 2021-01-28T04:02:56.018791+0000 mon.a (mon.0) 1540 : cluster [DBG] osdmap e217: 8 total, 8 up, 8 in 2021-01-28T04:02:57.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:56 smithi162 bash[9856]: audit 2021-01-28T04:02:56.024923+0000 mon.a (mon.0) 1541 : audit [INF] from='client.? 172.21.15.100:0/2331822136' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32195-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32195-2"}]: dispatch 2021-01-28T04:02:57.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:56 smithi162 bash[9856]: audit 2021-01-28T04:02:56.034596+0000 mon.c (mon.1) 254 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-27", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:57.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:56 smithi162 bash[9856]: audit 2021-01-28T04:02:56.034939+0000 mon.a (mon.0) 1542 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-27", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:57.079 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:56 smithi100 bash[13549]: cluster 2021-01-28T04:02:55.601856+0000 mgr.y (mgr.14138) 606 : cluster [DBG] pgmap v576: 236 pgs: 4 creating+peering, 36 unknown, 196 active+clean; 26 KiB data, 324 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:02:57.079 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:56 smithi100 bash[13549]: audit 2021-01-28T04:02:56.018472+0000 mon.a (mon.0) 1539 : audit [INF] from='client.? 172.21.15.100:0/2331822136' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32195-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:02:57.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:56 smithi100 bash[13549]: cluster 2021-01-28T04:02:56.018791+0000 mon.a (mon.0) 1540 : cluster [DBG] osdmap e217: 8 total, 8 up, 8 in 2021-01-28T04:02:57.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:56 smithi100 bash[13549]: audit 2021-01-28T04:02:56.024923+0000 mon.a (mon.0) 1541 : audit [INF] from='client.? 172.21.15.100:0/2331822136' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32195-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32195-2"}]: dispatch 2021-01-28T04:02:57.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:56 smithi100 bash[13549]: audit 2021-01-28T04:02:56.034596+0000 mon.c (mon.1) 254 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-27", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:57.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:56 smithi100 bash[13549]: audit 2021-01-28T04:02:56.034939+0000 mon.a (mon.0) 1542 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-27", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:57.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:56 smithi100 bash[9834]: cluster 2021-01-28T04:02:55.601856+0000 mgr.y (mgr.14138) 606 : cluster [DBG] pgmap v576: 236 pgs: 4 creating+peering, 36 unknown, 196 active+clean; 26 KiB data, 324 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:02:57.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:56 smithi100 bash[9834]: audit 2021-01-28T04:02:56.018472+0000 mon.a (mon.0) 1539 : audit [INF] from='client.? 172.21.15.100:0/2331822136' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32195-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:02:57.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:56 smithi100 bash[9834]: cluster 2021-01-28T04:02:56.018791+0000 mon.a (mon.0) 1540 : cluster [DBG] osdmap e217: 8 total, 8 up, 8 in 2021-01-28T04:02:57.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:56 smithi100 bash[9834]: audit 2021-01-28T04:02:56.024923+0000 mon.a (mon.0) 1541 : audit [INF] from='client.? 172.21.15.100:0/2331822136' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32195-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32195-2"}]: dispatch 2021-01-28T04:02:57.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:56 smithi100 bash[9834]: audit 2021-01-28T04:02:56.034596+0000 mon.c (mon.1) 254 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-27", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:57.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:56 smithi100 bash[9834]: audit 2021-01-28T04:02:56.034939+0000 mon.a (mon.0) 1542 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-27", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:02:58.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:57 smithi162 bash[9856]: audit 2021-01-28T04:02:56.608723+0000 mon.a (mon.0) 1543 : audit [INF] from='client.? 172.21.15.100:0/1597036295' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-43", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-43"}]': finished 2021-01-28T04:02:58.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:57 smithi162 bash[9856]: audit 2021-01-28T04:02:57.036930+0000 mon.a (mon.0) 1544 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-27", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:02:58.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:57 smithi162 bash[9856]: cluster 2021-01-28T04:02:57.037055+0000 mon.a (mon.0) 1545 : cluster [DBG] osdmap e218: 8 total, 8 up, 8 in 2021-01-28T04:02:58.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:57 smithi162 bash[9856]: audit 2021-01-28T04:02:57.038398+0000 mon.c (mon.1) 255 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-27"}]: dispatch 2021-01-28T04:02:58.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:57 smithi162 bash[9856]: audit 2021-01-28T04:02:57.039136+0000 mon.c (mon.1) 256 : audit [INF] from='client.? 172.21.15.100:0/841491844' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-35"}]: dispatch 2021-01-28T04:02:58.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:57 smithi162 bash[9856]: audit 2021-01-28T04:02:57.040197+0000 mon.a (mon.0) 1546 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-27"}]: dispatch 2021-01-28T04:02:58.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:57 smithi162 bash[9856]: audit 2021-01-28T04:02:57.040545+0000 mon.a (mon.0) 1547 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-35"}]: dispatch 2021-01-28T04:02:58.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:57 smithi100 bash[9834]: audit 2021-01-28T04:02:56.608723+0000 mon.a (mon.0) 1543 : audit [INF] from='client.? 172.21.15.100:0/1597036295' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-43", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-43"}]': finished 2021-01-28T04:02:58.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:57 smithi100 bash[9834]: audit 2021-01-28T04:02:57.036930+0000 mon.a (mon.0) 1544 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-27", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:02:58.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:57 smithi100 bash[9834]: cluster 2021-01-28T04:02:57.037055+0000 mon.a (mon.0) 1545 : cluster [DBG] osdmap e218: 8 total, 8 up, 8 in 2021-01-28T04:02:58.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:57 smithi100 bash[9834]: audit 2021-01-28T04:02:57.038398+0000 mon.c (mon.1) 255 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-27"}]: dispatch 2021-01-28T04:02:58.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:57 smithi100 bash[9834]: audit 2021-01-28T04:02:57.039136+0000 mon.c (mon.1) 256 : audit [INF] from='client.? 172.21.15.100:0/841491844' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-35"}]: dispatch 2021-01-28T04:02:58.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:57 smithi100 bash[9834]: audit 2021-01-28T04:02:57.040197+0000 mon.a (mon.0) 1546 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-27"}]: dispatch 2021-01-28T04:02:58.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:57 smithi100 bash[9834]: audit 2021-01-28T04:02:57.040545+0000 mon.a (mon.0) 1547 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-35"}]: dispatch 2021-01-28T04:02:58.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:57 smithi100 bash[13549]: audit 2021-01-28T04:02:56.608723+0000 mon.a (mon.0) 1543 : audit [INF] from='client.? 172.21.15.100:0/1597036295' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-43", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-43"}]': finished 2021-01-28T04:02:58.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:57 smithi100 bash[13549]: audit 2021-01-28T04:02:57.036930+0000 mon.a (mon.0) 1544 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-27", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:02:58.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:57 smithi100 bash[13549]: cluster 2021-01-28T04:02:57.037055+0000 mon.a (mon.0) 1545 : cluster [DBG] osdmap e218: 8 total, 8 up, 8 in 2021-01-28T04:02:58.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:57 smithi100 bash[13549]: audit 2021-01-28T04:02:57.038398+0000 mon.c (mon.1) 255 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-27"}]: dispatch 2021-01-28T04:02:58.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:57 smithi100 bash[13549]: audit 2021-01-28T04:02:57.039136+0000 mon.c (mon.1) 256 : audit [INF] from='client.? 172.21.15.100:0/841491844' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-35"}]: dispatch 2021-01-28T04:02:58.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:57 smithi100 bash[13549]: audit 2021-01-28T04:02:57.040197+0000 mon.a (mon.0) 1546 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-27"}]: dispatch 2021-01-28T04:02:58.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:57 smithi100 bash[13549]: audit 2021-01-28T04:02:57.040545+0000 mon.a (mon.0) 1547 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-35"}]: dispatch 2021-01-28T04:02:58.811 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio_pp: [ OK ad 2021-01-28T04:02:58.811 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > 12:b29083e3:::5:head -> 5 2021-01-28T04:02:58.811 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : entry=5 expected=5 2021-01-28T04:02:58.812 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : seek to 12:89d3ae78:::11:head 2021-01-28T04:02:58.812 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : cursor()=12:89d3ae78:::11:head expected=12:89d3ae78:::11:head 2021-01-28T04:02:58.812 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > 12:89d3ae78:::11:head -> 11 2021-01-28T04:02:58.812 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : entry=11 expected=11 2021-01-28T04:02:58.813 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : seek to 12:863748b0:::15:head 2021-01-28T04:02:58.813 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : cursor()=12:863748b0:::15:head expected=12:863748b0:::15:head 2021-01-28T04:02:58.813 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > 12:863748b0:::15:head -> 15 2021-01-28T04:02:58.813 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : entry=15 expected=15 2021-01-28T04:02:58.813 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : seek to 12:62a1935d:::14:head 2021-01-28T04:02:58.814 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : cursor()=12:62a1935d:::14:head expected=12:62a1935d:::14:head 2021-01-28T04:02:58.814 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > 12:62a1935d:::14:head -> 14 2021-01-28T04:02:58.814 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : entry=14 expected=14 2021-01-28T04:02:58.814 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : seek to 12:6cac518f:::0:head 2021-01-28T04:02:58.815 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : cursor()=12:6cac518f:::0:head expected=12:6cac518f:::0:head 2021-01-28T04:02:58.815 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > 12:6cac518f:::0:head -> 0 2021-01-28T04:02:58.815 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : entry=0 expected=0 2021-01-28T04:02:58.815 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : seek to 12:566253c9:::13:head 2021-01-28T04:02:58.816 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : cursor()=12:566253c9:::13:head expected=12:566253c9:::13:head 2021-01-28T04:02:58.816 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > 12:566253c9:::13:head -> 13 2021-01-28T04:02:58.816 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : entry=13 expected=13 2021-01-28T04:02:58.816 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : seek to 12:5c6b0b28:::7:head 2021-01-28T04:02:58.816 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : cursor()=12:5c6b0b28:::7:head expected=12:5c6b0b28:::7:head 2021-01-28T04:02:58.817 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > 12:5c6b0b28:::7:head -> 7 2021-01-28T04:02:58.817 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : entry=7 expected=7 2021-01-28T04:02:58.817 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : seek to 12:02547ec2:::1:head 2021-01-28T04:02:58.817 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : cursor()=12:02547ec2:::1:head expected=12:02547ec2:::1:head 2021-01-28T04:02:58.818 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: > 12:02547ec2:::1:head -> 1 2021-01-28T04:02:58.818 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: : entry=1 expected=1 2021-01-28T04:02:58.818 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: [ OK ] LibRadosList.ListObjectsCursor (542 ms) 2021-01-28T04:02:58.818 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjects 2021-01-28T04:02:58.818 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: [ OK ] LibRadosList.EnumerateObjects (113774 ms) 2021-01-28T04:02:58.819 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjectsSplit 2021-01-28T04:02:58.819 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: split 0/5 -> MIN 12:33333333::::head 2021-01-28T04:02:58.819 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: split 1/5 -> 12:33333333::::head 12:66666666::::head 2021-01-28T04:02:58.819 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: split 2/5 -> 12:66666666::::head 12:99999999::::head 2021-01-28T04:02:58.820 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: split 3/5 -> 12:99999999::::head 12:cccccccc::::head 2021-01-28T04:02:58.820 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: split 4/5 -> 12:cccccccc::::head MAX 2021-01-28T04:02:58.820 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: [ OK ] LibRadosList.EnumerateObjectsSplit (33953 ms) 2021-01-28T04:02:58.820 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: [----------] 6 tests from LibRadosList (151626 ms total) 2021-01-28T04:02:58.821 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: 2021-01-28T04:02:58.821 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: [----------] 3 tests from LibRadosListEC 2021-01-28T04:02:58.821 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: [ RUN ] LibRadosListEC.ListObjects 2021-01-28T04:02:58.821 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: [ OK ] LibRadosListEC.ListObjects (1045 ms) 2021-01-28T04:02:58.821 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsNS 2021-01-28T04:02:58.822 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: myset foo1,foo2,foo3 2021-01-28T04:02:58.822 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: foo1 2021-01-28T04:02:58.822 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: foo2 2021-01-28T04:02:58.823 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: foo3 2021-01-28T04:02:58.823 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: myset foo1,foo4,foo5 2021-01-28T04:02:58.823 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: foo4 2021-01-28T04:02:58.823 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: foo5 2021-01-28T04:02:58.823 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: foo1 2021-01-28T04:02:58.824 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: myset foo6,foo7 2021-01-28T04:02:58.824 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: foo7 2021-01-28T04:02:58.824 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: foo6 2021-01-28T04:02:58.824 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2021-01-28T04:02:58.825 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: ns1:foo4 2021-01-28T04:02:58.825 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: ns1:foo5 2021-01-28T04:02:58.825 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: ns2:foo7 2021-01-28T04:02:58.825 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: ns2:foo6 2021-01-28T04:02:58.826 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: ns1:foo1 2021-01-28T04:02:58.826 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: :foo1 2021-01-28T04:02:58.826 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: :foo2 2021-01-28T04:02:58.826 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: :foo3 2021-01-28T04:02:58.827 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsNS (83 ms) 2021-01-28T04:02:58.827 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsStart 2021-01-28T04:02:58.827 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: 1 0 2021-01-28T04:02:58.827 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: 10 0 2021-01-28T04:02:58.827 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: 13 0 2021-01-28T04:02:58.828 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: 7 0 2021-01-28T04:02:59.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:58 smithi162 bash[9856]: cluster 2021-01-28T04:02:57.603204+0000 mgr.y (mgr.14138) 607 : cluster [DBG] pgmap v578: 236 pgs: 6 creating+peering, 15 unknown, 215 active+clean; 26 KiB data, 329 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:02:59.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:58 smithi162 bash[9856]: audit 2021-01-28T04:02:57.618633+0000 mon.a (mon.0) 1548 : audit [INF] from='client.? 172.21.15.100:0/2331822136' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32195-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32195-2"}]': finished 2021-01-28T04:02:59.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:58 smithi162 bash[9856]: audit 2021-01-28T04:02:57.618791+0000 mon.a (mon.0) 1549 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-27"}]': finished 2021-01-28T04:02:59.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:58 smithi162 bash[9856]: audit 2021-01-28T04:02:57.618882+0000 mon.a (mon.0) 1550 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-35"}]': finished 2021-01-28T04:02:59.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:58 smithi162 bash[9856]: cluster 2021-01-28T04:02:57.618980+0000 mon.a (mon.0) 1551 : cluster [DBG] osdmap e219: 8 total, 8 up, 8 in 2021-01-28T04:02:59.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:58 smithi162 bash[9856]: audit 2021-01-28T04:02:57.620651+0000 mon.c (mon.1) 257 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-27", "mode": "writeback"}]: dispatch 2021-01-28T04:02:59.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:58 smithi162 bash[9856]: audit 2021-01-28T04:02:57.621104+0000 mon.c (mon.1) 258 : audit [INF] from='client.? 172.21.15.100:0/841491844' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-35"}]: dispatch 2021-01-28T04:02:59.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:58 smithi162 bash[9856]: audit 2021-01-28T04:02:57.622171+0000 mon.a (mon.0) 1552 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-27", "mode": "writeback"}]: dispatch 2021-01-28T04:02:59.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:58 smithi162 bash[9856]: audit 2021-01-28T04:02:57.623065+0000 mon.a (mon.0) 1553 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-35"}]: dispatch 2021-01-28T04:02:59.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:58 smithi162 bash[9856]: cluster 2021-01-28T04:02:58.610415+0000 mon.a (mon.0) 1554 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:02:59.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:58 smithi162 bash[9856]: audit 2021-01-28T04:02:58.619162+0000 mon.a (mon.0) 1555 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-27", "mode": "writeback"}]': finished 2021-01-28T04:02:59.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:58 smithi162 bash[9856]: audit 2021-01-28T04:02:58.619419+0000 mon.a (mon.0) 1556 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-35"}]': finished 2021-01-28T04:02:59.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:58 smithi162 bash[9856]: cluster 2021-01-28T04:02:58.619702+0000 mon.a (mon.0) 1557 : cluster [DBG] osdmap e220: 8 total, 8 up, 8 in 2021-01-28T04:02:59.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:58 smithi100 bash[9834]: cluster 2021-01-28T04:02:57.603204+0000 mgr.y (mgr.14138) 607 : cluster [DBG] pgmap v578: 236 pgs: 6 creating+peering, 15 unknown, 215 active+clean; 26 KiB data, 329 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:02:59.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:58 smithi100 bash[9834]: audit 2021-01-28T04:02:57.618633+0000 mon.a (mon.0) 1548 : audit [INF] from='client.? 172.21.15.100:0/2331822136' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32195-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32195-2"}]': finished 2021-01-28T04:02:59.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:58 smithi100 bash[9834]: audit 2021-01-28T04:02:57.618791+0000 mon.a (mon.0) 1549 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-27"}]': finished 2021-01-28T04:02:59.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:58 smithi100 bash[9834]: audit 2021-01-28T04:02:57.618882+0000 mon.a (mon.0) 1550 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-35"}]': finished 2021-01-28T04:02:59.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:58 smithi100 bash[9834]: cluster 2021-01-28T04:02:57.618980+0000 mon.a (mon.0) 1551 : cluster [DBG] osdmap e219: 8 total, 8 up, 8 in 2021-01-28T04:02:59.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:58 smithi100 bash[9834]: audit 2021-01-28T04:02:57.620651+0000 mon.c (mon.1) 257 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-27", "mode": "writeback"}]: dispatch 2021-01-28T04:02:59.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:58 smithi100 bash[9834]: audit 2021-01-28T04:02:57.621104+0000 mon.c (mon.1) 258 : audit [INF] from='client.? 172.21.15.100:0/841491844' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-35"}]: dispatch 2021-01-28T04:02:59.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:58 smithi100 bash[9834]: audit 2021-01-28T04:02:57.622171+0000 mon.a (mon.0) 1552 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-27", "mode": "writeback"}]: dispatch 2021-01-28T04:02:59.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:58 smithi100 bash[9834]: audit 2021-01-28T04:02:57.623065+0000 mon.a (mon.0) 1553 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-35"}]: dispatch 2021-01-28T04:02:59.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:58 smithi100 bash[9834]: cluster 2021-01-28T04:02:58.610415+0000 mon.a (mon.0) 1554 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:02:59.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:58 smithi100 bash[9834]: audit 2021-01-28T04:02:58.619162+0000 mon.a (mon.0) 1555 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-27", "mode": "writeback"}]': finished 2021-01-28T04:02:59.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:58 smithi100 bash[9834]: audit 2021-01-28T04:02:58.619419+0000 mon.a (mon.0) 1556 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-35"}]': finished 2021-01-28T04:02:59.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:58 smithi100 bash[9834]: cluster 2021-01-28T04:02:58.619702+0000 mon.a (mon.0) 1557 : cluster [DBG] osdmap e220: 8 total, 8 up, 8 in 2021-01-28T04:02:59.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:58 smithi100 bash[13549]: cluster 2021-01-28T04:02:57.603204+0000 mgr.y (mgr.14138) 607 : cluster [DBG] pgmap v578: 236 pgs: 6 creating+peering, 15 unknown, 215 active+clean; 26 KiB data, 329 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:02:59.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:58 smithi100 bash[13549]: audit 2021-01-28T04:02:57.618633+0000 mon.a (mon.0) 1548 : audit [INF] from='client.? 172.21.15.100:0/2331822136' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32195-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32195-2"}]': finished 2021-01-28T04:02:59.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:58 smithi100 bash[13549]: audit 2021-01-28T04:02:57.618791+0000 mon.a (mon.0) 1549 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-27"}]': finished 2021-01-28T04:02:59.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:58 smithi100 bash[13549]: audit 2021-01-28T04:02:57.618882+0000 mon.a (mon.0) 1550 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-35"}]': finished 2021-01-28T04:02:59.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:58 smithi100 bash[13549]: cluster 2021-01-28T04:02:57.618980+0000 mon.a (mon.0) 1551 : cluster [DBG] osdmap e219: 8 total, 8 up, 8 in 2021-01-28T04:02:59.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:58 smithi100 bash[13549]: audit 2021-01-28T04:02:57.620651+0000 mon.c (mon.1) 257 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-27", "mode": "writeback"}]: dispatch 2021-01-28T04:02:59.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:58 smithi100 bash[13549]: audit 2021-01-28T04:02:57.621104+0000 mon.c (mon.1) 258 : audit [INF] from='client.? 172.21.15.100:0/841491844' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-35"}]: dispatch 2021-01-28T04:02:59.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:58 smithi100 bash[13549]: audit 2021-01-28T04:02:57.622171+0000 mon.a (mon.0) 1552 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-27", "mode": "writeback"}]: dispatch 2021-01-28T04:02:59.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:58 smithi100 bash[13549]: audit 2021-01-28T04:02:57.623065+0000 mon.a (mon.0) 1553 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-35"}]: dispatch 2021-01-28T04:02:59.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:58 smithi100 bash[13549]: cluster 2021-01-28T04:02:58.610415+0000 mon.a (mon.0) 1554 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:02:59.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:58 smithi100 bash[13549]: audit 2021-01-28T04:02:58.619162+0000 mon.a (mon.0) 1555 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-27", "mode": "writeback"}]': finished 2021-01-28T04:02:59.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:58 smithi100 bash[13549]: audit 2021-01-28T04:02:58.619419+0000 mon.a (mon.0) 1556 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-35"}]': finished 2021-01-28T04:02:59.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:58 smithi100 bash[13549]: cluster 2021-01-28T04:02:58.619702+0000 mon.a (mon.0) 1557 : cluster [DBG] osdmap e220: 8 total, 8 up, 8 in 2021-01-28T04:03:00.014 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 04:02:59 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T04:03:00.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:59 smithi162 bash[9856]: audit 2021-01-28T04:02:58.625561+0000 mon.a (mon.0) 1558 : audit [INF] from='client.? 172.21.15.100:0/1597036295' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-43"}]: dispatch 2021-01-28T04:03:00.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:59 smithi162 bash[9856]: audit 2021-01-28T04:02:58.649087+0000 mon.c (mon.1) 259 : audit [INF] from='client.? 172.21.15.100:0/3747777518' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-36"}]: dispatch 2021-01-28T04:03:00.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:59 smithi162 bash[9856]: audit 2021-01-28T04:02:58.649437+0000 mon.a (mon.0) 1559 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-36"}]: dispatch 2021-01-28T04:03:00.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:59 smithi162 bash[9856]: audit 2021-01-28T04:02:58.651458+0000 mon.c (mon.1) 260 : audit [INF] from='client.? 172.21.15.100:0/3747777518' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-36"}]: dispatch 2021-01-28T04:03:00.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:59 smithi162 bash[9856]: audit 2021-01-28T04:02:58.651841+0000 mon.a (mon.0) 1560 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-36"}]: dispatch 2021-01-28T04:03:00.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:59 smithi162 bash[9856]: audit 2021-01-28T04:02:58.652637+0000 mon.c (mon.1) 261 : audit [INF] from='client.? 172.21.15.100:0/3747777518' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:00.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:59 smithi162 bash[9856]: audit 2021-01-28T04:02:58.653023+0000 mon.a (mon.0) 1561 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:00.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:59 smithi162 bash[9856]: audit 2021-01-28T04:02:59.620999+0000 mon.a (mon.0) 1562 : audit [INF] from='client.? 172.21.15.100:0/1597036295' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-43"}]': finished 2021-01-28T04:03:00.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:59 smithi162 bash[9856]: audit 2021-01-28T04:02:59.621120+0000 mon.a (mon.0) 1563 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:03:00.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:59 smithi162 bash[9856]: cluster 2021-01-28T04:02:59.621293+0000 mon.a (mon.0) 1564 : cluster [DBG] osdmap e221: 8 total, 8 up, 8 in 2021-01-28T04:03:00.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:59 smithi162 bash[9856]: audit 2021-01-28T04:02:59.622659+0000 mon.a (mon.0) 1565 : audit [INF] from='client.? 172.21.15.100:0/1597036295' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-43"}]: dispatch 2021-01-28T04:03:00.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:59 smithi162 bash[9856]: audit 2021-01-28T04:02:59.622833+0000 mon.c (mon.1) 262 : audit [INF] from='client.? 172.21.15.100:0/3747777518' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-36"}]: dispatch 2021-01-28T04:03:00.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:59 smithi162 bash[9856]: audit 2021-01-28T04:02:59.624064+0000 mon.a (mon.0) 1566 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-36"}]: dispatch 2021-01-28T04:03:00.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:02:59 smithi162 bash[9856]: audit 2021-01-28T04:02:59.624813+0000 mon.a (mon.0) 1567 : audit [INF] from='client.? 172.21.15.100:0/2331822136' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32195-2"}]: dispatch 2021-01-28T04:03:00.079 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 04:02:59 smithi100 bash[10061]: debug 2021-01-28T04:02:59.847+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:03:00.079 INFO:journalctl@ceph.osd.3.smithi100.stdout:Jan 28 04:02:59 smithi100 bash[24240]: debug 2021-01-28T04:02:59.643+0000 7ff10b99e700 -1 osd.3 pg_epoch: 221 pg[65.1b( v 217'37 (0'0,217'37] local-lis/les=87/88 n=4 ec=87/87 lis/c=87/87 les/c/f=88/88/0 sis=87) [3,5,1] r=0 lpr=87 crt=217'37 lcod 216'35 mlcod 216'35 active+clean+snaptrim trimq=[11~1]] removing snap head 2021-01-28T04:03:00.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:59 smithi100 bash[9834]: audit 2021-01-28T04:02:58.625561+0000 mon.a (mon.0) 1558 : audit [INF] from='client.? 172.21.15.100:0/1597036295' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-43"}]: dispatch 2021-01-28T04:03:00.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:59 smithi100 bash[9834]: audit 2021-01-28T04:02:58.649087+0000 mon.c (mon.1) 259 : audit [INF] from='client.? 172.21.15.100:0/3747777518' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-36"}]: dispatch 2021-01-28T04:03:00.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:59 smithi100 bash[9834]: audit 2021-01-28T04:02:58.649437+0000 mon.a (mon.0) 1559 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-36"}]: dispatch 2021-01-28T04:03:00.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:59 smithi100 bash[9834]: audit 2021-01-28T04:02:58.651458+0000 mon.c (mon.1) 260 : audit [INF] from='client.? 172.21.15.100:0/3747777518' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-36"}]: dispatch 2021-01-28T04:03:00.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:59 smithi100 bash[9834]: audit 2021-01-28T04:02:58.651841+0000 mon.a (mon.0) 1560 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-36"}]: dispatch 2021-01-28T04:03:00.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:59 smithi100 bash[9834]: audit 2021-01-28T04:02:58.652637+0000 mon.c (mon.1) 261 : audit [INF] from='client.? 172.21.15.100:0/3747777518' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:00.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:59 smithi100 bash[9834]: audit 2021-01-28T04:02:58.653023+0000 mon.a (mon.0) 1561 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:00.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:59 smithi100 bash[9834]: audit 2021-01-28T04:02:59.620999+0000 mon.a (mon.0) 1562 : audit [INF] from='client.? 172.21.15.100:0/1597036295' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-43"}]': finished 2021-01-28T04:03:00.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:59 smithi100 bash[9834]: audit 2021-01-28T04:02:59.621120+0000 mon.a (mon.0) 1563 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:03:00.084 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:59 smithi100 bash[9834]: cluster 2021-01-28T04:02:59.621293+0000 mon.a (mon.0) 1564 : cluster [DBG] osdmap e221: 8 total, 8 up, 8 in 2021-01-28T04:03:00.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:59 smithi100 bash[9834]: audit 2021-01-28T04:02:59.622659+0000 mon.a (mon.0) 1565 : audit [INF] from='client.? 172.21.15.100:0/1597036295' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-43"}]: dispatch 2021-01-28T04:03:00.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:59 smithi100 bash[9834]: audit 2021-01-28T04:02:59.622833+0000 mon.c (mon.1) 262 : audit [INF] from='client.? 172.21.15.100:0/3747777518' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-36"}]: dispatch 2021-01-28T04:03:00.085 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:59 smithi100 bash[9834]: audit 2021-01-28T04:02:59.624064+0000 mon.a (mon.0) 1566 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-36"}]: dispatch 2021-01-28T04:03:00.086 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:02:59 smithi100 bash[9834]: audit 2021-01-28T04:02:59.624813+0000 mon.a (mon.0) 1567 : audit [INF] from='client.? 172.21.15.100:0/2331822136' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32195-2"}]: dispatch 2021-01-28T04:03:00.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:59 smithi100 bash[13549]: audit 2021-01-28T04:02:58.625561+0000 mon.a (mon.0) 1558 : audit [INF] from='client.? 172.21.15.100:0/1597036295' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-43"}]: dispatch 2021-01-28T04:03:00.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:59 smithi100 bash[13549]: audit 2021-01-28T04:02:58.649087+0000 mon.c (mon.1) 259 : audit [INF] from='client.? 172.21.15.100:0/3747777518' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-36"}]: dispatch 2021-01-28T04:03:00.087 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:59 smithi100 bash[13549]: audit 2021-01-28T04:02:58.649437+0000 mon.a (mon.0) 1559 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-36"}]: dispatch 2021-01-28T04:03:00.087 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:59 smithi100 bash[13549]: audit 2021-01-28T04:02:58.651458+0000 mon.c (mon.1) 260 : audit [INF] from='client.? 172.21.15.100:0/3747777518' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-36"}]: dispatch 2021-01-28T04:03:00.087 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:59 smithi100 bash[13549]: audit 2021-01-28T04:02:58.651841+0000 mon.a (mon.0) 1560 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-36"}]: dispatch 2021-01-28T04:03:00.087 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:59 smithi100 bash[13549]: audit 2021-01-28T04:02:58.652637+0000 mon.c (mon.1) 261 : audit [INF] from='client.? 172.21.15.100:0/3747777518' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:00.088 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:59 smithi100 bash[13549]: audit 2021-01-28T04:02:58.653023+0000 mon.a (mon.0) 1561 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:00.088 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:59 smithi100 bash[13549]: audit 2021-01-28T04:02:59.620999+0000 mon.a (mon.0) 1562 : audit [INF] from='client.? 172.21.15.100:0/1597036295' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-43"}]': finished 2021-01-28T04:03:00.088 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:59 smithi100 bash[13549]: audit 2021-01-28T04:02:59.621120+0000 mon.a (mon.0) 1563 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:03:00.088 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:59 smithi100 bash[13549]: cluster 2021-01-28T04:02:59.621293+0000 mon.a (mon.0) 1564 : cluster [DBG] osdmap e221: 8 total, 8 up, 8 in 2021-01-28T04:03:00.088 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:59 smithi100 bash[13549]: audit 2021-01-28T04:02:59.622659+0000 mon.a (mon.0) 1565 : audit [INF] from='client.? 172.21.15.100:0/1597036295' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-43"}]: dispatch 2021-01-28T04:03:00.089 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:59 smithi100 bash[13549]: audit 2021-01-28T04:02:59.622833+0000 mon.c (mon.1) 262 : audit [INF] from='client.? 172.21.15.100:0/3747777518' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-36"}]: dispatch 2021-01-28T04:03:00.089 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:59 smithi100 bash[13549]: audit 2021-01-28T04:02:59.624064+0000 mon.a (mon.0) 1566 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-36"}]: dispatch 2021-01-28T04:03:00.089 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:02:59 smithi100 bash[13549]: audit 2021-01-28T04:02:59.624813+0000 mon.a (mon.0) 1567 : audit [INF] from='client.? 172.21.15.100:0/2331822136' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32195-2"}]: dispatch 2021-01-28T04:03:01.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:01 smithi100 bash[9834]: cluster 2021-01-28T04:02:59.604136+0000 mgr.y (mgr.14138) 608 : cluster [DBG] pgmap v581: 236 pgs: 2 creating+peering, 4 unknown, 230 active+clean; 26 KiB data, 314 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 6 op/s 2021-01-28T04:03:01.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:01 smithi100 bash[9834]: audit 2021-01-28T04:02:59.677525+0000 mon.c (mon.1) 263 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:03:01.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:01 smithi100 bash[9834]: audit 2021-01-28T04:02:59.678054+0000 mon.a (mon.0) 1568 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:03:01.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:01 smithi100 bash[9834]: audit 2021-01-28T04:02:59.851494+0000 mgr.y (mgr.14138) 609 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:03:01.329 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:01 smithi100 bash[13549]: cluster 2021-01-28T04:02:59.604136+0000 mgr.y (mgr.14138) 608 : cluster [DBG] pgmap v581: 236 pgs: 2 creating+peering, 4 unknown, 230 active+clean; 26 KiB data, 314 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 6 op/s 2021-01-28T04:03:01.329 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:01 smithi100 bash[13549]: audit 2021-01-28T04:02:59.677525+0000 mon.c (mon.1) 263 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:03:01.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:01 smithi100 bash[13549]: audit 2021-01-28T04:02:59.678054+0000 mon.a (mon.0) 1568 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:03:01.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:01 smithi100 bash[13549]: audit 2021-01-28T04:02:59.851494+0000 mgr.y (mgr.14138) 609 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:03:01.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:01 smithi162 bash[9856]: cluster 2021-01-28T04:02:59.604136+0000 mgr.y (mgr.14138) 608 : cluster [DBG] pgmap v581: 236 pgs: 2 creating+peering, 4 unknown, 230 active+clean; 26 KiB data, 314 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 6 op/s 2021-01-28T04:03:01.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:01 smithi162 bash[9856]: audit 2021-01-28T04:02:59.677525+0000 mon.c (mon.1) 263 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:03:01.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:01 smithi162 bash[9856]: audit 2021-01-28T04:02:59.678054+0000 mon.a (mon.0) 1568 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:03:01.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:01 smithi162 bash[9856]: audit 2021-01-28T04:02:59.851494+0000 mgr.y (mgr.14138) 609 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:03:02.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:02 smithi162 bash[9856]: audit 2021-01-28T04:03:00.627474+0000 mon.a (mon.0) 1569 : audit [INF] from='client.? 172.21.15.100:0/1597036295' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-43"}]': finished 2021-01-28T04:03:02.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:02 smithi162 bash[9856]: audit 2021-01-28T04:03:01.051864+0000 mon.a (mon.0) 1570 : audit [INF] from='client.? 172.21.15.100:0/2331822136' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32195-2"}]': finished 2021-01-28T04:03:02.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:02 smithi162 bash[9856]: audit 2021-01-28T04:03:01.052084+0000 mon.a (mon.0) 1571 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:03:02.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:02 smithi162 bash[9856]: cluster 2021-01-28T04:03:01.052270+0000 mon.a (mon.0) 1572 : cluster [DBG] osdmap e222: 8 total, 8 up, 8 in 2021-01-28T04:03:02.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:02 smithi162 bash[9856]: audit 2021-01-28T04:03:01.053065+0000 mon.c (mon.1) 264 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-27"}]: dispatch 2021-01-28T04:03:02.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:02 smithi162 bash[9856]: audit 2021-01-28T04:03:01.055048+0000 mon.a (mon.0) 1573 : audit [INF] from='client.? 172.21.15.100:0/2331822136' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32195-2"}]: dispatch 2021-01-28T04:03:02.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:02 smithi162 bash[9856]: audit 2021-01-28T04:03:01.055847+0000 mon.a (mon.0) 1574 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-27"}]: dispatch 2021-01-28T04:03:02.518 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:02 smithi162 bash[9856]: audit 2021-01-28T04:03:01.079252+0000 mon.a (mon.0) 1575 : audit [INF] from='client.? 172.21.15.100:0/3487941774' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-44"}]: dispatch 2021-01-28T04:03:02.518 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:02 smithi162 bash[9856]: audit 2021-01-28T04:03:01.081458+0000 mon.a (mon.0) 1576 : audit [INF] from='client.? 172.21.15.100:0/3487941774' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-44"}]: dispatch 2021-01-28T04:03:02.519 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:02 smithi162 bash[9856]: audit 2021-01-28T04:03:01.082013+0000 mon.a (mon.0) 1577 : audit [INF] from='client.? 172.21.15.100:0/3487941774' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-44", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:02.519 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:02 smithi162 bash[9856]: cluster 2021-01-28T04:03:01.619803+0000 mon.a (mon.0) 1578 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:03:02.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:02 smithi162 bash[9856]: audit 2021-01-28T04:03:01.628187+0000 mon.a (mon.0) 1579 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-36"}]': finished 2021-01-28T04:03:02.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:02 smithi162 bash[9856]: audit 2021-01-28T04:03:01.628346+0000 mon.a (mon.0) 1580 : audit [INF] from='client.? 172.21.15.100:0/2331822136' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32195-2"}]': finished 2021-01-28T04:03:02.520 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:02 smithi162 bash[9856]: audit 2021-01-28T04:03:01.628446+0000 mon.a (mon.0) 1581 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-27"}]': finished 2021-01-28T04:03:02.521 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:02 smithi162 bash[9856]: audit 2021-01-28T04:03:01.628562+0000 mon.a (mon.0) 1582 : audit [INF] from='client.? 172.21.15.100:0/3487941774' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-44", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:03:02.521 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:02 smithi162 bash[9856]: cluster 2021-01-28T04:03:01.628672+0000 mon.a (mon.0) 1583 : cluster [DBG] osdmap e223: 8 total, 8 up, 8 in 2021-01-28T04:03:02.522 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:02 smithi162 bash[9856]: audit 2021-01-28T04:03:01.630891+0000 mon.a (mon.0) 1584 : audit [INF] from='client.? 172.21.15.100:0/3487941774' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-44", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-44"}]: dispatch 2021-01-28T04:03:02.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:02 smithi100 bash[9834]: audit 2021-01-28T04:03:00.627474+0000 mon.a (mon.0) 1569 : audit [INF] from='client.? 172.21.15.100:0/1597036295' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-43"}]': finished 2021-01-28T04:03:02.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:02 smithi100 bash[9834]: audit 2021-01-28T04:03:01.051864+0000 mon.a (mon.0) 1570 : audit [INF] from='client.? 172.21.15.100:0/2331822136' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32195-2"}]': finished 2021-01-28T04:03:02.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:02 smithi100 bash[9834]: audit 2021-01-28T04:03:01.052084+0000 mon.a (mon.0) 1571 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:03:02.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:02 smithi100 bash[9834]: cluster 2021-01-28T04:03:01.052270+0000 mon.a (mon.0) 1572 : cluster [DBG] osdmap e222: 8 total, 8 up, 8 in 2021-01-28T04:03:02.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:02 smithi100 bash[9834]: audit 2021-01-28T04:03:01.053065+0000 mon.c (mon.1) 264 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-27"}]: dispatch 2021-01-28T04:03:02.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:02 smithi100 bash[9834]: audit 2021-01-28T04:03:01.055048+0000 mon.a (mon.0) 1573 : audit [INF] from='client.? 172.21.15.100:0/2331822136' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32195-2"}]: dispatch 2021-01-28T04:03:02.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:02 smithi100 bash[9834]: audit 2021-01-28T04:03:01.055847+0000 mon.a (mon.0) 1574 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-27"}]: dispatch 2021-01-28T04:03:02.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:02 smithi100 bash[9834]: audit 2021-01-28T04:03:01.079252+0000 mon.a (mon.0) 1575 : audit [INF] from='client.? 172.21.15.100:0/3487941774' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-44"}]: dispatch 2021-01-28T04:03:02.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:02 smithi100 bash[9834]: audit 2021-01-28T04:03:01.081458+0000 mon.a (mon.0) 1576 : audit [INF] from='client.? 172.21.15.100:0/3487941774' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-44"}]: dispatch 2021-01-28T04:03:02.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:02 smithi100 bash[9834]: audit 2021-01-28T04:03:01.082013+0000 mon.a (mon.0) 1577 : audit [INF] from='client.? 172.21.15.100:0/3487941774' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-44", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:02.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:02 smithi100 bash[9834]: cluster 2021-01-28T04:03:01.619803+0000 mon.a (mon.0) 1578 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:03:02.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:02 smithi100 bash[9834]: audit 2021-01-28T04:03:01.628187+0000 mon.a (mon.0) 1579 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-36"}]': finished 2021-01-28T04:03:02.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:02 smithi100 bash[9834]: audit 2021-01-28T04:03:01.628346+0000 mon.a (mon.0) 1580 : audit [INF] from='client.? 172.21.15.100:0/2331822136' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32195-2"}]': finished 2021-01-28T04:03:02.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:02 smithi100 bash[9834]: audit 2021-01-28T04:03:01.628446+0000 mon.a (mon.0) 1581 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-27"}]': finished 2021-01-28T04:03:02.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:02 smithi100 bash[9834]: audit 2021-01-28T04:03:01.628562+0000 mon.a (mon.0) 1582 : audit [INF] from='client.? 172.21.15.100:0/3487941774' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-44", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:03:02.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:02 smithi100 bash[9834]: cluster 2021-01-28T04:03:01.628672+0000 mon.a (mon.0) 1583 : cluster [DBG] osdmap e223: 8 total, 8 up, 8 in 2021-01-28T04:03:02.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:02 smithi100 bash[9834]: audit 2021-01-28T04:03:01.630891+0000 mon.a (mon.0) 1584 : audit [INF] from='client.? 172.21.15.100:0/3487941774' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-44", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-44"}]: dispatch 2021-01-28T04:03:02.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:02 smithi100 bash[13549]: audit 2021-01-28T04:03:00.627474+0000 mon.a (mon.0) 1569 : audit [INF] from='client.? 172.21.15.100:0/1597036295' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-43"}]': finished 2021-01-28T04:03:02.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:02 smithi100 bash[13549]: audit 2021-01-28T04:03:01.051864+0000 mon.a (mon.0) 1570 : audit [INF] from='client.? 172.21.15.100:0/2331822136' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32195-2"}]': finished 2021-01-28T04:03:02.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:02 smithi100 bash[13549]: audit 2021-01-28T04:03:01.052084+0000 mon.a (mon.0) 1571 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:03:02.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:02 smithi100 bash[13549]: cluster 2021-01-28T04:03:01.052270+0000 mon.a (mon.0) 1572 : cluster [DBG] osdmap e222: 8 total, 8 up, 8 in 2021-01-28T04:03:02.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:02 smithi100 bash[13549]: audit 2021-01-28T04:03:01.053065+0000 mon.c (mon.1) 264 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-27"}]: dispatch 2021-01-28T04:03:02.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:02 smithi100 bash[13549]: audit 2021-01-28T04:03:01.055048+0000 mon.a (mon.0) 1573 : audit [INF] from='client.? 172.21.15.100:0/2331822136' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32195-2"}]: dispatch 2021-01-28T04:03:02.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:02 smithi100 bash[13549]: audit 2021-01-28T04:03:01.055847+0000 mon.a (mon.0) 1574 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-27"}]: dispatch 2021-01-28T04:03:02.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:02 smithi100 bash[13549]: audit 2021-01-28T04:03:01.079252+0000 mon.a (mon.0) 1575 : audit [INF] from='client.? 172.21.15.100:0/3487941774' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-44"}]: dispatch 2021-01-28T04:03:02.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:02 smithi100 bash[13549]: audit 2021-01-28T04:03:01.081458+0000 mon.a (mon.0) 1576 : audit [INF] from='client.? 172.21.15.100:0/3487941774' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-44"}]: dispatch 2021-01-28T04:03:02.585 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:02 smithi100 bash[13549]: audit 2021-01-28T04:03:01.082013+0000 mon.a (mon.0) 1577 : audit [INF] from='client.? 172.21.15.100:0/3487941774' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-44", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:02.585 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:02 smithi100 bash[13549]: cluster 2021-01-28T04:03:01.619803+0000 mon.a (mon.0) 1578 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:03:02.585 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:02 smithi100 bash[13549]: audit 2021-01-28T04:03:01.628187+0000 mon.a (mon.0) 1579 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-36"}]': finished 2021-01-28T04:03:02.585 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:02 smithi100 bash[13549]: audit 2021-01-28T04:03:01.628346+0000 mon.a (mon.0) 1580 : audit [INF] from='client.? 172.21.15.100:0/2331822136' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32195-2"}]': finished 2021-01-28T04:03:02.586 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:02 smithi100 bash[13549]: audit 2021-01-28T04:03:01.628446+0000 mon.a (mon.0) 1581 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-27"}]': finished 2021-01-28T04:03:02.586 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:02 smithi100 bash[13549]: audit 2021-01-28T04:03:01.628562+0000 mon.a (mon.0) 1582 : audit [INF] from='client.? 172.21.15.100:0/3487941774' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-44", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:03:02.586 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:02 smithi100 bash[13549]: cluster 2021-01-28T04:03:01.628672+0000 mon.a (mon.0) 1583 : cluster [DBG] osdmap e223: 8 total, 8 up, 8 in 2021-01-28T04:03:02.586 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:02 smithi100 bash[13549]: audit 2021-01-28T04:03:01.630891+0000 mon.a (mon.0) 1584 : audit [INF] from='client.? 172.21.15.100:0/3487941774' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-44", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-44"}]: dispatch 2021-01-28T04:03:03.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:03 smithi162 bash[9856]: cluster 2021-01-28T04:03:01.605096+0000 mgr.y (mgr.14138) 610 : cluster [DBG] pgmap v584: 228 pgs: 228 active+clean; 26 KiB data, 314 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-01-28T04:03:03.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:03 smithi162 bash[9856]: cluster 2021-01-28T04:03:03.057267+0000 mon.a (mon.0) 1585 : cluster [DBG] osdmap e224: 8 total, 8 up, 8 in 2021-01-28T04:03:03.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:03 smithi162 bash[9856]: audit 2021-01-28T04:03:03.059326+0000 mon.a (mon.0) 1586 : audit [INF] from='client.? 172.21.15.100:0/2943765805' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32195-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:03.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:03 smithi100 bash[9834]: cluster 2021-01-28T04:03:01.605096+0000 mgr.y (mgr.14138) 610 : cluster [DBG] pgmap v584: 228 pgs: 228 active+clean; 26 KiB data, 314 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-01-28T04:03:03.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:03 smithi100 bash[9834]: cluster 2021-01-28T04:03:03.057267+0000 mon.a (mon.0) 1585 : cluster [DBG] osdmap e224: 8 total, 8 up, 8 in 2021-01-28T04:03:03.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:03 smithi100 bash[9834]: audit 2021-01-28T04:03:03.059326+0000 mon.a (mon.0) 1586 : audit [INF] from='client.? 172.21.15.100:0/2943765805' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32195-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:03.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:03 smithi100 bash[13549]: cluster 2021-01-28T04:03:01.605096+0000 mgr.y (mgr.14138) 610 : cluster [DBG] pgmap v584: 228 pgs: 228 active+clean; 26 KiB data, 314 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2021-01-28T04:03:03.830 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:03 smithi100 bash[13549]: cluster 2021-01-28T04:03:03.057267+0000 mon.a (mon.0) 1585 : cluster [DBG] osdmap e224: 8 total, 8 up, 8 in 2021-01-28T04:03:03.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:03 smithi100 bash[13549]: audit 2021-01-28T04:03:03.059326+0000 mon.a (mon.0) 1586 : audit [INF] from='client.? 172.21.15.100:0/2943765805' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32195-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:04.651 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: 14 0 2021-01-28T04:03:04.652 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: 0 0 2021-01-28T04:03:04.652 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: 15 0 2021-01-28T04:03:04.653 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: 11 0 2021-01-28T04:03:04.653 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: 5 0 2021-01-28T04:03:04.653 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: 8 0 2021-01-28T04:03:04.654 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: 6 0 2021-01-28T04:03:04.654 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: 3 0 2021-01-28T04:03:04.655 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: 4 0 2021-01-28T04:03:04.655 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: 12 0 2021-01-28T04:03:04.655 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: 9 0 2021-01-28T04:03:04.656 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: 2 0 2021-01-28T04:03:04.656 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2021-01-28T04:03:04.656 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsStart (124 ms) 2021-01-28T04:03:04.657 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: [----------] 3 tests from LibRadosListEC (1252 ms total) 2021-01-28T04:03:04.657 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: 2021-01-28T04:03:04.658 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: [----------] 1 test from LibRadosListNP 2021-01-28T04:03:04.658 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: [ RUN ] LibRadosListNP.ListObjectsError 2021-01-28T04:03:04.658 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: [ OK ] LibRadosListNP.ListObjectsError (3011 ms) 2021-01-28T04:03:04.659 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: [----------] 1 test from LibRadosListNP (3011 ms total) 2021-01-28T04:03:04.659 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: 2021-01-28T04:03:04.660 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: [----------] Global test environment tear-down 2021-01-28T04:03:04.660 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: [==========] 10 tests from 3 test suites ran. (171207 ms total) 2021-01-28T04:03:04.660 INFO:tasks.workunit.client.0.smithi100.stdout: api_list: [ PASSED ] 10 tests. 2021-01-28T04:03:05.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:04 smithi162 bash[9856]: cluster 2021-01-28T04:03:03.606410+0000 mgr.y (mgr.14138) 611 : cluster [DBG] pgmap v587: 236 pgs: 8 creating+peering, 30 unknown, 198 active+clean; 27 KiB data, 320 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:03:05.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:04 smithi162 bash[9856]: audit 2021-01-28T04:03:03.636077+0000 mon.a (mon.0) 1587 : audit [INF] from='client.? 172.21.15.100:0/3487941774' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-44", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-44"}]': finished 2021-01-28T04:03:05.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:04 smithi162 bash[9856]: audit 2021-01-28T04:03:03.636701+0000 mon.a (mon.0) 1588 : audit [INF] from='client.? 172.21.15.100:0/2943765805' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32195-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:03:05.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:04 smithi162 bash[9856]: cluster 2021-01-28T04:03:03.636980+0000 mon.a (mon.0) 1589 : cluster [DBG] osdmap e225: 8 total, 8 up, 8 in 2021-01-28T04:03:05.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:04 smithi162 bash[9856]: audit 2021-01-28T04:03:03.641274+0000 mon.c (mon.1) 265 : audit [INF] from='client.? 172.21.15.100:0/3747777518' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-36"}]: dispatch 2021-01-28T04:03:05.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:04 smithi162 bash[9856]: audit 2021-01-28T04:03:03.641568+0000 mon.c (mon.1) 266 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:05.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:04 smithi162 bash[9856]: audit 2021-01-28T04:03:03.648471+0000 mon.a (mon.0) 1590 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-36"}]: dispatch 2021-01-28T04:03:05.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:04 smithi162 bash[9856]: audit 2021-01-28T04:03:03.648907+0000 mon.a (mon.0) 1591 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:05.018 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:04 smithi162 bash[9856]: audit 2021-01-28T04:03:03.679599+0000 mon.a (mon.0) 1592 : audit [INF] from='client.? 172.21.15.100:0/2943765805' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi100-32195-3","pool2":"test-rados-api-smithi100-32195-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2021-01-28T04:03:05.018 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:04 smithi162 bash[9856]: cluster 2021-01-28T04:03:04.566742+0000 mon.a (mon.0) 1593 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:03:05.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:04 smithi100 bash[9834]: cluster 2021-01-28T04:03:03.606410+0000 mgr.y (mgr.14138) 611 : cluster [DBG] pgmap v587: 236 pgs: 8 creating+peering, 30 unknown, 198 active+clean; 27 KiB data, 320 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:03:05.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:04 smithi100 bash[9834]: audit 2021-01-28T04:03:03.636077+0000 mon.a (mon.0) 1587 : audit [INF] from='client.? 172.21.15.100:0/3487941774' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-44", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-44"}]': finished 2021-01-28T04:03:05.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:04 smithi100 bash[9834]: audit 2021-01-28T04:03:03.636701+0000 mon.a (mon.0) 1588 : audit [INF] from='client.? 172.21.15.100:0/2943765805' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32195-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:03:05.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:04 smithi100 bash[9834]: cluster 2021-01-28T04:03:03.636980+0000 mon.a (mon.0) 1589 : cluster [DBG] osdmap e225: 8 total, 8 up, 8 in 2021-01-28T04:03:05.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:04 smithi100 bash[9834]: audit 2021-01-28T04:03:03.641274+0000 mon.c (mon.1) 265 : audit [INF] from='client.? 172.21.15.100:0/3747777518' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-36"}]: dispatch 2021-01-28T04:03:05.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:04 smithi100 bash[9834]: audit 2021-01-28T04:03:03.641568+0000 mon.c (mon.1) 266 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:05.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:04 smithi100 bash[9834]: audit 2021-01-28T04:03:03.648471+0000 mon.a (mon.0) 1590 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-36"}]: dispatch 2021-01-28T04:03:05.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:04 smithi100 bash[9834]: audit 2021-01-28T04:03:03.648907+0000 mon.a (mon.0) 1591 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:05.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:04 smithi100 bash[9834]: audit 2021-01-28T04:03:03.679599+0000 mon.a (mon.0) 1592 : audit [INF] from='client.? 172.21.15.100:0/2943765805' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi100-32195-3","pool2":"test-rados-api-smithi100-32195-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2021-01-28T04:03:05.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:04 smithi100 bash[9834]: cluster 2021-01-28T04:03:04.566742+0000 mon.a (mon.0) 1593 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:03:05.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:04 smithi100 bash[13549]: cluster 2021-01-28T04:03:03.606410+0000 mgr.y (mgr.14138) 611 : cluster [DBG] pgmap v587: 236 pgs: 8 creating+peering, 30 unknown, 198 active+clean; 27 KiB data, 320 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:03:05.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:04 smithi100 bash[13549]: audit 2021-01-28T04:03:03.636077+0000 mon.a (mon.0) 1587 : audit [INF] from='client.? 172.21.15.100:0/3487941774' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-44", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-44"}]': finished 2021-01-28T04:03:05.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:04 smithi100 bash[13549]: audit 2021-01-28T04:03:03.636701+0000 mon.a (mon.0) 1588 : audit [INF] from='client.? 172.21.15.100:0/2943765805' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32195-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:03:05.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:04 smithi100 bash[13549]: cluster 2021-01-28T04:03:03.636980+0000 mon.a (mon.0) 1589 : cluster [DBG] osdmap e225: 8 total, 8 up, 8 in 2021-01-28T04:03:05.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:04 smithi100 bash[13549]: audit 2021-01-28T04:03:03.641274+0000 mon.c (mon.1) 265 : audit [INF] from='client.? 172.21.15.100:0/3747777518' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-36"}]: dispatch 2021-01-28T04:03:05.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:04 smithi100 bash[13549]: audit 2021-01-28T04:03:03.641568+0000 mon.c (mon.1) 266 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:05.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:04 smithi100 bash[13549]: audit 2021-01-28T04:03:03.648471+0000 mon.a (mon.0) 1590 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-36"}]: dispatch 2021-01-28T04:03:05.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:04 smithi100 bash[13549]: audit 2021-01-28T04:03:03.648907+0000 mon.a (mon.0) 1591 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:05.087 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:04 smithi100 bash[13549]: audit 2021-01-28T04:03:03.679599+0000 mon.a (mon.0) 1592 : audit [INF] from='client.? 172.21.15.100:0/2943765805' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi100-32195-3","pool2":"test-rados-api-smithi100-32195-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2021-01-28T04:03:05.087 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:04 smithi100 bash[13549]: cluster 2021-01-28T04:03:04.566742+0000 mon.a (mon.0) 1593 : cluster [WRN] Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:03:06.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:05 smithi162 bash[9856]: audit 2021-01-28T04:03:04.639626+0000 mon.a (mon.0) 1594 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-36"}]': finished 2021-01-28T04:03:06.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:05 smithi162 bash[9856]: audit 2021-01-28T04:03:04.639745+0000 mon.a (mon.0) 1595 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-29","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:03:06.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:05 smithi162 bash[9856]: audit 2021-01-28T04:03:04.639979+0000 mon.a (mon.0) 1596 : audit [INF] from='client.? 172.21.15.100:0/2943765805' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi100-32195-3","pool2":"test-rados-api-smithi100-32195-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2021-01-28T04:03:06.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:05 smithi162 bash[9856]: cluster 2021-01-28T04:03:04.640274+0000 mon.a (mon.0) 1597 : cluster [DBG] osdmap e226: 8 total, 8 up, 8 in 2021-01-28T04:03:06.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:05 smithi162 bash[9856]: audit 2021-01-28T04:03:04.642459+0000 mon.c (mon.1) 267 : audit [INF] from='client.? 172.21.15.100:0/3747777518' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-36"}]: dispatch 2021-01-28T04:03:06.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:05 smithi162 bash[9856]: audit 2021-01-28T04:03:04.652237+0000 mon.a (mon.0) 1598 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-36"}]: dispatch 2021-01-28T04:03:06.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:05 smithi162 bash[9856]: audit 2021-01-28T04:03:04.652764+0000 mon.c (mon.1) 268 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-29", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:03:06.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:05 smithi162 bash[9856]: audit 2021-01-28T04:03:04.658259+0000 mon.a (mon.0) 1599 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-29", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:03:06.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:05 smithi162 bash[9856]: audit 2021-01-28T04:03:05.645297+0000 mon.a (mon.0) 1600 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-36"}]': finished 2021-01-28T04:03:06.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:05 smithi162 bash[9856]: audit 2021-01-28T04:03:05.645466+0000 mon.a (mon.0) 1601 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-29", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:03:06.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:05 smithi162 bash[9856]: cluster 2021-01-28T04:03:05.645665+0000 mon.a (mon.0) 1602 : cluster [DBG] osdmap e227: 8 total, 8 up, 8 in 2021-01-28T04:03:06.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:05 smithi162 bash[9856]: audit 2021-01-28T04:03:05.647248+0000 mon.c (mon.1) 269 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-29"}]: dispatch 2021-01-28T04:03:06.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:05 smithi162 bash[9856]: audit 2021-01-28T04:03:05.648773+0000 mon.a (mon.0) 1603 : audit [INF] from='client.? 172.21.15.100:0/3487941774' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-44"}]: dispatch 2021-01-28T04:03:06.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:05 smithi162 bash[9856]: audit 2021-01-28T04:03:05.650469+0000 mon.a (mon.0) 1604 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-29"}]: dispatch 2021-01-28T04:03:06.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:05 smithi100 bash[9834]: audit 2021-01-28T04:03:04.639626+0000 mon.a (mon.0) 1594 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-36"}]': finished 2021-01-28T04:03:06.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:05 smithi100 bash[9834]: audit 2021-01-28T04:03:04.639745+0000 mon.a (mon.0) 1595 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-29","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:03:06.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:05 smithi100 bash[9834]: audit 2021-01-28T04:03:04.639979+0000 mon.a (mon.0) 1596 : audit [INF] from='client.? 172.21.15.100:0/2943765805' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi100-32195-3","pool2":"test-rados-api-smithi100-32195-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2021-01-28T04:03:06.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:05 smithi100 bash[9834]: cluster 2021-01-28T04:03:04.640274+0000 mon.a (mon.0) 1597 : cluster [DBG] osdmap e226: 8 total, 8 up, 8 in 2021-01-28T04:03:06.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:05 smithi100 bash[9834]: audit 2021-01-28T04:03:04.642459+0000 mon.c (mon.1) 267 : audit [INF] from='client.? 172.21.15.100:0/3747777518' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-36"}]: dispatch 2021-01-28T04:03:06.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:05 smithi100 bash[9834]: audit 2021-01-28T04:03:04.652237+0000 mon.a (mon.0) 1598 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-36"}]: dispatch 2021-01-28T04:03:06.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:05 smithi100 bash[9834]: audit 2021-01-28T04:03:04.652764+0000 mon.c (mon.1) 268 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-29", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:03:06.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:05 smithi100 bash[9834]: audit 2021-01-28T04:03:04.658259+0000 mon.a (mon.0) 1599 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-29", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:03:06.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:05 smithi100 bash[9834]: audit 2021-01-28T04:03:05.645297+0000 mon.a (mon.0) 1600 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-36"}]': finished 2021-01-28T04:03:06.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:05 smithi100 bash[9834]: audit 2021-01-28T04:03:05.645466+0000 mon.a (mon.0) 1601 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-29", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:03:06.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:05 smithi100 bash[9834]: cluster 2021-01-28T04:03:05.645665+0000 mon.a (mon.0) 1602 : cluster [DBG] osdmap e227: 8 total, 8 up, 8 in 2021-01-28T04:03:06.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:05 smithi100 bash[9834]: audit 2021-01-28T04:03:05.647248+0000 mon.c (mon.1) 269 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-29"}]: dispatch 2021-01-28T04:03:06.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:05 smithi100 bash[9834]: audit 2021-01-28T04:03:05.648773+0000 mon.a (mon.0) 1603 : audit [INF] from='client.? 172.21.15.100:0/3487941774' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-44"}]: dispatch 2021-01-28T04:03:06.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:05 smithi100 bash[9834]: audit 2021-01-28T04:03:05.650469+0000 mon.a (mon.0) 1604 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-29"}]: dispatch 2021-01-28T04:03:06.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:05 smithi100 bash[13549]: audit 2021-01-28T04:03:04.639626+0000 mon.a (mon.0) 1594 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-36"}]': finished 2021-01-28T04:03:06.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:05 smithi100 bash[13549]: audit 2021-01-28T04:03:04.639745+0000 mon.a (mon.0) 1595 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-29","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:03:06.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:05 smithi100 bash[13549]: audit 2021-01-28T04:03:04.639979+0000 mon.a (mon.0) 1596 : audit [INF] from='client.? 172.21.15.100:0/2943765805' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi100-32195-3","pool2":"test-rados-api-smithi100-32195-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2021-01-28T04:03:06.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:05 smithi100 bash[13549]: cluster 2021-01-28T04:03:04.640274+0000 mon.a (mon.0) 1597 : cluster [DBG] osdmap e226: 8 total, 8 up, 8 in 2021-01-28T04:03:06.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:05 smithi100 bash[13549]: audit 2021-01-28T04:03:04.642459+0000 mon.c (mon.1) 267 : audit [INF] from='client.? 172.21.15.100:0/3747777518' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-36"}]: dispatch 2021-01-28T04:03:06.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:05 smithi100 bash[13549]: audit 2021-01-28T04:03:04.652237+0000 mon.a (mon.0) 1598 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-36"}]: dispatch 2021-01-28T04:03:06.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:05 smithi100 bash[13549]: audit 2021-01-28T04:03:04.652764+0000 mon.c (mon.1) 268 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-29", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:03:06.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:05 smithi100 bash[13549]: audit 2021-01-28T04:03:04.658259+0000 mon.a (mon.0) 1599 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-29", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:03:06.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:05 smithi100 bash[13549]: audit 2021-01-28T04:03:05.645297+0000 mon.a (mon.0) 1600 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-36"}]': finished 2021-01-28T04:03:06.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:05 smithi100 bash[13549]: audit 2021-01-28T04:03:05.645466+0000 mon.a (mon.0) 1601 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-29", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:03:06.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:05 smithi100 bash[13549]: cluster 2021-01-28T04:03:05.645665+0000 mon.a (mon.0) 1602 : cluster [DBG] osdmap e227: 8 total, 8 up, 8 in 2021-01-28T04:03:06.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:05 smithi100 bash[13549]: audit 2021-01-28T04:03:05.647248+0000 mon.c (mon.1) 269 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-29"}]: dispatch 2021-01-28T04:03:06.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:05 smithi100 bash[13549]: audit 2021-01-28T04:03:05.648773+0000 mon.a (mon.0) 1603 : audit [INF] from='client.? 172.21.15.100:0/3487941774' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-44"}]: dispatch 2021-01-28T04:03:06.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:05 smithi100 bash[13549]: audit 2021-01-28T04:03:05.650469+0000 mon.a (mon.0) 1604 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-29"}]: dispatch 2021-01-28T04:03:07.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:06 smithi162 bash[9856]: cluster 2021-01-28T04:03:05.607327+0000 mgr.y (mgr.14138) 612 : cluster [DBG] pgmap v590: 236 pgs: 2 creating+peering, 38 unknown, 196 active+clean; 26 KiB data, 320 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:03:07.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:06 smithi162 bash[9856]: audit 2021-01-28T04:03:05.671168+0000 mon.a (mon.0) 1605 : audit [INF] from='client.? 172.21.15.100:0/2156402661' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-37"}]: dispatch 2021-01-28T04:03:07.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:06 smithi162 bash[9856]: audit 2021-01-28T04:03:05.672868+0000 mon.a (mon.0) 1606 : audit [INF] from='client.? 172.21.15.100:0/2156402661' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-37"}]: dispatch 2021-01-28T04:03:07.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:06 smithi162 bash[9856]: audit 2021-01-28T04:03:05.673328+0000 mon.a (mon.0) 1607 : audit [INF] from='client.? 172.21.15.100:0/2156402661' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:07.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:06 smithi162 bash[9856]: audit 2021-01-28T04:03:06.645928+0000 mon.a (mon.0) 1608 : audit [INF] from='client.? 172.21.15.100:0/3487941774' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-44"}]': finished 2021-01-28T04:03:07.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:06 smithi162 bash[9856]: audit 2021-01-28T04:03:06.646136+0000 mon.a (mon.0) 1609 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-29"}]': finished 2021-01-28T04:03:07.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:06 smithi162 bash[9856]: audit 2021-01-28T04:03:06.646359+0000 mon.a (mon.0) 1610 : audit [INF] from='client.? 172.21.15.100:0/2156402661' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:03:07.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:06 smithi162 bash[9856]: cluster 2021-01-28T04:03:06.646496+0000 mon.a (mon.0) 1611 : cluster [DBG] osdmap e228: 8 total, 8 up, 8 in 2021-01-28T04:03:07.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:06 smithi162 bash[9856]: audit 2021-01-28T04:03:06.647971+0000 mon.a (mon.0) 1612 : audit [INF] from='client.? 172.21.15.100:0/3487941774' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-44"}]: dispatch 2021-01-28T04:03:07.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:06 smithi162 bash[9856]: audit 2021-01-28T04:03:06.648264+0000 mon.a (mon.0) 1613 : audit [INF] from='client.? 172.21.15.100:0/2156402661' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-37"}]: dispatch 2021-01-28T04:03:07.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:06 smithi162 bash[9856]: audit 2021-01-28T04:03:06.649257+0000 mon.c (mon.1) 270 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-29", "mode": "writeback"}]: dispatch 2021-01-28T04:03:07.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:06 smithi162 bash[9856]: audit 2021-01-28T04:03:06.649744+0000 mon.a (mon.0) 1614 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-29", "mode": "writeback"}]: dispatch 2021-01-28T04:03:07.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:06 smithi100 bash[9834]: cluster 2021-01-28T04:03:05.607327+0000 mgr.y (mgr.14138) 612 : cluster [DBG] pgmap v590: 236 pgs: 2 creating+peering, 38 unknown, 196 active+clean; 26 KiB data, 320 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:03:07.219 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:06 smithi100 bash[9834]: audit 2021-01-28T04:03:05.671168+0000 mon.a (mon.0) 1605 : audit [INF] from='client.? 172.21.15.100:0/2156402661' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-37"}]: dispatch 2021-01-28T04:03:07.219 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:06 smithi100 bash[9834]: audit 2021-01-28T04:03:05.672868+0000 mon.a (mon.0) 1606 : audit [INF] from='client.? 172.21.15.100:0/2156402661' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-37"}]: dispatch 2021-01-28T04:03:07.220 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:06 smithi100 bash[9834]: audit 2021-01-28T04:03:05.673328+0000 mon.a (mon.0) 1607 : audit [INF] from='client.? 172.21.15.100:0/2156402661' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:07.220 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:06 smithi100 bash[9834]: audit 2021-01-28T04:03:06.645928+0000 mon.a (mon.0) 1608 : audit [INF] from='client.? 172.21.15.100:0/3487941774' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-44"}]': finished 2021-01-28T04:03:07.220 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:06 smithi100 bash[9834]: audit 2021-01-28T04:03:06.646136+0000 mon.a (mon.0) 1609 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-29"}]': finished 2021-01-28T04:03:07.220 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:06 smithi100 bash[9834]: audit 2021-01-28T04:03:06.646359+0000 mon.a (mon.0) 1610 : audit [INF] from='client.? 172.21.15.100:0/2156402661' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:03:07.221 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:06 smithi100 bash[9834]: cluster 2021-01-28T04:03:06.646496+0000 mon.a (mon.0) 1611 : cluster [DBG] osdmap e228: 8 total, 8 up, 8 in 2021-01-28T04:03:07.221 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:06 smithi100 bash[9834]: audit 2021-01-28T04:03:06.647971+0000 mon.a (mon.0) 1612 : audit [INF] from='client.? 172.21.15.100:0/3487941774' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-44"}]: dispatch 2021-01-28T04:03:07.221 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:06 smithi100 bash[9834]: audit 2021-01-28T04:03:06.648264+0000 mon.a (mon.0) 1613 : audit [INF] from='client.? 172.21.15.100:0/2156402661' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-37"}]: dispatch 2021-01-28T04:03:07.221 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:06 smithi100 bash[9834]: audit 2021-01-28T04:03:06.649257+0000 mon.c (mon.1) 270 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-29", "mode": "writeback"}]: dispatch 2021-01-28T04:03:07.222 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:06 smithi100 bash[9834]: audit 2021-01-28T04:03:06.649744+0000 mon.a (mon.0) 1614 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-29", "mode": "writeback"}]: dispatch 2021-01-28T04:03:07.222 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:06 smithi100 bash[13549]: cluster 2021-01-28T04:03:05.607327+0000 mgr.y (mgr.14138) 612 : cluster [DBG] pgmap v590: 236 pgs: 2 creating+peering, 38 unknown, 196 active+clean; 26 KiB data, 320 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:03:07.222 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:06 smithi100 bash[13549]: audit 2021-01-28T04:03:05.671168+0000 mon.a (mon.0) 1605 : audit [INF] from='client.? 172.21.15.100:0/2156402661' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-37"}]: dispatch 2021-01-28T04:03:07.222 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:06 smithi100 bash[13549]: audit 2021-01-28T04:03:05.672868+0000 mon.a (mon.0) 1606 : audit [INF] from='client.? 172.21.15.100:0/2156402661' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-37"}]: dispatch 2021-01-28T04:03:07.223 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:06 smithi100 bash[13549]: audit 2021-01-28T04:03:05.673328+0000 mon.a (mon.0) 1607 : audit [INF] from='client.? 172.21.15.100:0/2156402661' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:07.223 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:06 smithi100 bash[13549]: audit 2021-01-28T04:03:06.645928+0000 mon.a (mon.0) 1608 : audit [INF] from='client.? 172.21.15.100:0/3487941774' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-44"}]': finished 2021-01-28T04:03:07.223 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:06 smithi100 bash[13549]: audit 2021-01-28T04:03:06.646136+0000 mon.a (mon.0) 1609 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-29"}]': finished 2021-01-28T04:03:07.223 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:06 smithi100 bash[13549]: audit 2021-01-28T04:03:06.646359+0000 mon.a (mon.0) 1610 : audit [INF] from='client.? 172.21.15.100:0/2156402661' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:03:07.223 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:06 smithi100 bash[13549]: cluster 2021-01-28T04:03:06.646496+0000 mon.a (mon.0) 1611 : cluster [DBG] osdmap e228: 8 total, 8 up, 8 in 2021-01-28T04:03:07.224 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:06 smithi100 bash[13549]: audit 2021-01-28T04:03:06.647971+0000 mon.a (mon.0) 1612 : audit [INF] from='client.? 172.21.15.100:0/3487941774' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-44"}]: dispatch 2021-01-28T04:03:07.224 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:06 smithi100 bash[13549]: audit 2021-01-28T04:03:06.648264+0000 mon.a (mon.0) 1613 : audit [INF] from='client.? 172.21.15.100:0/2156402661' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-37"}]: dispatch 2021-01-28T04:03:07.224 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:06 smithi100 bash[13549]: audit 2021-01-28T04:03:06.649257+0000 mon.c (mon.1) 270 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-29", "mode": "writeback"}]: dispatch 2021-01-28T04:03:07.224 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:06 smithi100 bash[13549]: audit 2021-01-28T04:03:06.649744+0000 mon.a (mon.0) 1614 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-29", "mode": "writeback"}]: dispatch 2021-01-28T04:03:08.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:08 smithi162 bash[9856]: cluster 2021-01-28T04:03:07.640226+0000 mon.a (mon.0) 1615 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:03:08.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:08 smithi162 bash[9856]: audit 2021-01-28T04:03:07.648570+0000 mon.a (mon.0) 1616 : audit [INF] from='client.? 172.21.15.100:0/3487941774' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-44"}]': finished 2021-01-28T04:03:08.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:08 smithi100 bash[9834]: cluster 2021-01-28T04:03:07.640226+0000 mon.a (mon.0) 1615 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:03:08.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:08 smithi100 bash[9834]: audit 2021-01-28T04:03:07.648570+0000 mon.a (mon.0) 1616 : audit [INF] from='client.? 172.21.15.100:0/3487941774' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-44"}]': finished 2021-01-28T04:03:08.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:08 smithi100 bash[13549]: cluster 2021-01-28T04:03:07.640226+0000 mon.a (mon.0) 1615 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:03:08.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:08 smithi100 bash[13549]: audit 2021-01-28T04:03:07.648570+0000 mon.a (mon.0) 1616 : audit [INF] from='client.? 172.21.15.100:0/3487941774' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-44"}]': finished 2021-01-28T04:03:09.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:09 smithi162 bash[9856]: cluster 2021-01-28T04:03:07.608311+0000 mgr.y (mgr.14138) 613 : cluster [DBG] pgmap v593: 228 pgs: 2 creating+peering, 12 unknown, 214 active+clean; 26 KiB data, 322 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:03:09.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:09 smithi162 bash[9856]: audit 2021-01-28T04:03:08.077738+0000 mon.a (mon.0) 1617 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-29", "mode": "writeback"}]': finished 2021-01-28T04:03:09.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:09 smithi162 bash[9856]: cluster 2021-01-28T04:03:08.077962+0000 mon.a (mon.0) 1618 : cluster [DBG] osdmap e229: 8 total, 8 up, 8 in 2021-01-28T04:03:09.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:09 smithi162 bash[9856]: audit 2021-01-28T04:03:08.102164+0000 mon.c (mon.1) 271 : audit [INF] from='client.? 172.21.15.100:0/2443661241' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-45"}]: dispatch 2021-01-28T04:03:09.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:09 smithi162 bash[9856]: audit 2021-01-28T04:03:08.102508+0000 mon.a (mon.0) 1619 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-45"}]: dispatch 2021-01-28T04:03:09.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:09 smithi162 bash[9856]: audit 2021-01-28T04:03:08.103215+0000 mon.c (mon.1) 272 : audit [INF] from='client.? 172.21.15.100:0/2443661241' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-45"}]: dispatch 2021-01-28T04:03:09.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:09 smithi162 bash[9856]: audit 2021-01-28T04:03:08.103499+0000 mon.a (mon.0) 1620 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-45"}]: dispatch 2021-01-28T04:03:09.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:09 smithi162 bash[9856]: audit 2021-01-28T04:03:08.103949+0000 mon.c (mon.1) 273 : audit [INF] from='client.? 172.21.15.100:0/2443661241' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:09.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:09 smithi162 bash[9856]: audit 2021-01-28T04:03:08.104232+0000 mon.a (mon.0) 1621 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:09.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:09 smithi162 bash[9856]: audit 2021-01-28T04:03:08.279751+0000 mon.c (mon.1) 274 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:03:09.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:09 smithi162 bash[9856]: audit 2021-01-28T04:03:08.280585+0000 mon.a (mon.0) 1622 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:03:09.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:09 smithi162 bash[9856]: audit 2021-01-28T04:03:08.578976+0000 mon.a (mon.0) 1623 : audit [INF] from='client.? 172.21.15.100:0/2156402661' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-37"}]': finished 2021-01-28T04:03:09.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:09 smithi162 bash[9856]: audit 2021-01-28T04:03:08.579154+0000 mon.a (mon.0) 1624 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:03:09.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:09 smithi162 bash[9856]: audit 2021-01-28T04:03:08.579252+0000 mon.a (mon.0) 1625 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:03:09.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:09 smithi162 bash[9856]: cluster 2021-01-28T04:03:08.579391+0000 mon.a (mon.0) 1626 : cluster [DBG] osdmap e230: 8 total, 8 up, 8 in 2021-01-28T04:03:09.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:09 smithi162 bash[9856]: audit 2021-01-28T04:03:08.580870+0000 mon.c (mon.1) 275 : audit [INF] from='client.? 172.21.15.100:0/2443661241' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-45"}]: dispatch 2021-01-28T04:03:09.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:09 smithi162 bash[9856]: audit 2021-01-28T04:03:08.581218+0000 mon.c (mon.1) 276 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-29"}]: dispatch 2021-01-28T04:03:09.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:09 smithi162 bash[9856]: audit 2021-01-28T04:03:08.595160+0000 mon.a (mon.0) 1627 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-45"}]: dispatch 2021-01-28T04:03:09.518 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:09 smithi162 bash[9856]: audit 2021-01-28T04:03:08.595967+0000 mon.a (mon.0) 1628 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-29"}]: dispatch 2021-01-28T04:03:09.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[9834]: cluster 2021-01-28T04:03:07.608311+0000 mgr.y (mgr.14138) 613 : cluster [DBG] pgmap v593: 228 pgs: 2 creating+peering, 12 unknown, 214 active+clean; 26 KiB data, 322 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:03:09.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[9834]: audit 2021-01-28T04:03:08.077738+0000 mon.a (mon.0) 1617 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-29", "mode": "writeback"}]': finished 2021-01-28T04:03:09.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[9834]: cluster 2021-01-28T04:03:08.077962+0000 mon.a (mon.0) 1618 : cluster [DBG] osdmap e229: 8 total, 8 up, 8 in 2021-01-28T04:03:09.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[9834]: audit 2021-01-28T04:03:08.102164+0000 mon.c (mon.1) 271 : audit [INF] from='client.? 172.21.15.100:0/2443661241' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-45"}]: dispatch 2021-01-28T04:03:09.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[9834]: audit 2021-01-28T04:03:08.102508+0000 mon.a (mon.0) 1619 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-45"}]: dispatch 2021-01-28T04:03:09.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[9834]: audit 2021-01-28T04:03:08.103215+0000 mon.c (mon.1) 272 : audit [INF] from='client.? 172.21.15.100:0/2443661241' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-45"}]: dispatch 2021-01-28T04:03:09.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[9834]: audit 2021-01-28T04:03:08.103499+0000 mon.a (mon.0) 1620 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-45"}]: dispatch 2021-01-28T04:03:09.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[9834]: audit 2021-01-28T04:03:08.103949+0000 mon.c (mon.1) 273 : audit [INF] from='client.? 172.21.15.100:0/2443661241' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:09.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[9834]: audit 2021-01-28T04:03:08.104232+0000 mon.a (mon.0) 1621 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:09.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[9834]: audit 2021-01-28T04:03:08.279751+0000 mon.c (mon.1) 274 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:03:09.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[9834]: audit 2021-01-28T04:03:08.280585+0000 mon.a (mon.0) 1622 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:03:09.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[9834]: audit 2021-01-28T04:03:08.578976+0000 mon.a (mon.0) 1623 : audit [INF] from='client.? 172.21.15.100:0/2156402661' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-37"}]': finished 2021-01-28T04:03:09.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[9834]: audit 2021-01-28T04:03:08.579154+0000 mon.a (mon.0) 1624 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:03:09.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[9834]: audit 2021-01-28T04:03:08.579252+0000 mon.a (mon.0) 1625 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:03:09.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[9834]: cluster 2021-01-28T04:03:08.579391+0000 mon.a (mon.0) 1626 : cluster [DBG] osdmap e230: 8 total, 8 up, 8 in 2021-01-28T04:03:09.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[9834]: audit 2021-01-28T04:03:08.580870+0000 mon.c (mon.1) 275 : audit [INF] from='client.? 172.21.15.100:0/2443661241' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-45"}]: dispatch 2021-01-28T04:03:09.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[9834]: audit 2021-01-28T04:03:08.581218+0000 mon.c (mon.1) 276 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-29"}]: dispatch 2021-01-28T04:03:09.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[9834]: audit 2021-01-28T04:03:08.595160+0000 mon.a (mon.0) 1627 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-45"}]: dispatch 2021-01-28T04:03:09.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[9834]: audit 2021-01-28T04:03:08.595967+0000 mon.a (mon.0) 1628 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-29"}]: dispatch 2021-01-28T04:03:09.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[13549]: cluster 2021-01-28T04:03:07.608311+0000 mgr.y (mgr.14138) 613 : cluster [DBG] pgmap v593: 228 pgs: 2 creating+peering, 12 unknown, 214 active+clean; 26 KiB data, 322 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:03:09.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[13549]: audit 2021-01-28T04:03:08.077738+0000 mon.a (mon.0) 1617 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-29", "mode": "writeback"}]': finished 2021-01-28T04:03:09.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[13549]: cluster 2021-01-28T04:03:08.077962+0000 mon.a (mon.0) 1618 : cluster [DBG] osdmap e229: 8 total, 8 up, 8 in 2021-01-28T04:03:09.584 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[13549]: audit 2021-01-28T04:03:08.102164+0000 mon.c (mon.1) 271 : audit [INF] from='client.? 172.21.15.100:0/2443661241' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-45"}]: dispatch 2021-01-28T04:03:09.585 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[13549]: audit 2021-01-28T04:03:08.102508+0000 mon.a (mon.0) 1619 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-45"}]: dispatch 2021-01-28T04:03:09.585 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[13549]: audit 2021-01-28T04:03:08.103215+0000 mon.c (mon.1) 272 : audit [INF] from='client.? 172.21.15.100:0/2443661241' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-45"}]: dispatch 2021-01-28T04:03:09.585 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[13549]: audit 2021-01-28T04:03:08.103499+0000 mon.a (mon.0) 1620 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-45"}]: dispatch 2021-01-28T04:03:09.585 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[13549]: audit 2021-01-28T04:03:08.103949+0000 mon.c (mon.1) 273 : audit [INF] from='client.? 172.21.15.100:0/2443661241' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:09.586 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[13549]: audit 2021-01-28T04:03:08.104232+0000 mon.a (mon.0) 1621 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:09.586 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[13549]: audit 2021-01-28T04:03:08.279751+0000 mon.c (mon.1) 274 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:03:09.586 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[13549]: audit 2021-01-28T04:03:08.280585+0000 mon.a (mon.0) 1622 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:03:09.586 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[13549]: audit 2021-01-28T04:03:08.578976+0000 mon.a (mon.0) 1623 : audit [INF] from='client.? 172.21.15.100:0/2156402661' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-37"}]': finished 2021-01-28T04:03:09.587 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[13549]: audit 2021-01-28T04:03:08.579154+0000 mon.a (mon.0) 1624 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-45", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:03:09.587 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[13549]: audit 2021-01-28T04:03:08.579252+0000 mon.a (mon.0) 1625 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:03:09.587 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[13549]: cluster 2021-01-28T04:03:08.579391+0000 mon.a (mon.0) 1626 : cluster [DBG] osdmap e230: 8 total, 8 up, 8 in 2021-01-28T04:03:09.587 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[13549]: audit 2021-01-28T04:03:08.580870+0000 mon.c (mon.1) 275 : audit [INF] from='client.? 172.21.15.100:0/2443661241' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-45"}]: dispatch 2021-01-28T04:03:09.588 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[13549]: audit 2021-01-28T04:03:08.581218+0000 mon.c (mon.1) 276 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-29"}]: dispatch 2021-01-28T04:03:09.588 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[13549]: audit 2021-01-28T04:03:08.595160+0000 mon.a (mon.0) 1627 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-45"}]: dispatch 2021-01-28T04:03:09.588 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[13549]: audit 2021-01-28T04:03:08.595967+0000 mon.a (mon.0) 1628 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-29"}]: dispatch 2021-01-28T04:03:10.263 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 04:03:09 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T04:03:10.263 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:10 smithi162 bash[9856]: cluster 2021-01-28T04:03:09.570321+0000 mon.a (mon.0) 1629 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:03:10.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:10 smithi162 bash[9856]: audit 2021-01-28T04:03:10.008679+0000 mon.a (mon.0) 1630 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-29"}]': finished 2021-01-28T04:03:10.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:10 smithi162 bash[9856]: cluster 2021-01-28T04:03:10.009049+0000 mon.a (mon.0) 1631 : cluster [DBG] osdmap e231: 8 total, 8 up, 8 in 2021-01-28T04:03:10.328 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 04:03:09 smithi100 bash[10061]: debug 2021-01-28T04:03:09.851+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:03:10.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:10 smithi100 bash[9834]: cluster 2021-01-28T04:03:09.570321+0000 mon.a (mon.0) 1629 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:03:10.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:10 smithi100 bash[9834]: audit 2021-01-28T04:03:10.008679+0000 mon.a (mon.0) 1630 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-29"}]': finished 2021-01-28T04:03:10.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:10 smithi100 bash[9834]: cluster 2021-01-28T04:03:10.009049+0000 mon.a (mon.0) 1631 : cluster [DBG] osdmap e231: 8 total, 8 up, 8 in 2021-01-28T04:03:10.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:10 smithi100 bash[13549]: cluster 2021-01-28T04:03:09.570321+0000 mon.a (mon.0) 1629 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:03:10.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:10 smithi100 bash[13549]: audit 2021-01-28T04:03:10.008679+0000 mon.a (mon.0) 1630 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-29"}]': finished 2021-01-28T04:03:10.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:10 smithi100 bash[13549]: cluster 2021-01-28T04:03:10.009049+0000 mon.a (mon.0) 1631 : cluster [DBG] osdmap e231: 8 total, 8 up, 8 in 2021-01-28T04:03:11.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:11 smithi162 bash[9856]: cluster 2021-01-28T04:03:09.608938+0000 mgr.y (mgr.14138) 614 : cluster [DBG] pgmap v597: 236 pgs: 1 creating+peering, 7 unknown, 228 active+clean; 26 KiB data, 323 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 258 B/s wr, 2 op/s 2021-01-28T04:03:11.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:11 smithi162 bash[9856]: audit 2021-01-28T04:03:09.858795+0000 mgr.y (mgr.14138) 615 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:03:11.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:11 smithi162 bash[9856]: audit 2021-01-28T04:03:10.588862+0000 mon.a (mon.0) 1632 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-45"}]': finished 2021-01-28T04:03:11.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:11 smithi162 bash[9856]: cluster 2021-01-28T04:03:10.589034+0000 mon.a (mon.0) 1633 : cluster [DBG] osdmap e232: 8 total, 8 up, 8 in 2021-01-28T04:03:11.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:11 smithi162 bash[9856]: audit 2021-01-28T04:03:11.031667+0000 mon.a (mon.0) 1634 : audit [INF] from='client.? 172.21.15.100:0/2156402661' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-37"}]: dispatch 2021-01-28T04:03:11.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:11 smithi100 bash[9834]: cluster 2021-01-28T04:03:09.608938+0000 mgr.y (mgr.14138) 614 : cluster [DBG] pgmap v597: 236 pgs: 1 creating+peering, 7 unknown, 228 active+clean; 26 KiB data, 323 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 258 B/s wr, 2 op/s 2021-01-28T04:03:11.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:11 smithi100 bash[9834]: audit 2021-01-28T04:03:09.858795+0000 mgr.y (mgr.14138) 615 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:03:11.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:11 smithi100 bash[9834]: audit 2021-01-28T04:03:10.588862+0000 mon.a (mon.0) 1632 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-45"}]': finished 2021-01-28T04:03:11.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:11 smithi100 bash[9834]: cluster 2021-01-28T04:03:10.589034+0000 mon.a (mon.0) 1633 : cluster [DBG] osdmap e232: 8 total, 8 up, 8 in 2021-01-28T04:03:11.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:11 smithi100 bash[9834]: audit 2021-01-28T04:03:11.031667+0000 mon.a (mon.0) 1634 : audit [INF] from='client.? 172.21.15.100:0/2156402661' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-37"}]: dispatch 2021-01-28T04:03:11.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:11 smithi100 bash[13549]: cluster 2021-01-28T04:03:09.608938+0000 mgr.y (mgr.14138) 614 : cluster [DBG] pgmap v597: 236 pgs: 1 creating+peering, 7 unknown, 228 active+clean; 26 KiB data, 323 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 258 B/s wr, 2 op/s 2021-01-28T04:03:11.585 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:11 smithi100 bash[13549]: audit 2021-01-28T04:03:09.858795+0000 mgr.y (mgr.14138) 615 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:03:11.585 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:11 smithi100 bash[13549]: audit 2021-01-28T04:03:10.588862+0000 mon.a (mon.0) 1632 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-45", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-45"}]': finished 2021-01-28T04:03:11.586 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:11 smithi100 bash[13549]: cluster 2021-01-28T04:03:10.589034+0000 mon.a (mon.0) 1633 : cluster [DBG] osdmap e232: 8 total, 8 up, 8 in 2021-01-28T04:03:11.586 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:11 smithi100 bash[13549]: audit 2021-01-28T04:03:11.031667+0000 mon.a (mon.0) 1634 : audit [INF] from='client.? 172.21.15.100:0/2156402661' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-37"}]: dispatch 2021-01-28T04:03:13.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:12 smithi162 bash[9856]: audit 2021-01-28T04:03:11.592359+0000 mon.a (mon.0) 1635 : audit [INF] from='client.? 172.21.15.100:0/2156402661' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-37"}]': finished 2021-01-28T04:03:13.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:12 smithi162 bash[9856]: cluster 2021-01-28T04:03:11.592700+0000 mon.a (mon.0) 1636 : cluster [DBG] osdmap e233: 8 total, 8 up, 8 in 2021-01-28T04:03:13.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:12 smithi162 bash[9856]: audit 2021-01-28T04:03:11.596219+0000 mon.c (mon.1) 277 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:13.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:12 smithi162 bash[9856]: audit 2021-01-28T04:03:11.601595+0000 mon.a (mon.0) 1637 : audit [INF] from='client.? 172.21.15.100:0/2156402661' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-37"}]: dispatch 2021-01-28T04:03:13.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:12 smithi162 bash[9856]: audit 2021-01-28T04:03:11.602089+0000 mon.a (mon.0) 1638 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:13.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:12 smithi162 bash[9856]: cluster 2021-01-28T04:03:11.609746+0000 mgr.y (mgr.14138) 616 : cluster [DBG] pgmap v600: 236 pgs: 40 unknown, 196 active+clean; 26 KiB data, 323 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2021-01-28T04:03:13.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:12 smithi100 bash[9834]: audit 2021-01-28T04:03:11.592359+0000 mon.a (mon.0) 1635 : audit [INF] from='client.? 172.21.15.100:0/2156402661' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-37"}]': finished 2021-01-28T04:03:13.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:12 smithi100 bash[9834]: cluster 2021-01-28T04:03:11.592700+0000 mon.a (mon.0) 1636 : cluster [DBG] osdmap e233: 8 total, 8 up, 8 in 2021-01-28T04:03:13.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:12 smithi100 bash[9834]: audit 2021-01-28T04:03:11.596219+0000 mon.c (mon.1) 277 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:13.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:12 smithi100 bash[9834]: audit 2021-01-28T04:03:11.601595+0000 mon.a (mon.0) 1637 : audit [INF] from='client.? 172.21.15.100:0/2156402661' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-37"}]: dispatch 2021-01-28T04:03:13.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:12 smithi100 bash[9834]: audit 2021-01-28T04:03:11.602089+0000 mon.a (mon.0) 1638 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:13.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:12 smithi100 bash[9834]: cluster 2021-01-28T04:03:11.609746+0000 mgr.y (mgr.14138) 616 : cluster [DBG] pgmap v600: 236 pgs: 40 unknown, 196 active+clean; 26 KiB data, 323 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2021-01-28T04:03:13.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:12 smithi100 bash[13549]: audit 2021-01-28T04:03:11.592359+0000 mon.a (mon.0) 1635 : audit [INF] from='client.? 172.21.15.100:0/2156402661' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-37"}]': finished 2021-01-28T04:03:13.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:12 smithi100 bash[13549]: cluster 2021-01-28T04:03:11.592700+0000 mon.a (mon.0) 1636 : cluster [DBG] osdmap e233: 8 total, 8 up, 8 in 2021-01-28T04:03:13.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:12 smithi100 bash[13549]: audit 2021-01-28T04:03:11.596219+0000 mon.c (mon.1) 277 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:13.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:12 smithi100 bash[13549]: audit 2021-01-28T04:03:11.601595+0000 mon.a (mon.0) 1637 : audit [INF] from='client.? 172.21.15.100:0/2156402661' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-37"}]: dispatch 2021-01-28T04:03:13.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:12 smithi100 bash[13549]: audit 2021-01-28T04:03:11.602089+0000 mon.a (mon.0) 1638 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:13.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:12 smithi100 bash[13549]: cluster 2021-01-28T04:03:11.609746+0000 mgr.y (mgr.14138) 616 : cluster [DBG] pgmap v600: 236 pgs: 40 unknown, 196 active+clean; 26 KiB data, 323 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2021-01-28T04:03:14.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:13 smithi162 bash[9856]: audit 2021-01-28T04:03:12.597995+0000 mon.a (mon.0) 1639 : audit [INF] from='client.? 172.21.15.100:0/2156402661' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-37"}]': finished 2021-01-28T04:03:14.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:13 smithi162 bash[9856]: audit 2021-01-28T04:03:12.598205+0000 mon.a (mon.0) 1640 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-31","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:03:14.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:13 smithi162 bash[9856]: cluster 2021-01-28T04:03:12.598978+0000 mon.a (mon.0) 1641 : cluster [DBG] osdmap e234: 8 total, 8 up, 8 in 2021-01-28T04:03:14.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:13 smithi162 bash[9856]: audit 2021-01-28T04:03:12.600957+0000 mon.c (mon.1) 278 : audit [INF] from='client.? 172.21.15.100:0/2443661241' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-45"}]: dispatch 2021-01-28T04:03:14.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:13 smithi162 bash[9856]: audit 2021-01-28T04:03:12.601330+0000 mon.c (mon.1) 279 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-31", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:03:14.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:13 smithi162 bash[9856]: audit 2021-01-28T04:03:12.608936+0000 mon.a (mon.0) 1642 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-45"}]: dispatch 2021-01-28T04:03:14.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:13 smithi162 bash[9856]: audit 2021-01-28T04:03:12.610666+0000 mon.a (mon.0) 1643 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-31", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:03:14.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:13 smithi162 bash[9856]: audit 2021-01-28T04:03:12.640282+0000 mon.c (mon.1) 280 : audit [INF] from='client.? 172.21.15.100:0/3521310112' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-38"}]: dispatch 2021-01-28T04:03:14.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:13 smithi162 bash[9856]: audit 2021-01-28T04:03:12.640649+0000 mon.a (mon.0) 1644 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-38"}]: dispatch 2021-01-28T04:03:14.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:13 smithi162 bash[9856]: audit 2021-01-28T04:03:12.641236+0000 mon.c (mon.1) 281 : audit [INF] from='client.? 172.21.15.100:0/3521310112' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-38"}]: dispatch 2021-01-28T04:03:14.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:13 smithi162 bash[9856]: audit 2021-01-28T04:03:12.641583+0000 mon.a (mon.0) 1645 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-38"}]: dispatch 2021-01-28T04:03:14.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:13 smithi162 bash[9856]: audit 2021-01-28T04:03:12.642045+0000 mon.c (mon.1) 282 : audit [INF] from='client.? 172.21.15.100:0/3521310112' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:14.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:13 smithi162 bash[9856]: audit 2021-01-28T04:03:12.642333+0000 mon.a (mon.0) 1646 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:14.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:13 smithi162 bash[9856]: cluster 2021-01-28T04:03:13.568332+0000 mon.a (mon.0) 1647 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:03:14.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:13 smithi162 bash[9856]: audit 2021-01-28T04:03:13.595125+0000 mon.a (mon.0) 1648 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-45"}]': finished 2021-01-28T04:03:14.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:13 smithi162 bash[9856]: audit 2021-01-28T04:03:13.595408+0000 mon.a (mon.0) 1649 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-31", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:03:14.018 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:13 smithi162 bash[9856]: audit 2021-01-28T04:03:13.595704+0000 mon.a (mon.0) 1650 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:03:14.018 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:13 smithi162 bash[9856]: cluster 2021-01-28T04:03:13.595858+0000 mon.a (mon.0) 1651 : cluster [DBG] osdmap e235: 8 total, 8 up, 8 in 2021-01-28T04:03:14.018 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:13 smithi162 bash[9856]: audit 2021-01-28T04:03:13.600504+0000 mon.c (mon.1) 283 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-31"}]: dispatch 2021-01-28T04:03:14.019 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:13 smithi162 bash[9856]: audit 2021-01-28T04:03:13.600820+0000 mon.c (mon.1) 284 : audit [INF] from='client.? 172.21.15.100:0/2443661241' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-45"}]: dispatch 2021-01-28T04:03:14.019 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:13 smithi162 bash[9856]: audit 2021-01-28T04:03:13.601140+0000 mon.c (mon.1) 285 : audit [INF] from='client.? 172.21.15.100:0/3521310112' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-38"}]: dispatch 2021-01-28T04:03:14.019 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:13 smithi162 bash[9856]: audit 2021-01-28T04:03:13.601382+0000 mon.a (mon.0) 1652 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-31"}]: dispatch 2021-01-28T04:03:14.020 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:13 smithi162 bash[9856]: audit 2021-01-28T04:03:13.601848+0000 mon.a (mon.0) 1653 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-45"}]: dispatch 2021-01-28T04:03:14.020 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:13 smithi162 bash[9856]: audit 2021-01-28T04:03:13.602289+0000 mon.a (mon.0) 1654 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-38"}]: dispatch 2021-01-28T04:03:14.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[9834]: audit 2021-01-28T04:03:12.597995+0000 mon.a (mon.0) 1639 : audit [INF] from='client.? 172.21.15.100:0/2156402661' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-37"}]': finished 2021-01-28T04:03:14.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[9834]: audit 2021-01-28T04:03:12.598205+0000 mon.a (mon.0) 1640 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-31","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:03:14.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[9834]: cluster 2021-01-28T04:03:12.598978+0000 mon.a (mon.0) 1641 : cluster [DBG] osdmap e234: 8 total, 8 up, 8 in 2021-01-28T04:03:14.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[9834]: audit 2021-01-28T04:03:12.600957+0000 mon.c (mon.1) 278 : audit [INF] from='client.? 172.21.15.100:0/2443661241' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-45"}]: dispatch 2021-01-28T04:03:14.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[9834]: audit 2021-01-28T04:03:12.601330+0000 mon.c (mon.1) 279 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-31", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:03:14.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[9834]: audit 2021-01-28T04:03:12.608936+0000 mon.a (mon.0) 1642 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-45"}]: dispatch 2021-01-28T04:03:14.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[9834]: audit 2021-01-28T04:03:12.610666+0000 mon.a (mon.0) 1643 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-31", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:03:14.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[9834]: audit 2021-01-28T04:03:12.640282+0000 mon.c (mon.1) 280 : audit [INF] from='client.? 172.21.15.100:0/3521310112' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-38"}]: dispatch 2021-01-28T04:03:14.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[9834]: audit 2021-01-28T04:03:12.640649+0000 mon.a (mon.0) 1644 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-38"}]: dispatch 2021-01-28T04:03:14.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[9834]: audit 2021-01-28T04:03:12.641236+0000 mon.c (mon.1) 281 : audit [INF] from='client.? 172.21.15.100:0/3521310112' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-38"}]: dispatch 2021-01-28T04:03:14.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[9834]: audit 2021-01-28T04:03:12.641583+0000 mon.a (mon.0) 1645 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-38"}]: dispatch 2021-01-28T04:03:14.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[9834]: audit 2021-01-28T04:03:12.642045+0000 mon.c (mon.1) 282 : audit [INF] from='client.? 172.21.15.100:0/3521310112' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:14.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[9834]: audit 2021-01-28T04:03:12.642333+0000 mon.a (mon.0) 1646 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:14.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[9834]: cluster 2021-01-28T04:03:13.568332+0000 mon.a (mon.0) 1647 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:03:14.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[9834]: audit 2021-01-28T04:03:13.595125+0000 mon.a (mon.0) 1648 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-45"}]': finished 2021-01-28T04:03:14.087 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[9834]: audit 2021-01-28T04:03:13.595408+0000 mon.a (mon.0) 1649 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-31", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:03:14.087 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[9834]: audit 2021-01-28T04:03:13.595704+0000 mon.a (mon.0) 1650 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:03:14.087 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[9834]: cluster 2021-01-28T04:03:13.595858+0000 mon.a (mon.0) 1651 : cluster [DBG] osdmap e235: 8 total, 8 up, 8 in 2021-01-28T04:03:14.088 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[9834]: audit 2021-01-28T04:03:13.600504+0000 mon.c (mon.1) 283 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-31"}]: dispatch 2021-01-28T04:03:14.088 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[9834]: audit 2021-01-28T04:03:13.600820+0000 mon.c (mon.1) 284 : audit [INF] from='client.? 172.21.15.100:0/2443661241' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-45"}]: dispatch 2021-01-28T04:03:14.088 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[9834]: audit 2021-01-28T04:03:13.601140+0000 mon.c (mon.1) 285 : audit [INF] from='client.? 172.21.15.100:0/3521310112' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-38"}]: dispatch 2021-01-28T04:03:14.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[9834]: audit 2021-01-28T04:03:13.601382+0000 mon.a (mon.0) 1652 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-31"}]: dispatch 2021-01-28T04:03:14.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[9834]: audit 2021-01-28T04:03:13.601848+0000 mon.a (mon.0) 1653 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-45"}]: dispatch 2021-01-28T04:03:14.089 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[9834]: audit 2021-01-28T04:03:13.602289+0000 mon.a (mon.0) 1654 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-38"}]: dispatch 2021-01-28T04:03:14.090 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[13549]: audit 2021-01-28T04:03:12.597995+0000 mon.a (mon.0) 1639 : audit [INF] from='client.? 172.21.15.100:0/2156402661' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-37"}]': finished 2021-01-28T04:03:14.091 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[13549]: audit 2021-01-28T04:03:12.598205+0000 mon.a (mon.0) 1640 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-31","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:03:14.091 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[13549]: cluster 2021-01-28T04:03:12.598978+0000 mon.a (mon.0) 1641 : cluster [DBG] osdmap e234: 8 total, 8 up, 8 in 2021-01-28T04:03:14.091 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[13549]: audit 2021-01-28T04:03:12.600957+0000 mon.c (mon.1) 278 : audit [INF] from='client.? 172.21.15.100:0/2443661241' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-45"}]: dispatch 2021-01-28T04:03:14.091 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[13549]: audit 2021-01-28T04:03:12.601330+0000 mon.c (mon.1) 279 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-31", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:03:14.092 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[13549]: audit 2021-01-28T04:03:12.608936+0000 mon.a (mon.0) 1642 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-45"}]: dispatch 2021-01-28T04:03:14.092 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[13549]: audit 2021-01-28T04:03:12.610666+0000 mon.a (mon.0) 1643 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-31", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:03:14.092 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[13549]: audit 2021-01-28T04:03:12.640282+0000 mon.c (mon.1) 280 : audit [INF] from='client.? 172.21.15.100:0/3521310112' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-38"}]: dispatch 2021-01-28T04:03:14.092 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[13549]: audit 2021-01-28T04:03:12.640649+0000 mon.a (mon.0) 1644 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-38"}]: dispatch 2021-01-28T04:03:14.092 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[13549]: audit 2021-01-28T04:03:12.641236+0000 mon.c (mon.1) 281 : audit [INF] from='client.? 172.21.15.100:0/3521310112' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-38"}]: dispatch 2021-01-28T04:03:14.093 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[13549]: audit 2021-01-28T04:03:12.641583+0000 mon.a (mon.0) 1645 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-38"}]: dispatch 2021-01-28T04:03:14.093 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[13549]: audit 2021-01-28T04:03:12.642045+0000 mon.c (mon.1) 282 : audit [INF] from='client.? 172.21.15.100:0/3521310112' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:14.093 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[13549]: audit 2021-01-28T04:03:12.642333+0000 mon.a (mon.0) 1646 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:14.093 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[13549]: cluster 2021-01-28T04:03:13.568332+0000 mon.a (mon.0) 1647 : cluster [WRN] Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:03:14.094 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[13549]: audit 2021-01-28T04:03:13.595125+0000 mon.a (mon.0) 1648 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-45"}]': finished 2021-01-28T04:03:14.094 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[13549]: audit 2021-01-28T04:03:13.595408+0000 mon.a (mon.0) 1649 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-31", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:03:14.094 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[13549]: audit 2021-01-28T04:03:13.595704+0000 mon.a (mon.0) 1650 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:03:14.094 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[13549]: cluster 2021-01-28T04:03:13.595858+0000 mon.a (mon.0) 1651 : cluster [DBG] osdmap e235: 8 total, 8 up, 8 in 2021-01-28T04:03:14.094 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[13549]: audit 2021-01-28T04:03:13.600504+0000 mon.c (mon.1) 283 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-31"}]: dispatch 2021-01-28T04:03:14.095 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[13549]: audit 2021-01-28T04:03:13.600820+0000 mon.c (mon.1) 284 : audit [INF] from='client.? 172.21.15.100:0/2443661241' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-45"}]: dispatch 2021-01-28T04:03:14.095 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[13549]: audit 2021-01-28T04:03:13.601140+0000 mon.c (mon.1) 285 : audit [INF] from='client.? 172.21.15.100:0/3521310112' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-38"}]: dispatch 2021-01-28T04:03:14.095 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[13549]: audit 2021-01-28T04:03:13.601382+0000 mon.a (mon.0) 1652 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-31"}]: dispatch 2021-01-28T04:03:14.095 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[13549]: audit 2021-01-28T04:03:13.601848+0000 mon.a (mon.0) 1653 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-45"}]: dispatch 2021-01-28T04:03:14.096 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:13 smithi100 bash[13549]: audit 2021-01-28T04:03:13.602289+0000 mon.a (mon.0) 1654 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-38"}]: dispatch 2021-01-28T04:03:15.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:15 smithi100 bash[9834]: cluster 2021-01-28T04:03:13.610379+0000 mgr.y (mgr.14138) 617 : cluster [DBG] pgmap v603: 228 pgs: 14 creating+peering, 9 unknown, 205 active+clean; 26 KiB data, 324 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2021-01-28T04:03:15.328 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:15 smithi100 bash[13549]: cluster 2021-01-28T04:03:13.610379+0000 mgr.y (mgr.14138) 617 : cluster [DBG] pgmap v603: 228 pgs: 14 creating+peering, 9 unknown, 205 active+clean; 26 KiB data, 324 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2021-01-28T04:03:15.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:15 smithi162 bash[9856]: cluster 2021-01-28T04:03:13.610379+0000 mgr.y (mgr.14138) 617 : cluster [DBG] pgmap v603: 228 pgs: 14 creating+peering, 9 unknown, 205 active+clean; 26 KiB data, 324 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2021-01-28T04:03:16.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[9834]: audit 2021-01-28T04:03:14.611489+0000 mon.a (mon.0) 1655 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-31"}]': finished 2021-01-28T04:03:16.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[9834]: audit 2021-01-28T04:03:14.611717+0000 mon.a (mon.0) 1656 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-45"}]': finished 2021-01-28T04:03:16.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[9834]: audit 2021-01-28T04:03:14.612751+0000 mon.c (mon.1) 286 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-31", "mode": "writeback"}]: dispatch 2021-01-28T04:03:16.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[9834]: audit 2021-01-28T04:03:14.633021+0000 mon.c (mon.1) 287 : audit [INF] from='client.? 172.21.15.100:0/3050203363' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-46"}]: dispatch 2021-01-28T04:03:16.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[9834]: cluster 2021-01-28T04:03:15.039189+0000 mon.a (mon.0) 1657 : cluster [DBG] osdmap e236: 8 total, 8 up, 8 in 2021-01-28T04:03:16.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[9834]: audit 2021-01-28T04:03:15.041258+0000 mon.a (mon.0) 1658 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-31", "mode": "writeback"}]: dispatch 2021-01-28T04:03:16.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[9834]: audit 2021-01-28T04:03:15.041687+0000 mon.a (mon.0) 1659 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-46"}]: dispatch 2021-01-28T04:03:16.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[9834]: audit 2021-01-28T04:03:15.044364+0000 mon.c (mon.1) 288 : audit [INF] from='client.? 172.21.15.100:0/3050203363' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-46"}]: dispatch 2021-01-28T04:03:16.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[9834]: audit 2021-01-28T04:03:15.050301+0000 mon.a (mon.0) 1660 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-46"}]: dispatch 2021-01-28T04:03:16.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[9834]: audit 2021-01-28T04:03:15.051143+0000 mon.c (mon.1) 289 : audit [INF] from='client.? 172.21.15.100:0/3050203363' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:16.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[9834]: audit 2021-01-28T04:03:15.051654+0000 mon.a (mon.0) 1661 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:16.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[9834]: cluster 2021-01-28T04:03:15.602951+0000 mon.a (mon.0) 1662 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:03:16.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[9834]: audit 2021-01-28T04:03:15.611068+0000 mon.a (mon.0) 1663 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-38"}]': finished 2021-01-28T04:03:16.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[9834]: audit 2021-01-28T04:03:15.611228+0000 mon.a (mon.0) 1664 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-31", "mode": "writeback"}]': finished 2021-01-28T04:03:16.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[9834]: audit 2021-01-28T04:03:15.611366+0000 mon.a (mon.0) 1665 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:03:16.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[9834]: cluster 2021-01-28T04:03:15.611495+0000 mon.a (mon.0) 1666 : cluster [DBG] osdmap e237: 8 total, 8 up, 8 in 2021-01-28T04:03:16.333 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[9834]: audit 2021-01-28T04:03:15.617249+0000 mon.c (mon.1) 290 : audit [INF] from='client.? 172.21.15.100:0/3050203363' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-46"}]: dispatch 2021-01-28T04:03:16.333 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[9834]: audit 2021-01-28T04:03:15.618784+0000 mon.a (mon.0) 1667 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-46"}]: dispatch 2021-01-28T04:03:16.333 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[9834]: audit 2021-01-28T04:03:15.880944+0000 mon.c (mon.1) 291 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:03:16.333 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[9834]: audit 2021-01-28T04:03:15.881527+0000 mon.a (mon.0) 1668 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:03:16.334 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[13549]: audit 2021-01-28T04:03:14.611489+0000 mon.a (mon.0) 1655 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-31"}]': finished 2021-01-28T04:03:16.334 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[13549]: audit 2021-01-28T04:03:14.611717+0000 mon.a (mon.0) 1656 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-45"}]': finished 2021-01-28T04:03:16.334 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[13549]: audit 2021-01-28T04:03:14.612751+0000 mon.c (mon.1) 286 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-31", "mode": "writeback"}]: dispatch 2021-01-28T04:03:16.335 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[13549]: audit 2021-01-28T04:03:14.633021+0000 mon.c (mon.1) 287 : audit [INF] from='client.? 172.21.15.100:0/3050203363' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-46"}]: dispatch 2021-01-28T04:03:16.335 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[13549]: cluster 2021-01-28T04:03:15.039189+0000 mon.a (mon.0) 1657 : cluster [DBG] osdmap e236: 8 total, 8 up, 8 in 2021-01-28T04:03:16.336 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[13549]: audit 2021-01-28T04:03:15.041258+0000 mon.a (mon.0) 1658 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-31", "mode": "writeback"}]: dispatch 2021-01-28T04:03:16.336 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[13549]: audit 2021-01-28T04:03:15.041687+0000 mon.a (mon.0) 1659 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-46"}]: dispatch 2021-01-28T04:03:16.336 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[13549]: audit 2021-01-28T04:03:15.044364+0000 mon.c (mon.1) 288 : audit [INF] from='client.? 172.21.15.100:0/3050203363' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-46"}]: dispatch 2021-01-28T04:03:16.336 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[13549]: audit 2021-01-28T04:03:15.050301+0000 mon.a (mon.0) 1660 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-46"}]: dispatch 2021-01-28T04:03:16.337 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[13549]: audit 2021-01-28T04:03:15.051143+0000 mon.c (mon.1) 289 : audit [INF] from='client.? 172.21.15.100:0/3050203363' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:16.337 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[13549]: audit 2021-01-28T04:03:15.051654+0000 mon.a (mon.0) 1661 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:16.337 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[13549]: cluster 2021-01-28T04:03:15.602951+0000 mon.a (mon.0) 1662 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:03:16.338 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[13549]: audit 2021-01-28T04:03:15.611068+0000 mon.a (mon.0) 1663 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-38"}]': finished 2021-01-28T04:03:16.338 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[13549]: audit 2021-01-28T04:03:15.611228+0000 mon.a (mon.0) 1664 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-31", "mode": "writeback"}]': finished 2021-01-28T04:03:16.338 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[13549]: audit 2021-01-28T04:03:15.611366+0000 mon.a (mon.0) 1665 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:03:16.338 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[13549]: cluster 2021-01-28T04:03:15.611495+0000 mon.a (mon.0) 1666 : cluster [DBG] osdmap e237: 8 total, 8 up, 8 in 2021-01-28T04:03:16.338 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[13549]: audit 2021-01-28T04:03:15.617249+0000 mon.c (mon.1) 290 : audit [INF] from='client.? 172.21.15.100:0/3050203363' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-46"}]: dispatch 2021-01-28T04:03:16.339 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[13549]: audit 2021-01-28T04:03:15.618784+0000 mon.a (mon.0) 1667 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-46"}]: dispatch 2021-01-28T04:03:16.339 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[13549]: audit 2021-01-28T04:03:15.880944+0000 mon.c (mon.1) 291 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:03:16.339 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:16 smithi100 bash[13549]: audit 2021-01-28T04:03:15.881527+0000 mon.a (mon.0) 1668 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:03:16.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:16 smithi162 bash[9856]: audit 2021-01-28T04:03:14.611489+0000 mon.a (mon.0) 1655 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-31"}]': finished 2021-01-28T04:03:16.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:16 smithi162 bash[9856]: audit 2021-01-28T04:03:14.611717+0000 mon.a (mon.0) 1656 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-45"}]': finished 2021-01-28T04:03:16.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:16 smithi162 bash[9856]: audit 2021-01-28T04:03:14.612751+0000 mon.c (mon.1) 286 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-31", "mode": "writeback"}]: dispatch 2021-01-28T04:03:16.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:16 smithi162 bash[9856]: audit 2021-01-28T04:03:14.633021+0000 mon.c (mon.1) 287 : audit [INF] from='client.? 172.21.15.100:0/3050203363' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-46"}]: dispatch 2021-01-28T04:03:16.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:16 smithi162 bash[9856]: cluster 2021-01-28T04:03:15.039189+0000 mon.a (mon.0) 1657 : cluster [DBG] osdmap e236: 8 total, 8 up, 8 in 2021-01-28T04:03:16.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:16 smithi162 bash[9856]: audit 2021-01-28T04:03:15.041258+0000 mon.a (mon.0) 1658 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-31", "mode": "writeback"}]: dispatch 2021-01-28T04:03:16.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:16 smithi162 bash[9856]: audit 2021-01-28T04:03:15.041687+0000 mon.a (mon.0) 1659 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-46"}]: dispatch 2021-01-28T04:03:16.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:16 smithi162 bash[9856]: audit 2021-01-28T04:03:15.044364+0000 mon.c (mon.1) 288 : audit [INF] from='client.? 172.21.15.100:0/3050203363' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-46"}]: dispatch 2021-01-28T04:03:16.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:16 smithi162 bash[9856]: audit 2021-01-28T04:03:15.050301+0000 mon.a (mon.0) 1660 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-46"}]: dispatch 2021-01-28T04:03:16.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:16 smithi162 bash[9856]: audit 2021-01-28T04:03:15.051143+0000 mon.c (mon.1) 289 : audit [INF] from='client.? 172.21.15.100:0/3050203363' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:16.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:16 smithi162 bash[9856]: audit 2021-01-28T04:03:15.051654+0000 mon.a (mon.0) 1661 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:16.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:16 smithi162 bash[9856]: cluster 2021-01-28T04:03:15.602951+0000 mon.a (mon.0) 1662 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:03:16.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:16 smithi162 bash[9856]: audit 2021-01-28T04:03:15.611068+0000 mon.a (mon.0) 1663 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-38"}]': finished 2021-01-28T04:03:16.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:16 smithi162 bash[9856]: audit 2021-01-28T04:03:15.611228+0000 mon.a (mon.0) 1664 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-31", "mode": "writeback"}]': finished 2021-01-28T04:03:16.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:16 smithi162 bash[9856]: audit 2021-01-28T04:03:15.611366+0000 mon.a (mon.0) 1665 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:03:16.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:16 smithi162 bash[9856]: cluster 2021-01-28T04:03:15.611495+0000 mon.a (mon.0) 1666 : cluster [DBG] osdmap e237: 8 total, 8 up, 8 in 2021-01-28T04:03:16.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:16 smithi162 bash[9856]: audit 2021-01-28T04:03:15.617249+0000 mon.c (mon.1) 290 : audit [INF] from='client.? 172.21.15.100:0/3050203363' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-46"}]: dispatch 2021-01-28T04:03:16.517 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:16 smithi162 bash[9856]: audit 2021-01-28T04:03:15.618784+0000 mon.a (mon.0) 1667 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-46"}]: dispatch 2021-01-28T04:03:16.518 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:16 smithi162 bash[9856]: audit 2021-01-28T04:03:15.880944+0000 mon.c (mon.1) 291 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:03:16.518 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:16 smithi162 bash[9856]: audit 2021-01-28T04:03:15.881527+0000 mon.a (mon.0) 1668 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:03:17.328 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:17 smithi100 bash[13549]: cluster 2021-01-28T04:03:15.611133+0000 mgr.y (mgr.14138) 618 : cluster [DBG] pgmap v606: 236 pgs: 14 creating+peering, 12 unknown, 210 active+clean; 26 KiB data, 324 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-28T04:03:17.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:17 smithi100 bash[9834]: cluster 2021-01-28T04:03:15.611133+0000 mgr.y (mgr.14138) 618 : cluster [DBG] pgmap v606: 236 pgs: 14 creating+peering, 12 unknown, 210 active+clean; 26 KiB data, 324 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-28T04:03:17.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:17 smithi162 bash[9856]: cluster 2021-01-28T04:03:15.611133+0000 mgr.y (mgr.14138) 618 : cluster [DBG] pgmap v606: 236 pgs: 14 creating+peering, 12 unknown, 210 active+clean; 26 KiB data, 324 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-28T04:03:18.328 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:18 smithi100 bash[13549]: audit 2021-01-28T04:03:17.054069+0000 mon.a (mon.0) 1669 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:03:18.329 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:18 smithi100 bash[13549]: cluster 2021-01-28T04:03:17.054290+0000 mon.a (mon.0) 1670 : cluster [DBG] osdmap e238: 8 total, 8 up, 8 in 2021-01-28T04:03:18.329 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:18 smithi100 bash[13549]: audit 2021-01-28T04:03:17.055372+0000 mon.c (mon.1) 292 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-31"}]: dispatch 2021-01-28T04:03:18.329 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:18 smithi100 bash[13549]: audit 2021-01-28T04:03:17.065088+0000 mon.a (mon.0) 1671 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-31"}]: dispatch 2021-01-28T04:03:18.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:18 smithi100 bash[13549]: cluster 2021-01-28T04:03:17.617076+0000 mon.a (mon.0) 1672 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:03:18.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:18 smithi100 bash[13549]: audit 2021-01-28T04:03:17.624239+0000 mon.a (mon.0) 1673 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-46"}]': finished 2021-01-28T04:03:18.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:18 smithi100 bash[13549]: audit 2021-01-28T04:03:17.624545+0000 mon.a (mon.0) 1674 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-31"}]': finished 2021-01-28T04:03:18.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:18 smithi100 bash[13549]: cluster 2021-01-28T04:03:17.624695+0000 mon.a (mon.0) 1675 : cluster [DBG] osdmap e239: 8 total, 8 up, 8 in 2021-01-28T04:03:18.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:18 smithi100 bash[13549]: audit 2021-01-28T04:03:17.626326+0000 mon.c (mon.1) 293 : audit [INF] from='client.? 172.21.15.100:0/3521310112' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-38"}]: dispatch 2021-01-28T04:03:18.331 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:18 smithi100 bash[13549]: audit 2021-01-28T04:03:17.627696+0000 mon.a (mon.0) 1676 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-38"}]: dispatch 2021-01-28T04:03:18.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:18 smithi100 bash[9834]: audit 2021-01-28T04:03:17.054069+0000 mon.a (mon.0) 1669 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:03:18.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:18 smithi100 bash[9834]: cluster 2021-01-28T04:03:17.054290+0000 mon.a (mon.0) 1670 : cluster [DBG] osdmap e238: 8 total, 8 up, 8 in 2021-01-28T04:03:18.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:18 smithi100 bash[9834]: audit 2021-01-28T04:03:17.055372+0000 mon.c (mon.1) 292 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-31"}]: dispatch 2021-01-28T04:03:18.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:18 smithi100 bash[9834]: audit 2021-01-28T04:03:17.065088+0000 mon.a (mon.0) 1671 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-31"}]: dispatch 2021-01-28T04:03:18.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:18 smithi100 bash[9834]: cluster 2021-01-28T04:03:17.617076+0000 mon.a (mon.0) 1672 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:03:18.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:18 smithi100 bash[9834]: audit 2021-01-28T04:03:17.624239+0000 mon.a (mon.0) 1673 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-46"}]': finished 2021-01-28T04:03:18.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:18 smithi100 bash[9834]: audit 2021-01-28T04:03:17.624545+0000 mon.a (mon.0) 1674 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-31"}]': finished 2021-01-28T04:03:18.333 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:18 smithi100 bash[9834]: cluster 2021-01-28T04:03:17.624695+0000 mon.a (mon.0) 1675 : cluster [DBG] osdmap e239: 8 total, 8 up, 8 in 2021-01-28T04:03:18.333 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:18 smithi100 bash[9834]: audit 2021-01-28T04:03:17.626326+0000 mon.c (mon.1) 293 : audit [INF] from='client.? 172.21.15.100:0/3521310112' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-38"}]: dispatch 2021-01-28T04:03:18.333 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:18 smithi100 bash[9834]: audit 2021-01-28T04:03:17.627696+0000 mon.a (mon.0) 1676 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-38"}]: dispatch 2021-01-28T04:03:18.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:18 smithi162 bash[9856]: audit 2021-01-28T04:03:17.054069+0000 mon.a (mon.0) 1669 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:03:18.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:18 smithi162 bash[9856]: cluster 2021-01-28T04:03:17.054290+0000 mon.a (mon.0) 1670 : cluster [DBG] osdmap e238: 8 total, 8 up, 8 in 2021-01-28T04:03:18.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:18 smithi162 bash[9856]: audit 2021-01-28T04:03:17.055372+0000 mon.c (mon.1) 292 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-31"}]: dispatch 2021-01-28T04:03:18.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:18 smithi162 bash[9856]: audit 2021-01-28T04:03:17.065088+0000 mon.a (mon.0) 1671 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-31"}]: dispatch 2021-01-28T04:03:18.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:18 smithi162 bash[9856]: cluster 2021-01-28T04:03:17.617076+0000 mon.a (mon.0) 1672 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:03:18.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:18 smithi162 bash[9856]: audit 2021-01-28T04:03:17.624239+0000 mon.a (mon.0) 1673 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-46"}]': finished 2021-01-28T04:03:18.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:18 smithi162 bash[9856]: audit 2021-01-28T04:03:17.624545+0000 mon.a (mon.0) 1674 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-31"}]': finished 2021-01-28T04:03:18.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:18 smithi162 bash[9856]: cluster 2021-01-28T04:03:17.624695+0000 mon.a (mon.0) 1675 : cluster [DBG] osdmap e239: 8 total, 8 up, 8 in 2021-01-28T04:03:18.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:18 smithi162 bash[9856]: audit 2021-01-28T04:03:17.626326+0000 mon.c (mon.1) 293 : audit [INF] from='client.? 172.21.15.100:0/3521310112' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-38"}]: dispatch 2021-01-28T04:03:18.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:18 smithi162 bash[9856]: audit 2021-01-28T04:03:17.627696+0000 mon.a (mon.0) 1676 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-38"}]: dispatch 2021-01-28T04:03:19.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:19 smithi100 bash[9834]: cluster 2021-01-28T04:03:17.612517+0000 mgr.y (mgr.14138) 619 : cluster [DBG] pgmap v608: 236 pgs: 3 creating+peering, 1 unknown, 232 active+clean; 26 KiB data, 309 MiB used, 715 GiB / 715 GiB avail; 254 B/s rd, 254 B/s wr, 2 op/s 2021-01-28T04:03:19.328 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:19 smithi100 bash[9834]: audit 2021-01-28T04:03:18.631466+0000 mon.a (mon.0) 1677 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-38"}]': finished 2021-01-28T04:03:19.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:19 smithi100 bash[9834]: cluster 2021-01-28T04:03:18.631728+0000 mon.a (mon.0) 1678 : cluster [DBG] osdmap e240: 8 total, 8 up, 8 in 2021-01-28T04:03:19.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:19 smithi100 bash[9834]: audit 2021-01-28T04:03:18.634725+0000 mon.c (mon.1) 294 : audit [INF] from='client.? 172.21.15.100:0/3521310112' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-38"}]: dispatch 2021-01-28T04:03:19.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:19 smithi100 bash[9834]: audit 2021-01-28T04:03:18.635307+0000 mon.a (mon.0) 1679 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-38"}]: dispatch 2021-01-28T04:03:19.329 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:19 smithi100 bash[13549]: cluster 2021-01-28T04:03:17.612517+0000 mgr.y (mgr.14138) 619 : cluster [DBG] pgmap v608: 236 pgs: 3 creating+peering, 1 unknown, 232 active+clean; 26 KiB data, 309 MiB used, 715 GiB / 715 GiB avail; 254 B/s rd, 254 B/s wr, 2 op/s 2021-01-28T04:03:19.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:19 smithi100 bash[13549]: audit 2021-01-28T04:03:18.631466+0000 mon.a (mon.0) 1677 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-38"}]': finished 2021-01-28T04:03:19.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:19 smithi100 bash[13549]: cluster 2021-01-28T04:03:18.631728+0000 mon.a (mon.0) 1678 : cluster [DBG] osdmap e240: 8 total, 8 up, 8 in 2021-01-28T04:03:19.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:19 smithi100 bash[13549]: audit 2021-01-28T04:03:18.634725+0000 mon.c (mon.1) 294 : audit [INF] from='client.? 172.21.15.100:0/3521310112' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-38"}]: dispatch 2021-01-28T04:03:19.330 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:19 smithi100 bash[13549]: audit 2021-01-28T04:03:18.635307+0000 mon.a (mon.0) 1679 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-38"}]: dispatch 2021-01-28T04:03:19.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:19 smithi162 bash[9856]: cluster 2021-01-28T04:03:17.612517+0000 mgr.y (mgr.14138) 619 : cluster [DBG] pgmap v608: 236 pgs: 3 creating+peering, 1 unknown, 232 active+clean; 26 KiB data, 309 MiB used, 715 GiB / 715 GiB avail; 254 B/s rd, 254 B/s wr, 2 op/s 2021-01-28T04:03:19.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:19 smithi162 bash[9856]: audit 2021-01-28T04:03:18.631466+0000 mon.a (mon.0) 1677 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-38"}]': finished 2021-01-28T04:03:19.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:19 smithi162 bash[9856]: cluster 2021-01-28T04:03:18.631728+0000 mon.a (mon.0) 1678 : cluster [DBG] osdmap e240: 8 total, 8 up, 8 in 2021-01-28T04:03:19.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:19 smithi162 bash[9856]: audit 2021-01-28T04:03:18.634725+0000 mon.c (mon.1) 294 : audit [INF] from='client.? 172.21.15.100:0/3521310112' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-38"}]: dispatch 2021-01-28T04:03:19.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:19 smithi162 bash[9856]: audit 2021-01-28T04:03:18.635307+0000 mon.a (mon.0) 1679 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-38"}]: dispatch 2021-01-28T04:03:20.263 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 04:03:19 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T04:03:20.328 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 04:03:19 smithi100 bash[10061]: debug 2021-01-28T04:03:19.871+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:03:21.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:20 smithi162 bash[9856]: cluster 2021-01-28T04:03:19.613625+0000 mgr.y (mgr.14138) 620 : cluster [DBG] pgmap v611: 204 pgs: 3 creating+peering, 4 unknown, 197 active+clean; 26 KiB data, 310 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-28T04:03:21.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:20 smithi162 bash[9856]: audit 2021-01-28T04:03:19.633851+0000 mon.a (mon.0) 1680 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-38"}]': finished 2021-01-28T04:03:21.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:20 smithi162 bash[9856]: cluster 2021-01-28T04:03:19.634175+0000 mon.a (mon.0) 1681 : cluster [DBG] osdmap e241: 8 total, 8 up, 8 in 2021-01-28T04:03:21.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:20 smithi162 bash[9856]: audit 2021-01-28T04:03:19.637914+0000 mon.c (mon.1) 295 : audit [INF] from='client.? 172.21.15.100:0/3050203363' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-46"}]: dispatch 2021-01-28T04:03:21.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:20 smithi162 bash[9856]: audit 2021-01-28T04:03:19.641119+0000 mon.c (mon.1) 296 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:21.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:20 smithi162 bash[9856]: audit 2021-01-28T04:03:19.641287+0000 mon.a (mon.0) 1682 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-46"}]: dispatch 2021-01-28T04:03:21.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:20 smithi162 bash[9856]: audit 2021-01-28T04:03:19.641738+0000 mon.a (mon.0) 1683 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:21.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:20 smithi162 bash[9856]: audit 2021-01-28T04:03:19.664106+0000 mon.c (mon.1) 297 : audit [INF] from='client.? 172.21.15.100:0/2535583778' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-39"}]: dispatch 2021-01-28T04:03:21.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:20 smithi162 bash[9856]: audit 2021-01-28T04:03:19.664471+0000 mon.a (mon.0) 1684 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-39"}]: dispatch 2021-01-28T04:03:21.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:20 smithi162 bash[9856]: audit 2021-01-28T04:03:19.665303+0000 mon.c (mon.1) 298 : audit [INF] from='client.? 172.21.15.100:0/2535583778' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-39"}]: dispatch 2021-01-28T04:03:21.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:20 smithi162 bash[9856]: audit 2021-01-28T04:03:19.665644+0000 mon.a (mon.0) 1685 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-39"}]: dispatch 2021-01-28T04:03:21.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:20 smithi162 bash[9856]: audit 2021-01-28T04:03:19.666182+0000 mon.c (mon.1) 299 : audit [INF] from='client.? 172.21.15.100:0/2535583778' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:21.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:20 smithi162 bash[9856]: audit 2021-01-28T04:03:19.666493+0000 mon.a (mon.0) 1686 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:21.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:20 smithi162 bash[9856]: audit 2021-01-28T04:03:19.871417+0000 mgr.y (mgr.14138) 621 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:03:21.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:20 smithi100 bash[9834]: cluster 2021-01-28T04:03:19.613625+0000 mgr.y (mgr.14138) 620 : cluster [DBG] pgmap v611: 204 pgs: 3 creating+peering, 4 unknown, 197 active+clean; 26 KiB data, 310 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-28T04:03:21.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:20 smithi100 bash[9834]: audit 2021-01-28T04:03:19.633851+0000 mon.a (mon.0) 1680 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-38"}]': finished 2021-01-28T04:03:21.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:20 smithi100 bash[9834]: cluster 2021-01-28T04:03:19.634175+0000 mon.a (mon.0) 1681 : cluster [DBG] osdmap e241: 8 total, 8 up, 8 in 2021-01-28T04:03:21.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:20 smithi100 bash[9834]: audit 2021-01-28T04:03:19.637914+0000 mon.c (mon.1) 295 : audit [INF] from='client.? 172.21.15.100:0/3050203363' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-46"}]: dispatch 2021-01-28T04:03:21.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:20 smithi100 bash[9834]: audit 2021-01-28T04:03:19.641119+0000 mon.c (mon.1) 296 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:21.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:20 smithi100 bash[9834]: audit 2021-01-28T04:03:19.641287+0000 mon.a (mon.0) 1682 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-46"}]: dispatch 2021-01-28T04:03:21.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:20 smithi100 bash[9834]: audit 2021-01-28T04:03:19.641738+0000 mon.a (mon.0) 1683 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:21.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:20 smithi100 bash[9834]: audit 2021-01-28T04:03:19.664106+0000 mon.c (mon.1) 297 : audit [INF] from='client.? 172.21.15.100:0/2535583778' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-39"}]: dispatch 2021-01-28T04:03:21.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:20 smithi100 bash[9834]: audit 2021-01-28T04:03:19.664471+0000 mon.a (mon.0) 1684 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-39"}]: dispatch 2021-01-28T04:03:21.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:20 smithi100 bash[9834]: audit 2021-01-28T04:03:19.665303+0000 mon.c (mon.1) 298 : audit [INF] from='client.? 172.21.15.100:0/2535583778' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-39"}]: dispatch 2021-01-28T04:03:21.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:20 smithi100 bash[9834]: audit 2021-01-28T04:03:19.665644+0000 mon.a (mon.0) 1685 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-39"}]: dispatch 2021-01-28T04:03:21.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:20 smithi100 bash[9834]: audit 2021-01-28T04:03:19.666182+0000 mon.c (mon.1) 299 : audit [INF] from='client.? 172.21.15.100:0/2535583778' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:21.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:20 smithi100 bash[9834]: audit 2021-01-28T04:03:19.666493+0000 mon.a (mon.0) 1686 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:21.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:20 smithi100 bash[9834]: audit 2021-01-28T04:03:19.871417+0000 mgr.y (mgr.14138) 621 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:03:21.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:20 smithi100 bash[13549]: cluster 2021-01-28T04:03:19.613625+0000 mgr.y (mgr.14138) 620 : cluster [DBG] pgmap v611: 204 pgs: 3 creating+peering, 4 unknown, 197 active+clean; 26 KiB data, 310 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-28T04:03:21.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:20 smithi100 bash[13549]: audit 2021-01-28T04:03:19.633851+0000 mon.a (mon.0) 1680 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-38"}]': finished 2021-01-28T04:03:21.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:20 smithi100 bash[13549]: cluster 2021-01-28T04:03:19.634175+0000 mon.a (mon.0) 1681 : cluster [DBG] osdmap e241: 8 total, 8 up, 8 in 2021-01-28T04:03:21.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:20 smithi100 bash[13549]: audit 2021-01-28T04:03:19.637914+0000 mon.c (mon.1) 295 : audit [INF] from='client.? 172.21.15.100:0/3050203363' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-46"}]: dispatch 2021-01-28T04:03:21.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:20 smithi100 bash[13549]: audit 2021-01-28T04:03:19.641119+0000 mon.c (mon.1) 296 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:21.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:20 smithi100 bash[13549]: audit 2021-01-28T04:03:19.641287+0000 mon.a (mon.0) 1682 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-46"}]: dispatch 2021-01-28T04:03:21.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:20 smithi100 bash[13549]: audit 2021-01-28T04:03:19.641738+0000 mon.a (mon.0) 1683 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:21.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:20 smithi100 bash[13549]: audit 2021-01-28T04:03:19.664106+0000 mon.c (mon.1) 297 : audit [INF] from='client.? 172.21.15.100:0/2535583778' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-39"}]: dispatch 2021-01-28T04:03:21.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:20 smithi100 bash[13549]: audit 2021-01-28T04:03:19.664471+0000 mon.a (mon.0) 1684 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-39"}]: dispatch 2021-01-28T04:03:21.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:20 smithi100 bash[13549]: audit 2021-01-28T04:03:19.665303+0000 mon.c (mon.1) 298 : audit [INF] from='client.? 172.21.15.100:0/2535583778' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-39"}]: dispatch 2021-01-28T04:03:21.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:20 smithi100 bash[13549]: audit 2021-01-28T04:03:19.665644+0000 mon.a (mon.0) 1685 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-39"}]: dispatch 2021-01-28T04:03:21.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:20 smithi100 bash[13549]: audit 2021-01-28T04:03:19.666182+0000 mon.c (mon.1) 299 : audit [INF] from='client.? 172.21.15.100:0/2535583778' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:21.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:20 smithi100 bash[13549]: audit 2021-01-28T04:03:19.666493+0000 mon.a (mon.0) 1686 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:21.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:20 smithi100 bash[13549]: audit 2021-01-28T04:03:19.871417+0000 mgr.y (mgr.14138) 621 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:03:22.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:22 smithi162 bash[9856]: audit 2021-01-28T04:03:20.638651+0000 mon.a (mon.0) 1687 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-46"}]': finished 2021-01-28T04:03:22.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:22 smithi162 bash[9856]: audit 2021-01-28T04:03:20.638825+0000 mon.a (mon.0) 1688 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-33","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:03:22.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:22 smithi162 bash[9856]: audit 2021-01-28T04:03:20.639781+0000 mon.a (mon.0) 1689 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:03:22.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:22 smithi162 bash[9856]: cluster 2021-01-28T04:03:20.640246+0000 mon.a (mon.0) 1690 : cluster [DBG] osdmap e242: 8 total, 8 up, 8 in 2021-01-28T04:03:22.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:22 smithi162 bash[9856]: audit 2021-01-28T04:03:20.642777+0000 mon.c (mon.1) 300 : audit [INF] from='client.? 172.21.15.100:0/3050203363' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-46"}]: dispatch 2021-01-28T04:03:22.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:22 smithi162 bash[9856]: audit 2021-01-28T04:03:20.646157+0000 mon.c (mon.1) 301 : audit [INF] from='client.? 172.21.15.100:0/2535583778' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-39"}]: dispatch 2021-01-28T04:03:22.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:22 smithi162 bash[9856]: audit 2021-01-28T04:03:20.647143+0000 mon.a (mon.0) 1691 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-46"}]: dispatch 2021-01-28T04:03:22.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:22 smithi162 bash[9856]: audit 2021-01-28T04:03:20.648205+0000 mon.c (mon.1) 302 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-33", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:03:22.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:22 smithi162 bash[9856]: audit 2021-01-28T04:03:20.655720+0000 mon.a (mon.0) 1692 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-39"}]: dispatch 2021-01-28T04:03:22.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:22 smithi162 bash[9856]: audit 2021-01-28T04:03:20.656350+0000 mon.a (mon.0) 1693 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-33", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:03:22.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:22 smithi100 bash[9834]: audit 2021-01-28T04:03:20.638651+0000 mon.a (mon.0) 1687 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-46"}]': finished 2021-01-28T04:03:22.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:22 smithi100 bash[9834]: audit 2021-01-28T04:03:20.638825+0000 mon.a (mon.0) 1688 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-33","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:03:22.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:22 smithi100 bash[9834]: audit 2021-01-28T04:03:20.639781+0000 mon.a (mon.0) 1689 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:03:22.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:22 smithi100 bash[9834]: cluster 2021-01-28T04:03:20.640246+0000 mon.a (mon.0) 1690 : cluster [DBG] osdmap e242: 8 total, 8 up, 8 in 2021-01-28T04:03:22.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:22 smithi100 bash[9834]: audit 2021-01-28T04:03:20.642777+0000 mon.c (mon.1) 300 : audit [INF] from='client.? 172.21.15.100:0/3050203363' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-46"}]: dispatch 2021-01-28T04:03:22.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:22 smithi100 bash[9834]: audit 2021-01-28T04:03:20.646157+0000 mon.c (mon.1) 301 : audit [INF] from='client.? 172.21.15.100:0/2535583778' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-39"}]: dispatch 2021-01-28T04:03:22.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:22 smithi100 bash[9834]: audit 2021-01-28T04:03:20.647143+0000 mon.a (mon.0) 1691 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-46"}]: dispatch 2021-01-28T04:03:22.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:22 smithi100 bash[9834]: audit 2021-01-28T04:03:20.648205+0000 mon.c (mon.1) 302 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-33", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:03:22.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:22 smithi100 bash[9834]: audit 2021-01-28T04:03:20.655720+0000 mon.a (mon.0) 1692 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-39"}]: dispatch 2021-01-28T04:03:22.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:22 smithi100 bash[9834]: audit 2021-01-28T04:03:20.656350+0000 mon.a (mon.0) 1693 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-33", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:03:22.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:22 smithi100 bash[13549]: audit 2021-01-28T04:03:20.638651+0000 mon.a (mon.0) 1687 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-46"}]': finished 2021-01-28T04:03:22.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:22 smithi100 bash[13549]: audit 2021-01-28T04:03:20.638825+0000 mon.a (mon.0) 1688 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-33","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:03:22.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:22 smithi100 bash[13549]: audit 2021-01-28T04:03:20.639781+0000 mon.a (mon.0) 1689 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:03:22.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:22 smithi100 bash[13549]: cluster 2021-01-28T04:03:20.640246+0000 mon.a (mon.0) 1690 : cluster [DBG] osdmap e242: 8 total, 8 up, 8 in 2021-01-28T04:03:22.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:22 smithi100 bash[13549]: audit 2021-01-28T04:03:20.642777+0000 mon.c (mon.1) 300 : audit [INF] from='client.? 172.21.15.100:0/3050203363' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-46"}]: dispatch 2021-01-28T04:03:22.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:22 smithi100 bash[13549]: audit 2021-01-28T04:03:20.646157+0000 mon.c (mon.1) 301 : audit [INF] from='client.? 172.21.15.100:0/2535583778' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-39"}]: dispatch 2021-01-28T04:03:22.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:22 smithi100 bash[13549]: audit 2021-01-28T04:03:20.647143+0000 mon.a (mon.0) 1691 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-46"}]: dispatch 2021-01-28T04:03:22.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:22 smithi100 bash[13549]: audit 2021-01-28T04:03:20.648205+0000 mon.c (mon.1) 302 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-33", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:03:22.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:22 smithi100 bash[13549]: audit 2021-01-28T04:03:20.655720+0000 mon.a (mon.0) 1692 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-39"}]: dispatch 2021-01-28T04:03:22.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:22 smithi100 bash[13549]: audit 2021-01-28T04:03:20.656350+0000 mon.a (mon.0) 1693 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-33", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:03:23.763 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:23 smithi162 bash[9856]: cluster 2021-01-28T04:03:21.614696+0000 mgr.y (mgr.14138) 622 : cluster [DBG] pgmap v614: 228 pgs: 29 unknown, 199 active+clean; 26 KiB data, 310 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-28T04:03:23.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:23 smithi162 bash[9856]: audit 2021-01-28T04:03:21.639219+0000 mon.a (mon.0) 1694 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-46"}]': finished 2021-01-28T04:03:23.764 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:23 smithi162 bash[9856]: audit 2021-01-28T04:03:22.063822+0000 mon.a (mon.0) 1695 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-33", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:03:23.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:23 smithi162 bash[9856]: cluster 2021-01-28T04:03:22.064027+0000 mon.a (mon.0) 1696 : cluster [DBG] osdmap e243: 8 total, 8 up, 8 in 2021-01-28T04:03:23.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:23 smithi162 bash[9856]: audit 2021-01-28T04:03:22.065126+0000 mon.c (mon.1) 303 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-33"}]: dispatch 2021-01-28T04:03:23.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:23 smithi162 bash[9856]: audit 2021-01-28T04:03:22.494862+0000 mon.a (mon.0) 1697 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-33"}]: dispatch 2021-01-28T04:03:23.765 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:23 smithi162 bash[9856]: audit 2021-01-28T04:03:22.647026+0000 mon.a (mon.0) 1698 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-39"}]': finished 2021-01-28T04:03:23.766 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:23 smithi162 bash[9856]: audit 2021-01-28T04:03:22.647161+0000 mon.a (mon.0) 1699 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-33"}]': finished 2021-01-28T04:03:23.767 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:23 smithi162 bash[9856]: cluster 2021-01-28T04:03:22.647229+0000 mon.a (mon.0) 1700 : cluster [DBG] osdmap e244: 8 total, 8 up, 8 in 2021-01-28T04:03:23.767 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:23 smithi162 bash[9856]: audit 2021-01-28T04:03:22.650678+0000 mon.c (mon.1) 304 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-33", "mode": "writeback"}]: dispatch 2021-01-28T04:03:23.767 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:23 smithi162 bash[9856]: audit 2021-01-28T04:03:22.651063+0000 mon.c (mon.1) 305 : audit [INF] from='client.? 172.21.15.100:0/2809108197' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:23.768 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:23 smithi162 bash[9856]: audit 2021-01-28T04:03:22.652306+0000 mon.a (mon.0) 1701 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-33", "mode": "writeback"}]: dispatch 2021-01-28T04:03:23.768 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:23 smithi162 bash[9856]: audit 2021-01-28T04:03:22.652537+0000 mon.a (mon.0) 1702 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:23.828 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:23 smithi100 bash[9834]: cluster 2021-01-28T04:03:21.614696+0000 mgr.y (mgr.14138) 622 : cluster [DBG] pgmap v614: 228 pgs: 29 unknown, 199 active+clean; 26 KiB data, 310 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-28T04:03:23.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:23 smithi100 bash[9834]: audit 2021-01-28T04:03:21.639219+0000 mon.a (mon.0) 1694 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-46"}]': finished 2021-01-28T04:03:23.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:23 smithi100 bash[9834]: audit 2021-01-28T04:03:22.063822+0000 mon.a (mon.0) 1695 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-33", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:03:23.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:23 smithi100 bash[9834]: cluster 2021-01-28T04:03:22.064027+0000 mon.a (mon.0) 1696 : cluster [DBG] osdmap e243: 8 total, 8 up, 8 in 2021-01-28T04:03:23.829 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:23 smithi100 bash[9834]: audit 2021-01-28T04:03:22.065126+0000 mon.c (mon.1) 303 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-33"}]: dispatch 2021-01-28T04:03:23.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:23 smithi100 bash[9834]: audit 2021-01-28T04:03:22.494862+0000 mon.a (mon.0) 1697 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-33"}]: dispatch 2021-01-28T04:03:23.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:23 smithi100 bash[9834]: audit 2021-01-28T04:03:22.647026+0000 mon.a (mon.0) 1698 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-39"}]': finished 2021-01-28T04:03:23.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:23 smithi100 bash[9834]: audit 2021-01-28T04:03:22.647161+0000 mon.a (mon.0) 1699 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-33"}]': finished 2021-01-28T04:03:23.830 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:23 smithi100 bash[9834]: cluster 2021-01-28T04:03:22.647229+0000 mon.a (mon.0) 1700 : cluster [DBG] osdmap e244: 8 total, 8 up, 8 in 2021-01-28T04:03:23.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:23 smithi100 bash[9834]: audit 2021-01-28T04:03:22.650678+0000 mon.c (mon.1) 304 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-33", "mode": "writeback"}]: dispatch 2021-01-28T04:03:23.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:23 smithi100 bash[9834]: audit 2021-01-28T04:03:22.651063+0000 mon.c (mon.1) 305 : audit [INF] from='client.? 172.21.15.100:0/2809108197' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:23.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:23 smithi100 bash[9834]: audit 2021-01-28T04:03:22.652306+0000 mon.a (mon.0) 1701 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-33", "mode": "writeback"}]: dispatch 2021-01-28T04:03:23.831 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:23 smithi100 bash[9834]: audit 2021-01-28T04:03:22.652537+0000 mon.a (mon.0) 1702 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:23.831 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:23 smithi100 bash[13549]: cluster 2021-01-28T04:03:21.614696+0000 mgr.y (mgr.14138) 622 : cluster [DBG] pgmap v614: 228 pgs: 29 unknown, 199 active+clean; 26 KiB data, 310 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-28T04:03:23.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:23 smithi100 bash[13549]: audit 2021-01-28T04:03:21.639219+0000 mon.a (mon.0) 1694 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-46"}]': finished 2021-01-28T04:03:23.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:23 smithi100 bash[13549]: audit 2021-01-28T04:03:22.063822+0000 mon.a (mon.0) 1695 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-33", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:03:23.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:23 smithi100 bash[13549]: cluster 2021-01-28T04:03:22.064027+0000 mon.a (mon.0) 1696 : cluster [DBG] osdmap e243: 8 total, 8 up, 8 in 2021-01-28T04:03:23.832 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:23 smithi100 bash[13549]: audit 2021-01-28T04:03:22.065126+0000 mon.c (mon.1) 303 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-33"}]: dispatch 2021-01-28T04:03:23.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:23 smithi100 bash[13549]: audit 2021-01-28T04:03:22.494862+0000 mon.a (mon.0) 1697 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-33"}]: dispatch 2021-01-28T04:03:23.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:23 smithi100 bash[13549]: audit 2021-01-28T04:03:22.647026+0000 mon.a (mon.0) 1698 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-39"}]': finished 2021-01-28T04:03:23.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:23 smithi100 bash[13549]: audit 2021-01-28T04:03:22.647161+0000 mon.a (mon.0) 1699 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-33"}]': finished 2021-01-28T04:03:23.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:23 smithi100 bash[13549]: cluster 2021-01-28T04:03:22.647229+0000 mon.a (mon.0) 1700 : cluster [DBG] osdmap e244: 8 total, 8 up, 8 in 2021-01-28T04:03:23.833 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:23 smithi100 bash[13549]: audit 2021-01-28T04:03:22.650678+0000 mon.c (mon.1) 304 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-33", "mode": "writeback"}]: dispatch 2021-01-28T04:03:23.834 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:23 smithi100 bash[13549]: audit 2021-01-28T04:03:22.651063+0000 mon.c (mon.1) 305 : audit [INF] from='client.? 172.21.15.100:0/2809108197' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:23.834 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:23 smithi100 bash[13549]: audit 2021-01-28T04:03:22.652306+0000 mon.a (mon.0) 1701 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-33", "mode": "writeback"}]: dispatch 2021-01-28T04:03:23.834 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:23 smithi100 bash[13549]: audit 2021-01-28T04:03:22.652537+0000 mon.a (mon.0) 1702 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:25.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:24 smithi162 bash[9856]: cluster 2021-01-28T04:03:23.616027+0000 mgr.y (mgr.14138) 623 : cluster [DBG] pgmap v617: 268 pgs: 16 creating+peering, 36 unknown, 216 active+clean; 26 KiB data, 315 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:03:25.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:24 smithi162 bash[9856]: cluster 2021-01-28T04:03:23.636875+0000 mon.a (mon.0) 1703 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:03:25.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:24 smithi162 bash[9856]: audit 2021-01-28T04:03:23.650241+0000 mon.a (mon.0) 1704 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-33", "mode": "writeback"}]': finished 2021-01-28T04:03:25.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:24 smithi162 bash[9856]: audit 2021-01-28T04:03:23.650358+0000 mon.a (mon.0) 1705 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-47","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:03:25.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:24 smithi162 bash[9856]: cluster 2021-01-28T04:03:23.650581+0000 mon.a (mon.0) 1706 : cluster [DBG] osdmap e245: 8 total, 8 up, 8 in 2021-01-28T04:03:25.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:24 smithi100 bash[9834]: cluster 2021-01-28T04:03:23.616027+0000 mgr.y (mgr.14138) 623 : cluster [DBG] pgmap v617: 268 pgs: 16 creating+peering, 36 unknown, 216 active+clean; 26 KiB data, 315 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:03:25.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:24 smithi100 bash[9834]: cluster 2021-01-28T04:03:23.636875+0000 mon.a (mon.0) 1703 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:03:25.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:24 smithi100 bash[9834]: audit 2021-01-28T04:03:23.650241+0000 mon.a (mon.0) 1704 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-33", "mode": "writeback"}]': finished 2021-01-28T04:03:25.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:24 smithi100 bash[9834]: audit 2021-01-28T04:03:23.650358+0000 mon.a (mon.0) 1705 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-47","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:03:25.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:24 smithi100 bash[9834]: cluster 2021-01-28T04:03:23.650581+0000 mon.a (mon.0) 1706 : cluster [DBG] osdmap e245: 8 total, 8 up, 8 in 2021-01-28T04:03:25.079 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:24 smithi100 bash[13549]: cluster 2021-01-28T04:03:23.616027+0000 mgr.y (mgr.14138) 623 : cluster [DBG] pgmap v617: 268 pgs: 16 creating+peering, 36 unknown, 216 active+clean; 26 KiB data, 315 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:03:25.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:24 smithi100 bash[13549]: cluster 2021-01-28T04:03:23.636875+0000 mon.a (mon.0) 1703 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:03:25.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:24 smithi100 bash[13549]: audit 2021-01-28T04:03:23.650241+0000 mon.a (mon.0) 1704 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-33", "mode": "writeback"}]': finished 2021-01-28T04:03:25.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:24 smithi100 bash[13549]: audit 2021-01-28T04:03:23.650358+0000 mon.a (mon.0) 1705 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32163-47","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:03:25.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:24 smithi100 bash[13549]: cluster 2021-01-28T04:03:23.650581+0000 mon.a (mon.0) 1706 : cluster [DBG] osdmap e245: 8 total, 8 up, 8 in 2021-01-28T04:03:26.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:25 smithi162 bash[9856]: cluster 2021-01-28T04:03:24.647893+0000 mon.a (mon.0) 1707 : cluster [DBG] osdmap e246: 8 total, 8 up, 8 in 2021-01-28T04:03:26.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:25 smithi162 bash[9856]: audit 2021-01-28T04:03:24.650433+0000 mon.c (mon.1) 306 : audit [INF] from='client.? 172.21.15.100:0/2535583778' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-39"}]: dispatch 2021-01-28T04:03:26.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:25 smithi162 bash[9856]: audit 2021-01-28T04:03:24.652555+0000 mon.a (mon.0) 1708 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-39"}]: dispatch 2021-01-28T04:03:26.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:25 smithi162 bash[9856]: audit 2021-01-28T04:03:24.676809+0000 mon.c (mon.1) 307 : audit [INF] from='client.? 172.21.15.100:0/3618017223' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-48"}]: dispatch 2021-01-28T04:03:26.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:25 smithi162 bash[9856]: audit 2021-01-28T04:03:24.677292+0000 mon.a (mon.0) 1709 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-48"}]: dispatch 2021-01-28T04:03:26.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:25 smithi162 bash[9856]: audit 2021-01-28T04:03:24.678163+0000 mon.c (mon.1) 308 : audit [INF] from='client.? 172.21.15.100:0/3618017223' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-48"}]: dispatch 2021-01-28T04:03:26.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:25 smithi162 bash[9856]: audit 2021-01-28T04:03:24.678534+0000 mon.a (mon.0) 1710 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-48"}]: dispatch 2021-01-28T04:03:26.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:25 smithi162 bash[9856]: audit 2021-01-28T04:03:24.679182+0000 mon.c (mon.1) 309 : audit [INF] from='client.? 172.21.15.100:0/3618017223' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:26.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:25 smithi162 bash[9856]: audit 2021-01-28T04:03:24.679560+0000 mon.a (mon.0) 1711 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:26.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:25 smithi100 bash[9834]: cluster 2021-01-28T04:03:24.647893+0000 mon.a (mon.0) 1707 : cluster [DBG] osdmap e246: 8 total, 8 up, 8 in 2021-01-28T04:03:26.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:25 smithi100 bash[9834]: audit 2021-01-28T04:03:24.650433+0000 mon.c (mon.1) 306 : audit [INF] from='client.? 172.21.15.100:0/2535583778' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-39"}]: dispatch 2021-01-28T04:03:26.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:25 smithi100 bash[9834]: audit 2021-01-28T04:03:24.652555+0000 mon.a (mon.0) 1708 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-39"}]: dispatch 2021-01-28T04:03:26.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:25 smithi100 bash[9834]: audit 2021-01-28T04:03:24.676809+0000 mon.c (mon.1) 307 : audit [INF] from='client.? 172.21.15.100:0/3618017223' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-48"}]: dispatch 2021-01-28T04:03:26.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:25 smithi100 bash[9834]: audit 2021-01-28T04:03:24.677292+0000 mon.a (mon.0) 1709 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-48"}]: dispatch 2021-01-28T04:03:26.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:25 smithi100 bash[9834]: audit 2021-01-28T04:03:24.678163+0000 mon.c (mon.1) 308 : audit [INF] from='client.? 172.21.15.100:0/3618017223' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-48"}]: dispatch 2021-01-28T04:03:26.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:25 smithi100 bash[9834]: audit 2021-01-28T04:03:24.678534+0000 mon.a (mon.0) 1710 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-48"}]: dispatch 2021-01-28T04:03:26.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:25 smithi100 bash[9834]: audit 2021-01-28T04:03:24.679182+0000 mon.c (mon.1) 309 : audit [INF] from='client.? 172.21.15.100:0/3618017223' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:26.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:25 smithi100 bash[9834]: audit 2021-01-28T04:03:24.679560+0000 mon.a (mon.0) 1711 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:26.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:25 smithi100 bash[13549]: cluster 2021-01-28T04:03:24.647893+0000 mon.a (mon.0) 1707 : cluster [DBG] osdmap e246: 8 total, 8 up, 8 in 2021-01-28T04:03:26.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:25 smithi100 bash[13549]: audit 2021-01-28T04:03:24.650433+0000 mon.c (mon.1) 306 : audit [INF] from='client.? 172.21.15.100:0/2535583778' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-39"}]: dispatch 2021-01-28T04:03:26.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:25 smithi100 bash[13549]: audit 2021-01-28T04:03:24.652555+0000 mon.a (mon.0) 1708 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-39"}]: dispatch 2021-01-28T04:03:26.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:25 smithi100 bash[13549]: audit 2021-01-28T04:03:24.676809+0000 mon.c (mon.1) 307 : audit [INF] from='client.? 172.21.15.100:0/3618017223' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-48"}]: dispatch 2021-01-28T04:03:26.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:25 smithi100 bash[13549]: audit 2021-01-28T04:03:24.677292+0000 mon.a (mon.0) 1709 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-48"}]: dispatch 2021-01-28T04:03:26.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:25 smithi100 bash[13549]: audit 2021-01-28T04:03:24.678163+0000 mon.c (mon.1) 308 : audit [INF] from='client.? 172.21.15.100:0/3618017223' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-48"}]: dispatch 2021-01-28T04:03:26.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:25 smithi100 bash[13549]: audit 2021-01-28T04:03:24.678534+0000 mon.a (mon.0) 1710 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-48"}]: dispatch 2021-01-28T04:03:26.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:25 smithi100 bash[13549]: audit 2021-01-28T04:03:24.679182+0000 mon.c (mon.1) 309 : audit [INF] from='client.? 172.21.15.100:0/3618017223' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:26.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:25 smithi100 bash[13549]: audit 2021-01-28T04:03:24.679560+0000 mon.a (mon.0) 1711 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:27.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:26 smithi162 bash[9856]: cluster 2021-01-28T04:03:25.617136+0000 mgr.y (mgr.14138) 624 : cluster [DBG] pgmap v620: 228 pgs: 228 active+clean; 26 KiB data, 316 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:03:27.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:26 smithi162 bash[9856]: audit 2021-01-28T04:03:25.656852+0000 mon.a (mon.0) 1712 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-39"}]': finished 2021-01-28T04:03:27.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:26 smithi162 bash[9856]: audit 2021-01-28T04:03:25.657010+0000 mon.a (mon.0) 1713 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:03:27.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:26 smithi162 bash[9856]: cluster 2021-01-28T04:03:25.657105+0000 mon.a (mon.0) 1714 : cluster [DBG] osdmap e247: 8 total, 8 up, 8 in 2021-01-28T04:03:27.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:26 smithi162 bash[9856]: audit 2021-01-28T04:03:25.658866+0000 mon.c (mon.1) 310 : audit [INF] from='client.? 172.21.15.100:0/2535583778' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-39"}]: dispatch 2021-01-28T04:03:27.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:26 smithi162 bash[9856]: audit 2021-01-28T04:03:25.659287+0000 mon.c (mon.1) 311 : audit [INF] from='client.? 172.21.15.100:0/3618017223' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-48"}]: dispatch 2021-01-28T04:03:27.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:26 smithi162 bash[9856]: audit 2021-01-28T04:03:25.662388+0000 mon.a (mon.0) 1715 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-39"}]: dispatch 2021-01-28T04:03:27.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:26 smithi162 bash[9856]: audit 2021-01-28T04:03:25.662806+0000 mon.a (mon.0) 1716 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-48"}]: dispatch 2021-01-28T04:03:27.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:26 smithi162 bash[9856]: audit 2021-01-28T04:03:25.762160+0000 mon.c (mon.1) 312 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:03:27.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:26 smithi162 bash[9856]: audit 2021-01-28T04:03:25.762966+0000 mon.a (mon.0) 1717 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:03:27.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:26 smithi100 bash[9834]: cluster 2021-01-28T04:03:25.617136+0000 mgr.y (mgr.14138) 624 : cluster [DBG] pgmap v620: 228 pgs: 228 active+clean; 26 KiB data, 316 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:03:27.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:26 smithi100 bash[9834]: audit 2021-01-28T04:03:25.656852+0000 mon.a (mon.0) 1712 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-39"}]': finished 2021-01-28T04:03:27.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:26 smithi100 bash[9834]: audit 2021-01-28T04:03:25.657010+0000 mon.a (mon.0) 1713 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:03:27.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:26 smithi100 bash[9834]: cluster 2021-01-28T04:03:25.657105+0000 mon.a (mon.0) 1714 : cluster [DBG] osdmap e247: 8 total, 8 up, 8 in 2021-01-28T04:03:27.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:26 smithi100 bash[9834]: audit 2021-01-28T04:03:25.658866+0000 mon.c (mon.1) 310 : audit [INF] from='client.? 172.21.15.100:0/2535583778' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-39"}]: dispatch 2021-01-28T04:03:27.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:26 smithi100 bash[9834]: audit 2021-01-28T04:03:25.659287+0000 mon.c (mon.1) 311 : audit [INF] from='client.? 172.21.15.100:0/3618017223' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-48"}]: dispatch 2021-01-28T04:03:27.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:26 smithi100 bash[9834]: audit 2021-01-28T04:03:25.662388+0000 mon.a (mon.0) 1715 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-39"}]: dispatch 2021-01-28T04:03:27.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:26 smithi100 bash[9834]: audit 2021-01-28T04:03:25.662806+0000 mon.a (mon.0) 1716 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-48"}]: dispatch 2021-01-28T04:03:27.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:26 smithi100 bash[9834]: audit 2021-01-28T04:03:25.762160+0000 mon.c (mon.1) 312 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:03:27.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:26 smithi100 bash[9834]: audit 2021-01-28T04:03:25.762966+0000 mon.a (mon.0) 1717 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:03:27.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:26 smithi100 bash[13549]: cluster 2021-01-28T04:03:25.617136+0000 mgr.y (mgr.14138) 624 : cluster [DBG] pgmap v620: 228 pgs: 228 active+clean; 26 KiB data, 316 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:03:27.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:26 smithi100 bash[13549]: audit 2021-01-28T04:03:25.656852+0000 mon.a (mon.0) 1712 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-39"}]': finished 2021-01-28T04:03:27.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:26 smithi100 bash[13549]: audit 2021-01-28T04:03:25.657010+0000 mon.a (mon.0) 1713 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:03:27.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:26 smithi100 bash[13549]: cluster 2021-01-28T04:03:25.657105+0000 mon.a (mon.0) 1714 : cluster [DBG] osdmap e247: 8 total, 8 up, 8 in 2021-01-28T04:03:27.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:26 smithi100 bash[13549]: audit 2021-01-28T04:03:25.658866+0000 mon.c (mon.1) 310 : audit [INF] from='client.? 172.21.15.100:0/2535583778' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-39"}]: dispatch 2021-01-28T04:03:27.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:26 smithi100 bash[13549]: audit 2021-01-28T04:03:25.659287+0000 mon.c (mon.1) 311 : audit [INF] from='client.? 172.21.15.100:0/3618017223' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-48"}]: dispatch 2021-01-28T04:03:27.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:26 smithi100 bash[13549]: audit 2021-01-28T04:03:25.662388+0000 mon.a (mon.0) 1715 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-39"}]: dispatch 2021-01-28T04:03:27.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:26 smithi100 bash[13549]: audit 2021-01-28T04:03:25.662806+0000 mon.a (mon.0) 1716 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-48"}]: dispatch 2021-01-28T04:03:27.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:26 smithi100 bash[13549]: audit 2021-01-28T04:03:25.762160+0000 mon.c (mon.1) 312 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:03:27.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:26 smithi100 bash[13549]: audit 2021-01-28T04:03:25.762966+0000 mon.a (mon.0) 1717 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:03:28.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:27 smithi162 bash[9856]: audit 2021-01-28T04:03:26.668636+0000 mon.a (mon.0) 1718 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-39"}]': finished 2021-01-28T04:03:28.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:27 smithi162 bash[9856]: audit 2021-01-28T04:03:26.691711+0000 mon.c (mon.1) 313 : audit [INF] from='client.? 172.21.15.100:0/313343182' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-40"}]: dispatch 2021-01-28T04:03:28.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:27 smithi162 bash[9856]: audit 2021-01-28T04:03:27.096966+0000 mon.a (mon.0) 1719 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:03:28.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:27 smithi162 bash[9856]: cluster 2021-01-28T04:03:27.097181+0000 mon.a (mon.0) 1720 : cluster [DBG] osdmap e248: 8 total, 8 up, 8 in 2021-01-28T04:03:28.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:27 smithi162 bash[9856]: audit 2021-01-28T04:03:27.098660+0000 mon.a (mon.0) 1721 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-40"}]: dispatch 2021-01-28T04:03:28.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:27 smithi162 bash[9856]: audit 2021-01-28T04:03:27.099611+0000 mon.c (mon.1) 314 : audit [INF] from='client.? 172.21.15.100:0/313343182' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-40"}]: dispatch 2021-01-28T04:03:28.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:27 smithi162 bash[9856]: audit 2021-01-28T04:03:27.100023+0000 mon.a (mon.0) 1722 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-40"}]: dispatch 2021-01-28T04:03:28.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:27 smithi162 bash[9856]: audit 2021-01-28T04:03:27.100892+0000 mon.c (mon.1) 315 : audit [INF] from='client.? 172.21.15.100:0/313343182' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:28.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:27 smithi162 bash[9856]: audit 2021-01-28T04:03:27.101405+0000 mon.a (mon.0) 1723 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:28.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:27 smithi162 bash[9856]: audit 2021-01-28T04:03:27.103065+0000 mon.c (mon.1) 316 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-33"}]: dispatch 2021-01-28T04:03:28.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:27 smithi162 bash[9856]: audit 2021-01-28T04:03:27.103596+0000 mon.a (mon.0) 1724 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-33"}]: dispatch 2021-01-28T04:03:28.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:27 smithi100 bash[9834]: audit 2021-01-28T04:03:26.668636+0000 mon.a (mon.0) 1718 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-39"}]': finished 2021-01-28T04:03:28.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:27 smithi100 bash[9834]: audit 2021-01-28T04:03:26.691711+0000 mon.c (mon.1) 313 : audit [INF] from='client.? 172.21.15.100:0/313343182' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-40"}]: dispatch 2021-01-28T04:03:28.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:27 smithi100 bash[9834]: audit 2021-01-28T04:03:27.096966+0000 mon.a (mon.0) 1719 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:03:28.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:27 smithi100 bash[9834]: cluster 2021-01-28T04:03:27.097181+0000 mon.a (mon.0) 1720 : cluster [DBG] osdmap e248: 8 total, 8 up, 8 in 2021-01-28T04:03:28.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:27 smithi100 bash[9834]: audit 2021-01-28T04:03:27.098660+0000 mon.a (mon.0) 1721 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-40"}]: dispatch 2021-01-28T04:03:28.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:27 smithi100 bash[9834]: audit 2021-01-28T04:03:27.099611+0000 mon.c (mon.1) 314 : audit [INF] from='client.? 172.21.15.100:0/313343182' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-40"}]: dispatch 2021-01-28T04:03:28.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:27 smithi100 bash[9834]: audit 2021-01-28T04:03:27.100023+0000 mon.a (mon.0) 1722 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-40"}]: dispatch 2021-01-28T04:03:28.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:27 smithi100 bash[9834]: audit 2021-01-28T04:03:27.100892+0000 mon.c (mon.1) 315 : audit [INF] from='client.? 172.21.15.100:0/313343182' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:28.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:27 smithi100 bash[9834]: audit 2021-01-28T04:03:27.101405+0000 mon.a (mon.0) 1723 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:28.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:27 smithi100 bash[9834]: audit 2021-01-28T04:03:27.103065+0000 mon.c (mon.1) 316 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-33"}]: dispatch 2021-01-28T04:03:28.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:27 smithi100 bash[9834]: audit 2021-01-28T04:03:27.103596+0000 mon.a (mon.0) 1724 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-33"}]: dispatch 2021-01-28T04:03:28.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:27 smithi100 bash[13549]: audit 2021-01-28T04:03:26.668636+0000 mon.a (mon.0) 1718 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-39"}]': finished 2021-01-28T04:03:28.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:27 smithi100 bash[13549]: audit 2021-01-28T04:03:26.691711+0000 mon.c (mon.1) 313 : audit [INF] from='client.? 172.21.15.100:0/313343182' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-40"}]: dispatch 2021-01-28T04:03:28.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:27 smithi100 bash[13549]: audit 2021-01-28T04:03:27.096966+0000 mon.a (mon.0) 1719 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:03:28.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:27 smithi100 bash[13549]: cluster 2021-01-28T04:03:27.097181+0000 mon.a (mon.0) 1720 : cluster [DBG] osdmap e248: 8 total, 8 up, 8 in 2021-01-28T04:03:28.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:27 smithi100 bash[13549]: audit 2021-01-28T04:03:27.098660+0000 mon.a (mon.0) 1721 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-40"}]: dispatch 2021-01-28T04:03:28.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:27 smithi100 bash[13549]: audit 2021-01-28T04:03:27.099611+0000 mon.c (mon.1) 314 : audit [INF] from='client.? 172.21.15.100:0/313343182' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-40"}]: dispatch 2021-01-28T04:03:28.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:27 smithi100 bash[13549]: audit 2021-01-28T04:03:27.100023+0000 mon.a (mon.0) 1722 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-40"}]: dispatch 2021-01-28T04:03:28.087 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:27 smithi100 bash[13549]: audit 2021-01-28T04:03:27.100892+0000 mon.c (mon.1) 315 : audit [INF] from='client.? 172.21.15.100:0/313343182' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:28.087 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:27 smithi100 bash[13549]: audit 2021-01-28T04:03:27.101405+0000 mon.a (mon.0) 1723 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:28.088 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:27 smithi100 bash[13549]: audit 2021-01-28T04:03:27.103065+0000 mon.c (mon.1) 316 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-33"}]: dispatch 2021-01-28T04:03:28.088 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:27 smithi100 bash[13549]: audit 2021-01-28T04:03:27.103596+0000 mon.a (mon.0) 1724 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-33"}]: dispatch 2021-01-28T04:03:29.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:29 smithi162 bash[9856]: cluster 2021-01-28T04:03:27.618538+0000 mgr.y (mgr.14138) 625 : cluster [DBG] pgmap v623: 228 pgs: 228 active+clean; 26 KiB data, 317 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 767 B/s wr, 1 op/s 2021-01-28T04:03:29.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:29 smithi162 bash[9856]: audit 2021-01-28T04:03:27.687825+0000 mon.a (mon.0) 1725 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-48"}]': finished 2021-01-28T04:03:29.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:29 smithi162 bash[9856]: audit 2021-01-28T04:03:27.687973+0000 mon.a (mon.0) 1726 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:03:29.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:29 smithi162 bash[9856]: audit 2021-01-28T04:03:27.688082+0000 mon.a (mon.0) 1727 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-33"}]': finished 2021-01-28T04:03:29.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:29 smithi162 bash[9856]: cluster 2021-01-28T04:03:27.688179+0000 mon.a (mon.0) 1728 : cluster [DBG] osdmap e249: 8 total, 8 up, 8 in 2021-01-28T04:03:29.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:29 smithi162 bash[9856]: audit 2021-01-28T04:03:27.690098+0000 mon.c (mon.1) 317 : audit [INF] from='client.? 172.21.15.100:0/313343182' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-40"}]: dispatch 2021-01-28T04:03:29.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:29 smithi162 bash[9856]: audit 2021-01-28T04:03:27.690650+0000 mon.a (mon.0) 1729 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-40"}]: dispatch 2021-01-28T04:03:29.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:29 smithi100 bash[9834]: cluster 2021-01-28T04:03:27.618538+0000 mgr.y (mgr.14138) 625 : cluster [DBG] pgmap v623: 228 pgs: 228 active+clean; 26 KiB data, 317 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 767 B/s wr, 1 op/s 2021-01-28T04:03:29.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:29 smithi100 bash[9834]: audit 2021-01-28T04:03:27.687825+0000 mon.a (mon.0) 1725 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-48"}]': finished 2021-01-28T04:03:29.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:29 smithi100 bash[9834]: audit 2021-01-28T04:03:27.687973+0000 mon.a (mon.0) 1726 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:03:29.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:29 smithi100 bash[9834]: audit 2021-01-28T04:03:27.688082+0000 mon.a (mon.0) 1727 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-33"}]': finished 2021-01-28T04:03:29.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:29 smithi100 bash[9834]: cluster 2021-01-28T04:03:27.688179+0000 mon.a (mon.0) 1728 : cluster [DBG] osdmap e249: 8 total, 8 up, 8 in 2021-01-28T04:03:29.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:29 smithi100 bash[9834]: audit 2021-01-28T04:03:27.690098+0000 mon.c (mon.1) 317 : audit [INF] from='client.? 172.21.15.100:0/313343182' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-40"}]: dispatch 2021-01-28T04:03:29.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:29 smithi100 bash[9834]: audit 2021-01-28T04:03:27.690650+0000 mon.a (mon.0) 1729 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-40"}]: dispatch 2021-01-28T04:03:29.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:29 smithi100 bash[13549]: cluster 2021-01-28T04:03:27.618538+0000 mgr.y (mgr.14138) 625 : cluster [DBG] pgmap v623: 228 pgs: 228 active+clean; 26 KiB data, 317 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 767 B/s wr, 1 op/s 2021-01-28T04:03:29.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:29 smithi100 bash[13549]: audit 2021-01-28T04:03:27.687825+0000 mon.a (mon.0) 1725 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-48"}]': finished 2021-01-28T04:03:29.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:29 smithi100 bash[13549]: audit 2021-01-28T04:03:27.687973+0000 mon.a (mon.0) 1726 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32155-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:03:29.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:29 smithi100 bash[13549]: audit 2021-01-28T04:03:27.688082+0000 mon.a (mon.0) 1727 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-33"}]': finished 2021-01-28T04:03:29.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:29 smithi100 bash[13549]: cluster 2021-01-28T04:03:27.688179+0000 mon.a (mon.0) 1728 : cluster [DBG] osdmap e249: 8 total, 8 up, 8 in 2021-01-28T04:03:29.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:29 smithi100 bash[13549]: audit 2021-01-28T04:03:27.690098+0000 mon.c (mon.1) 317 : audit [INF] from='client.? 172.21.15.100:0/313343182' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-40"}]: dispatch 2021-01-28T04:03:29.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:29 smithi100 bash[13549]: audit 2021-01-28T04:03:27.690650+0000 mon.a (mon.0) 1729 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-40"}]: dispatch 2021-01-28T04:03:30.263 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 04:03:29 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T04:03:30.264 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:30 smithi162 bash[9856]: cluster 2021-01-28T04:03:29.112680+0000 mon.a (mon.0) 1730 : cluster [DBG] osdmap e250: 8 total, 8 up, 8 in 2021-01-28T04:03:30.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:30 smithi162 bash[9856]: audit 2021-01-28T04:03:29.143027+0000 mon.c (mon.1) 318 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:03:30.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:30 smithi162 bash[9856]: audit 2021-01-28T04:03:29.143553+0000 mon.a (mon.0) 1731 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:03:30.265 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:30 smithi162 bash[9856]: audit 2021-01-28T04:03:29.690053+0000 mon.a (mon.0) 1732 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-40"}]': finished 2021-01-28T04:03:30.266 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:30 smithi162 bash[9856]: audit 2021-01-28T04:03:29.690495+0000 mon.a (mon.0) 1733 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:03:30.268 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:30 smithi162 bash[9856]: cluster 2021-01-28T04:03:29.690709+0000 mon.a (mon.0) 1734 : cluster [DBG] osdmap e251: 8 total, 8 up, 8 in 2021-01-28T04:03:30.268 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:30 smithi162 bash[9856]: audit 2021-01-28T04:03:29.693905+0000 mon.c (mon.1) 319 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-33"}]: dispatch 2021-01-28T04:03:30.268 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:30 smithi162 bash[9856]: audit 2021-01-28T04:03:29.694393+0000 mon.c (mon.1) 320 : audit [INF] from='client.? 172.21.15.100:0/3618017223' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-48"}]: dispatch 2021-01-28T04:03:30.269 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:30 smithi162 bash[9856]: audit 2021-01-28T04:03:29.695899+0000 mon.a (mon.0) 1735 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-33"}]: dispatch 2021-01-28T04:03:30.270 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:30 smithi162 bash[9856]: audit 2021-01-28T04:03:29.696273+0000 mon.a (mon.0) 1736 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-48"}]: dispatch 2021-01-28T04:03:30.328 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 04:03:29 smithi100 bash[10061]: debug 2021-01-28T04:03:29.878+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:03:30.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:30 smithi100 bash[9834]: cluster 2021-01-28T04:03:29.112680+0000 mon.a (mon.0) 1730 : cluster [DBG] osdmap e250: 8 total, 8 up, 8 in 2021-01-28T04:03:30.329 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:30 smithi100 bash[9834]: audit 2021-01-28T04:03:29.143027+0000 mon.c (mon.1) 318 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:03:30.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:30 smithi100 bash[9834]: audit 2021-01-28T04:03:29.143553+0000 mon.a (mon.0) 1731 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:03:30.330 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:30 smithi100 bash[9834]: audit 2021-01-28T04:03:29.690053+0000 mon.a (mon.0) 1732 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-40"}]': finished 2021-01-28T04:03:30.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:30 smithi100 bash[9834]: audit 2021-01-28T04:03:29.690495+0000 mon.a (mon.0) 1733 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:03:30.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:30 smithi100 bash[9834]: cluster 2021-01-28T04:03:29.690709+0000 mon.a (mon.0) 1734 : cluster [DBG] osdmap e251: 8 total, 8 up, 8 in 2021-01-28T04:03:30.331 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:30 smithi100 bash[9834]: audit 2021-01-28T04:03:29.693905+0000 mon.c (mon.1) 319 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-33"}]: dispatch 2021-01-28T04:03:30.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:30 smithi100 bash[9834]: audit 2021-01-28T04:03:29.694393+0000 mon.c (mon.1) 320 : audit [INF] from='client.? 172.21.15.100:0/3618017223' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-48"}]: dispatch 2021-01-28T04:03:30.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:30 smithi100 bash[9834]: audit 2021-01-28T04:03:29.695899+0000 mon.a (mon.0) 1735 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-33"}]: dispatch 2021-01-28T04:03:30.332 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:30 smithi100 bash[9834]: audit 2021-01-28T04:03:29.696273+0000 mon.a (mon.0) 1736 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-48"}]: dispatch 2021-01-28T04:03:30.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:30 smithi100 bash[13549]: cluster 2021-01-28T04:03:29.112680+0000 mon.a (mon.0) 1730 : cluster [DBG] osdmap e250: 8 total, 8 up, 8 in 2021-01-28T04:03:30.333 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:30 smithi100 bash[13549]: audit 2021-01-28T04:03:29.143027+0000 mon.c (mon.1) 318 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:03:30.335 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:30 smithi100 bash[13549]: audit 2021-01-28T04:03:29.143553+0000 mon.a (mon.0) 1731 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:03:30.335 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:30 smithi100 bash[13549]: audit 2021-01-28T04:03:29.690053+0000 mon.a (mon.0) 1732 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32155-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32155-40"}]': finished 2021-01-28T04:03:30.336 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:30 smithi100 bash[13549]: audit 2021-01-28T04:03:29.690495+0000 mon.a (mon.0) 1733 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:03:30.336 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:30 smithi100 bash[13549]: cluster 2021-01-28T04:03:29.690709+0000 mon.a (mon.0) 1734 : cluster [DBG] osdmap e251: 8 total, 8 up, 8 in 2021-01-28T04:03:30.337 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:30 smithi100 bash[13549]: audit 2021-01-28T04:03:29.693905+0000 mon.c (mon.1) 319 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-33"}]: dispatch 2021-01-28T04:03:30.337 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:30 smithi100 bash[13549]: audit 2021-01-28T04:03:29.694393+0000 mon.c (mon.1) 320 : audit [INF] from='client.? 172.21.15.100:0/3618017223' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-48"}]: dispatch 2021-01-28T04:03:30.337 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:30 smithi100 bash[13549]: audit 2021-01-28T04:03:29.695899+0000 mon.a (mon.0) 1735 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-33"}]: dispatch 2021-01-28T04:03:30.338 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:30 smithi100 bash[13549]: audit 2021-01-28T04:03:29.696273+0000 mon.a (mon.0) 1736 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-48"}]: dispatch 2021-01-28T04:03:31.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:31 smithi162 bash[9856]: cluster 2021-01-28T04:03:29.619693+0000 mgr.y (mgr.14138) 626 : cluster [DBG] pgmap v626: 236 pgs: 3 creating+peering, 5 unknown, 228 active+clean; 26 KiB data, 318 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2021-01-28T04:03:31.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:31 smithi162 bash[9856]: audit 2021-01-28T04:03:29.882796+0000 mgr.y (mgr.14138) 627 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:03:31.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:31 smithi162 bash[9856]: cluster 2021-01-28T04:03:30.684134+0000 mon.a (mon.0) 1737 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:03:31.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:31 smithi162 bash[9856]: audit 2021-01-28T04:03:30.693133+0000 mon.a (mon.0) 1738 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-33"}]': finished 2021-01-28T04:03:31.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:31 smithi162 bash[9856]: audit 2021-01-28T04:03:30.694429+0000 mon.a (mon.0) 1739 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-48"}]': finished 2021-01-28T04:03:31.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:31 smithi162 bash[9856]: cluster 2021-01-28T04:03:30.694634+0000 mon.a (mon.0) 1740 : cluster [DBG] osdmap e252: 8 total, 8 up, 8 in 2021-01-28T04:03:31.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:31 smithi162 bash[9856]: audit 2021-01-28T04:03:30.698062+0000 mon.c (mon.1) 321 : audit [INF] from='client.? 172.21.15.100:0/3618017223' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-48"}]: dispatch 2021-01-28T04:03:31.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:31 smithi162 bash[9856]: audit 2021-01-28T04:03:30.698636+0000 mon.a (mon.0) 1741 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-48"}]: dispatch 2021-01-28T04:03:31.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:31 smithi100 bash[9834]: cluster 2021-01-28T04:03:29.619693+0000 mgr.y (mgr.14138) 626 : cluster [DBG] pgmap v626: 236 pgs: 3 creating+peering, 5 unknown, 228 active+clean; 26 KiB data, 318 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2021-01-28T04:03:31.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:31 smithi100 bash[9834]: audit 2021-01-28T04:03:29.882796+0000 mgr.y (mgr.14138) 627 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:03:31.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:31 smithi100 bash[9834]: cluster 2021-01-28T04:03:30.684134+0000 mon.a (mon.0) 1737 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:03:31.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:31 smithi100 bash[9834]: audit 2021-01-28T04:03:30.693133+0000 mon.a (mon.0) 1738 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-33"}]': finished 2021-01-28T04:03:31.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:31 smithi100 bash[9834]: audit 2021-01-28T04:03:30.694429+0000 mon.a (mon.0) 1739 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-48"}]': finished 2021-01-28T04:03:31.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:31 smithi100 bash[9834]: cluster 2021-01-28T04:03:30.694634+0000 mon.a (mon.0) 1740 : cluster [DBG] osdmap e252: 8 total, 8 up, 8 in 2021-01-28T04:03:31.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:31 smithi100 bash[9834]: audit 2021-01-28T04:03:30.698062+0000 mon.c (mon.1) 321 : audit [INF] from='client.? 172.21.15.100:0/3618017223' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-48"}]: dispatch 2021-01-28T04:03:31.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:31 smithi100 bash[9834]: audit 2021-01-28T04:03:30.698636+0000 mon.a (mon.0) 1741 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-48"}]: dispatch 2021-01-28T04:03:31.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:31 smithi100 bash[13549]: cluster 2021-01-28T04:03:29.619693+0000 mgr.y (mgr.14138) 626 : cluster [DBG] pgmap v626: 236 pgs: 3 creating+peering, 5 unknown, 228 active+clean; 26 KiB data, 318 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2021-01-28T04:03:31.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:31 smithi100 bash[13549]: audit 2021-01-28T04:03:29.882796+0000 mgr.y (mgr.14138) 627 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:03:31.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:31 smithi100 bash[13549]: cluster 2021-01-28T04:03:30.684134+0000 mon.a (mon.0) 1737 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:03:31.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:31 smithi100 bash[13549]: audit 2021-01-28T04:03:30.693133+0000 mon.a (mon.0) 1738 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-33"}]': finished 2021-01-28T04:03:31.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:31 smithi100 bash[13549]: audit 2021-01-28T04:03:30.694429+0000 mon.a (mon.0) 1739 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-48"}]': finished 2021-01-28T04:03:31.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:31 smithi100 bash[13549]: cluster 2021-01-28T04:03:30.694634+0000 mon.a (mon.0) 1740 : cluster [DBG] osdmap e252: 8 total, 8 up, 8 in 2021-01-28T04:03:31.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:31 smithi100 bash[13549]: audit 2021-01-28T04:03:30.698062+0000 mon.c (mon.1) 321 : audit [INF] from='client.? 172.21.15.100:0/3618017223' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-48"}]: dispatch 2021-01-28T04:03:31.583 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:31 smithi100 bash[13549]: audit 2021-01-28T04:03:30.698636+0000 mon.a (mon.0) 1741 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-48"}]: dispatch 2021-01-28T04:03:33.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:32 smithi162 bash[9856]: cluster 2021-01-28T04:03:31.620483+0000 mgr.y (mgr.14138) 628 : cluster [DBG] pgmap v629: 236 pgs: 2 creating+peering, 6 unknown, 228 active+clean; 26 KiB data, 318 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 767 B/s wr, 2 op/s 2021-01-28T04:03:33.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:32 smithi162 bash[9856]: audit 2021-01-28T04:03:31.697756+0000 mon.a (mon.0) 1742 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-48"}]': finished 2021-01-28T04:03:33.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:32 smithi162 bash[9856]: cluster 2021-01-28T04:03:31.698413+0000 mon.a (mon.0) 1743 : cluster [DBG] osdmap e253: 8 total, 8 up, 8 in 2021-01-28T04:03:33.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:32 smithi162 bash[9856]: audit 2021-01-28T04:03:31.701080+0000 mon.c (mon.1) 322 : audit [INF] from='client.? 172.21.15.100:0/313343182' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-40"}]: dispatch 2021-01-28T04:03:33.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:32 smithi162 bash[9856]: audit 2021-01-28T04:03:31.722129+0000 mon.c (mon.1) 323 : audit [INF] from='client.? 172.21.15.100:0/2149926891' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-49"}]: dispatch 2021-01-28T04:03:33.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:32 smithi162 bash[9856]: audit 2021-01-28T04:03:32.138727+0000 mon.a (mon.0) 1744 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-40"}]: dispatch 2021-01-28T04:03:33.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:32 smithi162 bash[9856]: audit 2021-01-28T04:03:32.139177+0000 mon.a (mon.0) 1745 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-49"}]: dispatch 2021-01-28T04:03:33.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:32 smithi162 bash[9856]: audit 2021-01-28T04:03:32.140036+0000 mon.c (mon.1) 324 : audit [INF] from='client.? 172.21.15.100:0/2149926891' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-49"}]: dispatch 2021-01-28T04:03:33.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:32 smithi162 bash[9856]: audit 2021-01-28T04:03:32.149031+0000 mon.a (mon.0) 1746 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-49"}]: dispatch 2021-01-28T04:03:33.018 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:32 smithi162 bash[9856]: audit 2021-01-28T04:03:32.149960+0000 mon.c (mon.1) 325 : audit [INF] from='client.? 172.21.15.100:0/2149926891' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:33.018 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:32 smithi162 bash[9856]: audit 2021-01-28T04:03:32.150467+0000 mon.a (mon.0) 1747 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:33.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:32 smithi100 bash[9834]: cluster 2021-01-28T04:03:31.620483+0000 mgr.y (mgr.14138) 628 : cluster [DBG] pgmap v629: 236 pgs: 2 creating+peering, 6 unknown, 228 active+clean; 26 KiB data, 318 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 767 B/s wr, 2 op/s 2021-01-28T04:03:33.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:32 smithi100 bash[9834]: audit 2021-01-28T04:03:31.697756+0000 mon.a (mon.0) 1742 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-48"}]': finished 2021-01-28T04:03:33.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:32 smithi100 bash[9834]: cluster 2021-01-28T04:03:31.698413+0000 mon.a (mon.0) 1743 : cluster [DBG] osdmap e253: 8 total, 8 up, 8 in 2021-01-28T04:03:33.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:32 smithi100 bash[9834]: audit 2021-01-28T04:03:31.701080+0000 mon.c (mon.1) 322 : audit [INF] from='client.? 172.21.15.100:0/313343182' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-40"}]: dispatch 2021-01-28T04:03:33.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:32 smithi100 bash[9834]: audit 2021-01-28T04:03:31.722129+0000 mon.c (mon.1) 323 : audit [INF] from='client.? 172.21.15.100:0/2149926891' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-49"}]: dispatch 2021-01-28T04:03:33.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:32 smithi100 bash[9834]: audit 2021-01-28T04:03:32.138727+0000 mon.a (mon.0) 1744 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-40"}]: dispatch 2021-01-28T04:03:33.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:32 smithi100 bash[9834]: audit 2021-01-28T04:03:32.139177+0000 mon.a (mon.0) 1745 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-49"}]: dispatch 2021-01-28T04:03:33.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:32 smithi100 bash[9834]: audit 2021-01-28T04:03:32.140036+0000 mon.c (mon.1) 324 : audit [INF] from='client.? 172.21.15.100:0/2149926891' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-49"}]: dispatch 2021-01-28T04:03:33.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:32 smithi100 bash[9834]: audit 2021-01-28T04:03:32.149031+0000 mon.a (mon.0) 1746 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-49"}]: dispatch 2021-01-28T04:03:33.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:32 smithi100 bash[9834]: audit 2021-01-28T04:03:32.149960+0000 mon.c (mon.1) 325 : audit [INF] from='client.? 172.21.15.100:0/2149926891' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:33.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:32 smithi100 bash[9834]: audit 2021-01-28T04:03:32.150467+0000 mon.a (mon.0) 1747 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:33.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:32 smithi100 bash[13549]: cluster 2021-01-28T04:03:31.620483+0000 mgr.y (mgr.14138) 628 : cluster [DBG] pgmap v629: 236 pgs: 2 creating+peering, 6 unknown, 228 active+clean; 26 KiB data, 318 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 767 B/s wr, 2 op/s 2021-01-28T04:03:33.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:32 smithi100 bash[13549]: audit 2021-01-28T04:03:31.697756+0000 mon.a (mon.0) 1742 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-48"}]': finished 2021-01-28T04:03:33.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:32 smithi100 bash[13549]: cluster 2021-01-28T04:03:31.698413+0000 mon.a (mon.0) 1743 : cluster [DBG] osdmap e253: 8 total, 8 up, 8 in 2021-01-28T04:03:33.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:32 smithi100 bash[13549]: audit 2021-01-28T04:03:31.701080+0000 mon.c (mon.1) 322 : audit [INF] from='client.? 172.21.15.100:0/313343182' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-40"}]: dispatch 2021-01-28T04:03:33.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:32 smithi100 bash[13549]: audit 2021-01-28T04:03:31.722129+0000 mon.c (mon.1) 323 : audit [INF] from='client.? 172.21.15.100:0/2149926891' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-49"}]: dispatch 2021-01-28T04:03:33.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:32 smithi100 bash[13549]: audit 2021-01-28T04:03:32.138727+0000 mon.a (mon.0) 1744 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-40"}]: dispatch 2021-01-28T04:03:33.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:32 smithi100 bash[13549]: audit 2021-01-28T04:03:32.139177+0000 mon.a (mon.0) 1745 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-49"}]: dispatch 2021-01-28T04:03:33.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:32 smithi100 bash[13549]: audit 2021-01-28T04:03:32.140036+0000 mon.c (mon.1) 324 : audit [INF] from='client.? 172.21.15.100:0/2149926891' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-49"}]: dispatch 2021-01-28T04:03:33.087 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:32 smithi100 bash[13549]: audit 2021-01-28T04:03:32.149031+0000 mon.a (mon.0) 1746 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-49"}]: dispatch 2021-01-28T04:03:33.087 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:32 smithi100 bash[13549]: audit 2021-01-28T04:03:32.149960+0000 mon.c (mon.1) 325 : audit [INF] from='client.? 172.21.15.100:0/2149926891' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:33.088 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:32 smithi100 bash[13549]: audit 2021-01-28T04:03:32.150467+0000 mon.a (mon.0) 1747 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:33.725 INFO:tasks.workunit.client.0.smithi100.stdout:ndTrip 2021-01-28T04:03:33.726 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip (7038 ms) 2021-01-28T04:03:33.726 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip2 2021-01-28T04:03:33.726 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip2 (7447 ms) 2021-01-28T04:03:33.727 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripAppend 2021-01-28T04:03:33.727 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripAppend (6538 ms) 2021-01-28T04:03:33.727 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAioEC.IsComplete 2021-01-28T04:03:33.727 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAioEC.IsComplete (7040 ms) 2021-01-28T04:03:33.727 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAioEC.IsSafe 2021-01-28T04:03:33.728 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAioEC.IsSafe (7343 ms) 2021-01-28T04:03:33.728 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAioEC.ReturnValue 2021-01-28T04:03:33.728 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAioEC.ReturnValue (7028 ms) 2021-01-28T04:03:33.728 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAioEC.Flush 2021-01-28T04:03:33.729 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAioEC.Flush (7033 ms) 2021-01-28T04:03:33.729 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAioEC.FlushAsync 2021-01-28T04:03:33.729 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAioEC.FlushAsync (6548 ms) 2021-01-28T04:03:33.729 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripWriteFull 2021-01-28T04:03:33.730 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripWriteFull (7041 ms) 2021-01-28T04:03:33.730 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStat 2021-01-28T04:03:33.730 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStat (7026 ms) 2021-01-28T04:03:33.730 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStatNS 2021-01-28T04:03:33.731 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStatNS (6964 ms) 2021-01-28T04:03:33.735 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAioEC.StatRemove 2021-01-28T04:03:33.735 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAioEC.StatRemove (7028 ms) 2021-01-28T04:03:33.736 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAioEC.ExecuteClass 2021-01-28T04:03:33.736 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAioEC.ExecuteClass (7032 ms) 2021-01-28T04:03:33.736 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ RUN ] LibRadosAioEC.MultiWrite 2021-01-28T04:03:33.736 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ OK ] LibRadosAioEC.MultiWrite (7047 ms) 2021-01-28T04:03:33.737 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [----------] 16 tests from LibRadosAioEC (112153 ms total) 2021-01-28T04:03:33.738 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: 2021-01-28T04:03:33.738 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [----------] Global test environment tear-down 2021-01-28T04:03:33.738 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [==========] 40 tests from 2 test suites ran. (200318 ms total) 2021-01-28T04:03:33.738 INFO:tasks.workunit.client.0.smithi100.stdout: api_aio: [ PASSED ] 40 tests. 2021-01-28T04:03:33.740 INFO:tasks.workunit.client.0.smithi100.stderr:+ for t in "${!pids[@]}" 2021-01-28T04:03:33.741 INFO:tasks.workunit.client.0.smithi100.stderr:+ pid=32210 2021-01-28T04:03:33.741 INFO:tasks.workunit.client.0.smithi100.stderr:+ wait 32210 2021-01-28T04:03:33.741 INFO:tasks.workunit.client.0.smithi100.stderr:+ for t in "${!pids[@]}" 2021-01-28T04:03:33.741 INFO:tasks.workunit.client.0.smithi100.stderr:+ pid=32593 2021-01-28T04:03:33.741 INFO:tasks.workunit.client.0.smithi100.stderr:+ wait 32593 2021-01-28T04:03:33.742 INFO:tasks.workunit.client.0.smithi100.stderr:+ for t in "${!pids[@]}" 2021-01-28T04:03:33.742 INFO:tasks.workunit.client.0.smithi100.stderr:+ pid=32522 2021-01-28T04:03:33.742 INFO:tasks.workunit.client.0.smithi100.stderr:+ wait 32522 2021-01-28T04:03:33.742 INFO:tasks.workunit.client.0.smithi100.stderr:+ for t in "${!pids[@]}" 2021-01-28T04:03:33.742 INFO:tasks.workunit.client.0.smithi100.stderr:+ pid=32166 2021-01-28T04:03:33.743 INFO:tasks.workunit.client.0.smithi100.stderr:+ wait 32166 2021-01-28T04:03:33.743 INFO:tasks.workunit.client.0.smithi100.stderr:+ for t in "${!pids[@]}" 2021-01-28T04:03:33.743 INFO:tasks.workunit.client.0.smithi100.stderr:+ pid=32349 2021-01-28T04:03:33.743 INFO:tasks.workunit.client.0.smithi100.stderr:+ wait 32349 2021-01-28T04:03:33.743 INFO:tasks.workunit.client.0.smithi100.stderr:+ for t in "${!pids[@]}" 2021-01-28T04:03:33.744 INFO:tasks.workunit.client.0.smithi100.stderr:+ pid=32479 2021-01-28T04:03:33.744 INFO:tasks.workunit.client.0.smithi100.stderr:+ wait 32479 2021-01-28T04:03:33.744 INFO:tasks.workunit.client.0.smithi100.stderr:+ for t in "${!pids[@]}" 2021-01-28T04:03:33.744 INFO:tasks.workunit.client.0.smithi100.stderr:+ pid=32318 2021-01-28T04:03:33.744 INFO:tasks.workunit.client.0.smithi100.stderr:+ wait 32318 2021-01-28T04:03:34.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:34 smithi162 bash[9856]: audit 2021-01-28T04:03:32.709213+0000 mon.a (mon.0) 1748 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-40"}]': finished 2021-01-28T04:03:34.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:34 smithi162 bash[9856]: audit 2021-01-28T04:03:32.709343+0000 mon.a (mon.0) 1749 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:03:34.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:34 smithi162 bash[9856]: cluster 2021-01-28T04:03:32.709450+0000 mon.a (mon.0) 1750 : cluster [DBG] osdmap e254: 8 total, 8 up, 8 in 2021-01-28T04:03:34.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:34 smithi162 bash[9856]: audit 2021-01-28T04:03:32.710854+0000 mon.c (mon.1) 326 : audit [INF] from='client.? 172.21.15.100:0/313343182' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-40"}]: dispatch 2021-01-28T04:03:34.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:34 smithi162 bash[9856]: audit 2021-01-28T04:03:32.711456+0000 mon.a (mon.0) 1751 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-40"}]: dispatch 2021-01-28T04:03:34.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:34 smithi162 bash[9856]: audit 2021-01-28T04:03:32.711809+0000 mon.c (mon.1) 327 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:34.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:34 smithi162 bash[9856]: audit 2021-01-28T04:03:32.712645+0000 mon.c (mon.1) 328 : audit [INF] from='client.? 172.21.15.100:0/2149926891' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-49"}]: dispatch 2021-01-28T04:03:34.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:34 smithi162 bash[9856]: audit 2021-01-28T04:03:32.712672+0000 mon.a (mon.0) 1752 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:34.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:34 smithi162 bash[9856]: audit 2021-01-28T04:03:32.715636+0000 mon.a (mon.0) 1753 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-49"}]: dispatch 2021-01-28T04:03:34.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:34 smithi100 bash[9834]: audit 2021-01-28T04:03:32.709213+0000 mon.a (mon.0) 1748 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-40"}]': finished 2021-01-28T04:03:34.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:34 smithi100 bash[9834]: audit 2021-01-28T04:03:32.709343+0000 mon.a (mon.0) 1749 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:03:34.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:34 smithi100 bash[9834]: cluster 2021-01-28T04:03:32.709450+0000 mon.a (mon.0) 1750 : cluster [DBG] osdmap e254: 8 total, 8 up, 8 in 2021-01-28T04:03:34.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:34 smithi100 bash[9834]: audit 2021-01-28T04:03:32.710854+0000 mon.c (mon.1) 326 : audit [INF] from='client.? 172.21.15.100:0/313343182' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-40"}]: dispatch 2021-01-28T04:03:34.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:34 smithi100 bash[9834]: audit 2021-01-28T04:03:32.711456+0000 mon.a (mon.0) 1751 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-40"}]: dispatch 2021-01-28T04:03:34.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:34 smithi100 bash[9834]: audit 2021-01-28T04:03:32.711809+0000 mon.c (mon.1) 327 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:34.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:34 smithi100 bash[9834]: audit 2021-01-28T04:03:32.712645+0000 mon.c (mon.1) 328 : audit [INF] from='client.? 172.21.15.100:0/2149926891' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-49"}]: dispatch 2021-01-28T04:03:34.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:34 smithi100 bash[9834]: audit 2021-01-28T04:03:32.712672+0000 mon.a (mon.0) 1752 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:34.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:34 smithi100 bash[9834]: audit 2021-01-28T04:03:32.715636+0000 mon.a (mon.0) 1753 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-49"}]: dispatch 2021-01-28T04:03:34.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:34 smithi100 bash[13549]: audit 2021-01-28T04:03:32.709213+0000 mon.a (mon.0) 1748 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32155-40"}]': finished 2021-01-28T04:03:34.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:34 smithi100 bash[13549]: audit 2021-01-28T04:03:32.709343+0000 mon.a (mon.0) 1749 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:03:34.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:34 smithi100 bash[13549]: cluster 2021-01-28T04:03:32.709450+0000 mon.a (mon.0) 1750 : cluster [DBG] osdmap e254: 8 total, 8 up, 8 in 2021-01-28T04:03:34.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:34 smithi100 bash[13549]: audit 2021-01-28T04:03:32.710854+0000 mon.c (mon.1) 326 : audit [INF] from='client.? 172.21.15.100:0/313343182' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-40"}]: dispatch 2021-01-28T04:03:34.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:34 smithi100 bash[13549]: audit 2021-01-28T04:03:32.711456+0000 mon.a (mon.0) 1751 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-40"}]: dispatch 2021-01-28T04:03:34.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:34 smithi100 bash[13549]: audit 2021-01-28T04:03:32.711809+0000 mon.c (mon.1) 327 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:34.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:34 smithi100 bash[13549]: audit 2021-01-28T04:03:32.712645+0000 mon.c (mon.1) 328 : audit [INF] from='client.? 172.21.15.100:0/2149926891' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-49"}]: dispatch 2021-01-28T04:03:34.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:34 smithi100 bash[13549]: audit 2021-01-28T04:03:32.712672+0000 mon.a (mon.0) 1752 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:34.582 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:34 smithi100 bash[13549]: audit 2021-01-28T04:03:32.715636+0000 mon.a (mon.0) 1753 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-49"}]: dispatch 2021-01-28T04:03:35.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:35 smithi162 bash[9856]: cluster 2021-01-28T04:03:33.621830+0000 mgr.y (mgr.14138) 629 : cluster [DBG] pgmap v632: 228 pgs: 15 creating+peering, 17 unknown, 196 active+clean; 26 KiB data, 323 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2021-01-28T04:03:35.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:35 smithi162 bash[9856]: audit 2021-01-28T04:03:33.715029+0000 mon.a (mon.0) 1754 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-40"}]': finished 2021-01-28T04:03:35.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:35 smithi162 bash[9856]: audit 2021-01-28T04:03:33.715287+0000 mon.a (mon.0) 1755 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-35","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:03:35.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:35 smithi162 bash[9856]: audit 2021-01-28T04:03:33.720998+0000 mon.c (mon.1) 329 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-35", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:03:35.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:35 smithi162 bash[9856]: cluster 2021-01-28T04:03:34.144376+0000 mon.a (mon.0) 1756 : cluster [DBG] osdmap e255: 8 total, 8 up, 8 in 2021-01-28T04:03:35.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:35 smithi162 bash[9856]: audit 2021-01-28T04:03:34.147138+0000 mon.a (mon.0) 1757 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-35", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:03:35.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:35 smithi162 bash[9856]: audit 2021-01-28T04:03:34.721131+0000 mon.a (mon.0) 1758 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-49"}]': finished 2021-01-28T04:03:35.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:35 smithi162 bash[9856]: audit 2021-01-28T04:03:34.721492+0000 mon.a (mon.0) 1759 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-35", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:03:35.515 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:35 smithi162 bash[9856]: cluster 2021-01-28T04:03:34.721854+0000 mon.a (mon.0) 1760 : cluster [DBG] osdmap e256: 8 total, 8 up, 8 in 2021-01-28T04:03:35.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:35 smithi162 bash[9856]: audit 2021-01-28T04:03:34.722693+0000 mon.c (mon.1) 330 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-35"}]: dispatch 2021-01-28T04:03:35.516 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:35 smithi162 bash[9856]: audit 2021-01-28T04:03:34.723825+0000 mon.a (mon.0) 1761 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-35"}]: dispatch 2021-01-28T04:03:35.578 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:35 smithi100 bash[13549]: cluster 2021-01-28T04:03:33.621830+0000 mgr.y (mgr.14138) 629 : cluster [DBG] pgmap v632: 228 pgs: 15 creating+peering, 17 unknown, 196 active+clean; 26 KiB data, 323 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2021-01-28T04:03:35.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:35 smithi100 bash[13549]: audit 2021-01-28T04:03:33.715029+0000 mon.a (mon.0) 1754 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-40"}]': finished 2021-01-28T04:03:35.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:35 smithi100 bash[13549]: audit 2021-01-28T04:03:33.715287+0000 mon.a (mon.0) 1755 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-35","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:03:35.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:35 smithi100 bash[13549]: audit 2021-01-28T04:03:33.720998+0000 mon.c (mon.1) 329 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-35", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:03:35.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:35 smithi100 bash[13549]: cluster 2021-01-28T04:03:34.144376+0000 mon.a (mon.0) 1756 : cluster [DBG] osdmap e255: 8 total, 8 up, 8 in 2021-01-28T04:03:35.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:35 smithi100 bash[13549]: audit 2021-01-28T04:03:34.147138+0000 mon.a (mon.0) 1757 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-35", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:03:35.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:35 smithi100 bash[13549]: audit 2021-01-28T04:03:34.721131+0000 mon.a (mon.0) 1758 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-49"}]': finished 2021-01-28T04:03:35.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:35 smithi100 bash[13549]: audit 2021-01-28T04:03:34.721492+0000 mon.a (mon.0) 1759 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-35", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:03:35.580 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:35 smithi100 bash[13549]: cluster 2021-01-28T04:03:34.721854+0000 mon.a (mon.0) 1760 : cluster [DBG] osdmap e256: 8 total, 8 up, 8 in 2021-01-28T04:03:35.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:35 smithi100 bash[13549]: audit 2021-01-28T04:03:34.722693+0000 mon.c (mon.1) 330 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-35"}]: dispatch 2021-01-28T04:03:35.581 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:35 smithi100 bash[13549]: audit 2021-01-28T04:03:34.723825+0000 mon.a (mon.0) 1761 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-35"}]: dispatch 2021-01-28T04:03:35.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:35 smithi100 bash[9834]: cluster 2021-01-28T04:03:33.621830+0000 mgr.y (mgr.14138) 629 : cluster [DBG] pgmap v632: 228 pgs: 15 creating+peering, 17 unknown, 196 active+clean; 26 KiB data, 323 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2021-01-28T04:03:35.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:35 smithi100 bash[9834]: audit 2021-01-28T04:03:33.715029+0000 mon.a (mon.0) 1754 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32155-40"}]': finished 2021-01-28T04:03:35.581 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:35 smithi100 bash[9834]: audit 2021-01-28T04:03:33.715287+0000 mon.a (mon.0) 1755 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-35","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:03:35.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:35 smithi100 bash[9834]: audit 2021-01-28T04:03:33.720998+0000 mon.c (mon.1) 329 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-35", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:03:35.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:35 smithi100 bash[9834]: cluster 2021-01-28T04:03:34.144376+0000 mon.a (mon.0) 1756 : cluster [DBG] osdmap e255: 8 total, 8 up, 8 in 2021-01-28T04:03:35.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:35 smithi100 bash[9834]: audit 2021-01-28T04:03:34.147138+0000 mon.a (mon.0) 1757 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-35", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:03:35.582 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:35 smithi100 bash[9834]: audit 2021-01-28T04:03:34.721131+0000 mon.a (mon.0) 1758 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-49"}]': finished 2021-01-28T04:03:35.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:35 smithi100 bash[9834]: audit 2021-01-28T04:03:34.721492+0000 mon.a (mon.0) 1759 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-35", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:03:35.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:35 smithi100 bash[9834]: cluster 2021-01-28T04:03:34.721854+0000 mon.a (mon.0) 1760 : cluster [DBG] osdmap e256: 8 total, 8 up, 8 in 2021-01-28T04:03:35.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:35 smithi100 bash[9834]: audit 2021-01-28T04:03:34.722693+0000 mon.c (mon.1) 330 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-35"}]: dispatch 2021-01-28T04:03:35.583 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:35 smithi100 bash[9834]: audit 2021-01-28T04:03:34.723825+0000 mon.a (mon.0) 1761 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-35"}]: dispatch 2021-01-28T04:03:37.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:36 smithi162 bash[9856]: cluster 2021-01-28T04:03:35.622660+0000 mgr.y (mgr.14138) 630 : cluster [DBG] pgmap v635: 236 pgs: 15 creating+peering, 21 unknown, 200 active+clean; 26 KiB data, 323 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2021-01-28T04:03:37.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:36 smithi162 bash[9856]: audit 2021-01-28T04:03:35.721192+0000 mon.a (mon.0) 1762 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-35"}]': finished 2021-01-28T04:03:37.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:36 smithi162 bash[9856]: cluster 2021-01-28T04:03:35.721632+0000 mon.a (mon.0) 1763 : cluster [DBG] osdmap e257: 8 total, 8 up, 8 in 2021-01-28T04:03:37.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:36 smithi162 bash[9856]: audit 2021-01-28T04:03:35.725259+0000 mon.c (mon.1) 331 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-35", "mode": "writeback"}]: dispatch 2021-01-28T04:03:37.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:36 smithi162 bash[9856]: audit 2021-01-28T04:03:35.726003+0000 mon.a (mon.0) 1764 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-35", "mode": "writeback"}]: dispatch 2021-01-28T04:03:37.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:36 smithi162 bash[9856]: audit 2021-01-28T04:03:36.110814+0000 mon.a (mon.0) 1765 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:03:37.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:36 smithi162 bash[9856]: audit 2021-01-28T04:03:36.111254+0000 mon.a (mon.0) 1766 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:03:37.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:36 smithi100 bash[9834]: cluster 2021-01-28T04:03:35.622660+0000 mgr.y (mgr.14138) 630 : cluster [DBG] pgmap v635: 236 pgs: 15 creating+peering, 21 unknown, 200 active+clean; 26 KiB data, 323 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2021-01-28T04:03:37.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:36 smithi100 bash[9834]: audit 2021-01-28T04:03:35.721192+0000 mon.a (mon.0) 1762 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-35"}]': finished 2021-01-28T04:03:37.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:36 smithi100 bash[9834]: cluster 2021-01-28T04:03:35.721632+0000 mon.a (mon.0) 1763 : cluster [DBG] osdmap e257: 8 total, 8 up, 8 in 2021-01-28T04:03:37.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:36 smithi100 bash[9834]: audit 2021-01-28T04:03:35.725259+0000 mon.c (mon.1) 331 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-35", "mode": "writeback"}]: dispatch 2021-01-28T04:03:37.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:36 smithi100 bash[9834]: audit 2021-01-28T04:03:35.726003+0000 mon.a (mon.0) 1764 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-35", "mode": "writeback"}]: dispatch 2021-01-28T04:03:37.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:36 smithi100 bash[9834]: audit 2021-01-28T04:03:36.110814+0000 mon.a (mon.0) 1765 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:03:37.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:36 smithi100 bash[9834]: audit 2021-01-28T04:03:36.111254+0000 mon.a (mon.0) 1766 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:03:37.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:36 smithi100 bash[13549]: cluster 2021-01-28T04:03:35.622660+0000 mgr.y (mgr.14138) 630 : cluster [DBG] pgmap v635: 236 pgs: 15 creating+peering, 21 unknown, 200 active+clean; 26 KiB data, 323 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2021-01-28T04:03:37.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:36 smithi100 bash[13549]: audit 2021-01-28T04:03:35.721192+0000 mon.a (mon.0) 1762 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-35"}]': finished 2021-01-28T04:03:37.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:36 smithi100 bash[13549]: cluster 2021-01-28T04:03:35.721632+0000 mon.a (mon.0) 1763 : cluster [DBG] osdmap e257: 8 total, 8 up, 8 in 2021-01-28T04:03:37.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:36 smithi100 bash[13549]: audit 2021-01-28T04:03:35.725259+0000 mon.c (mon.1) 331 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-35", "mode": "writeback"}]: dispatch 2021-01-28T04:03:37.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:36 smithi100 bash[13549]: audit 2021-01-28T04:03:35.726003+0000 mon.a (mon.0) 1764 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-35", "mode": "writeback"}]: dispatch 2021-01-28T04:03:37.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:36 smithi100 bash[13549]: audit 2021-01-28T04:03:36.110814+0000 mon.a (mon.0) 1765 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:03:37.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:36 smithi100 bash[13549]: audit 2021-01-28T04:03:36.111254+0000 mon.a (mon.0) 1766 : audit [INF] from='mgr.14138 172.21.15.100:0/3907657394' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:03:38.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:37 smithi162 bash[9856]: cluster 2021-01-28T04:03:36.715157+0000 mon.a (mon.0) 1767 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:03:38.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:37 smithi162 bash[9856]: audit 2021-01-28T04:03:36.726845+0000 mon.a (mon.0) 1768 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-35", "mode": "writeback"}]': finished 2021-01-28T04:03:38.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:37 smithi162 bash[9856]: cluster 2021-01-28T04:03:36.727234+0000 mon.a (mon.0) 1769 : cluster [DBG] osdmap e258: 8 total, 8 up, 8 in 2021-01-28T04:03:38.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:37 smithi162 bash[9856]: audit 2021-01-28T04:03:36.730819+0000 mon.c (mon.1) 332 : audit [INF] from='client.? 172.21.15.100:0/2149926891' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-49"}]: dispatch 2021-01-28T04:03:38.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:37 smithi162 bash[9856]: audit 2021-01-28T04:03:36.737067+0000 mon.a (mon.0) 1770 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-49"}]: dispatch 2021-01-28T04:03:38.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:37 smithi162 bash[9856]: audit 2021-01-28T04:03:36.803431+0000 mon.c (mon.1) 333 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:03:38.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:37 smithi162 bash[9856]: audit 2021-01-28T04:03:36.804099+0000 mon.a (mon.0) 1771 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:03:38.078 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:37 smithi100 bash[13549]: cluster 2021-01-28T04:03:36.715157+0000 mon.a (mon.0) 1767 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:03:38.079 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:37 smithi100 bash[13549]: audit 2021-01-28T04:03:36.726845+0000 mon.a (mon.0) 1768 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-35", "mode": "writeback"}]': finished 2021-01-28T04:03:38.079 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:37 smithi100 bash[13549]: cluster 2021-01-28T04:03:36.727234+0000 mon.a (mon.0) 1769 : cluster [DBG] osdmap e258: 8 total, 8 up, 8 in 2021-01-28T04:03:38.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:37 smithi100 bash[13549]: audit 2021-01-28T04:03:36.730819+0000 mon.c (mon.1) 332 : audit [INF] from='client.? 172.21.15.100:0/2149926891' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-49"}]: dispatch 2021-01-28T04:03:38.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:37 smithi100 bash[13549]: audit 2021-01-28T04:03:36.737067+0000 mon.a (mon.0) 1770 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-49"}]: dispatch 2021-01-28T04:03:38.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:37 smithi100 bash[13549]: audit 2021-01-28T04:03:36.803431+0000 mon.c (mon.1) 333 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:03:38.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:37 smithi100 bash[13549]: audit 2021-01-28T04:03:36.804099+0000 mon.a (mon.0) 1771 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:03:38.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:37 smithi100 bash[9834]: cluster 2021-01-28T04:03:36.715157+0000 mon.a (mon.0) 1767 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:03:38.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:37 smithi100 bash[9834]: audit 2021-01-28T04:03:36.726845+0000 mon.a (mon.0) 1768 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-35", "mode": "writeback"}]': finished 2021-01-28T04:03:38.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:37 smithi100 bash[9834]: cluster 2021-01-28T04:03:36.727234+0000 mon.a (mon.0) 1769 : cluster [DBG] osdmap e258: 8 total, 8 up, 8 in 2021-01-28T04:03:38.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:37 smithi100 bash[9834]: audit 2021-01-28T04:03:36.730819+0000 mon.c (mon.1) 332 : audit [INF] from='client.? 172.21.15.100:0/2149926891' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-49"}]: dispatch 2021-01-28T04:03:38.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:37 smithi100 bash[9834]: audit 2021-01-28T04:03:36.737067+0000 mon.a (mon.0) 1770 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-49"}]: dispatch 2021-01-28T04:03:38.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:37 smithi100 bash[9834]: audit 2021-01-28T04:03:36.803431+0000 mon.c (mon.1) 333 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:03:38.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:37 smithi100 bash[9834]: audit 2021-01-28T04:03:36.804099+0000 mon.a (mon.0) 1771 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]: dispatch 2021-01-28T04:03:39.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:38 smithi162 bash[9856]: cluster 2021-01-28T04:03:37.624006+0000 mgr.y (mgr.14138) 631 : cluster [DBG] pgmap v638: 228 pgs: 15 creating+peering, 213 active+clean; 26 KiB data, 324 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:03:39.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:38 smithi162 bash[9856]: audit 2021-01-28T04:03:37.742051+0000 mon.a (mon.0) 1772 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-49"}]': finished 2021-01-28T04:03:39.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:38 smithi162 bash[9856]: audit 2021-01-28T04:03:37.742309+0000 mon.a (mon.0) 1773 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:03:39.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:38 smithi162 bash[9856]: cluster 2021-01-28T04:03:37.742463+0000 mon.a (mon.0) 1774 : cluster [DBG] osdmap e259: 8 total, 8 up, 8 in 2021-01-28T04:03:39.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:38 smithi162 bash[9856]: audit 2021-01-28T04:03:37.744824+0000 mon.c (mon.1) 334 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-35"}]: dispatch 2021-01-28T04:03:39.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:38 smithi162 bash[9856]: audit 2021-01-28T04:03:37.745106+0000 mon.c (mon.1) 335 : audit [INF] from='client.? 172.21.15.100:0/2149926891' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-49"}]: dispatch 2021-01-28T04:03:39.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:38 smithi162 bash[9856]: audit 2021-01-28T04:03:37.746292+0000 mon.a (mon.0) 1775 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-35"}]: dispatch 2021-01-28T04:03:39.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:38 smithi162 bash[9856]: audit 2021-01-28T04:03:37.746688+0000 mon.a (mon.0) 1776 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-49"}]: dispatch 2021-01-28T04:03:39.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:38 smithi162 bash[9856]: cluster 2021-01-28T04:03:38.578589+0000 mon.a (mon.0) 1777 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:03:39.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:38 smithi162 bash[9856]: audit 2021-01-28T04:03:38.586666+0000 mon.a (mon.0) 1778 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-35"}]': finished 2021-01-28T04:03:39.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:38 smithi162 bash[9856]: audit 2021-01-28T04:03:38.586829+0000 mon.a (mon.0) 1779 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-49"}]': finished 2021-01-28T04:03:39.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:38 smithi162 bash[9856]: cluster 2021-01-28T04:03:38.586953+0000 mon.a (mon.0) 1780 : cluster [DBG] osdmap e260: 8 total, 8 up, 8 in 2021-01-28T04:03:39.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:38 smithi162 bash[9856]: audit 2021-01-28T04:03:38.618543+0000 mon.c (mon.1) 336 : audit [INF] from='client.? 172.21.15.100:0/2545899183' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-50"}]: dispatch 2021-01-28T04:03:39.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:38 smithi162 bash[9856]: audit 2021-01-28T04:03:38.618972+0000 mon.a (mon.0) 1781 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-50"}]: dispatch 2021-01-28T04:03:39.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:38 smithi162 bash[9856]: audit 2021-01-28T04:03:38.620139+0000 mon.c (mon.1) 337 : audit [INF] from='client.? 172.21.15.100:0/2545899183' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-50"}]: dispatch 2021-01-28T04:03:39.017 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:38 smithi162 bash[9856]: audit 2021-01-28T04:03:38.620806+0000 mon.a (mon.0) 1782 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-50"}]: dispatch 2021-01-28T04:03:39.018 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:38 smithi162 bash[9856]: audit 2021-01-28T04:03:38.623158+0000 mon.c (mon.1) 338 : audit [INF] from='client.? 172.21.15.100:0/2545899183' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:39.018 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:38 smithi162 bash[9856]: audit 2021-01-28T04:03:38.623717+0000 mon.a (mon.0) 1783 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:39.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:38 smithi100 bash[9834]: cluster 2021-01-28T04:03:37.624006+0000 mgr.y (mgr.14138) 631 : cluster [DBG] pgmap v638: 228 pgs: 15 creating+peering, 213 active+clean; 26 KiB data, 324 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:03:39.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:38 smithi100 bash[9834]: audit 2021-01-28T04:03:37.742051+0000 mon.a (mon.0) 1772 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-49"}]': finished 2021-01-28T04:03:39.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:38 smithi100 bash[9834]: audit 2021-01-28T04:03:37.742309+0000 mon.a (mon.0) 1773 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:03:39.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:38 smithi100 bash[9834]: cluster 2021-01-28T04:03:37.742463+0000 mon.a (mon.0) 1774 : cluster [DBG] osdmap e259: 8 total, 8 up, 8 in 2021-01-28T04:03:39.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:38 smithi100 bash[9834]: audit 2021-01-28T04:03:37.744824+0000 mon.c (mon.1) 334 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-35"}]: dispatch 2021-01-28T04:03:39.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:38 smithi100 bash[9834]: audit 2021-01-28T04:03:37.745106+0000 mon.c (mon.1) 335 : audit [INF] from='client.? 172.21.15.100:0/2149926891' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-49"}]: dispatch 2021-01-28T04:03:39.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:38 smithi100 bash[9834]: audit 2021-01-28T04:03:37.746292+0000 mon.a (mon.0) 1775 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-35"}]: dispatch 2021-01-28T04:03:39.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:38 smithi100 bash[9834]: audit 2021-01-28T04:03:37.746688+0000 mon.a (mon.0) 1776 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-49"}]: dispatch 2021-01-28T04:03:39.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:38 smithi100 bash[9834]: cluster 2021-01-28T04:03:38.578589+0000 mon.a (mon.0) 1777 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:03:39.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:38 smithi100 bash[9834]: audit 2021-01-28T04:03:38.586666+0000 mon.a (mon.0) 1778 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-35"}]': finished 2021-01-28T04:03:39.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:38 smithi100 bash[9834]: audit 2021-01-28T04:03:38.586829+0000 mon.a (mon.0) 1779 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-49"}]': finished 2021-01-28T04:03:39.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:38 smithi100 bash[9834]: cluster 2021-01-28T04:03:38.586953+0000 mon.a (mon.0) 1780 : cluster [DBG] osdmap e260: 8 total, 8 up, 8 in 2021-01-28T04:03:39.082 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:38 smithi100 bash[9834]: audit 2021-01-28T04:03:38.618543+0000 mon.c (mon.1) 336 : audit [INF] from='client.? 172.21.15.100:0/2545899183' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-50"}]: dispatch 2021-01-28T04:03:39.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:38 smithi100 bash[9834]: audit 2021-01-28T04:03:38.618972+0000 mon.a (mon.0) 1781 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-50"}]: dispatch 2021-01-28T04:03:39.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:38 smithi100 bash[9834]: audit 2021-01-28T04:03:38.620139+0000 mon.c (mon.1) 337 : audit [INF] from='client.? 172.21.15.100:0/2545899183' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-50"}]: dispatch 2021-01-28T04:03:39.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:38 smithi100 bash[9834]: audit 2021-01-28T04:03:38.620806+0000 mon.a (mon.0) 1782 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-50"}]: dispatch 2021-01-28T04:03:39.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:38 smithi100 bash[9834]: audit 2021-01-28T04:03:38.623158+0000 mon.c (mon.1) 338 : audit [INF] from='client.? 172.21.15.100:0/2545899183' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:39.083 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:38 smithi100 bash[9834]: audit 2021-01-28T04:03:38.623717+0000 mon.a (mon.0) 1783 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:39.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:38 smithi100 bash[13549]: cluster 2021-01-28T04:03:37.624006+0000 mgr.y (mgr.14138) 631 : cluster [DBG] pgmap v638: 228 pgs: 15 creating+peering, 213 active+clean; 26 KiB data, 324 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:03:39.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:38 smithi100 bash[13549]: audit 2021-01-28T04:03:37.742051+0000 mon.a (mon.0) 1772 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-49"}]': finished 2021-01-28T04:03:39.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:38 smithi100 bash[13549]: audit 2021-01-28T04:03:37.742309+0000 mon.a (mon.0) 1773 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi100-32332-6"}]': finished 2021-01-28T04:03:39.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:38 smithi100 bash[13549]: cluster 2021-01-28T04:03:37.742463+0000 mon.a (mon.0) 1774 : cluster [DBG] osdmap e259: 8 total, 8 up, 8 in 2021-01-28T04:03:39.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:38 smithi100 bash[13549]: audit 2021-01-28T04:03:37.744824+0000 mon.c (mon.1) 334 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-35"}]: dispatch 2021-01-28T04:03:39.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:38 smithi100 bash[13549]: audit 2021-01-28T04:03:37.745106+0000 mon.c (mon.1) 335 : audit [INF] from='client.? 172.21.15.100:0/2149926891' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-49"}]: dispatch 2021-01-28T04:03:39.085 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:38 smithi100 bash[13549]: audit 2021-01-28T04:03:37.746292+0000 mon.a (mon.0) 1775 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-35"}]: dispatch 2021-01-28T04:03:39.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:38 smithi100 bash[13549]: audit 2021-01-28T04:03:37.746688+0000 mon.a (mon.0) 1776 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-49"}]: dispatch 2021-01-28T04:03:39.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:38 smithi100 bash[13549]: cluster 2021-01-28T04:03:38.578589+0000 mon.a (mon.0) 1777 : cluster [INF] Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2021-01-28T04:03:39.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:38 smithi100 bash[13549]: audit 2021-01-28T04:03:38.586666+0000 mon.a (mon.0) 1778 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-35"}]': finished 2021-01-28T04:03:39.086 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:38 smithi100 bash[13549]: audit 2021-01-28T04:03:38.586829+0000 mon.a (mon.0) 1779 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-49"}]': finished 2021-01-28T04:03:39.087 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:38 smithi100 bash[13549]: cluster 2021-01-28T04:03:38.586953+0000 mon.a (mon.0) 1780 : cluster [DBG] osdmap e260: 8 total, 8 up, 8 in 2021-01-28T04:03:39.087 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:38 smithi100 bash[13549]: audit 2021-01-28T04:03:38.618543+0000 mon.c (mon.1) 336 : audit [INF] from='client.? 172.21.15.100:0/2545899183' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-50"}]: dispatch 2021-01-28T04:03:39.087 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:38 smithi100 bash[13549]: audit 2021-01-28T04:03:38.618972+0000 mon.a (mon.0) 1781 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-50"}]: dispatch 2021-01-28T04:03:39.087 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:38 smithi100 bash[13549]: audit 2021-01-28T04:03:38.620139+0000 mon.c (mon.1) 337 : audit [INF] from='client.? 172.21.15.100:0/2545899183' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-50"}]: dispatch 2021-01-28T04:03:39.088 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:38 smithi100 bash[13549]: audit 2021-01-28T04:03:38.620806+0000 mon.a (mon.0) 1782 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-50"}]: dispatch 2021-01-28T04:03:39.088 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:38 smithi100 bash[13549]: audit 2021-01-28T04:03:38.623158+0000 mon.c (mon.1) 338 : audit [INF] from='client.? 172.21.15.100:0/2545899183' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:39.088 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:38 smithi100 bash[13549]: audit 2021-01-28T04:03:38.623717+0000 mon.a (mon.0) 1783 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:40.263 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 04:03:39 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T04:03:40.328 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 04:03:39 smithi100 bash[10061]: debug 2021-01-28T04:03:39.890+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:03:41.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:40 smithi162 bash[9856]: audit 2021-01-28T04:03:39.601399+0000 mon.a (mon.0) 1784 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:03:41.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:40 smithi162 bash[9856]: cluster 2021-01-28T04:03:39.601556+0000 mon.a (mon.0) 1785 : cluster [DBG] osdmap e261: 8 total, 8 up, 8 in 2021-01-28T04:03:41.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:40 smithi162 bash[9856]: audit 2021-01-28T04:03:39.603668+0000 mon.c (mon.1) 339 : audit [INF] from='client.? 172.21.15.100:0/2545899183' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-50"}]: dispatch 2021-01-28T04:03:41.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:40 smithi162 bash[9856]: audit 2021-01-28T04:03:39.605621+0000 mon.a (mon.0) 1786 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-50"}]: dispatch 2021-01-28T04:03:41.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:40 smithi162 bash[9856]: cluster 2021-01-28T04:03:39.624589+0000 mgr.y (mgr.14138) 632 : cluster [DBG] pgmap v642: 196 pgs: 196 active+clean; 26 KiB data, 329 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.3 KiB/s wr, 2 op/s 2021-01-28T04:03:41.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:40 smithi162 bash[9856]: audit 2021-01-28T04:03:39.891674+0000 mgr.y (mgr.14138) 633 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:03:41.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:40 smithi100 bash[9834]: audit 2021-01-28T04:03:39.601399+0000 mon.a (mon.0) 1784 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:03:41.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:40 smithi100 bash[9834]: cluster 2021-01-28T04:03:39.601556+0000 mon.a (mon.0) 1785 : cluster [DBG] osdmap e261: 8 total, 8 up, 8 in 2021-01-28T04:03:41.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:40 smithi100 bash[9834]: audit 2021-01-28T04:03:39.603668+0000 mon.c (mon.1) 339 : audit [INF] from='client.? 172.21.15.100:0/2545899183' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-50"}]: dispatch 2021-01-28T04:03:41.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:40 smithi100 bash[9834]: audit 2021-01-28T04:03:39.605621+0000 mon.a (mon.0) 1786 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-50"}]: dispatch 2021-01-28T04:03:41.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:40 smithi100 bash[9834]: cluster 2021-01-28T04:03:39.624589+0000 mgr.y (mgr.14138) 632 : cluster [DBG] pgmap v642: 196 pgs: 196 active+clean; 26 KiB data, 329 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.3 KiB/s wr, 2 op/s 2021-01-28T04:03:41.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:40 smithi100 bash[9834]: audit 2021-01-28T04:03:39.891674+0000 mgr.y (mgr.14138) 633 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:03:41.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:40 smithi100 bash[13549]: audit 2021-01-28T04:03:39.601399+0000 mon.a (mon.0) 1784 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:03:41.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:40 smithi100 bash[13549]: cluster 2021-01-28T04:03:39.601556+0000 mon.a (mon.0) 1785 : cluster [DBG] osdmap e261: 8 total, 8 up, 8 in 2021-01-28T04:03:41.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:40 smithi100 bash[13549]: audit 2021-01-28T04:03:39.603668+0000 mon.c (mon.1) 339 : audit [INF] from='client.? 172.21.15.100:0/2545899183' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-50"}]: dispatch 2021-01-28T04:03:41.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:40 smithi100 bash[13549]: audit 2021-01-28T04:03:39.605621+0000 mon.a (mon.0) 1786 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-50"}]: dispatch 2021-01-28T04:03:41.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:40 smithi100 bash[13549]: cluster 2021-01-28T04:03:39.624589+0000 mgr.y (mgr.14138) 632 : cluster [DBG] pgmap v642: 196 pgs: 196 active+clean; 26 KiB data, 329 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.3 KiB/s wr, 2 op/s 2021-01-28T04:03:41.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:40 smithi100 bash[13549]: audit 2021-01-28T04:03:39.891674+0000 mgr.y (mgr.14138) 633 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:03:42.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:41 smithi162 bash[9856]: cluster 2021-01-28T04:03:41.019762+0000 mon.a (mon.0) 1787 : cluster [DBG] osdmap e262: 8 total, 8 up, 8 in 2021-01-28T04:03:42.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:41 smithi162 bash[9856]: audit 2021-01-28T04:03:41.021248+0000 mon.c (mon.1) 340 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:42.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:41 smithi162 bash[9856]: audit 2021-01-28T04:03:41.023646+0000 mon.a (mon.0) 1788 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:42.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:41 smithi100 bash[9834]: cluster 2021-01-28T04:03:41.019762+0000 mon.a (mon.0) 1787 : cluster [DBG] osdmap e262: 8 total, 8 up, 8 in 2021-01-28T04:03:42.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:41 smithi100 bash[9834]: audit 2021-01-28T04:03:41.021248+0000 mon.c (mon.1) 340 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:42.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:41 smithi100 bash[9834]: audit 2021-01-28T04:03:41.023646+0000 mon.a (mon.0) 1788 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:42.079 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:41 smithi100 bash[13549]: cluster 2021-01-28T04:03:41.019762+0000 mon.a (mon.0) 1787 : cluster [DBG] osdmap e262: 8 total, 8 up, 8 in 2021-01-28T04:03:42.079 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:41 smithi100 bash[13549]: audit 2021-01-28T04:03:41.021248+0000 mon.c (mon.1) 340 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:42.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:41 smithi100 bash[13549]: audit 2021-01-28T04:03:41.023646+0000 mon.a (mon.0) 1788 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:03:43.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:42 smithi162 bash[9856]: audit 2021-01-28T04:03:41.622211+0000 mon.a (mon.0) 1789 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-50"}]': finished 2021-01-28T04:03:43.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:42 smithi162 bash[9856]: audit 2021-01-28T04:03:41.622485+0000 mon.a (mon.0) 1790 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-37","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:03:43.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:42 smithi162 bash[9856]: cluster 2021-01-28T04:03:41.622625+0000 mon.a (mon.0) 1791 : cluster [DBG] osdmap e263: 8 total, 8 up, 8 in 2021-01-28T04:03:43.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:42 smithi162 bash[9856]: cluster 2021-01-28T04:03:41.625227+0000 mgr.y (mgr.14138) 634 : cluster [DBG] pgmap v645: 236 pgs: 1 creating+peering, 39 unknown, 196 active+clean; 26 KiB data, 333 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.3 KiB/s wr, 2 op/s 2021-01-28T04:03:43.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:42 smithi162 bash[9856]: audit 2021-01-28T04:03:41.643009+0000 mon.c (mon.1) 341 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-37", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:03:43.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:42 smithi162 bash[9856]: audit 2021-01-28T04:03:41.644009+0000 mon.a (mon.0) 1792 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-37", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:03:43.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:42 smithi100 bash[9834]: audit 2021-01-28T04:03:41.622211+0000 mon.a (mon.0) 1789 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-50"}]': finished 2021-01-28T04:03:43.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:42 smithi100 bash[9834]: audit 2021-01-28T04:03:41.622485+0000 mon.a (mon.0) 1790 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-37","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:03:43.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:42 smithi100 bash[9834]: cluster 2021-01-28T04:03:41.622625+0000 mon.a (mon.0) 1791 : cluster [DBG] osdmap e263: 8 total, 8 up, 8 in 2021-01-28T04:03:43.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:42 smithi100 bash[9834]: cluster 2021-01-28T04:03:41.625227+0000 mgr.y (mgr.14138) 634 : cluster [DBG] pgmap v645: 236 pgs: 1 creating+peering, 39 unknown, 196 active+clean; 26 KiB data, 333 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.3 KiB/s wr, 2 op/s 2021-01-28T04:03:43.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:42 smithi100 bash[9834]: audit 2021-01-28T04:03:41.643009+0000 mon.c (mon.1) 341 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-37", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:03:43.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:42 smithi100 bash[9834]: audit 2021-01-28T04:03:41.644009+0000 mon.a (mon.0) 1792 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-37", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:03:43.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:42 smithi100 bash[13549]: audit 2021-01-28T04:03:41.622211+0000 mon.a (mon.0) 1789 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-50"}]': finished 2021-01-28T04:03:43.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:42 smithi100 bash[13549]: audit 2021-01-28T04:03:41.622485+0000 mon.a (mon.0) 1790 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi100-32332-37","app": "rados","yes_i_really_mean_it": true}]': finished 2021-01-28T04:03:43.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:42 smithi100 bash[13549]: cluster 2021-01-28T04:03:41.622625+0000 mon.a (mon.0) 1791 : cluster [DBG] osdmap e263: 8 total, 8 up, 8 in 2021-01-28T04:03:43.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:42 smithi100 bash[13549]: cluster 2021-01-28T04:03:41.625227+0000 mgr.y (mgr.14138) 634 : cluster [DBG] pgmap v645: 236 pgs: 1 creating+peering, 39 unknown, 196 active+clean; 26 KiB data, 333 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.3 KiB/s wr, 2 op/s 2021-01-28T04:03:43.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:42 smithi100 bash[13549]: audit 2021-01-28T04:03:41.643009+0000 mon.c (mon.1) 341 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-37", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:03:43.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:42 smithi100 bash[13549]: audit 2021-01-28T04:03:41.644009+0000 mon.a (mon.0) 1792 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-37", "force_nonempty": "--force-nonempty" }]: dispatch 2021-01-28T04:03:44.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:43 smithi162 bash[9856]: audit 2021-01-28T04:03:42.634550+0000 mon.a (mon.0) 1793 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-37", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:03:44.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:43 smithi162 bash[9856]: cluster 2021-01-28T04:03:42.634670+0000 mon.a (mon.0) 1794 : cluster [DBG] osdmap e264: 8 total, 8 up, 8 in 2021-01-28T04:03:44.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:43 smithi162 bash[9856]: audit 2021-01-28T04:03:42.638855+0000 mon.c (mon.1) 342 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-37"}]: dispatch 2021-01-28T04:03:44.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:43 smithi162 bash[9856]: audit 2021-01-28T04:03:42.646964+0000 mon.a (mon.0) 1795 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-37"}]: dispatch 2021-01-28T04:03:44.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:43 smithi100 bash[9834]: audit 2021-01-28T04:03:42.634550+0000 mon.a (mon.0) 1793 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-37", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:03:44.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:43 smithi100 bash[9834]: cluster 2021-01-28T04:03:42.634670+0000 mon.a (mon.0) 1794 : cluster [DBG] osdmap e264: 8 total, 8 up, 8 in 2021-01-28T04:03:44.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:43 smithi100 bash[9834]: audit 2021-01-28T04:03:42.638855+0000 mon.c (mon.1) 342 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-37"}]: dispatch 2021-01-28T04:03:44.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:43 smithi100 bash[9834]: audit 2021-01-28T04:03:42.646964+0000 mon.a (mon.0) 1795 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-37"}]: dispatch 2021-01-28T04:03:44.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:43 smithi100 bash[13549]: audit 2021-01-28T04:03:42.634550+0000 mon.a (mon.0) 1793 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi100-32332-6", "tierpool": "test-rados-api-smithi100-32332-37", "force_nonempty": "--force-nonempty" }]': finished 2021-01-28T04:03:44.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:43 smithi100 bash[13549]: cluster 2021-01-28T04:03:42.634670+0000 mon.a (mon.0) 1794 : cluster [DBG] osdmap e264: 8 total, 8 up, 8 in 2021-01-28T04:03:44.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:43 smithi100 bash[13549]: audit 2021-01-28T04:03:42.638855+0000 mon.c (mon.1) 342 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-37"}]: dispatch 2021-01-28T04:03:44.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:43 smithi100 bash[13549]: audit 2021-01-28T04:03:42.646964+0000 mon.a (mon.0) 1795 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-37"}]: dispatch 2021-01-28T04:03:45.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:44 smithi162 bash[9856]: cluster 2021-01-28T04:03:43.626703+0000 mgr.y (mgr.14138) 635 : cluster [DBG] pgmap v647: 236 pgs: 2 creating+activating, 1 creating+peering, 8 unknown, 225 active+clean; 26 KiB data, 335 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:03:45.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:44 smithi162 bash[9856]: audit 2021-01-28T04:03:43.650719+0000 mon.a (mon.0) 1796 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-37"}]': finished 2021-01-28T04:03:45.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:44 smithi162 bash[9856]: cluster 2021-01-28T04:03:43.651052+0000 mon.a (mon.0) 1797 : cluster [DBG] osdmap e265: 8 total, 8 up, 8 in 2021-01-28T04:03:45.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:44 smithi162 bash[9856]: audit 2021-01-28T04:03:43.655022+0000 mon.c (mon.1) 343 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-37", "mode": "writeback"}]: dispatch 2021-01-28T04:03:45.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:44 smithi162 bash[9856]: audit 2021-01-28T04:03:43.655629+0000 mon.a (mon.0) 1798 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-37", "mode": "writeback"}]: dispatch 2021-01-28T04:03:45.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:44 smithi162 bash[9856]: audit 2021-01-28T04:03:43.655778+0000 mon.c (mon.1) 344 : audit [INF] from='client.? 172.21.15.100:0/2545899183' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-50"}]: dispatch 2021-01-28T04:03:45.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:44 smithi162 bash[9856]: audit 2021-01-28T04:03:43.662686+0000 mon.a (mon.0) 1799 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-50"}]: dispatch 2021-01-28T04:03:45.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:44 smithi162 bash[9856]: cluster 2021-01-28T04:03:44.643146+0000 mon.a (mon.0) 1800 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:03:45.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:44 smithi162 bash[9856]: audit 2021-01-28T04:03:44.651810+0000 mon.a (mon.0) 1801 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-37", "mode": "writeback"}]': finished 2021-01-28T04:03:45.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:44 smithi162 bash[9856]: audit 2021-01-28T04:03:44.652254+0000 mon.a (mon.0) 1802 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-50"}]': finished 2021-01-28T04:03:45.016 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:44 smithi162 bash[9856]: cluster 2021-01-28T04:03:44.652431+0000 mon.a (mon.0) 1803 : cluster [DBG] osdmap e266: 8 total, 8 up, 8 in 2021-01-28T04:03:45.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:44 smithi100 bash[9834]: cluster 2021-01-28T04:03:43.626703+0000 mgr.y (mgr.14138) 635 : cluster [DBG] pgmap v647: 236 pgs: 2 creating+activating, 1 creating+peering, 8 unknown, 225 active+clean; 26 KiB data, 335 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:03:45.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:44 smithi100 bash[9834]: audit 2021-01-28T04:03:43.650719+0000 mon.a (mon.0) 1796 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-37"}]': finished 2021-01-28T04:03:45.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:44 smithi100 bash[9834]: cluster 2021-01-28T04:03:43.651052+0000 mon.a (mon.0) 1797 : cluster [DBG] osdmap e265: 8 total, 8 up, 8 in 2021-01-28T04:03:45.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:44 smithi100 bash[9834]: audit 2021-01-28T04:03:43.655022+0000 mon.c (mon.1) 343 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-37", "mode": "writeback"}]: dispatch 2021-01-28T04:03:45.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:44 smithi100 bash[9834]: audit 2021-01-28T04:03:43.655629+0000 mon.a (mon.0) 1798 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-37", "mode": "writeback"}]: dispatch 2021-01-28T04:03:45.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:44 smithi100 bash[9834]: audit 2021-01-28T04:03:43.655778+0000 mon.c (mon.1) 344 : audit [INF] from='client.? 172.21.15.100:0/2545899183' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-50"}]: dispatch 2021-01-28T04:03:45.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:44 smithi100 bash[9834]: audit 2021-01-28T04:03:43.662686+0000 mon.a (mon.0) 1799 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-50"}]: dispatch 2021-01-28T04:03:45.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:44 smithi100 bash[9834]: cluster 2021-01-28T04:03:44.643146+0000 mon.a (mon.0) 1800 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:03:45.080 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:44 smithi100 bash[9834]: audit 2021-01-28T04:03:44.651810+0000 mon.a (mon.0) 1801 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-37", "mode": "writeback"}]': finished 2021-01-28T04:03:45.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:44 smithi100 bash[9834]: audit 2021-01-28T04:03:44.652254+0000 mon.a (mon.0) 1802 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-50"}]': finished 2021-01-28T04:03:45.081 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:44 smithi100 bash[9834]: cluster 2021-01-28T04:03:44.652431+0000 mon.a (mon.0) 1803 : cluster [DBG] osdmap e266: 8 total, 8 up, 8 in 2021-01-28T04:03:45.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:44 smithi100 bash[13549]: cluster 2021-01-28T04:03:43.626703+0000 mgr.y (mgr.14138) 635 : cluster [DBG] pgmap v647: 236 pgs: 2 creating+activating, 1 creating+peering, 8 unknown, 225 active+clean; 26 KiB data, 335 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:03:45.081 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:44 smithi100 bash[13549]: audit 2021-01-28T04:03:43.650719+0000 mon.a (mon.0) 1796 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi100-32332-6", "overlaypool": "test-rados-api-smithi100-32332-37"}]': finished 2021-01-28T04:03:45.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:44 smithi100 bash[13549]: cluster 2021-01-28T04:03:43.651052+0000 mon.a (mon.0) 1797 : cluster [DBG] osdmap e265: 8 total, 8 up, 8 in 2021-01-28T04:03:45.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:44 smithi100 bash[13549]: audit 2021-01-28T04:03:43.655022+0000 mon.c (mon.1) 343 : audit [INF] from='client.? 172.21.15.100:0/801793775' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-37", "mode": "writeback"}]: dispatch 2021-01-28T04:03:45.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:44 smithi100 bash[13549]: audit 2021-01-28T04:03:43.655629+0000 mon.a (mon.0) 1798 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-37", "mode": "writeback"}]: dispatch 2021-01-28T04:03:45.082 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:44 smithi100 bash[13549]: audit 2021-01-28T04:03:43.655778+0000 mon.c (mon.1) 344 : audit [INF] from='client.? 172.21.15.100:0/2545899183' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-50"}]: dispatch 2021-01-28T04:03:45.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:44 smithi100 bash[13549]: audit 2021-01-28T04:03:43.662686+0000 mon.a (mon.0) 1799 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-50"}]: dispatch 2021-01-28T04:03:45.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:44 smithi100 bash[13549]: cluster 2021-01-28T04:03:44.643146+0000 mon.a (mon.0) 1800 : cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2021-01-28T04:03:45.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:44 smithi100 bash[13549]: audit 2021-01-28T04:03:44.651810+0000 mon.a (mon.0) 1801 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi100-32332-37", "mode": "writeback"}]': finished 2021-01-28T04:03:45.083 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:44 smithi100 bash[13549]: audit 2021-01-28T04:03:44.652254+0000 mon.a (mon.0) 1802 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-50"}]': finished 2021-01-28T04:03:45.084 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:44 smithi100 bash[13549]: cluster 2021-01-28T04:03:44.652431+0000 mon.a (mon.0) 1803 : cluster [DBG] osdmap e266: 8 total, 8 up, 8 in 2021-01-28T04:03:46.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:45 smithi162 bash[9856]: audit 2021-01-28T04:03:44.656464+0000 mon.c (mon.1) 345 : audit [INF] from='client.? 172.21.15.100:0/2545899183' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-50"}]: dispatch 2021-01-28T04:03:46.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:45 smithi162 bash[9856]: audit 2021-01-28T04:03:44.658767+0000 mon.a (mon.0) 1804 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-50"}]: dispatch 2021-01-28T04:03:46.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:45 smithi162 bash[9856]: audit 2021-01-28T04:03:45.655982+0000 mon.a (mon.0) 1805 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-50"}]': finished 2021-01-28T04:03:46.015 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:45 smithi162 bash[9856]: cluster 2021-01-28T04:03:45.656127+0000 mon.a (mon.0) 1806 : cluster [DBG] osdmap e267: 8 total, 8 up, 8 in 2021-01-28T04:03:46.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:45 smithi100 bash[9834]: audit 2021-01-28T04:03:44.656464+0000 mon.c (mon.1) 345 : audit [INF] from='client.? 172.21.15.100:0/2545899183' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-50"}]: dispatch 2021-01-28T04:03:46.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:45 smithi100 bash[9834]: audit 2021-01-28T04:03:44.658767+0000 mon.a (mon.0) 1804 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-50"}]: dispatch 2021-01-28T04:03:46.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:45 smithi100 bash[9834]: audit 2021-01-28T04:03:45.655982+0000 mon.a (mon.0) 1805 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-50"}]': finished 2021-01-28T04:03:46.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:45 smithi100 bash[9834]: cluster 2021-01-28T04:03:45.656127+0000 mon.a (mon.0) 1806 : cluster [DBG] osdmap e267: 8 total, 8 up, 8 in 2021-01-28T04:03:46.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:45 smithi100 bash[13549]: audit 2021-01-28T04:03:44.656464+0000 mon.c (mon.1) 345 : audit [INF] from='client.? 172.21.15.100:0/2545899183' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-50"}]: dispatch 2021-01-28T04:03:46.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:45 smithi100 bash[13549]: audit 2021-01-28T04:03:44.658767+0000 mon.a (mon.0) 1804 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-50"}]: dispatch 2021-01-28T04:03:46.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:45 smithi100 bash[13549]: audit 2021-01-28T04:03:45.655982+0000 mon.a (mon.0) 1805 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-50"}]': finished 2021-01-28T04:03:46.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:45 smithi100 bash[13549]: cluster 2021-01-28T04:03:45.656127+0000 mon.a (mon.0) 1806 : cluster [DBG] osdmap e267: 8 total, 8 up, 8 in 2021-01-28T04:03:47.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:46 smithi162 bash[9856]: cluster 2021-01-28T04:03:45.627619+0000 mgr.y (mgr.14138) 636 : cluster [DBG] pgmap v650: 228 pgs: 1 creating+peering, 227 active+clean; 26 KiB data, 335 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:03:47.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:46 smithi162 bash[9856]: audit 2021-01-28T04:03:45.678165+0000 mon.a (mon.0) 1807 : audit [INF] from='client.? 172.21.15.100:0/1845995819' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-51"}]: dispatch 2021-01-28T04:03:47.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:46 smithi162 bash[9856]: audit 2021-01-28T04:03:45.679225+0000 mon.a (mon.0) 1808 : audit [INF] from='client.? 172.21.15.100:0/1845995819' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-51"}]: dispatch 2021-01-28T04:03:47.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:46 smithi162 bash[9856]: audit 2021-01-28T04:03:45.679803+0000 mon.a (mon.0) 1809 : audit [INF] from='client.? 172.21.15.100:0/1845995819' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-51", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:47.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:46 smithi100 bash[9834]: cluster 2021-01-28T04:03:45.627619+0000 mgr.y (mgr.14138) 636 : cluster [DBG] pgmap v650: 228 pgs: 1 creating+peering, 227 active+clean; 26 KiB data, 335 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:03:47.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:46 smithi100 bash[9834]: audit 2021-01-28T04:03:45.678165+0000 mon.a (mon.0) 1807 : audit [INF] from='client.? 172.21.15.100:0/1845995819' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-51"}]: dispatch 2021-01-28T04:03:47.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:46 smithi100 bash[9834]: audit 2021-01-28T04:03:45.679225+0000 mon.a (mon.0) 1808 : audit [INF] from='client.? 172.21.15.100:0/1845995819' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-51"}]: dispatch 2021-01-28T04:03:47.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:46 smithi100 bash[9834]: audit 2021-01-28T04:03:45.679803+0000 mon.a (mon.0) 1809 : audit [INF] from='client.? 172.21.15.100:0/1845995819' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-51", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:47.079 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:46 smithi100 bash[13549]: cluster 2021-01-28T04:03:45.627619+0000 mgr.y (mgr.14138) 636 : cluster [DBG] pgmap v650: 228 pgs: 1 creating+peering, 227 active+clean; 26 KiB data, 335 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:03:47.079 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:46 smithi100 bash[13549]: audit 2021-01-28T04:03:45.678165+0000 mon.a (mon.0) 1807 : audit [INF] from='client.? 172.21.15.100:0/1845995819' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-51"}]: dispatch 2021-01-28T04:03:47.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:46 smithi100 bash[13549]: audit 2021-01-28T04:03:45.679225+0000 mon.a (mon.0) 1808 : audit [INF] from='client.? 172.21.15.100:0/1845995819' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-51"}]: dispatch 2021-01-28T04:03:47.080 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:46 smithi100 bash[13549]: audit 2021-01-28T04:03:45.679803+0000 mon.a (mon.0) 1809 : audit [INF] from='client.? 172.21.15.100:0/1845995819' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-51", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-01-28T04:03:48.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:48 smithi162 bash[9856]: audit 2021-01-28T04:03:46.683002+0000 mon.a (mon.0) 1810 : audit [INF] from='client.? 172.21.15.100:0/1845995819' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-51", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:03:48.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:48 smithi162 bash[9856]: cluster 2021-01-28T04:03:46.683163+0000 mon.a (mon.0) 1811 : cluster [DBG] osdmap e268: 8 total, 8 up, 8 in 2021-01-28T04:03:48.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:48 smithi162 bash[9856]: audit 2021-01-28T04:03:46.686662+0000 mon.a (mon.0) 1812 : audit [INF] from='client.? 172.21.15.100:0/1845995819' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-51", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-51"}]: dispatch 2021-01-28T04:03:48.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:48 smithi100 bash[9834]: audit 2021-01-28T04:03:46.683002+0000 mon.a (mon.0) 1810 : audit [INF] from='client.? 172.21.15.100:0/1845995819' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-51", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:03:48.578 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:48 smithi100 bash[9834]: cluster 2021-01-28T04:03:46.683163+0000 mon.a (mon.0) 1811 : cluster [DBG] osdmap e268: 8 total, 8 up, 8 in 2021-01-28T04:03:48.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:48 smithi100 bash[9834]: audit 2021-01-28T04:03:46.686662+0000 mon.a (mon.0) 1812 : audit [INF] from='client.? 172.21.15.100:0/1845995819' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-51", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-51"}]: dispatch 2021-01-28T04:03:48.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:48 smithi100 bash[13549]: audit 2021-01-28T04:03:46.683002+0000 mon.a (mon.0) 1810 : audit [INF] from='client.? 172.21.15.100:0/1845995819' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi100-32163-51", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-01-28T04:03:48.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:48 smithi100 bash[13549]: cluster 2021-01-28T04:03:46.683163+0000 mon.a (mon.0) 1811 : cluster [DBG] osdmap e268: 8 total, 8 up, 8 in 2021-01-28T04:03:48.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:48 smithi100 bash[13549]: audit 2021-01-28T04:03:46.686662+0000 mon.a (mon.0) 1812 : audit [INF] from='client.? 172.21.15.100:0/1845995819' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-51", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-51"}]: dispatch 2021-01-28T04:03:49.513 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:49 smithi162 bash[9856]: cluster 2021-01-28T04:03:47.629016+0000 mgr.y (mgr.14138) 637 : cluster [DBG] pgmap v653: 228 pgs: 228 active+clean; 3.8 MiB data, 343 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 976 KiB/s wr, 12 op/s 2021-01-28T04:03:49.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:49 smithi162 bash[9856]: cluster 2021-01-28T04:03:48.112559+0000 mon.a (mon.0) 1813 : cluster [DBG] osdmap e269: 8 total, 8 up, 8 in 2021-01-28T04:03:49.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:49 smithi162 bash[9856]: audit 2021-01-28T04:03:48.689877+0000 mon.a (mon.0) 1814 : audit [INF] from='client.? 172.21.15.100:0/1845995819' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-51", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-51"}]': finished 2021-01-28T04:03:49.514 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:49 smithi162 bash[9856]: cluster 2021-01-28T04:03:48.690216+0000 mon.a (mon.0) 1815 : cluster [DBG] osdmap e270: 8 total, 8 up, 8 in 2021-01-28T04:03:49.578 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:49 smithi100 bash[13549]: cluster 2021-01-28T04:03:47.629016+0000 mgr.y (mgr.14138) 637 : cluster [DBG] pgmap v653: 228 pgs: 228 active+clean; 3.8 MiB data, 343 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 976 KiB/s wr, 12 op/s 2021-01-28T04:03:49.578 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:49 smithi100 bash[13549]: cluster 2021-01-28T04:03:48.112559+0000 mon.a (mon.0) 1813 : cluster [DBG] osdmap e269: 8 total, 8 up, 8 in 2021-01-28T04:03:49.578 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:49 smithi100 bash[13549]: audit 2021-01-28T04:03:48.689877+0000 mon.a (mon.0) 1814 : audit [INF] from='client.? 172.21.15.100:0/1845995819' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-51", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-51"}]': finished 2021-01-28T04:03:49.579 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:49 smithi100 bash[13549]: cluster 2021-01-28T04:03:48.690216+0000 mon.a (mon.0) 1815 : cluster [DBG] osdmap e270: 8 total, 8 up, 8 in 2021-01-28T04:03:49.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:49 smithi100 bash[9834]: cluster 2021-01-28T04:03:47.629016+0000 mgr.y (mgr.14138) 637 : cluster [DBG] pgmap v653: 228 pgs: 228 active+clean; 3.8 MiB data, 343 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 976 KiB/s wr, 12 op/s 2021-01-28T04:03:49.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:49 smithi100 bash[9834]: cluster 2021-01-28T04:03:48.112559+0000 mon.a (mon.0) 1813 : cluster [DBG] osdmap e269: 8 total, 8 up, 8 in 2021-01-28T04:03:49.579 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:49 smithi100 bash[9834]: audit 2021-01-28T04:03:48.689877+0000 mon.a (mon.0) 1814 : audit [INF] from='client.? 172.21.15.100:0/1845995819' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi100-32163-51", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi100-32163-51"}]': finished 2021-01-28T04:03:49.580 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:49 smithi100 bash[9834]: cluster 2021-01-28T04:03:48.690216+0000 mon.a (mon.0) 1815 : cluster [DBG] osdmap e270: 8 total, 8 up, 8 in 2021-01-28T04:03:50.263 INFO:journalctl@ceph.iscsi.iscsi.a.smithi162.stdout:Jan 28 04:03:49 smithi162 bash[22192]: debug mgr command failed -13 2021-01-28T04:03:50.328 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Jan 28 04:03:49 smithi100 bash[10061]: debug 2021-01-28T04:03:49.894+0000 7f55f63ba700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:03:51.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:50 smithi162 bash[9856]: cluster 2021-01-28T04:03:49.630125+0000 mgr.y (mgr.14138) 638 : cluster [DBG] pgmap v656: 236 pgs: 1 creating+peering, 7 unknown, 228 active+clean; 7.7 MiB data, 347 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 14 op/s 2021-01-28T04:03:51.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:50 smithi162 bash[9856]: cluster 2021-01-28T04:03:49.692880+0000 mon.a (mon.0) 1816 : cluster [DBG] osdmap e271: 8 total, 8 up, 8 in 2021-01-28T04:03:51.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:50 smithi162 bash[9856]: audit 2021-01-28T04:03:49.895841+0000 mgr.y (mgr.14138) 639 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:03:51.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:50 smithi100 bash[9834]: cluster 2021-01-28T04:03:49.630125+0000 mgr.y (mgr.14138) 638 : cluster [DBG] pgmap v656: 236 pgs: 1 creating+peering, 7 unknown, 228 active+clean; 7.7 MiB data, 347 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 14 op/s 2021-01-28T04:03:51.078 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:50 smithi100 bash[9834]: cluster 2021-01-28T04:03:49.692880+0000 mon.a (mon.0) 1816 : cluster [DBG] osdmap e271: 8 total, 8 up, 8 in 2021-01-28T04:03:51.079 INFO:journalctl@ceph.mon.a.smithi100.stdout:Jan 28 04:03:50 smithi100 bash[9834]: audit 2021-01-28T04:03:49.895841+0000 mgr.y (mgr.14138) 639 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:03:51.079 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:50 smithi100 bash[13549]: cluster 2021-01-28T04:03:49.630125+0000 mgr.y (mgr.14138) 638 : cluster [DBG] pgmap v656: 236 pgs: 1 creating+peering, 7 unknown, 228 active+clean; 7.7 MiB data, 347 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 14 op/s 2021-01-28T04:03:51.079 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:50 smithi100 bash[13549]: cluster 2021-01-28T04:03:49.692880+0000 mon.a (mon.0) 1816 : cluster [DBG] osdmap e271: 8 total, 8 up, 8 in 2021-01-28T04:03:51.079 INFO:journalctl@ceph.mon.c.smithi100.stdout:Jan 28 04:03:50 smithi100 bash[13549]: audit 2021-01-28T04:03:49.895841+0000 mgr.y (mgr.14138) 639 : audit [INF] from='client.34466 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:03:52.013 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:51 smithi162 bash[9856]: cluster 2021-01-28T04:03:50.699755+0000 mon.a (mon.0) 1817 : cluster [DBG] osdmap e272: 8 total, 8 up, 8 in 2021-01-28T04:03:52.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:51 smithi162 bash[9856]: audit 2021-01-28T04:03:50.702663+0000 mon.a (mon.0) 1818 : audit [INF] from='client.? 172.21.15.100:0/1845995819' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-51"}]: dispatch 2021-01-28T04:03:52.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:51 smithi162 bash[9856]: audit 2021-01-28T04:03:51.699245+0000 mon.a (mon.0) 1819 : audit [INF] from='client.? 172.21.15.100:0/1845995819' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi100-32163-51"}]': finished 2021-01-28T04:03:52.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:51 smithi162 bash[9856]: cluster 2021-01-28T04:03:51.699677+0000 mon.a (mon.0) 1820 : cluster [DBG] osdmap e273: 8 total, 8 up, 8 in 2021-01-28T04:03:52.014 INFO:journalctl@ceph.mon.b.smithi162.stdout:Jan 28 04:03:51 smithi162 bash[9856]: audit 2021-01-28T04:03:51.701216+0000 mon.a (mon.0) 1821 : audit [INF] from='client.? 172.21.15.100:0/1845995819' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi100-32163-51"}]: dispatch 2021-01-28T15:33:26.188 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2021-01-28T15:33:26.299 DEBUG:teuthology.task.console_log:Killing console logger for smithi100 2021-01-28T15:33:26.300 DEBUG:teuthology.task.console_log:Killing console logger for smithi162 2021-01-28T15:33:26.300 DEBUG:teuthology.task.console_log:Killing console logger for smithi100 2021-01-28T15:33:26.301 DEBUG:teuthology.task.console_log:Killing console logger for smithi162 2021-01-28T15:33:26.302 DEBUG:teuthology.exit:Finished running handlers